We investigate the asymptotic spectrum of deformed Wigner matrices. The deformation is deterministic will all but finitely many eigenvalues equal to zero. We show that, as soon as the first largest or last smallest eigenvalues of the deformation are sufficiently far from 0, the corresponding eigenvalues of the deformed Wigner matrix almost surely exit the limiting semicircle compact support as the size of the matrix becomes large. In the particular case of a diagonal pertubation of rank 1, we prove that the fluctuations of the largest eigenvalue are not universal and depend on the particular distribution of the entries of the Wigner matrix.