Karma is in the intention, so if your underlying hidden intention is bad, you cannot escape the karmic consequence of such intention even if you have not carried out that intention with actions.
Every millisecond of your thoughts leaves a karmic trail of your life where the destinations of each individual's trail are unique and different.