“The meaning of karma is in the intention. The intention behind action is what matters.” - The Bhagavad Gita

You can hide your intentions from others, but you can't hide your intentions from yourself. You definitely know your intentions, and karma builds on intention, not necessarily only on actions.