As children, we should visit his old man's house more often. If you have time, visit the grave more, spend more time with him, bring something your father liked before his death, chat with him more, offer incense, do more good deeds, tell him that you are fine and reassure him.
Don't worry! It's okay.