Videos don't have frames!

Huh? Ya, that is unexpected, let me explain a little. Even with flv files (compiled flash video) there is no easy way to figure out what frame of the video you are in. I found this very strange since Flash is known to be all about the frame based animation. There are ways to work around this, I was doing some math to figure out what frame was being shown by using the framerate and current playhead time of the video but it really wasn't that accurate. This eventually caused me to give up on trying to do anything based on frames, actually there was one other reason which I will get into later.