Well, then you thought wrong. There is a 2 hour margin in which miners can lie/be wrong/differ in opinion about time.
Bitcoin has its own oracle problem (because anything like this type of system needs an oracle). But Bitcoin uses the one thing that is hard to lie about, time. So it is workable that miners are the oracle, telling us the time of a block.