Google Gemini beats GPT 4 - Huge leaps in AI

[mmKay]

 

Edited December 23, 2023 by mmKay

[thenondualtankie]

Unfortunately, the Gemini video demo was faked. They actually fed Gemini a few images, not video.

Also a few of their benchmarks were basically rigged in favour of Gemini. For example: the MMLU benchmark where they claim Gemini surpassed human expert level at multi-domain question answering? They basically allowed Gemini to have 32 intermediate steps before getting it to give the final answer. And then they compared this to GPT-4 who was not given any.