What hasn't been released by Elon Musk's xAI is also of note
Critics have pointed to relatively sluggish performance in benchmarks; while Grok is a big model, it does poorly from what some engineers have seen."Considering how poor it is compared to other models, it really emphasises how important fine tuning is. Models with MUCH smaller parameter counts are outperforming it in many metrics," said one, even at 314 billion parameters, it still has some catching up to do with OpenAI's GPT-4, which had 1.76 trillion params at last count.
Notably, unlike existing LLMs, which are trained on data with a cutoff point in time, Grok has access to real time data corpus of everyone's Xeets via X.com, which should make for some interesting experiments in the days to come, although as another commenter noted:"Twitter tweet data in itself is both highly idiosyncratic and short by design, which alone is not conducive towards training a LLM.
Patrik Backman, general partner at OpenOcean, said of Grok1 code being released:"For once, Elon Musk is putting his principles into action. If you sue OpenAI for transforming into a profit-driven organization, you must be prepared to adhere to the same ideals."been released by xAI is also of note.
Open sourcing generative AI tools has proven controversial. Some developers worry that making the technology available risks abuse and others point to the inherent benefits of transparency.– its Llama 2 models last year, and other companies have followed suit. OpenAI, on the other hand, has most definitely not.
By opening up the code and weights behind Grok-1, Musk is attempting to plant a flag in the opposite camp to the proprietary world of OpenAI.
Ireland Latest News, Ireland Headlines
Similar News:You can also read news stories similar to this one that we have collected from other news sources.
Elon Musk bringing giant Tesla showroom to LincolnLincoln and Greater Lincolnshire news
Read more »
Elon Musk sues ChatGPT-maker OpenAI over Microsoft linksThe lawsuit accuses the firm of abandoning its founding principle of benefiting humanity.
Read more »
OpenAI’s legal battles are not putting off customers—yetElon Musk, the New York Times and trustbusters all want a piece of the startup
Read more »
Elon Musk eats humble pie over unpaid bakery billThe world's richest man steps in after his car firm Tesla U-turned on a request for 4,000 pies.
Read more »
ChatGPT-maker OpenAI hits back at Elon Musk criticismOpenAI rejects claims it is focusing too much on profit, saying it is an idea Elon Musk endorsed.
Read more »
Elon Musk’s SpaceX to blast ‘most powerful rocket ever built’ into space TODAY as US battles China for the...Elon Musk’s Starship dramatically explodes in second launch attempt after SpaceX confirms ‘unscheduled disassembly’
Read more »