Meta and Microsoft Launch Llama 2, AI-Language Model

Posted on Aug 04, 2023 at 09:08 PM

Meta, the company that owns Facebook, has recently commercialised its Llama 2 artificial intelligence model. This model presents a cost-effective option compared to proprietary models from OpenAI and Google. By distributing Llama 2 widely, Meta showcases its commitment to open innovation, in collaboration with Microsoft, as they work towards democratising AI.

Llama 2 is an advanced version of Meta's original Llama, an auto-regressive language model with transformers capable of handling generative AI tasks with up to 65 billion parameters. It benefits from pre-training on a dataset that's 40% larger than its predecessor's, and it offers model sizes of 7, 13, and 70 billion parameters. Moreover, it can handle a context length of two trillion tokens, twice as much as Llama 1.

This open-source AI model benefits startups, levelling the playing field by increasing their competitive potential. Meta's CEO, Mark Zuckerberg, has ensured its accessibility to academics and made it available for direct download and through providers like Hugging Face and Amazon Web Services. The first version of Llama has already attracted interest from over 100 researchers. Tech giants, including Amazon, IBM, NVIDIA, Intel, LG, Spotify, Dropbox, Zoom, Phone, Shopify, and Accenture, have backed it.

Meta has strongly emphasised safety and power in Llama 2, incorporating features like pre-trained data, Safe and Fair Transfer (SFT) procedures, and a Reinforcement Learning with Human Feedback (RLHF) cycle. The company's research report highlights the importance of understanding pretraining data for transparency and identifying potential issues and offers extensive safety and bias mitigation methods.

With the release of Llama 2, Meta could potentially disrupt the profit-making strategies of competitors who charge for similar technology. This was predicted in a leaked memo from Google, with the headline, "We have no moat, and neither does OpenAI". Following the path of platforms like PyTorch, Meta plans to profit from upgrades, patches, and new products born out of their AI innovation strategy.

In conclusion, Meta's open-source commercialisation of Llama 2 represents a significant shift in the AI industry. It offers a free alternative to proprietary models and boosts safety and security, thanks to its collaborative relationship with Microsoft.

Read more news:

• Understanding the Fiscal Responsibility Act of 2023: A Snapshot
• Saudi Arabia turns the "Big Four" of the Pro League into PIF firms
• The PIF's Launch of Lifera Marks a Significant Investment in the Health Sector