Back up by a published paper, OpenAI affirms that users who utilise CriticGPT to analyse ChatGPT code perform 60% better than users who do not use the AI tool. 

The AI giant stated that it is currently integrating CriticGPT models into its RLHF (reinforcement learning from human feedback) machines which assists the company’s AI trainers. RLHF collects feedback which the AI trainers compare and rate the various responses provided by ChatGPT. 

OpenAI’s CriticGPT and Why it is Needed

Over the years since its inception, ChatGPT has improved by leaps and bounds regarding its accuracy with answers and suggestions. Though this is a benefit, it also poses a challenge for RLHF. This is due to the lack of inaccuracies or mistakes available for AI trainers to draw their comparisons from. Alignment of models becomes more of a hurdle as responses become more accurate to which trainers are unable to provide feedback. CriticGPT is OpenAI’s answer to solving this problem. 

GPT-4 powers ChatGPT and CriticGPT is also based on this very model. Additionally, RLHF trained and integrated with CriticGPT. However, the new AI tool perceived more inaccuracies to be critiqued. AI trainers were then instructed to enter the inaccuracies into ChatGPT’s code and compose sample feedback under the pretence that the trainers found the bug.

The trainers are then asked to compare numerous critiques of the reviewed code. This is done to make it easier to detect a critique that catches the bug. CriticGPT also creates lengthier and more extensive critiques.

Suggested:

From OpenAI, ChatGPT Enterprise is Now Accessible.

ChatGPT for macOS: The AI Chatbot’s Integration into Apple’s OS.

The post OpenAI’s CriticGPT is the Solution to Improving AI-Generated Code appeared first on Tricky Enough.

Code Llama presents the possibility of a change in coding practices in a number of industries thanks to its specialized versions and promising benchmark performance.

Code Llama: What Is It?

Three different models are provided by Code Llama, which expands upon the well-known foundation of Llama 2.

• The fundamental code structure.
• A version specifically tailored for Python programming is called Codel Llama.
• To handle natural language instructions more effectively, Code Llama created Instruct.

The model is unique in that it is trained to use a variety of well-known programming languages. That includes Python, C++, Java, PHP, and others. With 7B, 13B, and 34B characteristics, the LLM offers three distinct sizes to accommodate various serving and latency needs.

The 7B model is best for single GPU serving, whereas the 34B model provides better results. And is better suited for extended code support.

Responsibility And Risks

Code Llama has displayed outstanding performance in benchmark testing. With scores of 53.7% on HumanEval and 56.2% on Mostly Basic Python Programming (MBPP). It outperformed other open-source code-specific LLMs and was on par with ChatGPT in terms of performance.

Meta emphasized the significance of appropriate AI usage. Even though the technology may be helpful to developers of all levels of expertise and sectors. The business performed in-depth analyses to determine the likelihood that the LLM might produce dangerous code and offered recommendations. These rules follow a paradigm for responsible synthetic media usage. That is endorsed by major players in big tech including Adobe, Google, Meta, Microsoft, OpenAI, and others.

Suggested:

Elon Musk confirms the Deletion of the context for links in X Posts.

Threads by Meta is Not Here to Replace Twitter.

The post Report: Meta AI Launches Code Llama: A Coding LLM appeared first on Tricky Enough.