“In the midst of chaos, there is also opportunity” – Sun Tzu, The Art of War – 5th Century BCE Today marks a significant milestone in the AI as DeepSeek, a Chinese AI startup, announced the release of its revolutionary R1 Open-Source large language model (LLM) rivalling OpenAI’s ChatGPT. This DeepSeek RI model has been designed to excel in complex reasoning tasks, rivaling the performance of OpenAI’s latest models while reportedly being developed at a fraction of the training & implementation cost. It is being widely reported that this R1 LLM was trained with Reinforcement Learning (RL) for a
Tag: Machine Learning
Beware of Human-injected left-leaning bias emanating from AI Large Language Models (LLM) Outputs – RLHF technique could be the misused
In the realm of Machine Learning, Reinforcement Learning with Human Feedback (RLHF) stands out as an innovative technique where human trainers play a crucial role in guiding the learning process of models. Unlike traditional reinforcement learning, which relies solely on pre-defined rewards, RLHF incorporates human judgment to shape the training environment. This method can have significant implications, especially when it comes to ensuring that models consistently favor certain outcomes over others. In this blog, we’ll delve into how trainers can influence models using RLHF, highlighting both the potential benefits and pitfalls. Human trainers can introduce biases, whether consciously or
Some quick steps to overcome Bias and institute Fairness in Machine Learning Models
We are seeing that bias in Machine Learnings Models can be a big issue since the Data available to train these models can be biased. Consequently, using biased Machine Learning Systems can be dangerous when it becomes the basis to make decisions about humans automatically, with no human oversight, resulting in biased outcomes in fields of Employment and Loans. Similarly, another area of concern is ML Models that are being used for Political Reporting with significant “left wing” bias and publishing Reports and Stories with a left leaning slant, which makes the current political divide more pronounced. Putting this
Strategic Countermeasures to combat Software Vulnerabilities effectively in AI/ML enabled applications
Looking back, Application Security has evolved significantly in the last couple of decades. In the early 2000s, SQL injection and Cross Site Scripting (XSS) attacks were a nightmare for cybersecurity teams as attackers easily bypassed network firewalls through attacks at the application layer. Since traditional network firewalls at that time were not application-aware, these attacks proved a blind spot allowing attackers to compromise web applications easily. Hence, the computer industry developed countermeasures which included and not limited to web application firewalls (WAF), source code security reviews, and DevSecOps, who automate these checks within CI/CD pipelines to and allow security