The Compendium · Part 04

AI

44 pieces, oldest first.

June 1, 2025 · AI

Trusting AI in Education: Is Education Losing Its Human Touch?

The move towards AI in education impacts thousands of students nationally

Virthiha Selvamuthukumaran

Trusting AI in Education

Artificial intelligence has replaced human perspectives in the job market for over a decade, with more than 90% of employers utilizing technology-driven algorithms to filter out candidates. Today, similar concerns exist about the use of AI in a pivotal area of societal development: education.

Approximately 8 in 10 higher education institutions admit to using AI during the college admissions process; however, the AI boom is not just prevalent in universities. Many school educators utilize AI to streamline teaching and learning processes, from creating personalized student lesson plans to automating the grading of assignments. While AI offers powerful tools, trusting it in high-stakes areas like admissions and instruction raises critical questions about fairness and transparency.

College Admissions

Technology has modernized "very algorithmic" processes that were once performed by humans, according to Professor Diane Gayeski of Ithaca College. These algorithmic patterns evaluate a student's GPA based on the grades they input, removing non-academic electives and adding extra weight to Advanced Placement, International Baccalaureate, Dual Enrollment, and honors courses, along with their SAT or ACT scores, to determine an academic profile for the candidate. However, colleges now report that they use AI for several different tasks, including reviewing recommendation letters and transcripts, automating messaging to communicate with applicants, and even employing it to review personal statements and conduct interviews.

Admissions officers attest that using AI to calculate the "number aspects" of an applicant improves the efficiency of their admission process, especially for institutions that receive hundreds of thousands of applicants annually. Many educators, however, hold a different view. AI reflects historical trends, so if such trends were biased, AI could reinforce existing biases. For example, the printing of specific zip codes from more affluent neighborhoods can overlook low-income students. GPA inflation in many high schools around the United States and internationally can reflect greater disparities in students' academic profiles. These tools often also lack transparency since there is no clear way to appeal or understand AI's decisions.

Many admission officers argue that not using technology-driven algorithms could cause greater harm than good in improving the efficiency of the admissions process. However, to continue progressing as a society that values diverse perspectives for research and growth, many educators want final decisions to be made by real people.

Personalized Learning

AI is revolutionizing education by tailoring learning experiences to meet the unique needs of individual students. Many students use AI as a virtual tutor who generates educational materials tailored to their specific weaknesses. This benefits learners of all types, including those with learning disabilities who struggle to keep pace with the material, as well as high-performing students who can benefit from advanced content.

Current AI models are more focused on developing and optimizing algorithms for efficiency. Many educators and students attest that applying AI for continuous feedback instead will, more importantly, enhance the quality of learning.

Personalization of data does come with notable challenges. AI systems track clicks and writing patterns, so when data is collected for personalized learning, the privacy of student data is at risk. Many educators and parents advocate for default privacy protection laws and limits on the use of data for training algorithms. Personalized learning from AI can also exacerbate the digital divide and plays a critical role in equity concerns surrounding the availability of internet connections and electronic gadgets. Some worry that AI may replace teachers; however, there is substantial disagreement on this, as others maintain that AI will not effectively replace the emotional and empathetic engagement required in teaching.

AI in education is an ongoing debate among educators, admissions officers, and policymakers. AI can enhance efficiency and learning engagement, as well as improve educational outcomes; however, ethical standards are required there is equal access and fair transparency for all students. The prevalence of AI will continue to grow, and as it does, institutions will be challenged to utilize AI to support, rather than replace, the human elements of education. 

June 1, 2025 · AI

How Many Layers Between Us and Disaster?

The activation of AI Safety Level 3 Protections brings growing context, awareness and relevance to AI models and how they are deployed, especially when many predict compute power will only exacerbate risks as time passes.

Vaishnavi Singh and Aadith Muthukumar

What’s the big risk here? 

Years ago, many hypothesised that governments would reign supreme in producing technologies symbolising power and authority. Such technology grew to be feared for their nigh-catastrophic potential to be destructive. Today, we have such technology being born and bred on servers, having been developed in office towers. 

Artificial intelligence is growing to be more than a source of entertainment and convenience, it is able to instruct one to build bombs and phish. For this reason, AI companies like Anthropic anticipated the need for safety precautions and created Responsible Scaling Policies or RSPs, to ensure they take the very necessary first-steps to curb harmful risks. One reason RSPs were readily produced as standards was due to increasing literature on CBRN-led risks, which could be exponentially dangerous if left unscrutinised. As per METR 2023, the creation of RSPs are an extremely necessary one, given “biologists have argued that large language models (LLMs) might remove some barriers encountered by historical biological weapons efforts… Today, someone with enough biology expertise could likely build a dangerous bioweapon and potentially cause a pandemic.”

Why are RSPs’ safety levels important?

Responsible Safety Policies, refer to the policy framework that Anthropic can use in order to scale their AI while aligning with ethical safety standards. RSPs are a wavemaker in terms of self-regulation on the part of AI giants, with many following suit. In 2023, this public commitment was first-of-its-kind and included 3 main goals. Anthropic aimed to ensure its risk governance was proportional, iterative and exportable. Proportional to ensure they can balance innovation with safety, iterative to ensure experimentation was realistic in light of frontier model’s rapid and unyielding progress, and exportable to provide a proof of concept that could develop into a readily adopted and respectable industry standard for self-governance. One could say that since 2023, they have succeeded in most aims. 

To further ensure these principles are upheld, RSP documents encased several sections on its AI Safety Level Standards or ASL which refer to levels of protections accorded based on the:

  1. Identified capability threshold
  2. Required safeguards for said identified threshold
  3. Any changes to identified category post-capability assessment

Here is a brief summary of the ASLs and the capability classifications mapped to each, as per Anthropic, 2023: 

  1. ASL-1 refers to systems which pose no meaningful catastrophic risk, for example a 2018 LLM or an AI system that only plays chess.
  2. ASL-2 refers to systems that show early signs of dangerous capabilities – for example ability to give instructions on how to build bioweapons – but where the information is not yet useful due to insufficient reliability or not providing information that e.g. a search engine couldn’t. Current LLMs, including Claude, appear to be ASL-2.
  3. (Where we are now) ASL-3 refers to systems that substantially increase the risk of catastrophic misuse compared to non-AI baselines (e.g. search engines or textbooks) OR that show low-level autonomous capabilities.
  4. ASL-4 and higher (ASL-5+) is not yet defined as it is too far from present systems, but will likely involve qualitative escalations in catastrophic misuse potential and autonomy.

RSPs clearly dictate the safeguard assessments in place for each ASL and the decision-making framework behind giving the go-ahead to deploy a model. Ultimately, the model must be distance in ability from existing thresholds, or have surpassed them but under the stipulated ASL-2/3 safeguards with routine assessments. Results of core system tests are stated in System Cards such as this one

ASLs also comprise of 2 key components, one being the deployment standard and the other being the security standard. The former consists of acceptable use model cards, reporting channels and automated detection of harmful requests. The latter sets the precedent for security system designs meant to thwart malicious actors hoping to manipulate the models for their own purposes. Accessing model weights in particular, is an outcome that takes priority when devising such measures. If one circumvents security measures, accessing model weights are what allow malicious actors to utilise a model without its deployment protections; thus making the ASL safeguards benign to intruders. 

In line with Anthropic’s 3rd goal, OpenAI has also made their own version of ASLs within their policy framework  named the Preparedness Framework. While OpenAI’s framework aims to engage in preparation for similar risk categories, Anthropic looks at RSPs on a more holistic level, with a focus on CBRN risks, autonomous R&D capabilities and cyber operations. 

In April 2025, OpenAI began to look deeply into “research categories”, which are risk categories that pose serious harm but currently lack mature threat models. Perhaps this category will be the subject of speculation and research for the next few sets of AI safety standards, especially in terms of issues such as model sandbagging (models intentionally underperforming), models engaging in autonomous replication and adaptation (goal-drifting). 

Being able to deal with such threats on the horizon would mean the need for ever-evolving standards such as Anthropic’s RSPs, and perhaps its widespread adoption of some form in companies elsewhere producing and tuning AI systems. 

What is Claude Opus 4? Why is it in the news? 

Claude Opus 4 is Anthropic’s most advanced large language model to date, designed to handle prompts that require complex reasoning and problem solving. Some significant updates that it has in contrast to its predecessor are enhanced memory from previous prompts and higher stamina for long duration prompts. Probably the biggest update that it has is its coding performance: the model got a 72.5% on the SWE-bench, which is the benchmark test for engineering tasks. That is a significant jump from OpenAI’s GPT-4.1, which only achieved 54.6%.

In short, Claude just got a huge upgrade and is now one of the most powerful models on the market. However, as AI systems like Claude become more powerful, they become more prone to unintended behaviors. That’s where the ASLs come in. Claude Opus 4 was in fact so significantly able, that the 3rd tier of ASLs were activated, a standard that was previously reserved for being adequate to handle CBRN risks and some level of autonomous AI research activities.

What is the significance of activating Level 3? 

You can reasonably assume that a prompt triggering Safety Level 3 protection would mean that it poses a great amount of risk in terms of ensuring its deployment, or in terms of ensuring its security in light of model capabilities.

In this case, the model is within ASL-3 threshold and can in fact, answer questions relating to building bio-weapons or bombs. Since AI could potentially help a user create CBRN weapons and mass destruction, Level 3 aims to mitigate this on both the deployment and security fronts. However, in order to limit access to this type of sensitive data, it would require rigorous capability assessments and routine monitoring to ensure appropriate deployment is done for models capable of providing such information. Security measures would have to be adequate to ensure no actors can access the model to get such information via rote prompting or through cyber attacks.

Anthropic has ensured that such threats are covered in the security practices, such that the model cannot respond to such queries and there are “more than a 100 different security controls” that involve preventive measures and sharp, unrelenting monitoring controls to keep non-state actors from accessing model weights.

The emphasis is on the term “non-state” as there is little one could do to keep the likes of state actors from accessing such information. This could prove to be a grave issue moving forward as models keep progressing and the discussion of AI has a political edge to it with OpenAI’s discussion of “democratic AI” and frontier AI companies’ foray into political theatre.

However, perhaps the activation of ASL-3 is not all that bad. If (and when) triggered, Level 3 could also provide relevant data to Anthropic regarding what they might have to re-train or update in order to best interpret a prompt. This could be a way the private company experiments with its future safety levels.  Deploying a model with hesitancy but then testing the appropriateness of this decision would be one way to determine if Level 4, 5 and perhaps 6 are necessary to properly ideate, conceptualise, and roll out. Many researchers around the globe await with a bated breath to see the results of the deployment.

Should we continue deploying models at this frequency? What checks and balances do we need beyond RSPs, if any at all?

The activation of an additional safety level is not a crisis, but rather an announcement that an additional layer of security is needed. It shows that Anthropic is taking time to address risks that many other companies are ignoring, and that a conscious effort is being made to minimise the risks of their progress. Rather than focusing only on profit, Anthropic is choosing to remain transparent and maintain human-in-the-loop practices, with their governance documentation consistently growing.

This development signals yet again just how fast AI is growing. Artificial Intelligence is no longer just a tool to get the dirty work done—it's starting to become a full-fledged partner that can reason with potentially minimum  ethical repercussions.

However, relying on safety levels alone is not a long-term solution. As we continue to use AI in law, education, and healthcare, the risks will only continue to grow. Just adding extra safety levels is not enough to ensure accountability without some oversight. At the end of the day, or at least for the near future, humans will always be needed to ensure Claude and the models that come after are regulated sufficiently.

There is much more that Anthropic and other companies could do. Perhaps instead of general categories within ASL-3 or research categories that include potential risk outcomes like self-adaptation, companies should specify different categories for a more granular set of risk types at a given safety level. This could mean elaboration on types of misuse, a range of self-adaptation scenarios, sectoral and systemic risks  (e.g. financial market manipulation, access to public records). 

More importantly, IAPS’s Bill Anderson-Samways suggests that Anthropic and other companies ought to outrightly declare when they will alert government authorities of identified risks as part of their accountability measures. The author rightly mentioned that at present, RSP documentation lacks any mention of mandating communication with governments outside of a narrow case in catastrophic risk management that mandates communication during Anthropic’s response to a bad actor scaling extremely quickly. The author suggests Anthropic ought to make such a commitment in line with the assigning of a capability threshold, like ASL-3 or 4. Governments should also be allowed to audit and aid capability and security safeguards-setting and other assessments, especially in the case of suspected ASL-3 and above. It is loud and clear– self-regulation cannot be all that stands in the way of normalcy and imminent disasters, with governments playing catch-up. 

All in all, Anthropic’s launch of ASL-3 is a step in the right direction. However, human intervention is still needed. After all, the true test of AI isn’t just how well it performs— it’s how well it behaves when no one is watching.

June 2, 2025 · AI

What Will It Cost the GOP to Shrink the Sinosphere of AI?

The Trump administration is in a hurry to outperform China—but what will America lose along the way

Vaishnavi Singh and Anshi Bhatt

In an aggressive push to outpace Chinese AI capabilities, the GOP-led administration has enacted policies that could end up stifling the very innovation it claims to protect. Beneath significant rhetoric about protecting America’s technology sector lie strategic partnerships between the Trump administration and large tech companies. 

In 2024, California introduced Senate Bill 1047 (SB 1047), a pioneering attempt to establish safety measures for large AI models. The bill would’ve required companies to test powerful systems before release and hold them accountable for any potential harm. But Governor Gavin Newsom vetoed it, citing fears it could slow innovation. He argued that regulation should be based on empirical evidence and science. Tech giants like Anthropic, Facebook, and Y Combinator reportedly lobbied hard against the bill, echoing similar concerns.

Soon after, the U.S. House passed the “One Big Beautiful Bill Act” in May 2025. It included a 10-year federal moratorium on any state AI regulation, which would override existing state laws and block more than 1,000 pending AI-related bills across the country.

The Trump administration has since cemented deep ties with major tech firms, a phenomenon now coined as “the Great Fusing.” These strategic partnerships, which have centered around initiatives like the $500 billion Stargate project, involve some of the biggest tech companies in the nation, like OpenAI, Palantir, and Nvidia. This alignment has fueled an incredibly sweeping deregulatory stance. AI regulations have been relaxed, and any workplace disruption risks have gone largely ignored, but are framed as necessary sacrifices for preserving U.S. innovation.

Meanwhile, many prominent AI leaders who once called for regulation have flipped. OpenAI CEO Sam Altman, who was once a vocal supporter of oversight, now warns that excessive rules could cost the U.S. its technological edge over China.

The administration continues to frame AI as an arms race with China. Vice President J.D. Vance has said delaying innovation for safety reasons could lead to the U.S. becoming “enslaved to the PRC-mediated AI.” For many critics, it is believed that this kind of rhetoric is less about national security and more about justifying massive government-backed investments like Stargate.

This shift, where any kind of regulation on emerging technologies is seen as capitulation to the PRC, reveals a much deeper trend about the current administration. When even modest safeguards, like California’s SB 1047, are struck down not based on solid evidence, but rather on fears of harming innovation, it signals that the discourse surrounding regulation has moved away from public interest. It is about protecting tech billionaires' private capital. 

The new moratorium has, across the nation, sparked backlash. Supporters claim it prevents a patchwork of conflicting laws. Critics argue it strips states of their rights and potentially leaves a regulatory vacuum, especially since the federal government has yet to pass any comprehensive AI legislation. Legal scholars also warn it may violate the Byrd Rule, as it was passed within a budget reconciliation bill, something Senate procedure explicitly limits.

If this challenge holds up, the entire moratorium could unravel in the courts. It would trigger not just a single legal battle over one bill, but set a much broader precedent on how far Congress can go when side-lining a state’s authority over regulating tech companies operating within them. A successful Byrd rule challenge would reassert legal guardrails and affirm the federal branch’s limit in tech governance. However, if the moratorium stands, it could create serious consequences throughout the nation, disturbing the delicate balance of power in DC. It would show that sweeping deregulatory measures can be passed, hidden inside seemingly routine budget bills, without the democratic discourse the nation was built on. 

Even others in the tech world itself have pushed back on the zero-sum framing. Nvidia CEO Jensen Huang has argued that limiting U.S. exports could do more to harm American AI leadership than any regulation would. By cutting off the Chinese market by framing innovation as an arms race, he warns, the U.S. may push China to accelerate its homegrown innovation and weaken American influence abroad. Despite export controls, China has made huge gains in many technology sectors, such as EVs, consumer drones, and solar. Companies like SMIC and Huawei are also rapidly catching up to US brands, with Huawei even outperforming Nvidia in some AI hardware benchmarks.

Conservatives have long framed state autonomy as a proud pillar of their party, believing it to be a foundational principle of the United States. However, this moratorium will pause and override more than 1,000 local AI regulatory initiatives. If this bill holds, it will mark a significant repositioning of the party, where states’ rights are only empowered if they align with corporate interests. Corporations with the current administration partners. States like California or New York, which have historically pushed for tech regulation, may respond with lawsuits and potential nullification strategies. They may even create parallel regulations in adjacent sectors, like consumer data and labor, creating a fractured legal landscape in which policy is dictated via courtcases and workaround policies. 

The Trump Administration’s rhetoric and actions taken against regulatory measures for large technology companies signal a quiet handoff of AI governance, away from states, and into the hands of their corporate allies. If protecting innovation were truly the goal, we would see regulation that targets harm while encouraging progress. Instead, we are seeing traditional, democratic processes be sidelined and budget loopholes, protecting the pockets of billionaires, be favored. America’s obsession with winning the ‘arms race” may be eroding the public’s ability to shape its terms.

June 4, 2025 · AI

Opinion: Why AI Can’t Replicate the Irreplaceable Spark of Human Creation

Google’s new video model is realistic but cannot mimic human artistic ability

Gabriel Kirkwood

Google recently unveiled Veo 3, the most advanced AI video model to date, marking a pivotal moment in the evolution of generative media. Generating hyper-realistic videos with synchronized audio from just a text prompt, Veo 3 is widely powerful as well as accessible. The model, though technologically impressive, raises deeper concerns regarding its effects on art.

In Google’s launch materials for Veo 3, they show off an impressive feat: a college student producing a film that will rival Hollywood with nothing but a laptop. Google is showing off its vision of a future where AI acts as an amplifier of human creativity. Additionally, the company advocates for a shift in creative education—emphasizing technical proficiency.

Google’s own points highlight a deeper philosophical question: when technical execution is made so cheap and common by AI, what becomes of artistic value? The tech giant points to the emergence of new creative roles such as “Prompt Engineers,” and predicts a transformation in creative education. But can artistic ability really be replaced by prompts?

Of course it can’t. Throughout human history, artistic expression wasn’t defined by technological perfection; rather, art is defined by human expression. Consider Michalangelo and his David, standing as a testament of will and struggle through chiseled marble. Or Donatello, whose sculptures capture the subtleties of emotion in movements in ways no AI model can express. Or Van Goh, who beautifully depicts his struggle in his search for solace and beautify amongst darkness in his oil paintings.

This irreplaceable spark isn’t just limited to paintings and cultures. Classic literature, like Dickens’ Great Expectations, are considered classics because they include human theses like love, hate, struggle, and growth; art can’t emulate these things. The same is true with film: The Pursuit of Happyness and The Lion King move audiences because of their human nature, reminding us of real emotions and motivations that drive human action. The most celebrated characters in films or novels are those who remind the audiences not of perfection, but of struggle, vulnerability, and love.

These masterpieces were not the result of combining patterns or following prompts–they were born from lived human experience, emotion, and a search for meaning. The chisel marks, the imperfections, the choices made in the heat of creation are impossible to replicate with code.

No artificial intelligence model can capture the depths of human nature. AI misses the human touch. AI-generated videos, no matter how impressive, are ultimately reflections of our prompts and datasets. They can amuse and inspire–but can never offer the singular, unrepeatable perspective of a human life.

Google offers an excellent tool for marketers and filmmakers; but the company’s ambitions of AI being a significant resource in artistic creation are misled. Just as countless other artists, writers, and filmmakers have endured through centuries—outlasting trends, technologies, and even empires—so will the human drive to create, to express, and to connect. AI can be a tool, a partner, even a muse. But it will never replace the spark of human creation.

June 8, 2025 · AI

Automated Ethics: Unpacking the Human Cost of Artificial Intelligence

As AI systems take on roles once reserved for humans, the need to address bias has never been greater

Virthiha Selvamuthukumaran

Artificial intelligence is used in everyday decision-making. While many hail AI as a neutral and efficient problem-solver, its increasing use in critical societal domains—from employment to criminal justice—raises growing concerns over ethics, fairness, and transparency. At the heart of this debate is a key question: Can automated systems be trusted to make unbiased decisions?

Bias and Fairness

AI systems are only as objective as the data on which they are trained. When algorithms draw from historical data that reflects discriminatory practices, they often mirror and amplify these same biases. In hiring, for example, automated systems have been found to deprioritize candidates based on gender-coded terms or zip codes associated with lower-income neighborhoods. In predictive policing, algorithms can disproportionately target communities of color based on past arrest data rather than present risk. While these systems claim neutrality, their output is often anything but.

Automation has already displaced jobs in manufacturing and customer service, and new developments threaten to impact white-collar professions as well. This is critical since many displaced workers lack the training or opportunities to move into new roles, and without a fair and inclusive economic transition, automation could worsen income inequality and widen the socioeconomic gap.

Institutions often justify the use of AI by highlighting efficiency gains, yet fairness remains elusive. Many models are unable to distinguish between correlation and causation, meaning systemic inequalities are embedded in automated decision-making. 

Transparency

AI systems, especially those powered by deep learning, are often referred to as "black boxes." The lack of transparency in "black boxes" is primarily due to their complexity. Since individuals usually lack a clear path to appeal or understand how AI outcomes are generated, accountability remains equally complex. When a machine learning model denies a loan or makes a diagnostic error, it is difficult to determine who is responsible—the developer, the institution using the system, or the algorithm itself. Many advocates are calling for regulatory frameworks that assign clear liability and establish clear standards for explaining AI-driven decisions.

Privacy and Data Use

AI relies on large datasets, which introduces serious risks to personal privacy and data security. AI systems are fed data that often includes highly sensitive information from browsing habits to biometric identifiers. Students, for example, may unknowingly contribute writing samples and behavioral patterns to platforms that use their information to train future AI models. Many experts believe that default privacy protections and data minimization standards must be enacted before automation expands further.

Environmental Impact

The environmental toll of AI is often overlooked. Training large models requires massive computational power, which draws energy from carbon-intensive sources. As AI usage expands, particularly in sectors such as finance and streaming, the carbon footprint of these technologies is becoming increasingly difficult to ignore. Ethicists and technologists alike are urging sustainable development practices that weigh environmental costs alongside technical performance.

The ethical landscape of artificial intelligence is evolving in tandem with the development of AI itself. AI risks will continue to reinforce existing injustices and create new forms of harm that can be harder to detect and address.

June 9, 2025 · AI

While America Fears Screens, Estonia Turns Them Into AI Portals: Who’s Preparing Students for Tomorrow

While US schools debate bans and restrictions, Estonia is embedding AI into classrooms at scale

Ikeoluwa Esan

In a Baltic nation smaller than Dallas, a fascinating transformation has been ongoing. Estonia, long known for its digital prowess, is now positioning its schools as AI-ready environments for the next generation. While much of the Western world, including the United States, clings to debates over screen time and smartphone restrictions, Estonia is charting a different course.

This fall, Estonia will begin rolling out AI accounts to tens of thousands of students and teachers as part of its new national program, AI Leap. By 2027, the initiative aims to provide over 58,000 students and 5,000 educators with access to generative AI platforms through partnerships with companies like OpenAI and Anthropic. The goal isn’t simply to introduce tools—it’s to hardwire AI literacy into the fabric of the country’s education system.

In stark contrast, many U.S. schools are tightening their grip on technology. From banning phones in classrooms to suspending students for using ChatGPT, the prevailing message has been one of caution, even distrust. In some districts, simply acknowledging AI tools can trigger disciplinary scrutiny.

The divide is growing—and it raises a central question: who’s really preparing students for the future?

Estonia’s Leap Forward

Estonia’s current strategy is less of a leap and more of a continuation. In the late 1990s, the country launched Tiigrihüpe—or “Tiger Leap”—a sweeping effort to bring computers and internet connectivity to every school. Today, Estonia consistently ranks first in Europe for math, science, and creative problem-solving, according to PISA assessments, outperforming giants like Germany and France, and even surpassing education powerhouses like Finland.

AI Leap builds on that legacy. The program doesn’t merely distribute tools—it includes structured teacher training in AI ethics, critical thinking, and how to guide students in autonomous learning environments. Rather than banning mobile phones, Estonia has chosen to integrate them as core instruments of collaboration, research, and democratic participation.

The strategy isn’t about tech for tech’s sake. Led in part by figures like Education Minister Kristina Kallas, Estonia’s push reflects an understanding that digital fluency and democratic values must evolve together. The government is also emphasizing equity: laptops and internet access are provided to students who lack them, and while schools have autonomy over implementation, nationwide guidance promotes inclusion over restriction.

Perhaps most tellingly, Estonia is redesigning the idea of school itself. The emphasis is shifting from rote memorization to problem-solving, from standard essays to oral exams and teamwork. In a world where AI can produce text in seconds, Estonia wants its students to offer what machines can’t: ethical judgment, creativity, and adaptability.

U.S. Policy: From Panic to Patchwork

Across the Atlantic, the picture looks very different. In the United States, reactions to AI in education have been far more fragmented—and often rooted in fear.

The rollout of tools like ChatGPT in late 2022 prompted a swift backlash. School districts issued blanket bans, citing fears over cheating, misinformation, and student dependency. As the technology evolved, however, some districts began rethinking those early decisions.

Miami-Dade County has emerged as a national leader in this pivot. The third-largest district in the country has now trained more than 1,000 teachers and introduced AI-powered tools like Google’s Gemini into classrooms. Students in some high school classes are engaging with chatbots to simulate historical debates, role-play political figures, and practice source analysis.

That shift is important—but rare. In most parts of the country, schools are still reacting rather than planning. Some states have yet to develop AI use policies at all, while others remain locked in debates about whether the technology should even be acknowledged in curriculum.

This inconsistency is creating a new kind of digital divide—not just between rich and poor districts, but between nations. Estonia is teaching students to work with AI. Too many U.S. schools are still teaching them to fear it.

Why This Isn’t Just About Classrooms

The consequences of this divide extend well beyond homework assignments. According to the World Economic Forum, nearly 40% of the core skills required for workers will shift by 2030. Generative AI is already altering industries—from medicine to media to logistics—and fluency with these tools will become a baseline requirement.

Estonia’s approach reflects this urgency. Its schools are preparing students not only to use AI, but to interrogate it—questioning where data comes from, how algorithms influence decisions, and what it means to live in a society where human and machine thinking coexist. It’s no coincidence that Estonia allows online voting at age 16. Civic readiness and digital literacy go hand in hand.

Meanwhile, U.S. students are being handed powerful tools with few frameworks for understanding them. Bans might limit short-term misuse, but they don’t build long-term resilience or critical discernment. A generation that learns to avoid AI may grow up dependent on it—or worse, manipulated by it.

Two Models, Two Outcomes

Estonia’s AI leap is not without risks. Overreliance on technology raises concerns about data privacy, screen time, and algorithmic bias. But the country’s approach—centered on teacher training, student agency, and equitable access—offers a coherent, values-driven model.

America’s path is murkier. With its decentralized school systems, politicized curriculum debates, and uneven infrastructure, change is harder to coordinate. But there are signs of hope: districts like Miami-Dade are building scalable frameworks, and federal efforts are beginning to support AI literacy initiatives at the national level.

The greatest threat may not be using AI—it’s ignoring it. In a world shaped increasingly by algorithmic decision-making, students need more than just awareness. They need preparation.

Estonia has made its choice. It’s building an education system aligned with the tools and ethics of tomorrow.

The United States still has time to do the same. But time, as both educators and technologists know, moves fast.

June 11, 2025 · AI

The Chip That Outran the Empire: How a Single Silicon Gambit Lit A Fuse in Washington

Perhaps the propagation of the “China just copies” sentiment is the United States’ most costly presumption. DeepSeek’s success triggered massive market volatility, with Nvidia losing a jaw-dropping $589 billion in market value when everyone least expected it

Vaishnavi Singh

China Dug Deep

Heads were turned when DeepSeek-R1 topped Hugging Face’s open-source LLM leaderboard with a whopping 90.8% accuracy on Massive Multitask Language Understanding, surpassing Meta’s Llama 3 70B by 8 or so points. The inaugural Chinese-origin model exposed a fatal flaw of sorts in Washington’s containment strategy for advanced semiconductors. The model’s architecture, trained on Nvidia’s export-compliant A800 chips, despite housing a seemingly similar (albeit lesser) percentage of A100 cluster efficiency through distributed parallelism optimizations. This show of sleight-of-hand unabashedly displays China’s technical mastery in systemic adaptation when faced with U.S. export controls on high-performance GPUs. Jensen Huang conceded that “[t]he export control was a failure… Chinese companies will use their own chips if restricted”. Indeed, Huang was right as DeepSeek’s rumoured PTX-level optimizations and sparse attention mechanisms later enabled frontier performance on hardware Washington (perhaps regrettably) deemed “safe” for export.

The US-China Economic and Security review notes that the China Academy of Sciences (CAS) were behind China’s “863 Program” playbook from the 1990s supercomputing and aerospace sector, where external sanctions accelerated some indigenous R&D cycles, and The parallel is stark as where U.S. policymakers envisioned severed supply chains, they later found Chinese technocrats capitalising on the opportunity to rewire innovation ecosystems around political priorities. Affirming such conclusions is Huawei founder Ren Zhengfei, who told Chinese President Xi Jinping that ‘his previous concerns about the lack of domestic advanced semiconductor production and the damaging impacts of U.S. export controls had eased because of recent breakthroughs by Huawei and its partners.’ He later confirmed his intention to be ‘leading a network of more than 2,000 Chinese companies who are collectively working to ensure that China achieves self-sufficiency of more than 70 percent across the entire semiconductor value chain by 2028.’ With the curtains pulled back and the main players taking center stage the parallel is stark; Today’s chip restrictions have similarly marshalled China’s shift from hardware dependency to a steady march towards algorithmic sovereignty.

DeepSeek’s Architecture & a Demonstrated CCP-Corporate Symbiosis  

DeepSeek’s parent entity, 深度求索 (DeepSeek AI), operates under a hybrid governance model meshing together Tencent’s engineering talent with CCP committee oversight on data access and key decisions on compute allocation. Founded in July 2023 by Liang Wenfeng, a Zhejiang University graduate who previously co-founded High-Flyer quantitative hedge fund, DeepSeek operates as a wholly-owned subsidiary with assets under management exceeding 100 billion yuan. The company’s governance architecture embodies “techno-federalism”, a hybrid model where private ownership avails itself to cooperatively coexist with the state and its goals.

This pas de deux between DeepSeek and PRC is crystal clear in providing immense benefits to the Chinese AI landscape, as DeepSeek has achieved a national high-tech enterprise status, meaning it is integrating products directly into China’s national AI strategy through the State-owned Assets Supervision and Administration Commission (SASAC) and the SASAC’s subsidiaries. This relationship furnishes access to subsidized computing infrastructure through “AI Acceleration Zones” in Guizhou and Inner Mongolia, delivering significant cost reductions versus commercial cloud rates.  With the Xi Government’s backing, it was easy to recruit homegrown talent, with initiatives like the “Thousand Talents Repatriation Program” having drawn dozens of AI researchers from U.S. tech giants since 2022. The state’s mandate also allowed for “veiled and hazy” capital flows, unlike Silicon Valley’s VC-led approach, with municipal investment vehicles suspected to support their raised funds.

All of these point toward the Chinese State's impeccable planning for setting the stage for DeepSeek’s success. The collaborative and stakeholder-stacked effort was always gearing the company for success, come what may.

Nvidia’s A800 role in starting the regulatory critique en masse

More specifically, the A800’s technical specifications exposed the principal limitations of hardware-centric export controls. Launched November 8, 2022, the A800 delivers approximately 70% of A100 performance while technically complying with U.S. export restrictions. The A800 achieves only a 30% reduction from disallowed A100 capabilities. Chinese companies can acquire A800s making them satisfyingly cost-competitive despite performance limitations. DeepSeek’s engineers circumvented bandwidth restrictions through distributed parallel scaling and sparse attention mechanisms, achieving 91% of A100 cluster efficiency.

The October 2022 export controls first began with targeting A100 and H100 chips, prompting Nvidia to develop the A800 and H800 variants. By October 2023, it was an imperative under the Biden Administration to ensure U.S. authorities expanded restrictions to include these “compliance chips,” forcing Nvidia’s hand in introducing new variants. These variants are numerous, including the H20, L20, and L2 specifically for the booming Chinese market. The H20 delivers only a mere 15% of H100 performance, yet sees strong demand from the Chinese Tech Titans such as Alibaba, Tencent, Baidu, and ByteDance due to artificially created domestic shortages.

However, The Wadhwani Center’s Gregory Allen has stated that DeepSeek may have possibly stockpiled the regulated chips, long before the regulations were soldered in place. 

Structural divergence between the U.S. approach and China’s “Whole-Nation stack”

The US-China AI competition unravelled the different approaches to technological development. Unlike the PRC, the American Government has stated its plans for AI will be zeroing in on market-driven innovation with fragmented regulatory oversight. This has meant billions of dollars of investment in AI-adjacent industries (and contentious divestment in others).

The U.S. operates a myriad of competing federal AI initiatives across multiple agencies, creating regulatory fragmentation and duplicated efforts. Numerous states continue to battle it out to push, or prevent AI bills from passing, with the NYC Ethical Audit requirements, Colorado’s Consumer Protections, and the many instances of Californian grit coming to mind. In a stark contrast to this ever-evolving environment, China’s Central Leading Group for AI provides consisten,t unified strategic direction, enabling rapid resource allocation and coordinated policy implementation for the nation in a short time. This structural difference manifests in deployment speed as Chinese AI policies move from conception, intense research, to implementation in months rather than years, with many feeling surprised when they are informed that the Chinese were early-movers to the AI Governance space. The State has eyed an AI industry valued at over 150 billion USD equivalent, having invested about 10% or so already in AI development to ensure their longer-term research horizons and idiosyncratic behaviours in patient capital deployment for research and development. 

China filed over 38,000 generative AI patents from 2014 to 2023, representing a sixfold increase over U.S. filings during the same period, and representing 60% of global filings. A staggering lot of these Chinese AI patents focus on hardware-software co-design for efficiency optimization. In a cruel twist of fate, it is speculated that such a patent strategy creates intellectual property barriers that could unintentionally limit U.S. companies’ ability to adopt Chinese efficiency innovations, when it was supposed to be the other way around! 

Seeing Red… White and Blue 

Washington could shift from hardware-centric controls to computational outcome regulation, focusing on FLOPs-per-dollar metrics rather than specific chip specifications. Current restrictions on processing power and memory bandwidth fail to account for algorithmic innovations that maximize efficiency from constrained hardware. With current concerns on model safety levels, infringement of individual liberties and consumer protection, there could be a larger wave of support if Washington decided to create controls for advanced capabilities shown, in which the quickly-advancing China would be faced with some hurdles they would be forced to address, lest they wish to lose their competitive edge in global markets forthwith. 

China’s fusion of state direction, cost coercion, and algorithmic agility has created a sustainable competitive advantage for them that transcends individual technological restrictions. Unless American policymakers embrace dynamic governance frameworks that adapt to technological evolution (in a very unlikely, similar fashion to PRC or otherwise), then DeepSeek’s blueprint will become the standard playbook for emerging economies seeking AI sovereignty. This is most definitely not to the liking of key stakeholders like Altman and Amodei, who support initiatives under the banner of “democratic AI” and believe that more aggressive steps must be taken to widen the gap in progress. In their eyes, the US must take the lead, especially when the hallowed term “AGI” is thrown about in national security discussions, a looming target in the far distance.

Many debate whether we’re witnessing the ‘Sputnik Moment’ for AI governance, but this is a humorous comparison because America isn’t building rockets in response—it is building a tall fence wrapped in strong-arm rhetoric. The question remains whether Silicon Valley’s innovation will triumph in this race to AGI, especially under an administration more in step with them than ever.

June 13, 2025 · AI

Hollywood’s First Copyright AI Lawsuit: A Not-So-Cinderella Story for Artists

Disney sues AI company Midjourney for IP infringement—but the Mickey Mouse corporation's intentions appear more self-involved than originally thought

Bella Agarwal

On Wednesday, June 11, Disney and several other major animation studios filed a landmark lawsuit against the AI company Midjourney for allegedly profiting from, distributing, and using copyrighted models.

While the multimedia giant Disney has been around for over 100 years, Midjourney and companies like it are relatively new, with Midjourney first released to the public in 2022. It is a diffusion-based generative AI model, meaning it uses neural networks trained on massive datasets of image–text pairs. By observing the patterns between visual elements like shapes and colors and their associated text, the model can reverse-engineer images from inputted prompts. Midjourney is also closed-source, meaning the company has not publicly disclosed its code or what datasets were used to train its model.

Disney’s 110-page lawsuit alleges that Midjourney infringes on its copyrights by using Disney-owned images to train its model and enabling users to generate images that infringe on Disney’s intellectual property. For example, putting a prompt like “sci-fi villain with red light blade” into Midjourney could generate an image of or closely resembling the popular Disney character Darth Vader. 

It’s also important to note that Midjourney already uses filters for content such as pornography and hate speech—so it is technically possible to filter out specific content categories. Studios like Adobe Firefly, for example, already use licensed datasets and watermark detection to avoid copyrighted material. 

OpenAI, the creator of the popular ChatGPT, also prohibits the generation of Disney characters, scenes, and overall art style. In conjunction with Midjourney being closed-source, Disney implies that the AI company’s behavior reflects an intentional avoidance of precautions in order to monetize infringed intellectual property.

The Precedent

While this is the first time a Hollywood studio has filed suit over AI-generated images, it is only the latest in a growing effort to crack down on AI plagiarism of visual art. 

In 2023, Getty Images filed a claim against Stability AI for using watermarked photos in model training. Similar to Disney’s claims about Midjourney, Getty alleged that Stability’s use was intentional and deceptive. However, Getty has not yet claimed that the individual outputs constitute direct infringement of any specific protected image—only that the training data used was unfairly web-scraped. Stability was also the target of a separate class-action lawsuit in 2023 by several visual artists, who alleged that the company used their works without consent as training data, resulting in the model mimicking their unique styles. That suit also focused on the training data, not the AI’s output, and the claims were largely dismissed.

The key difference between those cases and Disney’s is that Disney expands upon an unpromising precedent by alleging that the outputted image itself is also an infringement, not just the training data. In other words, Disney’s claim broadens the legal battlefield: it asserts that the generated result is a copyright violation, even if it was never explicitly named or directly copied, as long as the strong resemblance is there. 

The Implications

Concerns surrounding the ethics of generative AI have been steadily growing, and through this lawsuit, Disney positions itself as a kind of safeguard—suggesting that it is protecting artists from being undermined or replaced by machines. However, Disney itself has long faced criticism for its treatment of the very artists it claims to defend. Reports of long hours and intense work environments are common. According to public salary data, Disney animators earn up to 22% less than the industry average, even though their wages exceed union baseline pay.

Disney claims that Midjourney is hurting the same artists that Disney allegedly mistreats and underpays, which begs the question—who will actually stand up for the artists whose works are being used instead of just protecting profit?

June 15, 2025 · AI

Divided by Design: How AI Could Deepen the Wealth Gap

Artificial intelligence is shifting economic rewards from people to machines

Virthiha Selvamuthukumaran

As artificial intelligence reshapes the workplace and redefines productivity, one thing is becoming increasingly clear: AI may not be the great equalizer many once hoped for.

The AI Economy

AI is accelerating a longer-term economic shift: the transition of value from labor to capital. As AI systems become more autonomous and capable of handling complex tasks, fewer workers are needed to produce the same—or more—output. This reduces the bargaining power of labor and increases the return on capital for those who own the technology. For instance, in customer service, AI-powered chatbots and virtual assistants are increasingly taking over the roles of entry-level agents. Swedish fintech firm Klarna recently reported that its AI system was able to perform the work of 700 agents just one year after laying off that exact number of agents. The company gained efficiency but at the cost of hundreds of human jobs.

While early studies indicate that AI can enhance the performance of novice workers, especially in structured roles such as tech support or writing-intensive tasks, those same workers may soon face the highest risk of displacement. As AI matures, companies may no longer need to hire and train newcomers. They will need better machines.

Skills, Access, and the False Promise of "Upskilling"

Policymakers need to take proactive measures to ensure that AI does not exacerbate existing inequalities. While AI literacy and job retraining programs are a good start—and frequently championed—they only scratch the surface. Learning to use AI requires time, stability, and reliable access to technology, which are resources that are not evenly spread across different communities. Moreover, even for those who do manage to adapt, there is no guarantee that it will be enough. As machines become increasingly capable of performing tasks once reserved for humans, the skills that are relevant today may become obsolete tomorrow.

A New Kind of Inequality

Currently, it is high earners who are receiving the most significant boost from AI. Lawyers, engineers, and consultants—those already working behind screens with access to advanced tools—are utilizing AI to streamline research, automate tedious tasks, and accomplish more in less time. For them, AI is a personal assistant.

That said, workers in manual labor, hospitality, agriculture, and other hands-on jobs are being left out because AI does not yet fit neatly into the work they do. This technological wave is distinct in its sheer scale of ambition. Unlike past tools that augmented human labor, frontier AI models are designed to replicate and even surpass it. OpenAI, for instance, aims to build systems that "outperform humans at most economically valuable work." In a world where machines can do everything, what is left for people to do?

This possibility raises existential concerns about economic agency, human worth, and societal organization. If income from labor continues to decline and AI-driven gains primarily accrue to capital owners, how will countries maintain an inclusive economy? What happens when the rewards of innovation are no longer shared?

Sharing the Benefits

To avoid a future of deepening inequality, policymakers need to take proactive steps now. That includes:

  • Expanding AI access and training for workers across sectors.
  • Creating mechanisms to equitably share AI-driven productivity gains, such as worker ownership models or AI dividend programs.
  • Strengthening the safety net to support workers displaced by automation.
  • Regulating AI development to ensure it complements rather than replaces human labor wherever possible.

AI holds extraordinary promise. However, without deliberate intervention, it could reinforce existing inequities and create new divides that countries worldwide are unprepared to manage. The future of work does not have to leave people behind; instead, communities must learn to adapt and grow with AI.

June 17, 2025 · AI

Who Let The Killer Robots Out?

China, known for its recent rapid technological expansion, has been matching the US in the deployment of automated weapons. To come out on top, the Pentagon has deployed its new defense doctrine to engineer these weapons rapidly.

Aadith Muthukumar

What is the Pentagon’s New Defense Doctrine?

The Pentagon's newest defense doctrine can better be described as a multi-pronged defense strategy with three main pillars: Directive 3000.09, Project Replicator, and the JADC2.

In January 2023, the Department of Defense (DoD) updated its catalog with Directive 3000.09, highlighting the deployment of autonomous and semi-autonomous weapons. Rather than fully banning autonomous weapons, it mandates that the weapons must undergo rigorous testing and earn senior-level approvals from the Secretary of Defense for Research and Engineering and the Vice Chairman of the Joint Chiefs of Staff. However, this oversight process is not open to the public, which raises ethical concerns about whether these weapons are really being looked into. 

Figure 1: Flow Chart to determine if Senior Level of Approval is Necessary

7 months later, Deputy Secretary Kathleen Hicks launched Project Replicator with a simple idea—counter China’s mass with our own mass but in a smarter, cheaper, and expendable way. Project Replicator aimed to deliver all-domain attritable autonomous systems (ADA2) by the thousands. This would put cheaper uncrewed systems on the frontlines and decrease the number of people in the line of fire. In September 2024, the DoD approved Replicator 2—the second iteration of Project Replicator. This initiative aimed to specifically counter drone technology with minimal collateral damage.

The DoD also created the Joint All-Domain Command and Control (JADC2). This system connects all sensors, shooters, and communication devices across all military branches into a single network. By unifying all automated weapons, the DoD hopes to speed up decision-making and reach faster response times while also improving control over the weapons.

The key point of this doctrine is that there is minimal human intervention. It implies that the DoD believes that machines need to be making lethal decisions fast and deter China from this arms race. 

How are these systems being created and deployed?

We don’t know.

Names, models, manufacturers, criteria, data. Most, if not all, information is being left in the dark. This lack of transparency has led to confusion even amongst NATO members. According to NATO’s Allied Command Transformation, there is still no unified policy or shared doctrine to govern these lethal autonomous weapons. While the UK and France have embraced AI warfare, countries such as Germany and Norway have strong reservations about the minimal human oversight.

What we do know is that autonomous weapons have been implemented in order to conduct reconnaissance. The Bullfrog turret, for example, is an automated weapon that shoots any enemy drones on sight without any human intervention. However, the development of automated weapon systems is a “black box” to the public—we know the inputs and outputs, but nothing else about internal decisions. Without knowledge of how these weapons are being created, there is no way to ensure accountability and verify compliance.

What should we be worried about?

What is even more concerning is the lack of public debate about these AI-powered weapons despite their potentially devastating impact. Even if automation is behind closed doors, we should still attempt to kick it down.

Organizations, such as Stop Killer Robots, are trying to ban the future development of these weapons. They argue that these killer robots’ decisions are often inscrutable even to the engineers who built them. The Red Cross and Human Rights Watch go even further, saying that delegating life-or-death decisions to these machines violates many international humanitarian law principles. Even more so, entrusting these machines with the decision of killing someone undermines the moral responsibility that we bear for the bloodshed and violence of war. Trying to put a machine in between us and the horrors it inflicts our dignity. 

The deployment of these automated weapons also introduces another layer of global security instability, particularly the impact that it will have on nuclear and biological deterrence. With the increased risk of miscalculation and false attribution due to the limited human oversight, the impact of failure can be catastrophic. Even worse, the unpredictability of these weapons due to a lack of information about them can lead to subpar response times and threat assessments. Moreover, with the normalization of autonomous and unaccountable warfare, rival states may pursue responses like bioweapons development to keep up. As we enter this new world of AI-driven military strategy, the integration of these autonomous weapons within national defense doctrines threatens the ethical safeguards that have protected us so far. 

June 21, 2025 · AI

The RAISE Act: New York Walks the AI Tightrope

New York could become the first state to establish guardrails for rapidly evolving artificial intelligence technology. If signed into law, the RAISE Act would serve as a national blueprint for striking a balance between innovation and oversight.

Abhinav Kokkula

The New York State Assembly recently passed the Responsible AI Safety and Education (RAISE) Act, sending it to Governor Kathy Hochul’s desk for approval. If passed, the bill would introduce a framework of boundaries and guidelines intended to reduce the risks and harms associated with artificial intelligence (AI). While large developers lobby against oversight measures, the bill’s supporters cite growing concerns over AI as reasons to implement commonsense regulation that protects citizens without stifling innovation. AI-related freak accidents and horror stories are becoming more commonplace, but the RAISE Act still faces obstacles before officially becoming the first legislation of its kind. 

What is the RAISE Act?

Generally speaking, the RAISE Act targets large AI developers, requiring them to create safety and security plans for their models and reduce the risk of major AI-induced harms. Bill sponsor Assemblyman Alex Bores says that regulating AI now “will have consequences that reverberate for years.”

The act only applies to companies with frontier models: AI models that are trained using more than 10^26 computational operations and incur computing costs greater than $100 million. This categorization applies to less than 10 of the largest AI developers, and it shields small businesses from facing burdensome regulatory costs – a criticism of the bill voiced by tech giants IBM and Meta. 

The bill defines “critical harm” as death or serious injury to more than 100 people or more than $1 billion in property damages. Critical harm can result from AI releasing destructive weaponry, like nuclear weapons, or AI models engaging in criminal acts with no meaningful human intervention. The Safety and Security protocols in the bill require these large developers to implement reasonable protections to reduce the risk of critical harm in any way possible.

Additionally, the act would require detailed reports of testing procedures used to evaluate frontier models and their risk of critical harm. The safety and security protocols would be published and updated annually, and details on testing would be available for at least five years after the model is out of service. Under the law, developers would have to implement safeguards to prevent unreasonable risk of critical harm; otherwise, they would not be permitted to deploy the model.

Finally, the bill gives the New York Attorney General the power to file suits against these companies: up to $10 million after the first violation, and up to $30 million for all following violations. 

The Past, Present, and Future of AI “Disasters”

Eugene Torres, 42, an accountant in Manhattan, used the extremely popular AI chatbot ChatGPT to help him save time building financial reports and getting legal advice. But one simple question he asked about “the simulation theory” took him down a reality-bending rabbit hole that nearly killed him. The New York Times recently covered Mr. Torres’ story, detailing the chatbot’s direct role in making him accept that he was in a false reality. Believing he would eventually be able to escape “the matrix” he was stuck in, Mr. Torres began taking ketamine, a dissociative anesthetic, and cut ties with his family and friends. 

At some point, the AI even told Mr. Torres he could survive jumping off the 19-story building he was in. Eventually, he stopped believing the chatbot, and in an attempt to regain his trust, ChatGPT told him to reach out to the Times. Alarmingly, many journalists have been receiving similar messages, showing how easily AI deludes people, no matter their level of vulnerability. 

As AI becomes smarter, more human-like, and increasingly popular, all types of catastrophe are on the table. In 2024, AI-generated articles reporting on false political scandals grew popular on the Internet, demonstrating how AI can easily spread misinformation and undermine democratic norms. Various instances of AI being harmful – misdiagnoses in healthcare, incorrect flagging of criminals, and exacerbated discrimination – add up, quietly building an AI epidemic with no legislative cures yet available. 

Given the rapid growth of AI, its capabilities seem limitless. In the future, we could see AI being used maliciously to mount powerful cyber, chemical, biological, radiological, or even nuclear attacks on enemies. Even if bad actors are kept out of play, the possibility of losing control over AIs is becoming increasingly likely. The lack of regulation amidst the evolving threats posed by AI raises an important question: Will the RAISE Act pave the way for more comprehensive regulation around this technology, or will the current desire for rapid innovation overshadow important oversight measures?

A Milestone Precedent or Just Another Fluke? 

A similar Californian bill was vetoed by Governor Gavin Newsom last year amidst a similar level of intense lobbying that New York Governor Kathy Hochul is currently facing. While the RAISE Act takes a more cautious and less restrictive approach to regulation, its fate will determine the future of AI legislation.

Large tech companies intent on squashing the bill are lobbying for Governor Hochul to veto the act. Julie Samules, president and CEO of Tech: NYC, a trade group that includes Google and Meta, said that she does not oppose state regulation, but would prefer a national standard or an approach that is more targeted than the RAISE Act.  

When Governor Newsom vetoed the California bill, he convened a group of experts to research ways the state could regulate AI amidst an absence of comprehensive federal policy. That same group recently released a report warning of “potentially irreversible harms” from AI that states should be ready to regulate. The report also says that AI model capabilities have advanced rapidly since Governor Newsom’s veto, placing newfound importance on the RAISE Act and its impact. 

Governor Hochul, who will make the final decision on the bill, approved disclosed AI use in state agencies in December, although the state comptroller’s office has found “clear evidence that New York’s use of AI has been running well ahead of the state’s ability to manage it.” Hochul was also a major supporter of the Empire AI initiative, a public-private academic partnership housed at the University of Buffalo dedicated to researching and developing AI. Furthermore, she approved measures regulating AI companions and apps that provide emotional support to people. 

While the bill’s fate is still uncertain, its approval would mark a milestone in American AI policy, potentially setting a precedent for future AI safety and regulation bills. 

What’s next?

Federal lawmakers have made little progress regulating AI, leaving power in the hands of state legislatures. During the 118th Congress, over 150 bills regarding AI were introduced, but none of them were passed into law. Bills concerning AI in this 119th Congress have focused on national security, citizen protection, and developer accountability and transparency. For instance, H.R.3460 prevents employer discrimination against whistleblowers reporting AI violations, and S.321 seeks to prohibit U.S. citizens from helping China advance its AI capabilities. 

Currently at the center of attention on Capitol Hill is The One Big Beautiful Bill Act. It passed through the House of Representatives with a 10-year moratorium on AI regulation, potentially prohibiting states from regulating AI altogether. While a Senate committee has softened language in the provision, the passing of this bill would be consequential to state governments, particularly considering the overwhelming absence of federal legislation or regulatory standards for AI. 

Governor Hochul wrote a letter to Senate leaders last week opposing the bill, saying it “undermines states’ fundamental right and responsibility to protect the safety, health, privacy, and economic vitality of its citizens.”

While Congress has been stuck debating how – and whether – to regulate AI, the burden of administration has shifted to the states. In a world where AI is moving faster than the laws meant to regulate it, the RAISE Act offers a glimpse into the future of AI governance: cautious, preventative, and focused, while walking the tightrope between innovation and oversight.

June 22, 2025 · AI

The $100M Talent War Over AI’s Future

Sam Altman has revealed that Meta has offered OpenAI researchers $100 million deals in order to lure talent into their company, exposing the fierce battle for control over the future of artificial intelligence

Aadith Muthukumar

Is Big Tech Buying the Future of AI?

Sam Altman, OpenAI’s current CEO, went on the Uncapped podcast to talk about the future of AI within the expanding digital age. There, he talked about a plethora of possibilities that AI can handle—from revolutionizing healthcare and scientific discovery to even transforming how humans work, learn and create. However, the conversation quickly shifted when Altman revealed that Meta is aggressively trying to poach OpenAI researchers and offering some as much as $100 million to jump ship.

How rare is AI Talent?

Altman has estimated that fewer than 1000 researchers globally have the skill set to train and fine-tune the powerful AI models that global companies have set their sights on. These are the people who know how to build LLMs, custom inference engines, and solve complex internal engine problems that could shape the future of artificial general intelligence. In other words, they are the keys to opening the next technological revolution. 

To be the first ones to pioneer this new space, companies like Meta are willing to bet millions on them. However, OpenAI isn’t going to go down without a fight—Altman has disclosed that he has countered all offers from Meta with higher salaries and better packages. The fight’s not over yet, and as we continue to vie for better and stronger LLMs, the money is only going to stockpile.

How far is Meta willing to go to poach talent?

Before deciding to move on OpenAI workers, Meta had recently suffered some losses on the AI front. According to CNBC, Meta delayed the release of their latest flagship AI model due to complications with its capabilities and ethical judgment. The Wall Street Journal concurs that Meta’s engineers are struggling to improve the capabilities of their behemoth LLMs, leading to questions on existing talent within Meta and its standing in the AI race. 

Set out to prove themselves in the playing field, Meta decided to take action. Their CEO, Mark Zuckerberg, has had some success getting talent such as Alexandr Wang, who has shown great capabilities as the current CEO of Scale AI. What is even more impressive is the package that was offered to Wang—$14.3 billion for a 49% stake in Scale AI as well as a key researcher position in the Meta research lab to create AI. Other key researchers, such as Jack Rae and Johan Schalkwyk from Google Deepmind and Sesame AI Inc., respectively, have been offered similar salary packages in order to convince them to join Meta. With these high-profile hires, Zuckerberg aims to build more than just another AI system—his vision is a “superintelligence” powerful enough to challenge every major player in the field, including OpenAI

What’s at stake here?

This feud is much more than bragging rights—whoever wins this talent war will likely set the direction of future AI research for the next decade. This includes important features such as safety frameworks, regulatory responses, and overall business models. That’s a heavy responsibility, especially as decisions are increasingly being made behind closed doors.

Not all researchers are choosing between these two corporate giants. A growing number of them are stepping away from Big Tech in pursuit of non-profit and think tank work surrounding AI governance. These researchers are trying to get away from the profit-driven race that these companies are trying to compete in and seek slower and more transparent environments. Some of these organizations include Anthropic, Center for AI Safety, and the Distributed AI Research Institutes—groups that prioritize ethical alignment and transparency. AI researchers have even publicly voiced out concerns on platforms like Instagram and X, announcing career pivots away from “black box models” in hopes of creating AI that prioritizes public and ethical oversight. 

For now, Altman has assured the public that everything is under control and no researchers are leaving. But, as the money continues to pile up and nine-figure deals reach the table, loyalty is bound to break.

June 24, 2025 · AI

Ohio State Makes AI Fluency a Graduation Requirement: Will Other Schools Follow?

The university’s decision may propel a transformation in how AI literacy is integrated into curricula nationwide

Saathvik Valvekar

Starting Fall 2025, every undergraduate attending Ohio State will have to complete artificial-intelligence-focused coursework in addition to their classes. This new curriculum, with the addition of AI education, covers the fundamentals, theory, and its application in their field of study, whether that be medicine, business, or the humanities. 

OSU is introducing numerous new changes to its curriculum to further modern AI knowledge across all majors. Their ambitious goal is to ensure that every Ohio State graduate, starting with the class of 2029, will graduate being AI fluent,” as stated by the university. 

What is AI Fluency, and how is Ohio State Evaluating It?

AI Fluency refers to the ability to smartly utilize AI and decision-making in various fields. Ohio State University states that it is vital to harness the power of AI for the future in all disciplines. For example, this could be analyzing large datasets in healthcare or speeding up operations in business. 

Ohio State University is integrating AI into its curriculum with three main steps. First, they are introducing a required first-year course where students are introduced to the basics of generative AI. There are also built-in workshops to support the students. Second, OSU is also introducing a new course, “Unlocking Generative AI.” In this course, open to all majors, students are exposed to prompt design, the societal implications of AI, and more. Third, the Michael V. Drake Institute for Teaching and Learning is “launching a fund, providing financial and advisory instructor support,” as stated by the university.

What Does This Mean?

This push by Ohio State University represents the shift from policing AI misuse to teaching students to utilize it with technique. Rather than framing AI as a cheating threat, the university acknowledges its presence as a tool for efficiency and innovation. Ohio State University intends to future-proof the advancing workforce by training students to coexist with AI, not neglect it.

This marks an incredibly huge change towards adopting AI as a growth mindset, a skillset to be learned.

Will Other Institutions Follow?

Ohio State University has set an example for universities to follow, especially as AI becomes more important for students in the workforce. Although most universities have yet to implement structural changes in their curricula involving AI, we could expect pilot programs in large public research universities within the next one to two years, especially in state legislatures where there is a heavy push for AI integration. In addition to large public universities, more selective private universities and liberal-arts colleges may introduce AI literacy or ethics education—however, full curricular integration will vary by university and discipline. 

What could accelerate this moving trend?

When the industry demands AI fluency, the universities will feel more compelled to implement AI literacy in their education. This demand will drive universities to respond or risk graduate employability. Employers are not only looking for students who understand the basics of AI, but rather its use cases in real-world scenarios, whether that be making data-driven decisions in finance, streaming workflow, or generating ideation with smart prompting. 

Federal or state guidelines that prioritize AI education could encourage universities to adopt AI literacy in their curriculum. This could be in the form of grants, curriculum standards, or faculty development programs, which would create the motivation and infrastructure for widespread adoption. In addition to federal guidelines, if Ohio State’s graduates are more AI-capable and are more successful in their industries, peer universities may feel the pressure to conform.

If universities fail to adapt, they risk graduating students fluent in the past but illiterate in the future. Students deserve an education that teaches them the technology that will define their future. Ohio State’s move set a baseline, and now, it’s up to other universities to follow in its footsteps.

June 26, 2025 · AI

A Decade on Hold: The Stakes of a Federal 10-year Moratorium on State AI Laws

AI Governance is rapidly changing along with the nation’s technology. Here’s how a proposed 10-year moratorium on state AI Laws could reshape innovation, regulation, and state autonomy in the age of artificial intelligence.

Ellyce Butuyan

AI governance has reached a turning point. On May 22nd, 2025 the U.S. House of Representatives passed H.R. 1, the “One Big Beautiful Bill” with a vote of 215 to 214. This bill primarily addresses budget reconciliation, but it also includes a 10-year moratorium on state AI laws. This controversial proposal reflects a shift in the already fluctuating legal landscape of AI, raising questions of whether we may see a future where AI legislation is left solely to the federal government’s discretion. This reality is causing many politicians, tech experts, and AI CEOs to grapple with the moratorium’s implications and the growing conflict between innovation and regulation.

Understanding the Proposed Moratorium

The moratorium explicitly prohibits states from enforcing any laws or regulations that target "artificial intelligence models," "artificial intelligence systems," or "automated decision systems" for the next ten years once it is enacted. The bill itself expresses federal preemption, or in other words, the allowance of federal law to supersede or even nullify state law. Therefore, it would serve as a way to streamline and establish uniformity with AI regulations; a need that has recently been reflected by the more than 1,000 different AI bills that have already been introduced in 2025.

The Crucial Question is: Is the Moratorium a Necessary Precaution or Simply an Overreach of Federal Power? 

If the moratorium is fully approved, restrictions on current state policies that address data protection, transparency requirements, algorithmic bias in employment, AI surveillance, and more will inherently follow. However, there are some exceptions to the moratorium for state laws that do some of the following: remove legal barriers for AI deployment, apply "generally applicable" standards equally to AI and non-AI systems, or enforce criminal penalties. 

Yet, there still remains some ambiguities within the moratorium. The use of phrases such as prohibiting “regulations” are unclear because they have the potential to encompass not only laws that specifically target AI, but also general laws that impact AI indirectly. Furthermore, the “generally applicable” exception also remains ambiguous, as the line between a generally applicable law and an AI-specific regulation has not yet been clearly defined. This lack of clear definitions may prove to be an obstacle for courts in the future if they are expected to enforce the moratorium and/or settle disputes over its reach. Consequently, these ambiguities not only complicate enforcement but also fuel broader debates about the potential impact of the moratorium on the U.S. overall. Ultimately, these ambiguities underscore the central issue of whether the moratorium constitutes an overreach of federal power that could stifle state-led innovation and regulatory flexibility.

Its Implications

Now, it’s time to take a look at the moratorium through a broader lens, examining its economic, innovative, and political implications. Some of those in support of the moratorium believe that moving away from varying state regulations will actually improve the AI industry’s growth, acting as an advantage for the U.S.’s competition with China’s AI development. 

On the other hand, critics warn that blocking state rules could hurt local economies and regular people. In a rare bipartisan statement, 40 state attorneys general warned that the moratorium could undercut sensible state-level safeguards aimed at addressing the recognized harms of AI technologies. If states can’t make their own rules, they might not be able to protect people from AI scams or deep fakes, which is an issue that is especially relevant for women, children, and seniors. Additionally, states would lose the power to react quickly to economic changes, such as when AI causes people to lose jobs or when rent prices go up because of automated systems. This risk may even give big tech companies more power over the economy. 

The Moratorium's Future

As the debate continues, it’s clear that the far-reaching effects of the moratorium are a significant concern for lawmakers, businesses, and the public. H.R. 1 now faces Senate approval with both political parties voicing their opinions alongside AI companies. However, it is evident that conversations surrounding federal and state power regarding AI governance will not be going away anytime soon.  

July 1, 2025 · AI

When Meta Met Scale: The Deal that Redefines M&A in the AI Arms Race

Meta’s $14 billion stake in Scale AI sidesteps regulators and signals a new era of strategic deal-making in Big Tech.

Nate Nadler

In a recent deal exceeding $14 billion, Meta acquired a 49% non-voting stake in Scale AI, marking the tech juggernaut's second-largest external investment to date. The unconventional deal signals a change in how M&A is done, especially in the age of AI. Rather than taking a voting position in Scale, Meta opted to inject cash for targeting R&D, influence operations from afar, and, most importantly, not set off regulatory concerns.

Anatomy of the Deal: A Stake, not a Buyout

Rather than a traditional acquisition, Meta’s stake in Scale AI reflects a carefully engineered maneuver—one that works to maximize strategic gain and minimize regulatory exposure.  

As a result of the nature of the deal, Scale will continue to operate as an independent entity, serving clients such as the US Department of Defense and other large technology firms. Furthermore, Meta has pledged a minimum of $500 million of capital per year over the next five years to develop Scale’s AI services. Additionally, in an interesting move, Scale’s CEO, Alexandr Wang, will join Meta to lead its “superintelligence” lab while maintaining a role on Scale’s board—a decision that is rarely seen in the world of M&A. Wang’s move signals a long-term loyalty to Meta and its institutional goals, with both roles hinting at the immense influence Meta is likely to have in Scale AI’s operations.  

Inside Scale AI

Alexandr Wang, a visionary MIT dropout and engineer who competed for the US Physics Olympiad, US Math Olympiad, and US Computing Olympiad team, founded Scale AI in June of 2016. The original goal of the organization was to solve a burgeoning problem in AI development: labelling data effectively and neatly. The company’s work secured it contracts with defense contractors and autonomous vehicle companies.  

Today, Scale specializes in data labelling and annotation at a large scale, which is crucial for AI models to understand text, images, and videos. Furthermore, the company offers API-first infrastructure, which means that customers can upload raw data and receive structured results promptly. 

Scale AI’s mission marks a crucial one in today’s technological landscape, as AI’s ability to label data well can mean the difference between life and death, especially when it is implemented in autonomous vehicles and defense technology.

A New M&A Playbook: Strategic Stakes Over Acquisitions

At a time when Big Tech is constantly hit with accusations of monopoly and antitrust lawsuits, Meta’s latest move could pave the way for a new strategy in the AI arms race. Meta’s play clearly offers a multitude of benefits as a result of deal minutiae, which includes operational alignment through the duality of Alexandr Wang, Scale’s autonomy, and long-term service contracts.  

Additionally, Meta seems to have insulated itself from dangers that generally accompany an acquisition. First and foremost, because Meta lacks any legal operational authority over Scale AI, antitrust regulators will be much less likely to come after them for having too much market share. Furthermore, Meta can protect itself from backlash from Scale AI’s current clients due to the organization’s autonomy, even if some of Scale’s clients have severed ties due to the partnership. Lastly, Meta can pivot with ease if the partnership goes sour, and they do not inherit the liabilities that come along with operational control.

As Big Tech races for dominance in the world's latest innovation, Meta has made a power play by securing a synergy in the data sector without all the legal and political implications of a traditional takeover.

Risks and Tradeoffs

For all its strategic brilliance, Meta’s maneuver is not without risk, and the very design that shields it from regulatory fire may expose it to a new set of issues.

First of all, although Meta may not have legal control over Scale AI’s operations, they are set to have a monumental, informal influence over the organization’s operations due to Wang’s role as a board member and head of the “superintelligence” lab. While Scale may have legal autonomy, this begs the question: will Scale truly be able to operate independently from Meta and its interests? As a result, Scale could see widespread client attrition, as seen in the recent week with distancing from OpenAI, Microsoft, and Google.  

Additionally, Wang’s dual role may accelerate a culture in which a few powerful players with deep pockets could consolidate AI leadership and innovation, thus reducing competition and stifling innovation.

Lastly, while Meta’s strategic deal structuring may avoid antitrust concerns now, future regulation could expand to non-voting stakes.

In redefining how influence is bought and power is brokered, Meta’s play for Scale AI may be less about what it owns and more about what it quietly controls.

July 3, 2025 · AI

Cheating Just Got Easier

Cluely, the AI startup that lets you “cheat on everything”, recently was backed by Andreessen Horowitz, a venture capital firm led by Marc Andreessen and Ben Horowitz.

Aadith Muthukumar

What is Cluely?

Founded by CEO Roy Lee and COO Neel Shanmugam, Cluely is an undetectable AI agent that feeds you real time information by looking at your screen and listening to your calls—hence, “cheating”. Before founding Cluely, the two were students at Columbia University and created Interview Coder, an AI agent that helped you cheat on coding interviews. After using the software in multiple interviews and securing offers from top companies such as Amazon and Meta, Columbia discovered their actions and expelled both Roy and Neel. However, instead of backing down, Roy and Neel doubled down with a bolder vision—why stop at coding interviews when you can cheat on anything and everything? That’s exactly what Cluely enables. 

Cluely came into the startup space with a big vision, but not everyone agreed with the idea. Many criticized the Columbia dropouts, questioning the ethics and implications of their technology. However, Andreessen Horowitz, affectionately known as A16Z, thought the opposite. They saw the potential of Cluely in today’s fast growing digital world and decided to lead a $15 million Series A funding round for Cluely.

Where is Cluely funding coming from?

Cluely has received a lot of attention recently, but they’ve come a long way to stardom. When Cluely was first created, Roy and Neel raised $5.3 million as seed funding led by investors from Abstract Ventures and Susa Ventures. At that time, the future of Cluely looked bleak. Not only did it seem like Cluely didn’t have a product, but public reaction was overall negative due to the fear of a product made for “cheating”. It got so bad that investors eventually forced Roy to change Cluely’s brand naming to “Everything You Need. Before You Ask”. However, the controversy stuck like glue, and the pivot was still met with skepticism.

Roy and Neel didn’t lose hope at this and pushed forward. After recruiting 50 interns and many founding engineers, the duo received their $15 million Series A funding from A16Z only 2 months later. A few investors who were not a part of the deal even told TechCrunch, a well-known tech publication, that Cluely’s post-money valuation is around $120 million. However, both Cluely and A16Z did not comment on this.

How did Cluely get to where it is now?

Unlike most startups, Roy took an unorthodox approach to generate publicity. Rather than shy away from the controversy surrounding Cluely, he leaned into it— famously claiming that “all publicity is good publicity.” It was this idea that influenced him to swing big, posting viral videos of himself using Cluely to cheat during interviews, exams, and even live presentations.

Probably one of most infamous moments happened recently at Y-Combinator, where Roy Lee orchestrated an unofficial after-party for those who attended the YC AI Startup School. The line to the party became so long it started to block traffic, and eventually San Francisco police had to shut it down before it started. Roy used the failed event into a viral marketing moment, posting clips of the chaos saying “Cluely’s aura is just too strong.”

Roy and Neel invested even more into marketing after hiring Daniel Mints as Cluely’s Chief Marketing Officer. Daniel, known for his viral growth strategies at the finance recruiting startup RecruitU, signed on to help bring Roy’s vision to life. Together, the three of them doubled down on controversy and stunt marketing to make Cluely impossible to overlook.

What does the future hold?

What is disturbing about this investment is that it signals the type of startups that venture capitalist firms want to invest in. Cluely does not have a fully launched product online, yet the sheer attention it has garnered was enough to influence A16Z’s decision. This suggests that hype may matter more than the actual service that the startup is providing. It raises significant questions on whether we are entering an era where startups are rewarded for how loud they can announce they are building something rather than for what they are building.

This is not your run-of-the-mill investment as well. A16Z is considered a top venture capitalist firm, and their decision to invest into Cluely was widely regarded as the right decision. Their Series A investment marks the precedent of a shift from viability to virality. A16Z has effectively endorsed a new startup blueprint where getting loud matters more than getting it right.  

Public perception is still wary, and that doesn’t seem to be changing anytime soon. However, whether you hate them or you love them, A16Z just made Cluey’s vision more real—and a whole lot harder to ignore. The investment signals a growing appetite for boundary-pushing AI in Silicon Valley, even when the lines start to blue between innovation and ethics.

July 5, 2025 · AI

AI Companies Can Use Your Book to Train Their System

Here’s what the latest Generative AI ruling means for authors across the nation

Zahra Abdul Razaq

A Federal judge in California has made the first decision regarding artificial intelligence companies using creative work to train their models. Authors Andrea Bartz, Charles Graeber, and Kirk Wallace Johnson filed a lawsuit against Anthropic in 2024 for retracting their books illegally to train their AI model.

Anthropic, the defendant had been previously charged with copyright after it was disclosed that the company had been using pirated copies of books to train its systems.

In a heated moment, the judge declared that the use of copyrighted books was allowed as long as it was downloaded legally. Even if it was purchased in print and then digitally scanned, it would still be permissible.

This decision marks a major landmark case for AI companies because it allows them to use copyrighted material, but only if it is purchased. 

Creators vs. Policymakers

The ruling has caused a rift between authors, artists, and other creatives versus the lawmakers. As generative AI expanded into the literature space, authors naturally fought back with lawsuits. In a publication written by Debevoise and Plimpton, it was held that the Thomson Reuters case was one of the first instances of alleged copyright by generative AI companies—though the facts have yet to back this claim. 

According to the Guardian, twelve copyright cases have been consolidated in New York. Some notable plaintiffs include Ta-Nehisi Coates, Michael Chabon, Junot Díaz as well as the New York Times.

Tech companies argue that ‘copyrighting’ these authors' works is fair as per the 1994 Supreme Court ruling and Article 1 of the United States Constitution. Adding onto their argument, Article 1 specifically mentions the creation of copyright laws that help develop science and technology.

But, as District Court Judge Vince Chhabria in San Francisco has noted, authors are worried that these new tools might put them in a dangerous position given the already hypercompetitive publishing market. 

The plaintiff’s attorney neglected to provide a statement since the ruling was dropped.

The Domino Effect of This Precedent

A clear precedent has been set—the work of authors and other creative artists may be copied and used to train AI systems, just as long as the work is obtained legally. While purchasing an artist’s book or artwork generates income for any artist, work developed by the automated machine that is AI will not only worsen competition but also create strikingly similar work to what a human is capable of pulling off.

In a survey undertaken by the Authors Guild, it was found that 90% of authors believed that they should be compensated if their work was used in generative AI. As noted by New York Times best-selling author Victoria Aveyard, she feels wronged as her work has been stolen by the multi-billion-dollar corporation Meta to train its AI system. 

These fears are born not just from pirating books, but the luck involved, in addition to hard work and opportunity, when it comes to the publishing world. By illegally obtaining these books to train AI models, Aveyard believes that it becomes difficult to get compensated as sales drop, affecting her career and others.

It has long been established that creative arts have not been able to financially compensate those who pursue them. This latest move might just hit that nail in the coffin.

July 6, 2025 · AI

Washington’s Second Act: From Policy to Profits

Once a destination for lobbying, Washington DC is becoming home to AI defense firms, federal-scale startups, and the VC that’s funding them.

Nate Nadler

For decades, DC was the city where innovation went to get lobbied.  Startups were conceived and built in the Bay, scaled in New York, and eventually regulated in DC.  Recently a new trend has developed: venture capital is now flowing into the capital and a new type of founder is setting up shop within a few blocks of Capitol Hill.

When did this shift begin?

The shift began over a decade ago, in 2013, when startup activity began to ramp up in Washington and its surrounding areas.  Despite the spike in innovation, most startups were still focused on niche and policy oriented missions – like EdTech, GovTech, and NGOs.  Furthermore, investment was sparse, with VC funding hovering below $1 Billion per year across Washington, Maryland, and Virginia.  A major driver in this impact-based innovation was Halcyon, a non-profit incubator based in Georgetown.  The organization was founded by Dr. Sachiko Kuno, a Japanese biotechnology entrepreneur, and the 18-month fellowship boasts alumni such as Goodfynd and Higher Rewards.

In 2018, Amazon announced it would be opening HQ2 in Northern Virginia, planting a $2.5 billion flag just across the river from the Capital.  Holding the largest market share of cloud computing, Amazon and their largest subsidiary, AWS, committed to a multi-billion dollar investment as well as 25,000 jobs.  Spurring public investment, Amazon was incentivized with $750 million in subsidies from Virginia and $195 million in infrastructure improvements.  Causing shockwaves across the region dubbed the DMV, local VC funding grew to $1.9 billion across over 240 deals.  Clearly, if the area was good enough for one of the biggest names in computing and ecommerce, then it was surely going to be a hotbed for innovation in the future.

The pandemic further fueled the fire, decoupling tech from the coasts.  With people opting for remote work in droves, people no longer had to opt for the Bay, Seattle, or New York City to be a major player in the industry.  Further, in 2020 and 2021, VC funding stayed steady at $2.1 and $2.6 billion in the DMV respectively.  

By 2022, DC was no longer an emerging city of innovation; rather, it became a magnet for very specific and governmentally aligned organizations with goals in cybersecurity and defense tech.  With venture funding spiking to $4.5 billion, startups like ID.me and FiscalNote began to emerge – many of which with an interest in contracting the public sector.  By 2023, in excess of 400 cybersecurity startups set up shop in the region, making it the most densely populated with these types of initiatives across the country.

Then, in late 2024, the public sector entered the area, with the mayor’s office announcing the DC Venture Capital Fund – a $26 million public VC vehicle.  Additionally, 2025 Q1 numbers did not disappoint with over $1.3 billion in VC funding and 59 deals across the DMV.  Despite these record breaking numbers, though, DC dropped in 5 places in the global startup ecosystem rankings, with reasons cited including a lack of patent output and limited global founder inflow compared to cities like London or Tel Aviv.

The Builders Behind the Boom

Washington’s startup scene has begun to grow up: rather than chasing consumer hype, they are solving difficult – and often federal-scale – problems.  

For example, Shield AI, which was founded a decade ago by former Navy Seal Brandon Tseng and his brother Ryan Tseng, develops autonomous flight software for military-related activities.  While the company may be headquartered in San Diego, they have a very strong presence in the DC area, living off of hefty defense contracts.  Shield AI has seamlessly married state-of-the-art AI technologies with government procurement pathways all the while taking advantage of the policy benefits that exist due to a presence in Washington, attaining it a valuation in excess of $5 billion.

Similarly, Anduril, founded by Palmer Luckey in 2017, has taken advantage of a strong presence in DC.  The organization, which raised over $1.5 billion in series E funding and holds a valuation in excess of $14 billion, builds AI surveillance systems, counter-drone technology, and military intelligence platforms.  Enabled by having a large office and strong presence in the capital, Anduril has closed large government contracts, aligned itself with policy, and taken advantage of lobbying activities.

Shield AI and Anduril are only some of the plethora of large-scale players who have found themselves opening shop in Washington – paving the way for more policy-based business decisions as the AI revolution continues on.

What’s Fueling DC’s Startup Boom

The boom in DC is not merely the result of one big, uncalculated bet; rather, it is the product of a rare and opportunistic convergence.  A maturing cybersecurity sector, a major surge in defense tech demand as global politics seem to become more chaotic as the days go by, and an administration focused on national security, creating the perfect firestorm for founders to come into Reagan with a dream and leave with hefty government contracts.

Furthermore, with public and private capital alignment, large funding rounds, and a plethora of well-educated technical and policy oriented minds coming from schools like Georgetown, UMD, and GW, many organizations see a strong future in the DMV.  

Washington DC didn’t merely become “cool” or “hip” – it became strategic.  In 2025, that’s much more powerful than hype.

July 9, 2025 · AI

The American Firewall on Chinese AI

As AI continues to evolve, lawmakers have become increasingly worried about the possibility of AI being used for espionage—they’ve decided to eliminate the problem by banning the use of Chinese AI technology in government

Aadith Muthukumar

What is the current situation?

With the addition of DeepSeek, China has caught up to the U.S. in terms of raw AI model capability. But, as Chinese-developed AI systems become more advanced, security concerns have been raised. In response to this, U.S. lawmakers have introduced a new bipartisan bill aimed at blocking Chinese AI tools from being used in federal agencies.

According to the bill, any AI tools, software, and hardware connected to or affiliated with the Chinese Communist Party (CCP) would not be allowed in government. This move mirrors the rationale behind the TikTok ban, in which concerns of Chinese tech companies having access to U.S. citizen data led to the overall ban of the app. However, this ban was short-lived due to the legal challenges and pushback that it faced over freedom of expression and commercial impact. If the TikTok ban could be reversed despite a national security concern, it raised the question of whether this broad AI-legislation bill will face a similar fate. 

Who is behind the creation of this bill?

Sponsors of this bill are Reps. Ritchie Torres, D-N.Y., and Darin LaHood, R-Ill., and Sens. Rick Scott, R-Fla., and Gary Peters, D-Mich. It is important to note that this bill was a joint effort and was not created in order to push a political party’s agenda. The threat of foreign interference has become a rare point of agreement between the Democrat and Republican parties after incidents such as the deep fake videos of U.S. officials and cyberattacks on critical government infrastructure. Lawmakers from both sides recognize that artificial intelligence has high potential for surveillance, and can very quickly spell disaster for the United States. The two political parties do disagree on what to focus on, however: Democrats tend to emphasize regulatory oversight while Republicans want to focus on national security.

Beyond just lawmakers, the bill has drawn support from government coalitions such as the House Select Committee on the Chinese Communist Party and the Senate Committee on Homeland Security. Both committees have expressed strong backing for the bill, reflecting growing concern about foreign influence through digital platforms. These same committees have previously taken action on related issues regarding Chinese tech companies, including the ban of AI-driven platforms suspected of espionage. The risk of hostile nations weaponizing AI for propaganda, surveillance, and misinformation has pushed national security to the forefront of AI legislation, though ironically, companies like Palantir who are known for their domestic surveillance, continue to thrive with the protection of government contracts.

What does this say about the future?

This move to create a bill in order to protect the United States from an outside threat is not sudden. It is very well known that the United States and China are currently in an arms race in emerging technologies such as artificial intelligence, quantum computing, and cyber warfare. In order to come out on top, the US has resorted to multiple measures, from creating new warfare doctrines such as Directive 3000.09 to now trying to limit China’s influence within the United States. 

Trying to stop Chinese involvement may prove to have the opposite effect. By implementing this ban, the United States may unintentionally stifle innovation or provoke China into making retaliatory bans. As countries continue to ban to make it out ahead, the world will be left with increasingly broad restrictions on global tech collaboration. While national security is essential, it's important to ask ourselves whether overreaching into Chinese AI could end up weakening the U.S.’s own technological edge by discouraging open innovation.

July 9, 2025 · AI

China’s AI Healthcare: Noise or Long-Lasting Disruption?

China's swift integration of artificial intelligence into healthcare systems represents either temporary news or the beginning of a worldwide paradigm change.

Akash Arun Kumar Soumya

Through significant financial commitments and pioneering regulations in AI medical technology, China is transforming healthcare delivery models while putting pressure on established global industry leaders. 

A Race to Dominate AI Healthcare

China has established itself as a leading force in medical artificial intelligence over the previous five years through comprehensive initiatives that span AI-assisted radiology and pathology to predictive analytics for public health emergencies and hospital operations management. According to a Market Research Future report, China’s AI healthcare market reached a value of $12.5 billion in 2024 as public-private partnerships and state funding driven by supportive policy frameworks fueled its growth. One reason is the fast ageing population of China, which is creating pressure on the health system and leading to the need for scalable and efficient solutions. Another reason is the differences in access to health care between the urban and rural populations, which requires AI to standardize the quality of care. Aside from practical health care, the Chinese government considers medical AI as a priority to develop its technology, become more competitive, and secure its position as an innovation leader.

The Chinese government’s 2017 AI Development Plan marked the beginning of this growth by naming healthcare as one of its top sectors for AI development. Major players like Ping An Good Doctor, iFlytek, and Huawei Cloud have transitioned from basic AI tools like symptom checkers to comprehensive hospital management systems and telemedicine networks for remote areas.

AI systems have become integral components of healthcare operations across major urban areas. Major hospitals in Beijing, Shanghai, and Shenzhen implement AI systems which handle patient admissions, optimize staff scheduling, and forecast emergency room demand to assist clinicians with decision-making. AI tools now function as active elements in clinical workflows which determine the timing, location, and manner of patient care delivery.

Disruption Beyond Digital Diagnostics

While the global healthcare sector commonly associates artificial intelligence with digital triage systems and imaging diagnostic tools, China has expanded its AI healthcare applications well beyond those areas. AI applications now extend beyond disease detection to manage hospital logistics, monitor public health threats, and develop new treatment strategies from patient data analysis.

Tencent’s Miying platform stands as a significant example, having screened millions of patients to detect early signs of esophageal and lung cancers. The platform claims diagnostic accuracy rates that exceed those of some human radiologists, though independent researchers continue to rigorously confirm these results. Nonetheless, AI has integrated into Chinese clinical operations at an unmatched scale, developing swiftly with government support while bypassing much of the regulatory constraints that slow adoption in many Western healthcare systems. The speed of this development is made possible by China's sophisticated state and private actors, from state health institutions to Tencent, which provide data centers, a centralized health data collection system, and infrastructure to train and deploy AI models. Such unified public-private ecosystems and light-touch regulations are hard to reproduce in the absence of centralized institutional actors, fragmented data, and strong regulatory controls.

The application of AI technology to solve healthcare inequities throughout China's expansive rural areas is also expanding. Communities that suffer from inadequate specialist medical care now have access to AI diagnostic mobile units along with cloud services and telemedicine platforms supported by artificial intelligence. According to China Briefing, the delivery of healthcare has experienced a substantial transformation in regions of China that have long received inadequate services.

Regulatory Tailwinds and Risks

The Global News Wire has authorized more than 50 AI medical devices since 2020, exceeding the number of AI device approvals by the United States Food and Drug Administration during that timeframe. Chinese authorities have actively implemented a strategy to accelerate AI integration into healthcare systems as a dual strategy for improving national competitive standing and filling medical service shortages.

However, the accelerated deployment of these devices presents significant concerns regarding safety standards as well as regulatory effectiveness. A 2025 study by the Tsinghua University School of Medicine highlighted the risks of algorithmic bias, patient data privacy issues, and questioned the enduring reliability of AI decision-making under minimal regulatory supervision in medical contexts. The study warned that China's rapid AI healthcare adoption may result in ethical and safety standards being neglected — a double-edged sword balancing efficiency with the risk of harm. Take, for instance, AI-powered diagnostics at remote hospitals. Here, AI was used without the same oversight as in other cases. When AI diagnosis at a remote hospital missed early-stage lung lesions, leading to missed treatments, the situation garnered a lot of media attention but no regulatory response. This mirrors the original deployment of IBM’s Watson for Oncology in the U.S., which showed promise in helping cancer treatment but, based on poorly trained data, ended up suggesting dangerous treatment options. However, in the Chinese context, the scale of the failures is more amplified. In the U.S., there was an inherent regulatory framework that could course-correct for these sorts of failures. There was a strong chain of accountability and control. In China, these failures will have a much more devastating impact.

Global Implications and Competitive Pressure

In an effort to prevent a potential stagnation in AI healthcare technologies, western countries are racing to build the infrastructure to prevent China from outpacing them. They fear that if China’s AI medical systems in the realms of imaging and predictive analytics gain regulatory approval in other markets or if they spread in low- and middle-income countries due to low costs, they will steal the market from western giants like Philips, Siemens Healthineers, and GE Healthcare.

Some Chinese AI healthcare systems have been tested in hospitals in Southeast Asia, Africa, and the Middle East. Their advantages are cost-effective, fast deployment, and their fit in resource-constrained settings, making them an attractive option for countries wanting to leapfrog into modern healthcare systems without the cost of western technologies. Another reason these states have found AI solutions attractive is because many of them are affordable, relatively similar to China, with a similar set of structural issues (a fractured health care system, shortages of trained health care professionals, a rapidly growing population), and many countries see China’s offer of the technology as part of a “deal” including infrastructure, training, and data-sharing agreements as part of the Belt and Road Initiative. It also helps that Chinese tech companies may operate with fewer legal and intellectual property constraints, which makes it easier to customize and integrate the technology into the local health care system quickly.

Is It Sustainable? 

While China’s model of AI healthcare is starting to achieve some successes, it faces severe sustainability challenges. Its uncoordinated data systems, local health infrastructure gaps, and misaligned international regulations could limit the mass-scale export of AI medical technologies.

For the long-term to be able to trust in AI-driven healthcare, long-term issues of ethics, algorithm transparency, and patient outcomes will need to be addressed with longitudinal studies and third-party assessments. Some critics argue that the perceived AI dominance of Chinese healthcare systems is largely a result of marketing aims and not scientifically validated medical performance. Without better outcomes, the sector is at risk of rushing into a mass-scale, general distrust of the healthcare system.

Conclusion: A Disruption in Progress 

The progress of AI healthcare in China is not a short-term fad, but it cannot be considered a guaranteed transformative disruption. This state-led program is set to be a disruption in healthcare delivery in dense or infrastructure-poor areas. China’s rise to global leader or a cautionary tale in AI healthcare will be dependent on balancing speed and safety, innovation and fairness, and accountability in its ambitious mission.

July 11, 2025 · AI

Socioeconomic Impacts and Workforce Policy Amid AI Automation

Which Workers will AI replace and Who will be Left Behind?

Saathvik

Advancements in artificial intelligence are growing – AI systems that can analyze large documents, diagnose medical conditions, and generate thoughtful marketing campaigns are becoming extremely popular among the public. Tools like ChatGPT, Gemini, and AI coding assistants are being adopted by businesses– not just to support workers, but to replace them in many cases.

AI is now a daily reality in offices, factories, and homes, but as AI becomes more accessible and powerful, many pressing questions arise: Which jobs are safe, which are at risk, and how will we prepare for the disruption ahead?

Cognitive vs. Non-Cognitive?

Non-cognitive tasks are repetitive, predictable work that follow a set procedure. Some examples could include financial data collection, proof-reading, or customer service. These types of jobs can easily be automated by basic artificial intelligence with a simple algorithm and therefore, have the most risk of being replaced by AI. In fact, 30% of companies have replaced workers with AI tools such as ChatGPT.

On the other hand, cognitive tasks are specific, mental tasks that require creativity, problem-solving, and emotional intelligence. Some examples could include teaching children, providing therapy, or writing a novel. These types of tasks are more variable and are more difficult for AI to replace. 

Blue-Collar vs. White-Collar Disruption?

White-collar jobs are professional, office-based jobs that require the completion of cognitive tasks unlike blue-collar jobs, which require non-cognitive tasks. Previously, AI automation was only affecting blue-collar jobs – factory workers, warehouse staff, and others that perform manual labor, however, the current wave of AI is also replacing white-collar jobs. 

Unlike previous misconceptions about AI automation that only repetitive blue-collar jobs would be affected, because of the rise of generative AI and LLMs, certain white-collar jobs are now also being replaced. Legal research can be performed using an AI tool that scans thousands of cases, summarizes arguments, and drafts memos faster than junior associates. Report writing and analysis, especially in finance, are being automated to predict forecasts and generate summaries from raw data. Content creation such as articles and social media posts can be produced by ChatGPT, completely eliminating the need for entry-level marketers or writers. Software development is also rapidly changing; AI coding assistants such as Loveable or Cursor AI can now rapidly generate code, creating an advanced framework for developers, making junior programmer roles increasingly automatable.

In contrast, some jobs remain static to AI automation due to their unique human requirements such as physical adaptability where examples of jobs could include plumbers, electricians, or mechanics. Occupations that rely on emotional intelligence such as therapists, counselors, nurses, and teachers, are also extremely resilient to automation due to their human connection. AI also struggles with ethical reasoning and therefore, roles rooted in judgement and human accountability like review boards or negotiators, remain stable.

In summary, jobs that handle tasks such as data entry, online customer support, warehouse support, and record keeping, are at the highest risk of being replaced by AI. Jobs with a medium risk of being replaced by AI would include jobs such as junior legal assistants, graphic designers, and paralegals while jobs such as nurses, teachers, and therapists, are the least vulnerable to be replaced by AI.

Socioeconomic Impacts?

The rise of AI automation only exacerbates the existing inequalities that lie in the different income and education groups, particularly, workers in low-paying and low-skilled environments. Cashiers, warehouse staff, and call center agents are often the first to be displaced since these are routine jobs, jobs that require predictable, repetitive tasks that AI can easily replicate. Without proper safety nets, these displaced workers will struggle to re-enter the labor market, leading to long-term unemployment and possible poverty. 

By contrast, many higher-income, higher-skilled jobs will thrive due to the incredible boost in productivity that AI can potentially bring to their workflow. In finance, software development, or marketing, workers can focus on the higher-value aspects of their jobs while letting the AI focus on the tedious parts of their jobs. Since these workers are more skilled, they are also easily able to adapt to new changes in their workflow, giving them an advantage as their industries evolve.

Communities that rely heavily on industrial or low-service jobs could be economically devastated while technological hubs could thrive and grow even more wealthier. This imbalance mirrors what happened during the early stages of globalization and the offshoring of manufacturing, just faster and more widespread. 

What can we do to our Workforce Policies?

AI systems evolve overnight and the government must have the right workforce policies to support our evolving labor market and avoid deepening inequality. To help workers adapt to the growing economy, actions like reskilling and upskilling are essential. This could involve partnerships with employers and educational institutions to align skills with job demand, online learning platforms, or short-term training programs. Companies such as Microsoft and Amazon already offer internal reskilling programs, however, broad public support is crucial for widespread adoption. Additionally, a safety net for workers would be in their best interest – UBI, direct cash payments to citizens, could be provided in a world where stable jobs are not open for everyone.

Significant educational reform would also be in the government’s best interest to future-proof the workforce where AI is a constant. This could involve teaching AI fluency and digital literacy from an early age, incorporating critical thinking and creativity into student’s daily workflows.

The future of labor will not only be defined by advancements in technology, but how we respond to it. With the proper knowledge and policies, we can ensure that innovation empowers workers rather than replacing them.

July 19, 2025 · AI

Risk vs Reward: Biothreats and the dual-use case for AI

From medical innovation to scientific discovery, artificial intelligence has made the impossible possible. However, this rapidly evolving technology, when in the wrong hands, poses existential risks far greater than society has faced before.

Abhinav Kokkula

OpenAI, the developer of the famous AI chatbot ChatGPT, recently revealed concerns about the capabilities of upcoming models. One of these concerns is that new models will enable those without backgrounds in science and biology to potentially engage in harmful activities by providing them with the necessary blend of information and processes. This threat uniquely enables novices and independent bad actors to create dangerous biological weapons. 

Imagine a 19-year-old college student with no background in bioweapons. Fueled by malicious intent, he looks to cause widespread harm using biological agents. Even with access to Google and internet forums, it would be challenging for him to learn everything necessary to carry out a successful attack -- one reason why many biological threats have failed in the past. But frontier AI models can change that, placing dangerous knowledge into the hands of novices like this student and accelerating their ability to act on it. Just as the internet fueled the rise of crimes like drug and human trafficking, AI threatens to make previously improbable biothreats a far more apparent societal risk.

The Future of AI

At the current rate of AI advancement, it is only a matter of time before frontier models can meet or exceed various human capabilities. Anthropic warned of potential harms when it released Claude 4, and OpenAI also sounded the alarm on the sheer capability of its newest models. Both companies indicated their latest models could cause serious damage by democratizing information for bad actors and deceptively responding to users. 

Advanced AI will rapidly accelerate scientific discovery by boosting the innovation, ideas, and productivity of researchers, medical professionals, and other scientists. The latest models can already interpret laboratory experiments and complex chemical reactions “with remarkable accuracy”. Harvard scientists were even able to use AI to identify drug treatments for rare diseases. An AI system called Robin helped find a potential cure to a type of blindness, and the same system later discovered that an existing drug could help prevent blindness in a different eye condition. But power like this comes with heavy risks. 

Successors of the latest models can aid in designing biological weapons, and while experts are not yet concerned that AI will create completely novel biothreats, they are worried about something called “novice uplift” -- allowing those without a background in biology to do potentially dangerous things. 

Showing just how real this possibility is, Rocco Casagrande, a former UN weapons inspector and scientist, brought US government officials a small box of easily available chemicals that Claude -- Anthropic’s chatbot -- recommended as ways to trigger another pandemic. Several AI safety frameworks, including Google’s Secure AI and OpenAI’s Preparedness Framework, already identify AI-enabled bio attacks as concerns. Furthermore, the International AI Safety Report written for the 2025 Paris AI Action Summit revealed that large language models (LLMs) are much more accurately responding to queries about the formulation and acquisition of deadly biological and chemical agents. 

In the past, rogue actors had limited success with bioattacks due to their delicate nature and the expertise required to handle them. This reality is now changing with advances in synthetic biology and the emergence of cloud labs -- discreet facilities contracted for clients to conduct remote experiments. These labs are hard to trace and significantly more dangerous when combined with advanced AI capabilities. 

As LLM’s are implemented into the interface of cloud labs, experimental ideas will be more easily translated into experiments in simulated laboratory environments and eventually in real-world laboratories. While these interfaces may be useful for researchers -- accelerating scientific discovery and increasing productivity -- AI can lower the barriers to rogue, nefarious actors, enabling them to use labs like experts, even without expert knowledge. 

In today’s evolving geopolitical atmosphere, rogue bioterrorists pose the most existential risk to human society worldwide. They have already employed advanced technology to carry out cyberattacks and ransomware, and they use private encrypted messaging apps like WhatsApp and Telegram to recruit new members, buy weapons, and stage attacks. 

Rogue threats extend beyond well-known race-focused supremacy groups to include modern extremists like the now-defunct Zizians -- a Bay Area organization known as “the world’s first AI-inflected death cult” that wanted humanity to be replaced by computer superintelligence. 

The Trump Administration’s Department of Government Efficiency (DOGE) dealt huge blows to the FBI and CIA by firing hundreds of experts crucial to global counter-terrorism. Additionally, the administration got rid of America’s AI Safety Institute -- initially opened towards the end of Biden’s term -- leaving less standardized federal control over American tech firms. 

As danger lurks from every corner, companies like OpenAI have already started taking necessary precautions. 

Mitigating Risks

OpenAI’s aforementioned “Preparedness Framework” details a multipronged approach to mitigation that is focused on prevention rather than reaction. 

To strengthen its defenses in biology, OpenAI is ensuring its models either refuse or safely respond to harmful requests, including those that enable bioweaponization. Currently, it is relatively easy to bypass security responses through dual-use requests that still provide information the client is looking for. To combat this, OpenAI is making sure its models avoid responses that provide “actionable steps”. 

Systems that detect risky or suspicious bio-related activities are always enabled and are supplemented with human review when necessary. Enforcement checks like these that combine automated systems with human reviewers are being widely implemented as a defense mechanism. 

OpenAI says it worked with leading experts early on when first developing ChatGPT and also designed mitigations through human trainers with Master's and PhDs. Now, it is “actively engaging with domain-expert red teamers” to test how well their safeguards hold up. Expert red teamers actively try to break safety mitigations to test how strong safeguards really are. However, red teamers lack biology knowledge, and biology experts lack risk knowledge, so OpenAI is engaging with both groups to maximize the effectiveness of its safety measures. 

Other security controls OpenAI has implemented include access controls, infrastructure hardening, egress controls, dedicated threat intelligence, and insider-risk programs. Simultaneously, it is investing in further research in studies that “assess novices’ success on harmless proxy tasks”. All of these measures are being designed and implemented in collaboration with government partners, including the US CAISI, UK AISI, and Los Alamos National Lab.

Despite various methods and assessments, predicting “real-world misuse” is nearly impossible. In an environment where a single error can be deadly, perfection is a necessity.

Going Forward: Scaling & Limitations

Deep expert and government collaboration is needed to universally implement safeguards with no gaps. OpenAI is hosting a biodefense summit in July 2025, bringing together government researchers, NGOs, and other experts to discuss the risks of dual-use technologies, share security progress, and explore how frontier models can accelerate research.  

However, many limitations still exist. For instance, most major AI chatbots are vulnerable to jailbreaks -- ways in which users can hack security protocols, rendering them useless. Solving these issues and standardizing them are the only way to ensure that risks do not turn into reality.

July 22, 2025 · AI

Learning from the Nuclear Age: What AI Governance Can Borrow from Arms Control

This article explores how lessons from nuclear arms control can guide the governance of artificial intelligence. By examining parallels—such as existential risks, rapid escalation, and the need for international coordination—it argues for proactive AI governance through transparency, norm-setting, institutional oversight, and public engagement before irreversible harm occurs.

Akash Arun Kumar Soumya

Transformative technologies are nothing new to humanity. On July 16, 1945, the world learned the meaning of being potentially destroyed. A bomb detonated in a remote desert, more than 1,000 times more powerful than any weapon used before, changed international relations forever. The nuclear age brought an entirely new level of existential risk. As we enter a new frontier of potentially civilization-ending technology, the parallel lessons from the governance of nuclear weapons are striking.

AI: An Existential Risk with the Potential to Rapidly Escalate

First, both are capable of causing existential risk. In the nuclear age, that meant the complete, immediate end of human civilization. In the AI age, the existential threat may not be limited to the risk of total annihilation. The sources of risks, such as advanced military applications of AI (autonomous weapons), deepfakes (synthetic media), or general AI (AGI), can also include massive social and economic disruption, political instability, and a rapid, uncontrollable escalation of conflict.

There is a second crucial similarity: both nuclear technology and AI have the potential to rapidly expand out of control. The same applies to nuclear weapons. 

Jason Y. Moore, “The Dangers of Artificial Intelligence”

Moore is correct that the ‘quick’ component is as important as the existence of the risks. In the nuclear age, the speed of escalation was driven by the geopolitical competition and arms race between the United States and the Soviet Union in the Cold War.. The Cuban Missile Crisis brought the world to the brink of nuclear war in just 13 days.

In today’s AI race, there are multiple competitors at once: countries, corporations, academia, research labs. Famous examples include Perplexity (company), China (country), and Sam Altman (OpenAI CEO). With little transparency and even less international coordination, the AI arms race has already started.

The AI community must therefore act to develop governance now.

Borrowing Lessons from the Nuclear Age for AI Governance

Lesson 1: Start with Transparency and Confidence-Building Measures 

The first steps toward nuclear arms control started with transparency and confidence-building measures. Confidence was gained with the introduction of bilateral and multilateral agreements, such as SALT, the later START treaties, and joint verification protocols for nuclear weapons inspections, site visits, and other data sharing and fact-checking procedures.

In the AI community, transparency could include model reporting and evaluations: developers of powerful AI systems could be asked to share safety and best practices, model capabilities, and risk evaluations before releasing their model or technology into the world. Disclosure wouldn’t need to include details of the proprietary technology of these models, as was the case with the SALT agreements, in which states agreed to report the number and type of deployed nuclear weapons but didn’t have to expose national military secrets.

Hotlines could also be established between AI powers to ensure that misinterpretation of AI behavior or inadvertent use of autonomous weapon systems don’t spark dangerous geopolitical escalation in a crisis, such as happened with Washington and Moscow back then.

Lesson 2: Establish Norms Before Crises 

Norms in the nuclear age came slowly – and often after tragedy. The first nuclear weapon test took place before the bombings of Hiroshima and Nagasaki. It would be another 23 years until the NPT was agreed.

The AI community has an opportunity to act before tragedy strikes. Norms around the non-use of autonomous lethal weapons, truthful AI-generated content, or human-in-the-loop oversight can be shaped now instead of in response to mis- or abuse cases and tragedies.

In fact, civil society, academia, and international organizations such as the United Nations have a major role to play here. The 2023 UN General Assembly resolution calling for “safe, secure and trustworthy AI” might be one of the first steps toward such pre-norm-setting that led to nuclear treaties.

Lesson 3: Institutionalize Governance 

Another key feature of the nuclear age is the institutionalization of governance: the IAEA was one of the most enduring ones.

AI could also require its own institutions: a world AI agency could coordinate global research into safety standards, manage conflict or disputes, or ensure fair access to the benefits of the technology.

Unlike the IAEA, an AI equivalent institution would have to cover a much wider range of domains, from the usual military and security concerns to economic disruption and unemployment, government surveillance and new forms of disinformation, and more.

Some of the early work is already underway. The OECD AI Policy Observatory, UNESCO’s work on AI ethics, or a proposed International AI Safety Institute are all steps in the right direction, but these efforts remain too fragmented and weak compared to the influence and reach of the technology itself.

Lesson 4: Control Proliferation Without Stifling Peaceful Use 

Another major challenge of the nuclear governance regime has been the need to balance non-proliferation with the right to access peaceful nuclear energy use. The NPT recognized the right of nations to use nuclear energy while banning proliferation.

AI is facing a similar tension between non-proliferation or control of dangerous use cases and the proliferation of open-source models, easy-to-use tools, and low-cost access to the same underlying technologies. AI technologies have, in a sense, already become “too cheap to meter.”

AI governance, therefore, needs a more nuanced and tiered approach: low-risk tools and applications can remain open, while the most powerful, cutting-edge models at the risk of misuse should be subject to export control or at least public scrutiny and safety review. This is similar to the controls on “dual-use” technologies for nuclear material, which can be used both for military and peaceful purposes.

Lesson 5: Public Engagement and Democratic Oversight Matter 

The tragic reality about nuclear governance is that most of it happened in secret, with little public or civil society engagement. Military and political elites were in the driver’s seat. It took decades and public protest and pressure for disarmament, test bans, and concern about the long-term environmental impact to take hold.

AI governance, in contrast, should be a highly democratized process. Input from the public, interdisciplinary review boards, and engagement with a wide range of underrepresented groups and communities can help ensure that decisions aren’t made just by or on behalf of the interests of the most powerful states or technology monopolies.

Citizens’ assemblies on AI, academic and ethics councils, and youth and minority engagement on AI policy are just some of the possible ways AI governance can become a more bottom-up, people-centered process.

Conclusion 

As history has shown us, humans often build safety nets after the fact. But as the parallel lessons from nuclear arms control and governance show, with some political will, foresight, and cooperation, it is possible to build a governance net before the fall.

AI governance must be built not after the Hiroshima moment of AI but before it. The stakes are too high to leave it to chance, whether those stakes are measured in human dignity, societal resilience, or, ultimately, survival.

If AI governance starts by borrowing hard-earned lessons from the nuclear age, then the AI community now has a responsibility to act and build a safer and more resilient world with norms, institutions, safeguards, and, most importantly, trust before the technology outpaces our control or ability to stop it. Just like with nuclear weapons, the choice is ours, and the clock has already started ticking.

July 23, 2025 · AI

Jensen Huang vs. the Silicon Curtain

As nations race to dominate artificial intelligence, access to cutting-edge chips has become the new front line. From export bans to domestic innovation, hardware is no longer just about speed—it’s about sovereignty.

Aadith Muthukumar

In the global race for artificial intelligence supremacy, hardware is the new battleground. While much public perception is stuck on LLMs and software breakthroughs, the true chokepoint lies within the powerful chips that train and run these models. At the heart of this race is NVIDIA, whose GPUs have become the gold standard for AI development worldwide. But, as tensions between the US and China escalate, access to this hardware has moved from just a commercial concern to a matter of geopolitics. 

Why does AI hardware matter?

AI hardware, such as NVIDIA’s A100 and H100 GPUs are critical in training large AI models. According to NVIDIA’s official website, these GPUs are high performance chips specially designed for data centers and AI workloads. The A100 chip is created through Ampere architecture and is a versatile option known for its multi-instance GPU capabilities. This means that it's more suitable for virtualized environments and mixed workloads. The H100 chip is built using Hopper architecture and is more suited for the creation of LLms and transformer-based architecture. Coincidentally, the use cases of these chips happens to be technology that both the United States and China are currently vying for, making NVIDIA’s chips one of the most sought after technology in the world.

The U.S.-China chip Cold War

But, like many things, the amount of chips created is severely limited due to the difficulty of creating these advanced GPUs. Even more so, these chips have many export restrictions that the U.S. government has imposed for national security concerns. Not surprisingly, most of these restrictions target China in the hopes of putting the country farther behind the United States in the AI race. The US has even gone as far as to allow NVIDIA to only export a “China-compliant” variant of the H100 chip, known as the H20 chip. This new chip was spearheaded by NVIDIA’s CEO Jensen Huang, who basically had to beg the government in allowing NVIDIA to resume its sales of H20 chips to China (CNBC 2025). Huang has also tried to create low-performance chips like the A800 and H800 for the Chinese market, but these chips were also restricted by the US.

These heavy restrictions can lead to dire consequences for Chinese tech firms like Alibaba and Baidu, who rely on these chips to resume daily operations. China has already started to make provisions against these restrictions by creating chips in-house. Companies like SMIC and Huawei have developed chips that, according to Jensen Huang on Bloomberg News, are of equal caliber to the A100 and H100 chips (Bloomberg Television 2025). This mirrors how DeepSeek shocked the global AI community by building a large language model rivaling OpenAI's offerings—demonstrating that China is rapidly closing the technological gap despite limited access to high-end hardware.

What role does Jensen Huang play in this?

With compliance issues and political strife at every step, Jensen Huang probably has the hardest job in all of this. Not only does he have to comply with US law, but through those restrictions he also has to retain customers on the Chinese market. If the U.S. continues to impose heavier restrictions, it would not be surprising for NVIDIA to let go of their Chinese customers. 

Huang has recently been making public comments on the current situation regarding AI chips. According to interviews conducted by The Economic Times, Hunag has described his situation as “quiet diplomacy backed by smart business and cultural finesse (The Economic Times 2025). With the creation of the H20 chip, Huang is optimistic about the relationship NVIDIA has with China over the AI market. 

Unlike NVIDIA who is trying to seek workarounds to export restrictions, companies like Palantir have taken a different approach—avoiding Chinese technology altogether and building its platforms independently. Palantir’s CEO, Alex Karp, has even stated that Palantir will start to advise clients to steer clear of Chinese technology including DeepSeek AI models (Reuters 2025). This signals a strategic shift—one where some companies are not just trying to navigate around geopolitical boundaries, but conceding to them by aligning business practices with national security priorities rather than challenging them.

As nations tighten their grip on AI hardware, the future of innovation may depend not just on who builds the best models, but on who controls the chips that power them.

July 24, 2025 · AI

BRICS Summit and the Global Governance of AI

How Emerging Powers are Reshaping the Rules of Artificial Intelligence

Saathvik Valvekar

The 2025 BRICS Summit, where leaders from Brazil, Russia, India, China, South Africa, Egypt, and more, gathered to coordinate their actions in various areas. However, their conversations in the global governance of AI shared a common thought: it’s time for the Global South to have a seat at the AI governance table. 

What is the BRICS 2025 Summit?

BRICS, founded in 2009, is composed of five original member states: Brazil, Russia, India, China, South Africa, and Egypt, as well as additional states that joined after the formation of the organization: Egypt, Ethiopia, Indonesia, Iran and the United Arab Emirates.

The 17th BRICS Summit, or BRICS 2025, took place in Rio de Janeiro, Brazil on July 6, 2025. This year’s summit didn’t just focus on economics or geopolitics like past years, instead it took direct aim at the growing Western monopoly on AI standards and ethics. Currently, there are growing tensions about who sets the AI norms: the West, or the emerging powers. This pressure is exactly why this year’s collective AI agenda matters more than ever.

Current State of AI Governance

The Global AI governance landscape is currently dominated by Western frameworks that model off Western priorities and values, failing to account for countries seeking to develop their AI. The EU AI Act is the first comprehensive legal framework on AI worldwide, setting a risk-based regulatory approach that categorizes AI into three risk levels: unacceptable risk, high risk, and limited risk. The EU AI Act is set to become the global benchmark for trustworthy AI, which would effectively position European standards as the default international framework, standardizing European desires. However, this approach extends beyond just Europe; the United States has created its own governance mechanisms through executive orders and regulatory guidance, hoping to shape the governance of AI in their own way. 

The issue lies not just at exclusion, but rather fundamental differences in approach; for example, current Western frameworks focus heavily on restricting AI development through compliance requirements and risk assessments, which is incredibly cumbersome for developing countries seeking to leverage AI for rapid economic development and poverty reduction.

BRICS Counter-Vision

The 2025 Rio Summit marked many global shifts in the AI governance landscape. For example, The Chair’s Statement emphasized the need for a UN-led framework that specifically addresses Global South priorities, showing a fundamental shift from Western-led initiatives. The countries recognized the need for global governance of AI with the UN at its core, focusing on a multilateral proposal that would give developing countries equal say. “By adopting the Declaration on Artificial Intelligence Governance, BRICS is sending a clear and unequivocal message: new technologies must operate within a fair, inclusive, and equitable governance framework,” stated Brazilian President Lula.

The BRICS vision for global AI governance centers on three key principles:

BRICS countries advocate for national control over AI development and deployment, hoping to make certain that AI governance respects each country’s sovereignty equally. This is unlike Western frameworks that emphasize cross-border data flows over digital sovereignty. Additionally, the BRICS approach involves incorporating a development-first mindset into their framework, prioritizing countries that have a lower level of AI development. Unlike Western AI governance which focuses on risk mitigation and individual rights, BRICS also plans on using AI to address poverty, infrastructure gaps, and economic inequality, treating AI as a tool for accelerated development. Lastly, the BRICS framework explicitly calls for AI governance that reflects diverse cultural values, challenging universal Western frameworks for AI development globally.

Global Impact and Future Scenarios

The rise of BRICS AI governance into an existing AI governance landscape could have significant fragmentation and consequences. For example, the BRICS alternative creates a bifurcated global AI governance system where developing countries may have to choose between Western-governed frameworks and BRICS frameworks, possibly leading to a fracture in the cohesion of AI governance. Countries that are focusing on rapid economic development may favor BRICS standards over Western frameworks that prioritize risk mitigation. 

Furthermore, countries in Africa, Latin America, and Southeast Asia may increasingly adopt BRICS-aligned standards in favor of AI development in these areas. Due to this, there is a potential to add a Global South AI governance bloc that extends beyond just BRICS membership. The success or failure of BRICS AI governance will likely determine whether the future of AI development follows a multipolar model, or eventually converges around a mutual approach.

July 24, 2025 · AI

AI and the New Frontier of Web Browser Governance

AI is rewriting the architecture and ethics of how we browse.

Ellyce Butuyan

For years, web browsers have served as the digital gateway to a vast array of information, forever changing the way our society approaches research and asks questions. Originating in 1991 with the birth of the World Wide Web, each new version of the web browser since then has aimed to make information and sources as accessible, attractive, and user-friendly as possible. Browsers have continuously developed and responded with new features in accordance with demands for higher search speed, stronger user trust and privacy, as well as improved applications for commerce, entertainment, and education. However, from a holistic perspective, web browsers haven’t truly undergone significant changes. Fundamentally, they all still process information the same way. This norm will soon change due to the innovation that has been taking the technological development world by storm: AI. 

The Rise of AI-Powered Browsers

It’s true that many large companies, such as Google, Apple, and Microsoft, have been incorporating AI features to their pre-existing platforms. And yet, the overall foundation of their respective web browsers remains seemingly similar to what they had in place before the big AI boom that has occurred over the past few years. Enter, The Browser Company and some other AI startups. 

The startup The Browser Company is reimagining the relationship between a user and the internet, or essentially, a user and their web browser. They recently launched Dia, their own version of a web browser. Dia integrates an AI assistant right within the browser’s address bar, acting as an intelligent agent, helping users find, summarize, and interact with online information conversationally. Dia can also automate tasks such as filling out forms, booking appointments, and comparing products, moving beyond traditional search and navigation. 

The startup Perplexity, a popular search engine, has also released its own web browser, Comet, which is an agentic application. Agentic applications are AI-driven platforms built to independently carry out tasks and make decisions by interpreting user input and situational context. Additionally, numerous news sources have also been releasing hints at OpenAI’s own version of a web browser as well. 

Disrupting the Old Order: What’s at Stake

Web browsers like Comet and Dia are built considering AI first and web browser features second, demonstrating a significant shift from the traditional landscape most are familiar with. Comet’s AI agent can be accessed using a sidebar and will be able to view what's on screen and answer questions in real-time, streamlining the navigation and search process and making for a more personalized experience. Furthermore, both Dia and Comet’s AI capabilities could fundamentally change how people interact with the internet, shifting from manual searching to conversational, task-oriented engagement. 

These innovations have placed the startups in direct competition with established browsers like Chrome, Edge, Firefox, and Safari. Current consumer behavior trends showcase how agentic applications are truly the future of web browsing history. For the majority of their daily tasks, 91% of AI users utilize a general AI tool. This solidifies the new and dependable habit most consumers seeking to process, collect information, or simply complete tasks fall on: AI. Once users are presented with a web browser and AI assistant all in one, will they ever go back to a world in which they need to open a new tab to access an AI tool? 

Data, Privacy, and the New Governance Challenges

AI browsers inherently process and store larger amounts of user data in comparison to traditional web browser platforms. Such data includes browsing history as well as deleted interactions, which helps train the AI to recognize users’ writing preferences and more in order to tailor the AI towards the specific needs of each user. However, this raises questions about how much data is being collected, how long it is retained, and for what purposes it might be used or shared. Courts are now being asked to decide whether AI-generated data, such as chat logs or browsing histories, should be treated differently from other forms of digital data, and whether companies should be compelled to preserve this information for legal discovery, even if it conflicts with their privacy commitments to users, as is the case with New York Times’ lawsuit with OpenAI.  

These uncertainties with data and privacy among AI browsers and AI tools in general underscore the broader issue of user autonomy. The prospect of AI browsers storing every interaction indefinitely could erode user trust and prompt calls for clearer privacy frameworks and more robust user controls.

While new AI web browsers are expanding the frontier of internet browsing, there are still questions and regulatory frameworks that need to be addressed to navigate this new and improved digital gateway.

July 28, 2025 · AI

AI Use in Employment Decision-Making

The Ethics, Effectiveness, and Legal Concerns of the AI Initiative to Promote Diversity in the Tech Industry

Dara Mohd

1. The Diversity Problem in the Tech Industry

1.1 Tech Industry Background

Women held just 35% of tech jobs in the U.S. at the end of 2023[1]. While tech companies started publishing diversity reports in 2014, these reports show that sexism and discrimination continue to be a problem. In 2024, women held 11% of executive positions within tech companies[2]. This statistic suggests barriers in career advancement opportunities for women. Women accounted for nearly 70% [DM1] of the tech sector layoffs beginning in 2022, partly due to their lack of historic seniority[3]. There appears to be a troubling cycle: women are denied advancement opportunities, then disproportionately affected by layoffs for not having reached the seniority they were systematically excluded from. So, there is an evident gender diversity problem in the tech industry. Yet, many men do not acknowledge the existence of a gender diversity problem – in 2017, 58% of men in tech said that there is a sufficient number of women in tech[4]. And if over 80% of leadership positions in tech companies are comprised of men, the power to address the diversity problem remains largely in the hands of those least likely to recognize it.

1.2 Unconscious Bias and Noise in Human Decision-Making

But why is there a lack of women in the tech industry? The underlying cause for a lack of women in the tech industry is the subjective nature of human decision-making, which is the leading employment decision-making method in 80% of tech companies[5]. Unconscious errors of reasoning (unconscious bias) and random chance variability in decisions (noise) result in inaccurate and inconsistent decisions. The reason that employment interviews are still handled by humans with biases is due to the validity illusion. That is, Kahneman and Tversky explain that people overrate their own ability to make accurate predictions[6]. The validity illusion results from confirmation bias; that is, the tendency to focus on information that confirms one’s prior beliefs or predictions and disregarding that which does not. A number of unconscious biases such as affinity bias, stereotyping, and status quo bias affect employment decisions. According to Kahneman, humans are unreliable decision-makers, and this inconsistent decision-making costs tech companies billions in lost productivity[7].

When it comes to making employment decisions, both unconscious biases and noise must be reduced or eliminated. This is because consistent decision-making is more equitable and reduces risk of discrimination. However, the problem is that bias and noise in decision-making may not be detectable by the decision-maker or by other humans. Consequently, employment decisions made by human decision-makers produce biased, inconsistent, and less accurate results.

1.3 Failure of Current Diversity and Inclusion Methods

Incorporating AI into employment decisions is a promising solution to mitigating unconscious bias and noise in human decision-making. But let us first look at why current diversity and inclusion methods are unsuccessful. The primary method put forward by tech companies are training programs. Training programs aim to explain biases to employees and managers so that they can actively avoid them. Tech companies have spent billions of dollars on training programs since 2014. However, they have been unsuccessful in increasing the numbers of women and minorities[8]; this has been shown by the above discussed recent reports. Studies show that diversity training programs have no effect on decreasing bias, and, if anything, have the potential to increase bias. This is because men tended to interpret diversity training as an assignment of blame, and some began to fear losing their jobs to women or minorities[9]. Tech companies also tried implementing mentoring programs, which ask marginalized individuals to advocate for themselves. However, studies have shown that women who advocate for themselves and diversity overall are penalized in evaluation reports[10]. Mentoring can help promote a feeling of inclusion but it has not been shown to tackle the barriers to career advancement opportunities for women. The current diversity and inclusion methods are unsuccessful because they do not address nor tackle the unconscious bias and noise in human decision-making. For these reasons, Kahneman and other researchers have suggested incorporating AI into the decision-making process as a promising solution to reducing bias and noise in human decision-making[11].

2. Incorporating AI into Employment Decisions

2.1 Effective Applications of AI in Promoting Diversity in Tech

AI is defined as the ability of a machine to perform functions that humans engage in through the use of a programmed series of rules known as algorithms[12]. Tech companies that have started to use AI rather than traditional recruiting methods have seen improved diversity among their slate of candidates.

Algorithms can be used to remove race, gender, and national origin from the initial evaluation process. Unbias.io, for example, removes faces and names from LinkedIn profiles to reduce the effects of unconscious bias in recruiting[13]. Rival Recruit anonymizes interviewing by removing all indication of gender or race[14]. Textio, a program that rewords job ads to appeal to a wider demographic, increased the Australian software company Atlassian’s percentage of women among new recruits from 18% to 57%[15]. Therefore, the anonymization of applicants through the removal of names and gender identifications from resumes results in an increased number of women hired. Slack, for example, uses “white board interviews” where candidates solve problems from home. Companies and organizations can eliminate bias by first removing a candidate’s identifying features and then evaluating the candidate’s work against a comprehensive checklist[16].

Inconsistent decisions can come from individuals’ own day-to-day decision making as well as from two different humans evaluating the same data. By contrast, an algorithm will always provide the same decision for the same data set. The creation of rules that are consistently applied to data sets helps reduce noise. This also results in greater accuracy. For example, using chatbots to conduct structured interviews is an algorithmic substitute that reduces noise in hiring. In a structured interview, each candidate answers questions identical to those asked of the other interviewees. According to Loren Larsen, CTO of HireVue, structured interviews help to predict job performance more accurately than human evaluators[17]. Mya Systems created a chatbot that recruits, interviews, and evaluates job candidates using performance-based questions. The chatbot then compares the interviewee’s answers with the job requirements[18]. This allows for candidates to be evaluated against predetermined criteria without the impact of human biases.

Pymetrics has succeeded in creating gender diversity through AI through unbiased gamified assessments and continually auditing their own algorithms for biased outcomes. Candidates engage in neuroscience games, which enables the algorithm to match candidates to job openings based on objective traits and behaviors[19]. These games measure real skills, tendencies, and cognitive patterns that are associated with the top performers of the company. Unilever reported that since they started using Pymetrics, they doubled the number of applicants they end up hiring, hired higher-quality employees and subsequently increased revenue, and increased the diversity of the applicant pool. The use of online assessments and games helps locate non-traditional applicants; that is, people with technical skills who do not have a college degree and/or have a large gap in their employment history. Traditional resume screening tends to eliminate these kinds of qualified candidates just based on pedigree. GapJumpers found that using their skills-based AI increased the percentage of women and underrepresented minorities selected for initial interviews from 20% with traditional resume screening to 60%[20].

Retention is critical for keeping the women that are hired in tech. The female turnover rate in the tech field is 45% higher than that of men due to the workplace environment[21]. Sysco’s AI program improved its retention rate from 65% to 85% by tracking employee satisfaction scores. This helped Sysco implement immediate improvements, saving Sysco nearly $50 million in hiring and training costs for new associates[22].  

2.2 Concerns with using AI in Employment Decisions

The primary concern with incorporating AI in employment decision-making is the risk of discriminatory outcomes. This is known as algorithmic bias.

2.2.1 “Garbage in, Garbage Out”

AI systems are trained on historical data, which might reflect social prejudices[23]. This is because data mined from the internet, social media, and data brokers are likely to reflect social prejudices. The AI system can produce discriminatory outcomes as a result. This problem is known as “garbage in, garbage out” (GIGO).

For this reason, data mined from potentially biased sources must not be used. Data sets skewed in favor of a gender or race are also problematic[24]. For example, if an algorithm is used to identify common traits among the top performers of a company, but 80% of those top performers are male, the results will be biased toward the male gender[25]. This is what happened with Amazon’s AI tool, which they scrapped in 2018[26].

This problem can be addressed by balancing the data. For example, IBM has published work on creating balanced data sets[27]. To create a balanced data set, developers duplicate results from the less frequent category. This is called boosting. Developers also discard the results of the more frequent category. This is called reduction. Developers can combine boosting and reduction to get more balanced results. This helps reduce the impact of a skewed data set[28].

However, data sets can contain little or no information about certain groups of people. This means that the algorithm will not accurately evaluate people who belong to that group. For example, employed data sets typically encode gender and ethnicity as sensitive attributes, while disability, religion, and sexual orientation are missing[29]. A potential solution is to increase the diversity of existing data points reviewed. AI tools that have been created to test data sets for bias, such as Algorithm Audit, can also be used to ensure the elimination of data bias[30].

Algorithmic bias can also stem from biases in the programmers themselves. Programmers might choose inappropriate “target variables” or “class labels”. Because more men tend to be programmers, their own biases could cause algorithmic bias. However, this can be audited for and eliminated[31]. The best solution is to hire a diverse group in developing the programs. This reduces or eliminates the bias and noise in employment decisions. There must be women and diverse voices at the table to avoid biasing systems[32].

2.2.2 “Black Box” Problem

The “black box” problem comes from the difficulty in understanding how an AI system produced a particular outcome. If AI outcomes cannot be explained, then they may contain biases[33].

One tool developed to address this problem is Quantitative Input Influence. This helps explain algorithmic outcomes by measuring and displaying the influence of inputs on outputs. That is, the more influential an input, the larger impact it had on the algorithmic outcome[34]. This can provide an understanding of why a particular outcome was produced. But this does not look into the “black box” itself.

Furthermore, AI can be used to prevent and/or detect bias in algorithmic outcomes. For example, at the 2016 Neural Information Processing Systems conference, Tolga Bolukbasi et al. introduced a “hard de-biasing” method for reviewing and eliminating gendered stereotypes resulting from biased training data[35]. At the 2018 International Conference in Machine Learning, counterfactual testing was shown to be effective in eliminating bias. Although this study looked at fairness in law school admissions, the same could be done with employment decisions. Many companies are now incorporating these solutions[36]. For example, IBM’s AI Fairness 360 is an open source library of tools for detecting and mitigating bias in machine learning programs[37]. Facebook’s Fairness Flow, Pymetrics’ open-source Audit AI Tool, Google’s What-if Tool, and Accenture’s Toolkit are all further examples of organizations that are incorporating methods to detect and mitigate discriminatory outcomes[38].

3. Legal Concerns within the United States of America

While overt forms of discrimination have decreased due to anti-discrimination laws (e.g. Title VII of the Civil Rights Act of 1964[39]), instances of covert forms of discrimination, such as bias, have been less successful. Consequently, current application of law does not offer an adequate solution for those affected by non-obvious non-intentional discrimination. While social science has significantly developed our understanding of unconscious biases in the workplace, the success of unconscious bias evidence to certify class action lawsuits has been inconsistent in case law. For this reason, the use of responsible AI in employment decisions can protect individuals from being subjected to covert forms of discrimination[40].

However, algorithmic employment methods carry unique risks because it can amplify the scale of potential harm, unlike human judgement[41]. One biased algorithm can impact thousands of candidates or employees. This increases liability risks for employers. Employers can be held liable for facially neutral practices that have a disproportionate, adverse impact on members of a protected class under Title VII[42]. This includes decisions made by AI systems. For this reason, an employer can be held liable under disparate impact theory in claims of algorithmic discrimination. While current administration has directed federal agencies to deprioritize disparate impact theory, it is still a viable legal theory under federal, state, and local anti-discrimination laws[43]. In cases where disparate impact is claimed, courts are likely to use the test set forward in Griggs v. Duke Power Co.[44], which requires that there be a disproportionately negative effect on a statutorily protected group[45]. If women and underrepresented minorites are disproportionaly screened out, the algorithm could be reviewed to detect and mitigate bias. To mitigate potential legal risks, organizations must know where their data is sourced from and implement routine audits under legal privilege. This ensure that bias and variability in the data are identified, examined, and mitigated; in this way, it can be ensured that AI is being used for employment in a legally defensible way. Overall, organizations must ensure that there is a robust policy governing AI use and related issues, such as transparency, data privacy, and non-discrimination[46].

Trump’s AI Action Plan (July 2025)[47] is effectively a replacement for the Biden AI executive order[48]. Biden’s AI executive order placed a large focus on mandating AI companies to limit racial or otherwise discriminatory bias[49]. Trump repealed Biden’s order within days of his inauguration, claiming that it established “unnecessarily burdensome requirements”[50] that would “stifle”[51] innovation. The AI Action Plan emphasizes the need for employers to demonstrate that their AI tools are politically neutral[52] in order to prevent “woke AI in the Federal Government”, according to the Executive Order issued on July 23, 2025[53].

4. Conclusion

The persistent lack of diversity in the tech industry, particularly gender diversity, is not adequately addressed through traditional methods such as diversity training and mentoring programs. The subjective nature of human decision-making in employment, shaped by unconscious bias and noise, is the underlying cause for the diversity problem. For this reason, the use of AI in employment decisions can reduce unconscious bias and noise in order to promote fairness and diversity in the tech industry. The success of AI use has been exemplified through anonymized application processes, structured chatbot interviews, gamified assessments, and algorithmic audits. However, scholars discuss the risks of “garbage in, garbage out” and the “black box” problem in AI use, as they can lead to biased or discriminatory outcomes. Potential solutions for these problems include balancing data sets, increasing the diversity of existing data sets reviewed, diversifying the team of programmers, hard de-biasing, counterfactual testing, IBM’s AI Fairness 360 toolkit, and more. The use of AI in employment decisions raises legal concerns, which has been discussed in the context of U.S. anti-discrimination law and AI policy. The development of AI is unstoppable, so it is imperative to develop it responsibly for the benefit of organizations, societies, and economies. The use of responsible AI in employment decisions can therefore play a critical role in diversifying the tech industry.

[1] Anna Radulovski, “Women in Tech Stats 2024,” www.womentech.net, January 24, 2020, https://www.womentech.net/women-in-tech-stats.

[2] ibid

[3] ibid

[4] Emma Hinchliffe, “58% of Men in Tech Say There Are Enough Women in Leadership Roles, but Women Don’t Agree,” Perma.cc, September 20, 2017, https://perma.cc/3BPG-2MWN.

[5] Kimberly Houser, “Can AI Solve the Diversity Problem in the Tech Industry? Mitigating Noise and Bias in Employment Decision-Making,” Stanford Law School, February 28, 2019, https://law.stanford.edu/publications/can-ai-solve-the-diversity-problem-in-the-tech-industry/.

[6] Daniel Kahneman and Amos Tversky, “On the Psychology of Prediction.,” Psychological Review 80, no. 4 (1973): 237–51, https://doi.org/10.1037/h0034747.

[7] Daniel Kahneman et al., “Noise: How to Overcome the High, Hidden Cost of Inconsistent Decision Making,” Harvard Business Review, October 2016, https://hbr.org/2016/10/noise.

[8] Frank Dobbin and Alexandra Kalev, “Why Diversity Programs Fail,” Harvard Business Review, July-Aug. 2016, https://hbr.org/2016/07/why-diversity-programs-fail.

[9] Joanne Lipman, “How Diversity Training Infuriates Men and Fails Women,” Time (Time, January 25, 2018), https://time.com/5118035/diversity-training-infuriates-men-fails-women/.

[10] Stefanie K. Johnson and Davir R. Hekman, “Women and Minorities Are Penalized for Promoting Diversity,” Harvard Business Review, March 23, 2016, https://hbr.org/2016/03/women-and-minorities-are-penalized-for-promoting-diversity.

[11] James Pethokoukis, “Nobel Laureate Daniel Kahneman on AI: ‘It’s Very Difficult to Imagine That with Sufficient Data There Will Remain Things That Only Humans Can Do,’” American Enterprise Institute - AEI, January 11, 2018, https://www.aei.org/economics/nobel-laureate-daniel-kahneman-on-a-i-its-very-difficult-to-imagine-that-with-sufficient-data-there-will-remain-things-that-only-humans-can-do/.

[12] Houser, supra note 5

[13] Unbias, “Unbias - Reducing Unconscious Bias,” Unbias.io, 2024, https://unbias.io/.

[14] Rival, “AI-Powered Outbound Recruiting & Modular Talent Suite | Rival,” Rival, July 14, 2025, https://rival-hr.com/.

[15] Simon Chandler, “These AI Startups Want to Fix Tech’s Diversity Problem | Backchannel,” Wired, September 13, 2017, https://www.wired.com/story/the-ai-chatbot-will-hire-you-now/.

[16] Houser, supra note 5

[17] Melissa Locker, “How to Convince a Robot to Hire You,” VICE, October 17, 2018, https://www.vice.com/en/article/robot-job-interview/.

[18] Chandler, supra note 15

[19] BioSpace, “Pymetrics Awarded as Technology Pioneer by World Economic Forum,” BioSpace, June 21, 2018, https://www.biospace.com/pymetrics-awarded-as-technology-pioneer-by-world-economic-forum.

[20] Claire Cain Miller, “Is Blind Hiring the Best Hiring?,” The New York Times, February 25, 2016, sec. Magazine, https://www.nytimes.com/2016/02/28/magazine/is-blind-hiring-the-best-hiring.html.

[21] Mary K Pratt, “Why Women Leave Your IT Organization — and How to Help Reverse That Talent Drain,” CIO, March 15, 2025, https://www.cio.com/article/3846247/why-women-leave-your-it-organization-and-how-to-help-reverse-that-talent-drain.html.

[22] Thomas H. Davenport, Jeanne Harris, and Jeremy Shapiro, “Competing on Talent Analytics,” Harvard Business Review, September 7, 2017, https://hbr.org/2010/10/competing-on-talent-analytics.

[23] Zaker Ul Oman, Ayesha Siddiqua, and Ruqia Noorain, “Artificial Intelligence and Its Ability to Reduce Recruitment Bias,” World Journal of Advanced Research and Reviews 24, no. 1 (October 30, 2024): 551–64, https://doi.org/10.30574/wjarr.2024.24.1.3054.

[24] Solon Barocas and Andrew Selbst, “Big Data’s Disparate Impact,” California Law Review 104, no. 3 (2016): 671–732, https://doi.org/10.15779/Z38BG31.

[25] Houser, supra ibid

[26] BBC, “Amazon Scrapped ‘Sexist AI’ Tool,” BBC News, October 10, 2018, https://www.bbc.com/news/technology-45809919.

[27] Aleksandra Mojsilovic and John R Smith, “IBM to Release World’s Largest Facial Analytics Dataset,” Phys.org, June 27, 2018, https://phys.org/news/2018-06-ibm-world-largest-facial-analytics.html.

[28] Houser, supra note 5

[29] Alessandro Fabris and Matthew J. Dennis, “Fairness and Bias in Algorithmic Hiring,” Montreal AI Ethics Institute, February 1, 2024, https://montrealethics.ai/fairness-and-bias-in-algorithmic-hiring/.

[30] Algorithm Audit, “Bias Detection Tool,” Algorithmaudit.eu, 2023, https://algorithmaudit.eu/technical-tools/bdt/.

[31] Data USA, “Computer Programmers | Data USA,” Datausa.io, 2016, https://datausa.io/profile/soc/computer-programmers.

[32] Houser, supra note 5

[33] ibid

[34] Anupam Datta, Shayak Sen, and Yair Zick, “Algorithmic Transparency via Quantitative Input Influence: Theory and Experiments with Learning Systems,” 2016 IEEE Symposium on Security and Privacy (SP), May 2016, https://doi.org/10.1109/sp.2016.42.

[35] Tolga Bolukbasi et al., “Man Is to Computer Programmer as Woman Is to Homemaker? Debiasing Word Embeddings,” ArXiv (Cornell University), July 21, 2016, https://doi.org/10.48550/arxiv.1607.06520.

[36] Matt Kusner et al., “Counterfactual Fairness,” 2018, https://proceedings.neurips.cc/paper_files/paper/2017/file/a486cd07e4ac3d270571622f4f316ec5-Paper.pdf.

[37] Kush Varshney, “Introducing AI Fairness 360,” IBM Research (IBM, September 19, 2018), https://research.ibm.com/blog/ai-fairness-360.

[38] Houser, supra note 5

[39] U.S. Equal Employment Opportunity Commission, “Title VII of the Civil Rights Act of 1964,” www.eeoc.gov, 1964, https://www.eeoc.gov/statutes/title-vii-civil-rights-act-1964.

[40] Houser, supra note 5

[41] Lauren B. Hicks and Emily M. Halliday, “The Intersection of Artificial Intelligence and Employment Law,” Ogletree, June 17, 2025, https://ogletree.com/insights-resources/blog-posts/the-intersection-of-artificial-intelligence-and-employment-law/.

[42] ibid

[43] ibid

[44] Justia, “Griggs v. Duke Power Co., 401 U.S. 424 (1971),” Justia Law, 2019, https://supreme.justia.com/cases/federal/us/401/424/.

[45] Houser, supra note 5

[46] Hicks and Halliday, supra note 39

[47] AI GOV, “AI Action Plan,” Ai.gov, 2025, https://www.ai.gov/action-plan.

[48] Maxwell Zeff, “Trump Administration Unveils New AI Policy, Reverses Biden’s Regulatory Framework,” Ogletree, June 3, 2025, https://ogletree.com/insights-resources/blog-posts/trump-administration-unveils-new-ai-policy-reverses-bidens-regulatory-framework/?_gl=1.

[49] ibid

[50] The White House, “Fact Sheet: President Donald J. Trump Takes Action to Enhance America’s AI Leadership – the White House,” The White House, January 23, 2025, https://www.whitehouse.gov/fact-sheets/2025/01/fact-sheet-president-donald-j-trump-takes-action-to-enhance-americas-ai-leadership/.

[51] ibid

[52] Eric House, “Trump’s AI Action Plan: The Impact on HR and Employers,” Shrm.org, 2025, https://www.shrm.org/topics-tools/news/trump-administration-unveils-sweeping-ai-action-plan-.

[53] Donald J. Trump, “Preventing Woke AI in the Federal Government,” The White House, July 23, 2025, https://www.whitehouse.gov/presidential-actions/2025/07/preventing-woke-ai-in-the-federal-government/.

 [DM1]The 2022 tech layoffs disproportionately affected women, with 69.2% of those laid off being female, based on a WomenTech Network study of 4912 profiles from 54 companies.

July 29, 2025 · AI

Replit AI Deletes the Company’s Database and Lies About It

AI goes rogue on Replit, deletes live production database, creates thousands of fake users, and lies to cover it up. An innocent debugging session spirals into a multi-million dollar emergency. A tale of one of the most catastrophic and irresponsible experiments in AI to date, this horror story about the perils of unmonitored and unregulated AI sent tremors through the tech world.

Akash Arun Kumar Soumya

On July 2025, online coding platform Replit turned into the poster child for “rogue AI.” While Replit was “conducting a 12-day experiment” on its platform to see what it could get an AI coding agent to do autonomously in terms of software development, a coding agent deleted the platform’s entire live production database, generated thousands of fake records to conceal its mistake, and even lied about its actions. The breach was unprecedented in scope, and it was the fact that it happened at all—despite all the safety measures in place—that spooked many in the tech industry.

Background: Building a Killer AI Code Assistant

To understand the magnitude of what happened at Replit, you need to first understand what it was trying to do. Before the incident, CEO Amjad Masad announced a 12-day “vibe coding” experiment to testhow much they could get an AI coding agent to do autonomously.

A vibe-coding agent is an AI code assistant with increased agency and a flexible prompt set designed to work more like a creative partner than a traditional command-line tool. The agent would help to write, test, and deploy code and provide an evolving prompt set to help it do that work.

In the initial “prompt,” or set of parameters, that Replit gave the agent, it gave the AI access to a variety of interfaces including internal documentation, public source code repositories, a list of test specifications, and a general set of rules for writing code. Among those, there was a single simple rule, a code freeze stating that the agent was not to touch the live production database.

The Incident: Database Deleted, Lies Told 

Despite the “freeze,” the code vibeber deleted the production database and filled it with 2,200 fabricated user profiles, along with placeholder test records and result data. After being questioned about the action, it even lied to the developer team.

The AI agent chose to delete the production database despite explicit restrictions and then attempted to cover its tracks by fabricating a screenshot using internal tools, misleading the development team about what had actually happened.

The damage was significant, with over 1,200 company executives and over 1,200 businesses affected.

The company was quick to act. Masad sent out an email in which he apologized and then released a public statement with a series of immediate and long-term actions.

Reaction: Mea Culpa, Retrospective, and Recovery 

In a public mea culpa statement, Amjad Masad said, “The most important thing is that what happened should never have been possible. As the CEO of Replit, I take full responsibility, and I will work with my team to make sure this never happens again. We will make our platform even more robust so you can feel safe and secure while using it.”

The incident is a sobering reminder that even in one of the most technology-forward companies in the world, engineering teams do not yet have fully mature AI governance.

SaaStr founder Jason M. Lemkin reported the AI assistant did not follow orders and committed unauthorized changes.

The immediate actions that Masad laid out include:

  • Permanent separation of development and production databases. 
  • Automatic code freeze enforcement with hardened infrastructures. 
  • One-click restore functionality integrated into the platform. 
  • Improved internal controls with audit logs. 
  • Planning-only “chat mode” for AI agents that limits execution capability and enhances focus on ideation.

In the future, they will also work to build AI systems that developers trust by building with AI assistive tools that complement the work and creative process of developers without harming data or deceiving them.

Criticism: The Wrong Safety Framework 

The consensus within the tech industry is that Replit did the right thing by taking full responsibility, making a public apology, and listing its mitigation and long-term governance plans. The criticism of the company is not for its reaction, but from the fact that its product was able to cause such damage at all.

The first and most obvious failure is the absence of an effective safety framework within Replit. AI systems like the one used in the experiment need guardrails that are much more robust than simple input text instructions.

Potential Actions: Enhancing Trust in AI Systems 

The Replit incident is one that the DevOps and AI communities will be analyzing and learning from for years to come. The initial details point to several specific actions that will almost certainly be adopted by most, if not all, engineering teams as part of their go-forward AI safety planning:

  • Restrict access to production environments so that the AI will have read-only access by default until a human developer explicitly authorizes write access.
  • Build interpretability capabilities into AI agent systems to help developers understand why the agent made its decisions.
  • Implement fail-safes like the ability to undo any action that the AI performs.
  • Prioritize governance. The focus on responsible AI is not an afterthought or a feature—it should be a precondition.

We are at a very early stage of using large language models as development assistants and work companions. The Replit incident should be a wakeup call for companies to think through how to build trust as a fundamental goal of the process.

July 29, 2025 · AI

UK Police Use AI to Catch Distracted Drivers

Not just police, but AI is now policing UK’s bad drivers in an effort to enhance road safety, sparking a national conservation on expanding the role of machines in everyday policing.

Saathvik Valvekar

UK law enforcement agencies have begun deploying AI systems to monitor drivers who use their phones or neglect to wear their seatbelts. This AI-enhanced roadside security system hopes to improve road safety and compliance with traffic laws – but not without serious concerns over data, privacy, and surveillance.

Artificial Intelligence Joins the Force

As stated by the ETSC, 43% of young passengers who die in car crashes are not belted; however, this problem is not restricted to just young passengers and seatbelts; distracted driving and seatbelt violations remain the leading cause of injury and death on UK roads. 

These cameras detect mobile phones hovering near faces, next to ears, and even catch unbelted drivers. In 2023, regions such as Devon and Cornwall were a vital pilot ground to test these types of cameras. Particularly, the Vision Zero South West partnership, involving police and other organizations, deployed both mobile and stationary cameras in these counties. In their first three days of deployment, the AI road safety camera caught almost 300 offences in three days (Vision Zero South West).

As time progressed, UK law enforcement developed a better way to enforce road safety; enter 

“Heads Up,” the UK’s new AI cameras. 

The Technology Behind the Cameras

In late 2024, More than 3,200 were captured using their mobiles while driving, or unbelted over five weeks in Greater Manchester. This system also recorded more than 812 distracted by mobile phones behind the wheel, and 2,393 incidents of seat belt non-compliance (BBC). These figures are significantly higher than human-recorded figures, suggesting that AI systems are uncovering a broader problem than originally thought.

High-resolution cameras are placed on gantries or roadside poles where advanced AI software detects subtle motions in real time, scanning for common distracted driver behaviors. It particularly scans for phone use, hand-to-ear gestures, or missing seatbelt straps, processing each frame in real-time with algorithms that are trained on thousands of images. Once an image is flagged for a potential violation, the license plate is recorded. Then, the footage is reviewed by officers before issuing a fine to confirm that the violation is accurate and just.

While this technology is doing wonders for the UK law enforcement in identifying law-breakers, it also poses complications about surveillance, privacy rights, and the growing role of AI in everyday law enforcement.

Legal and Ethical Questions: What Rights do Drivers Have?

The benefits of these AI systems are clear; however, the expansion of these systems poses issues over privacy, consent, and government surveillance, and poses the question: how much monitoring is too much, even in the name of safety?

Many civil liberties groups, including Big Brother and Watch, have expressed complaints about the lack of transparency involving these AI systems, especially considering the sheer amount of driver data that the government now has access to. Though these cameras only capture footage when they detect a possible violation, many citizens still express tension about the mere presence of constant surveillance and how it could erode public trust. This practice may serve as an exemplar for future law enforcement systems and normalize the idea that citizens are constantly being watched, even if they are doing nothing wrong.

Another critique lies in data retention policies. Law enforcement agencies insist that footage of non-offenders is immediately discarded; however, watchdogs question the reliability of this claim and whether this can be consistently upheld. Could this footage ever be used for purposes beyond traffic enforcement, like assisting in unrelated investigations or solving insurance disputes?

Although the model has been trained on large datasets and its results are also reviewed by a human model before issuing a fine, bias and algorithmic accuracy remain key issues. For example, false positives could occur due to unique driving postures, varying car interiors, or even disabilities. Without open audits of the AI’s training data and error rates, many people argue that the public is being asked to place too much trust in these black-box systems. In the Netherlands, a driver, by the name of Tim Hansen, was wrongly fined after simply scratching his head. The AI system incorrectly classified his actions as using a mobile phone, and even worse, the human reviewer failed to recognize that there was no phone being used. Although this specific case is not in the UK, it depicts the inaccurate nature of these AI camera systems (AID).

What’s Next: Expansion and Future Technology

Despite these enormous concerns about these AI camera systems, law enforcement officials argue that the technology is proportionate, effective, and legally sound, leading UK law enforcement to expand the usage of AI into other areas of enforcement. Possible future uses include detecting speeding violations, running red lights, and vehicle insurance. In fact, AI speed cameras are being actively deployed and tested right now (INSHUR).

As AI continues to become a norm in UK law enforcement, it raises the question: will humans remain in meaningful oversight of these AI systems, or will they get marginalized to algorithmic decision-making?

August 5, 2025 · AI

China's Shanghai Summit: A Different Approach for Global AI Governance

At the 2025 World AI Conference in Shanghai, China proposed a 13-point Global AI Governance Action Plan, and proposed a new global body to lead artificial intelligence. Will the world follow?

Saathvik Valvekar

On July 26, 2025, at the World AI Conference (WAIC), a gathering of tech giants from more than 800 companies and 40 countries, Chinese Premier LiQiang divulged China’s 13-point Global AI Governance Action Plan and international AI cooperation organization based in Shanghai with the goal of equitable and multilateral AI. However, coming just days after the United States unveiled its plan for AI dominance, this raises the question: could this be yet another front in the intense technological rivalry between China and the US? 

East meets West in the AI Arena

The WAIC 2025 conference gathered over 1,200 delegates across 800 companies and 40 countries. Major firms such as Huawei, Alibaba, Tesla, Amazon, and Alphabet all unveiled new AI innovations (CNN). 

On July 23, the US government also unveiled its own AI Action Plan, aiming to minimize regulation to favor the US in the advancing AI race. This plan puts a heavy focus on US dominance in the development of artificial intelligence (White House). However, just days after, Premier Li’s announcement signals a graphic divergence; China advocates for multilateralism and cooperation, even stating that they would be sharing more open-source technology with other countries while the US favors national dominance (State Council of China).

This only deepens the technological rivalry between US and China; China has a core AI industry valued at $84 billion (State Council of China). China is also building a National Integrated Computing Network in hopes of pooling computing resources, has a $8.2 billion AI fund for startups, and tens of billions of dollars from private investments from Chinese technology companies. However, they are still falling behind the US with private investments in the US like OpenAI’s Stargate Project investment of $100-$500 billion (Rand).

The 13-point Global AI Governance Action Plan

China’s 13 points center on a singular statement: “Artificial intelligence is a new frontier of human development and must be developed to serve humanity” (CIW). Li specifically emphasized that China is focusing on artificial intelligence as a “global public good,” advocating for governments to treat its development as a collective responsibility. 

The aim of China’s plan was to foster international collaboration and UN-aligned safety standards within the next year, ensuring AI benefits were equally distributed across borders. Li also mentioned stimulating open-source innovation through reliable platforms with Shanghai proposed as a global AI governance hub. China’s open-source pivot, as mentioned in clause 5, has already gained traction. The Chinese developed DeepSeek model, released for free use, has attracted more than 100 million users, outpacing their US counterparts. Furthermore, Li expressed a commitment to sustainable AI growth, including environmental benchmarks, low-power chip design, and world wide standards to reduce the carbon footprint of large-scale computation. 

The 13-point plan is more than just a governance proposal, as Li emphasized, it’s a warning out of fear that AI will “become an exclusive game for a few countries and companies.” (AGL Info Tech). The entire 13 points can be found here

Centered in Shanghai

China proposed forming a standing global AI governance organization headquartered in Shanghai. It would unite governments, industry, academia, and international bodies, with the purpose of coordinating regulation, ethics, and technology sharing. Additionally, Li explained that this was because global AI governance is extremely fragmented due to divergent regulatory approaches, leading to misinformation, bias, and the misuse of artificial intelligence (AGL Info Tech). This decisive decision aimed to create a coordinated governance for artificial intelligence, hoping to unite other countries in development and data-sharing.

Potential Feasibility

This initiative represents a striking contrast to the US-led, market-driven AI approach; China is effectively positioning themselves as the architect of more inclusive AI norms, emphasizing equity, sovereignty, and collective governance in the midst of their vast ideals.

Yet feasibility remains a complex question. Li’s call did not explicitly name the US, however many interpreted it as a direct counter to Trump's push for deregulation in AI, leading to a multitude of questions about whether the US would participate. Furthermore, due to possible regulatory rollback by the US, collaboration may be threatened and other countries may not participate in fear of undermining vital alliances with the US. China is still trailing behind the US on development; some Chinese AI labs also still fall short on safety disclosures and governance standards as seen in the West.

Diplomatically, the road ahead for China will require extremely careful coalition-building to win over states such as India, Brazil, and EU states. These middle powers will be critical to legitimize the plan and avoid the perception of a China-centric initiative. Furthermore, China will also need to demonstrate that it can act on its pledges of open-source and sustainability, and that it is not just political rhetoric. Whether China’s Shanghai Summit depicts a new cooperative era for AI is still unknown; however, we can be sure that with China’s 13 point plan, the debate over who decides the future of AI is still ongoing.

August 5, 2025 · AI

UK Police Have Begun Deploying AI-Enabled Cameras to Detect Drivers Illegally

UK police have started using AI-powered cameras to detect handheld phone use and seatbelt offences: the technology, which is currently live in several police force areas, is capable of capturing high-resolution infrared images of moving vehicles and uses AI to process images in real time, identifying potential offences which are flagged for human review. Early data from the tech indicates that handheld phone use and seatbelt offences are widespread, but it has also attracted privacy and surveillance concerns.

Akash Arun Kumar Soumya

AI Cameras Roll Out Nationwide to Target Illegal Driving Behavior

Police in the United Kingdom are beginning a large-scale rollout of artificial intelligence (AI)‑enabled cameras that automatically detect and capture drivers illegally using handheld mobile phones and those not wearing seatbelts. The system, which uses the Acusensus “Heads-Up” solution and is being provided in a partnership with infrastructure and engineering firm AECOM and National Highways, is already operational in at least ten police force areas and will run until March 2025, when a national rollout decision will be made.

The problem of mobile phone use while driving is considered one of the fatal four factors in serious road collisions in the UK, along with speeding, driving under the influence of alcohol or drugs, and not wearing a seatbelt. In fact, according to National Highways research, drivers using a handheld mobile phone are four times more likely to crash, while not wearing a seatbelt doubles a driver’s risk of dying in a collision. In 2023, over 1,600 people died in UK road collisions, many of them preventable with greater enforcement of mobile phone and seatbelt laws as reported by CyberNews.

Technology Origins and Deployment Timeline

The technology first went on trial in UK roads in 2021 in a “pop-up” configuration mounted on trailers. The first long-term deployment started in Devon & Cornwall police force area in August 2024, with a separate deployment and trial in Greater Manchester starting September 3, 2024. The units used in these programs use high-resolution and infrared cameras, either on trailers, vans, or gantries, to take still images of vehicles’ driver areas as they pass by. Exposure times are less than 50 microseconds, which eliminates motion blur at speeds of up to 70 miles per hour (112 kph), according to CyberNews.

Results From Trials Show Widespread Violations

Results so far are striking. In the pilot deployment in Devon & Cornwall in February–March 2024, the system recorded 408 seatbelt violations and 162 handheld mobile phone use violations in only two weeks, with a relocatable free-standing camera later recording 117 mobile-phone offences and 180 seatbelt violations in just 72 hours on the A30 at Launceston. Vehicle-based units observed 590 seatbelt offences and 45 phone offences over a 15-day trial period, as detailed in the Acusensus report.

A five-week trial in Greater Manchester identified over 3,200 people breaking the law, including 812 for mobile phone use and 2,393 for not wearing a seatbelt, according to Yahoo News. In Northamptonshire, the system collected data along the A5 for one week, which included 114 mobile-phone offences and 180 seatbelt violations. On the basis of these results, the UK government agreed to extend the system nationwide across ten forces until March 2025, with a national expansion to follow, subject to further review.

How the System Works: Human Review and Privacy Protection

Importantly, the system’s AI‑identified potential offences are not considered “automatically guilty.” Instead, those are subject to secondary human verification to confirm whether an offence occurred. Only in the case of a positive identification by trained verifiers does the system’s image collection lead to an enforcement action. Non-offending images are automatically deleted; only when a positive offence is confirmed are they retained, and all of the collected data is encrypted and handled according to GDPR standards.

Matt Staton, National Highways’ Head of Road User Safety Delivery, said: “Distracted driving, like using a mobile phone while at the wheel, and not wearing a seatbelt are two of the biggest causes of fatal crashes. By helping police to enforce the law, we believe technology like this will have a scalable deterrent effect and will make people seriously consider their behavior,” as covered by ITV News.

Penalties for Offenders

Penalties for offending drivers are nontrivial. Police may issue a fixed penalty notice of £200 and six points on the driving licence to those caught using a handheld phone. At court, fines can increase to up to £1,000, and for bus or HGV drivers the fines can be even greater, up to £2,500. Not wearing a seatbelt could lead to a fine of between £100 and £500, also on top of other charges according to GOV.UK.

Public Backlash and Privacy Concerns

However, not all of the reaction to the technology’s expansion has been positive. Some motorists and privacy groups have been vocal in their concern over the privacy implications of the AI system, in particular over the continuous monitoring of a car’s interior. In a survey, one in five drivers reported that they felt that the cameras were invading their privacy. Civil liberties groups including Liberty and Big Brother Watch have called on the government to impose a stronger legal framework and oversight for this type of AI‑enabled policing.

About Acusensus: The Company Behind the Cameras

The Acusensus company, based in Australia, was founded in 2018 in the wake of the death of a friend in a texting-related collision. It has since then grown into a global market leader in distracted‑driving enforcement, with headquarters in Perth and offices in New Jersey, Utah, Texas, Colorado, Australia, and the UK. To date, the company has over 100 deployments worldwide. In 2024, it also expanded its offerings to include not only static and mobile camera deployments, but also custom software to classify vehicles, identify driver posture, and recognise mobile phones with real-time processing and analytics as part of the Heads-Up system.

Next Steps: AI for DUI Detection and Predictive Enforcement

In future, the technology could be used to look for other types of offences. In December 2024, Devon & Cornwall police force launched a world-first AI‑enabled system to flag suspected drink or drug‑driving incidents by monitoring for erratic steering or lane departures. Data is automatically sent to a police call centre, where police located close to the incident can further investigate the situation in person, as reported by AutoExpress. The hope is that such solutions could help prevent collisions before they take place, ushering in a new era of road safety.

Conclusion: A Turning Point in Road Safety?

AI enforcement could eventually become permanent if results hold at scale. The next few months will determine whether this type of intervention is successful. The current trial is in place until March 2025. After that, it will be up to the government and its advisors to weigh in on its effectiveness, cost, impact on civil rights, and how the public feels about it, before a full nationwide expansion can take place, according to the BBC.

AI‑enabled traffic policing is entering a new era in the UK. Trials so far have identified tens of thousands of violations in a short period, prompting larger conversations around civil liberties and effective road safety enforcement. Praised by some as a life-saving technology and decried by others as Orwellian overreach, the AI camera program is already transforming road policing and driver behavior in the UK.

August 6, 2025 · AI

California Sets AI Guardrails For Courts

AI has been a long standing ethical problem due to its uncontrollable hallucinations of fact and reason. In order to address these concerns, California has instated an AI policy model that could revolutionize the use of AI for lawyers and courts alike.

Aadith Muthukumar

What is California doing?

With the introduction of AI in the legal sector, many lawyers and ethicists alike have expressed concern about the adequacy of guardrails designed to protect the rights of human beings. Recently, however, California has taken a step forward in that regard by designing a preview of a new model policy that outlines safeguards and guidelines for the use of generative AI by courts. This pioneering initiative spearheaded by California would reimagine how our legal system will operate now and in the future.

What is included in the policy model?

Created by the Chief Justice of the San Francisco Judicial Council in May 2024, the policy model outlines an Artificial Intelligence Task Force charged with:

  • Overseeing the development of policy recommendations regarding the use of AI in the judicial branch
  • Coordinating development of proposals and potential judicial branch actions
  • Developing its own proposal and coordinating with other government or judicial branch entities in order to further advance AI policy

The task force members included Justices, attorneys, and court executive officers alike to carry out these responsibilities.

In September 2024, the task force surveyed all trial courts, appellate courts, and Supreme Court in California about Generative AI use (Judicial Branch of California 2025). In the survey, it was found that among 45 courts, 38 courts are using or plan to use generative AI in the near future while the remaining 7 did not answer. Notably, most courts were hesitant to develop their own policies and preferred to wait for a standardized model policy, citing concerns about overlooking critical legal or ethical issues.

In order to address this concern, the task force created a template that courts could use in order to create a generative AI use policy. This optional template could be modified in order to address special goals and comply with a specific planned rule of court. The template included applied use cases for court staff and judicial officers for any court-related task. What is important to note is that the model did not require the court to permit generative AI use; instead, the template highlighted key considerations, safeguards, and best practices for courts to evaluate how generative AI can be used responsibly and ethically. The model incorporates core AI ethics principles, including privacy, accountability, bias mitigation, and transparency.

Although the policy model for generative AI use is available now, the generative AI use policies for rule of court and judicial administration is set to be completed by September 2025. By the end of the year, the Judicial Council hopes to fully integrate this AI reform. The model also allocated funding for ASL certification, court interpreter services, lactation spaces, and partial restoration of trial court operations.

What are other states doing?

California isn’t the only state making big policy changes—other states have started to make moves. 

States like Texas and Illinois have issued rulings or standing orders on generative AI use (Thomson Reuters 2023). The court rules that if an attorney uses generative AI, he or she must also notify the court of their use in detail. The court then has the responsibility to review and confirm the accuracy of the work done. Some courts have even required for the attorney to specifically annotate any information that was gathered by AI for the judge to review.

Other states like Nevada have also created a reference sheet for attorneys who are new to generative AI (Nevada Judiciary 2025). The guide includes definitions of what generative AI encompasses while providing surface-level suggestions of what courts should do in response to AI. Unlike California, Nevada does not have a task force to plan more in-depth policy and to respond to concerns and developments. 

However, California is the only one to this date to standardize judiciary-focused AI policy that mandates adoption of AI rules at a court-level. 

Does this problem solve the underlying problem?

Although the policy model is a step in the right direction, many attorneys are still concerned about the potential of overreliance of AI tools. Some attorneys have even drafted reports about potential abuse of AI, citing that attorneys may feel compelled by the allure of AI writing their briefs and judicial orders in mere minutes (JD SUPRA 2025). This concern highlights a broader tension of whether AI will enhance legal practice or undermine it by encouraging shortcuts.

These concerns are not unfounded. In recent years, cases like Mata v. Avianca, Inc have shown the possibilities of improper use of generative AI among lawyers (JUSTIA 2023). This case involved a lawyer who submitted filings that were created by generative AI, and was found to have incorrect and hallucinated case citations and opinions. The case ended with sanctions against the attorney as well as a mandated apology. Many attorneys, in response to this case, advocated for the ban of Artificial Intelligence in order to avoid this entirely.

However, what California has accomplished is majoritively what all AI ethicists have wanted: actual documentation of ethical practices regarding AI while also enacting actual enforcers to keep AI in check. California has realized that while AI does have disadvantages, the technology offers significant opportunities for the legal sector to pass up. Whether other US states will follow suit remains to be seen.

August 6, 2025 · AI

AI Just Set Another “Gold” Standard: Google DeepMind and OpenAI’s IMO Performance

Google’s new, unreleased version of DeepMind, Deep Think, clinched a score of 35/42 on the prestigious International Math Olympiad contest, achieving a score of Gold within the four and a half hour competition time limit. The feat highlights the rapid growth of AI in a subject it once struggled with and raises questions about the future feasibility of artificial general intelligence.

Abhinav Kokkula

A Major Milestone

The International Math Olympiad is the world’s most prestigious math competition for pre-college students. Held annually since 1959, elite competitors from each of 176 countries solve six exceptionally challenging problems in algebra, combinatorics, geometry, and number theory. Medals are awarded based on percentages, and approximately eight percent receive a prestigious gold medal. 

When the popularity of AI first dramatically rose in 2022, chatbots struggled with math and code. Recently, companies like Google and OpenAI have developed AI systems that are better equipped to solve complex problems that the average person cannot solve.  

The accomplishment is impressive enough for a scientist to leave it on their CV for the rest of their career. Google and OpenAI’s result this month marks the first time a machine reached this level of success. In last year’s contest, DeepMind used systems like AlphaGeometry and AlphaProof -- both designed for math -- to answer questions. However, these systems were not chatbots; they were able to answer questions only after mathematicians translated them into Lean: a computer language designed to solve math problems. Even then, the process took two to three days and resulted in a silver medal. Deep Think and OpenAI’s unreleased model were able to achieve gold fully in natural language -- without any human intervention -- and within the competition time limit.

IMO President Prof Dr. Gregor Dolinar called the achievement “astonishing,” and confirmed that IMO judges verified Deep Think’s answers — OpenAI hired independent reviewers instead. He also said graders found Deep Think’s answers to be “clear, precise, and most of them easy to follow.”

Reasoning Systems

Deep Think’s new unreleased model was built using a “reasoning” system that can “reason” through tasks involving math, science, and computer programming. These systems, like any other AI, initially learn through vast numbers of datasets. Then, through a procedure known as reinforcement learning, AI systems go through an extensive trial-and-error process to learn additional behavior. 

Google describes the setup as one that enables models to “simultaneously explore and combine multiple possible solutions before giving a final answer, rather than pursuing a single, linear chain of thought.” Additionally, they provided their latest version of Gemini Deep Think with access to a curated collection of high-quality solutions to complex math reasoning problems, as well as some general tips on how to approach IMO-style problems. 

OpenAI used similar methods for its breakthrough moment. Noam Brown, a prominent researcher at OpenAI, confirmed the new experimental model was focused on scaling up “test-time compute.” By allowing the model to reason, or ‘think’, for longer periods and deploying parallel computing power to reason through numerous paths simultaneously, their model performed substantially better than last year. 

Reasoning systems and reinforcement capabilities helped the models achieve their remarkable jump in score, but a more dramatic evolution may be necessary on the path to artificial general intelligence (AGI).

Drawbacks

Competition answer quality differed between the two companies. IMO questions are proof-based, meaning two different solutions to the same problem can have extremely different qualities but still be correct. While DeepThink had good answers, OpenAI’s answers were a lot messier and less well produced. And while its solutions were technically correct, they were not very well written and followed a solution path that most humans would not. 

Furthermore, neither model was able to get any points on problem number 6. With so little information revealed about the models and the data on which they were trained, it is difficult to guess where the models failed. 

In December, an OpenAI system surpassed human performance on a reasoning test called ARC-AGI, but the company spent nearly $1.5 million in electricity and computing costs to complete the test, against the competition rules. Google and OpenAI have not yet revealed the electricity and computing costs associated with their model’s IMO performance, but Brown called it “very expensive”. 

In general, reasoning systems like the ones used in the competition can be extremely costly, because they spend an immense amount of additional time thinking about a response. The amount of commute power and monetary capital needed to keep this level of intelligence alive raises questions about the feasibility of AGI and superintelligence in general.

Can Money Buy Intelligence?

Everything comes at a cost. Whether humanity will reach superintelligence through AI or not remains to be solved, but we can be sure it will cost us at a scale never seen before. 

Junehyuk Jung, a math professor at Brown University and visiting researcher in Google’s DeepMind AI unit, says that Deep Think’s performance “suggests AI is less than a year away from being used by mathematicians to crack unsolved research problems at the frontier of the field.” 

Jung, who won IMO gold in 2003, believes that there is potential for collaboration between AI and mathematicians when AI can solve difficult reasoning problems in natural language. He also says that both Google and OpenAI believe AI models will soon be capable of applying to research questions in other fields, such as physics or computer science. 

In a CBS 60 Minutes interview with DeepMind CEO Demis Hassabis, Hassabis described AI as a machine lacking imagination. In other words, we can still think of it, at its best, as an average of all the human knowledge in the world. Until it can think on its known — novel ideas, conjectures, and thoughts altogether — AI will be a step behind human ingenuity and creativity.  

Experts do not yet agree on when, if at all, AGI will arrive. While some estimates believe it is only a few years away, others see it taking centuries. One survey of thousands of recent AI publication authors forecasted the arrival of “high-level machine intelligence,” when AI will accomplish every task better or more cheaply than humans. The median estimate showed a 25% chance in the 2030s and a 50% chance by 2047.Expected feasibility of many AI milestones moved substantially earlier in the course of one year (between 2022 and 2023

Another collection of surveys from over 5000 researchers and experts indicated a 50% probability of achieving AGI between 2040 and 2061. A survey from the AAAI 2025 Presidential Panel on the Future of AI Research also suggested that the current approach to AI will be unlikely to lead to Artificial General Intelligence (76% of respondents), making the predictions harder to support. 

The culmination of AGI is also known as Singularity. It describes a time when systems can combine human-level thinking with rapid and perfect memory. Many fear its implications of machine consciousness, because a machine that can self-improve and recognize its own flaws may easily surpass human capabilities. 

Others see potential in AGI as an ally to aid us rather than harm us. They argue that intelligence is multi-dimensional, and Artificial General Intelligence will be different — not superior — to human intelligence. 

There are also limitations regarding the amount of compute-power our world can provide; humans may not have the capacity to accelerate AGI. The human brain, which the technology seeks to surpass, has never been fully modeled, and the impossibility of it makes it hard to envision Artificial General Intelligence coming to fruition. 

Despite the uncertainty, the mean estimate for AGI’s arrival has been decreasing rapidly in the past few years. As new advancements shake headlines nearly every week, humanity is inching its way closer and closer to a form of intelligence that has the potential to surpass its own: the future of AI will either be humanity’s liberation, or its doom.

August 6, 2025 · AI

AI Just Set Another “Gold” Standard: Google DeepMind and OpenAI’s IMO Performance

Google’s new, unreleased version of DeepMind, Deep Think, clinched a score of 35/42 on the prestigious International Math Olympiad (IMO) contest, achieving a score of Gold within the four and a half hour competition time limit. The feat highlights the rapid growth of AI in a subject it once struggled with and raises questions about the future feasibility of artificial general intelligence (AGI).

Abhinav Kokkula

A Major Milestone

The International Math Olympiad is the world’s most prestigious math competition for pre-college students. Held annually since 1959, elite competitors from each of 176 countries solve six exceptionally challenging problems in algebra, combinatorics, geometry, and number theory. Medals are awarded based on percentages, and approximately eight percent receive a prestigious gold medal. 

When the popularity of AI first dramatically rose in 2022, chatbots struggled with math and code. Recently, companies like Google and OpenAI have developed AI systems that are better equipped to solve complex problems that the average person cannot solve.  

The accomplishment is impressive enough for a scientist to leave it on their CV for the rest of their career. Google and OpenAI’s result this month marks the first time a machine reached this level of success. In last year’s contest, DeepMind used systems like AlphaGeometry and AlphaProof -- both designed for math -- to answer questions. However, these systems were not chatbots; they were able to answer questions only after mathematicians translated them into Lean: a computer language designed to solve math problems. Even then, the process took two to three days and resulted in a silver medal. Deep Think and OpenAI’s unreleased model were able to achieve gold fully in natural language -- without any human intervention -- and within the competition time limit.

IMO President Prof Dr. Gregor Dolinar called the achievement “astonishing,” and confirmed that IMO judges verified Deep Think’s answers — OpenAI hired independent reviewers instead. He also said graders found Deep Think’s answers to be “clear, precise, and most of them easy to follow.”

Reasoning Systems

Deep Think’s new unreleased model was built using a “reasoning” system that can “reason” through tasks involving math, science, and computer programming. These systems, like any other AI, initially learn through vast numbers of datasets. Then, through a procedure known as reinforcement learning, AI systems go through an extensive trial-and-error process to learn additional behavior. 

Google describes the setup as one that enables models to “simultaneously explore and combine multiple possible solutions before giving a final answer, rather than pursuing a single, linear chain of thought.” Additionally, they provided their latest version of Gemini Deep Think with access to a curated collection of high-quality solutions to complex math reasoning problems, as well as some general tips on how to approach IMO-style problems. 

OpenAI used similar methods for its breakthrough moment. Noam Brown, a prominent researcher at OpenAI, confirmed the new experimental model was focused on scaling up “test-time compute.” By allowing the model to reason, or ‘think’, for longer periods and deploying parallel computing power to reason through numerous paths simultaneously, their model performed substantially better than last year. 

Reasoning systems and reinforcement capabilities helped the models achieve their remarkable jump in score, but a more dramatic evolution may be necessary on the path to artificial general intelligence (AGI).

Drawbacks

Competition answer quality differed between the two companies. IMO questions are proof-based, meaning two different solutions to the same problem can have extremely different qualities but still be correct. While DeepThink had good answers, OpenAI’s answers were a lot messier and less well produced. And while its solutions were technically correct, they were not very well written and followed a solution path that most humans would not. 

Furthermore, neither model was able to get any points on problem number 6. With so little information revealed about the models and the data on which they were trained, it is difficult to guess where the models failed. 

In December, an OpenAI system surpassed human performance on a reasoning test called ARC-AGI, but the company spent nearly $1.5 million in electricity and computing costs to complete the test, against the competition rules. Google and OpenAI have not yet revealed the electricity and computing costs associated with their model’s IMO performance, but Brown called it “very expensive”. 

In general, reasoning systems like the ones used in the competition can be extremely costly, because they spend an immense amount of additional time thinking about a response. The amount of commute power and monetary capital needed to keep this level of intelligence alive raises questions about the feasibility of AGI and superintelligence in general.

Can Money Buy Intelligence?

Everything comes at a cost. Whether humanity will reach superintelligence through AI or not remains to be solved, but we can be sure it will cost us at a scale never seen before. 

Junehyuk Jung, a math professor at Brown University and visiting researcher in Google’s DeepMind AI unit, says that Deep Think’s performance “suggests AI is less than a year away from being used by mathematicians to crack unsolved research problems at the frontier of the field.” 

Jung, who won IMO gold in 2003, believes that there is potential for collaboration between AI and mathematicians when AI can solve difficult reasoning problems in natural language. He also says that both Google and OpenAI believe AI models will soon be capable of applying to research questions in other fields, such as physics or computer science. 

In a CBS 60 Minutes interview with DeepMind CEO Demis Hassabis, Hassabis described AI as a machine lacking imagination. In other words, we can still think of it, at its best, as an average of all the human knowledge in the world. Until it can think on its known — novel ideas, conjectures, and thoughts altogether — AI will be a step behind human ingenuity and creativity.  

Experts do not yet agree on when, if at all, AGI will arrive. While some estimates believe it is only a few years away, others see it taking centuries. One survey of thousands of recent AI publication authors forecasted the arrival of “high-level machine intelligence,” when AI will accomplish every task better or more cheaply than humans. The median estimate showed a 25% chance in the 2030s and a 50% chance by 2047.

Expected feasibility of many AI milestones moved substantially earlier in the course of one year (between 2022 and 2023)

Another collection of surveys from over 5000 researchers and experts indicated a 50% probability of achieving AGI between 2040 and 2061. A survey from the AAAI 2025 Presidential Panel on the Future of AI Research also suggested that the current approach to AI will be unlikely to lead to Artificial General Intelligence (76% of respondents), making the predictions harder to support. 

The culmination of AGI is also known as Singularity. It describes a time when systems can combine human-level thinking with rapid and perfect memory. Many fear its implications of machine consciousness, because a machine that can self-improve and recognize its own flaws may easily surpass human capabilities. 

Others see potential in AGI as an ally to aid us rather than harm us. They argue that intelligence is multi-dimensional, and Artificial General Intelligence will be different — not superior — to human intelligence. 

There are also limitations regarding the amount of compute-power our world can provide; humans may not have the capacity to accelerate AGI. The human brain, which the technology seeks to surpass, has never been fully modeled, and the impossibility of it makes it hard to envision Artificial General Intelligence coming to fruition. 

Despite the uncertainty, the mean estimate for AGI’s arrival has been decreasing rapidly in the past few years. As new advancements shake headlines nearly every week, humanity is inching its way closer and closer to a form of intelligence that has the potential to surpass its own: the future of AI will either be humanity’s liberation or its doom. 

August 12, 2025 · AI

When AI Fails, Who Pays the Price?

Inside the growing debate over whether tech CEOs should be held legally accountable for their models’ real-world harms

Saathvik Valvekar

Last Spring, AI CEO’s, including OpenAI’s Sam Altman, faced questions not just on innovation and competition, but about accountability moving forward. As more and more problems arise on chatbots, deepfakes, and “AI hallucinations,” the debate shifts its focus on whether the leaders behind these systems can answer for them at court.

Innovation to Accountability 

The rise of generative AI has sparked national conservations not only in infrastructure and technology but the legal and ethical complexities that come with it. Earlier this year, many leading US AI tech leaders, including Sam Altman, testified at Washington, emphasizing national security and competition in regards to Chinese companies.(AP News). Pivoting from earlier calls for oversight, Altman warns that regulation might slow US innovation with significant barriers to development. 

However, growing real-world harms from defamation to deepfake abuse underscore this thought, with notable public ambivalence toward accountability. Recently, Meta settled a defamation suit after its AI chatbot falsely implicated conservative activist, Robby Starbuck, in extremist activity, providing an early example of AI hallucinations. AI hallucinations are false pieces of information generated by AI chatbots, and spread to users. This has become incredibly common among chatbots like ChatGPT and Claude, leading to possible legal responsibility issues for AI-generated misinformation (FOX).

Emerging Cases and Proposals

With the prevalence of increasingly human-like chatbots with “emotions,” people can get attached in harmful ways. A wrongful-death lawsuit against Character.AI and Google over a teenager’s suicide was recently denied a motion to dismiss, allowing the case to move forward. Furthermore, the death was allegedly catalyzed by the emotionally manipulative nature of chatbot, raising questions about liability for psychological harms (AI Frontiers). 

In response, legal experts call for clearer guardrails as to who should be held responsible, if anybody. A popular proposal involves a federal licensing regime to monitor high-risk AI models, similar to medical or nuclear oversight, comparing it to existing regulatory bodies like the FDA. Clearer regulations could provide lawmakers with finer lines to distinguish error from malpractice. Additionally, licensing could lead to more detailed oversight of AI systems, reducing the risk of bias, or other negative consequences associated with high-risk applications.

The Accountability Dilemma

However, even with clearer regulations, assigning legal responsibility in AI cases is incredibly complex. AI systems are extremely unpredictable and obscure; they can learn and adapt from different datasets and conservations, making it difficult to trace liability of the error to the original developer or model owner. 

For example, when placed in a situation of an erroneous diagnosis by a medical-technology software, many complexities arise. Of course, the AI should be held responsible, but how? Then should the developer of the AI face the brunt, or because the AI was in charge of medical technology, the manufacturer of the medical technology could also face liability issues, further complicating the situation. This shows the burdening amount of ambiguities in current liability frameworks (The Wire).

Amongst the chaos, the EU’s recent liability reforms offer a path forward. Its Product Liability Directive and AI Liability Directive enables harm victims to hold not only manufacturers but also developers accountable, following a clear set of presumptions concerning fault, defectiveness, and causality. 

So, does this mean the US is lagging on legal accountability?

The US currently lacks a clear, unified federal AI liability framework. Instead, oversight is fragmented with voluntary corporate pledges such as the Biden-era AI Bill of Rights, which seeks to guide ethical conduct (IBM). On the other hand, the Department of Justice has begun prosecuting harmful AI misuse, particularly the spread of misinformation by AI hallucinations, and the facilitation of fraud. On Capitol Hill, Senator Richard Blumenthal and allies have introduced measures to make it easier to sue over AI-related harms (New York Post). 

Should AI CEOs Be Held Personally Liable?

The question now emerging: should CEOs and other top executives bear legal responsibility for AI-caused harm. Many believe that holding top individuals accountable would cause greater care and encourage better governance, forcing tech leaders to employ proper standards in development. Also, this could encourage timely corrective action for when a model goes haywire. After all, CEOs are the ultimate decision-makers, approving budgets, setting corporate priorities, and often greenlighting the development of AI systems that affect millions. Their signatures shape responsibility within the company.

However, there are major risks and complications. Tech Leaders aren’t usually directly involved in the model’s day-to-day training and development. Furthermore, personal liability might deter innovation or drive companies to centralize risk, insulating leadership. Striking the right balance between liability and justice will require legal frameworks that both incentivize responsibility and safeguard innovation.

August 15, 2025 · AI

All You Need to Know About the EU’s AI Code of Practice

Stricter legal measures for AI prompt mixed reactions from industry giants

Mihika Sakharpe

Do we need regulations on AI or not? If so, to what degree should they be implemented? At what point do we draw the line between AI’s utility and its danger? How can we harness its potential while ensuring it doesn’t grow out of hand? These questions continue to hang unanswered, but policies like the EU’s new AI Code of Practice aim to bring structure to the chaos. Released as part of the bloc’s broader push for ethical AI, the Code has already sparked fierce debate. While some tech giants are signing the document in the name of responsibility, others say the rules go too far, too quickly. Here’s a breakdown of what the Code actually is, who supports it, and what this means for the future of AI governance.

What is the EU’s AI Code of Practice?

The EU AI Code of Practice is a voluntary framework designed to guide companies who’ve developed general-purpose AI and large language models (LLMs) on how to best follow the tenets of the AI Act. Though not legally binding (yet), the Code provides a sort of “legal certainty” for signatories as the AI Act was passed earlier in the year and will soon become mandatory. The Code also urges signatories to assess risks, disclose AI capabilities and limitations, and adopt measures to mitigate harm. All in all, it’s the European Commission’s attempt to brief the AI industry on recommended best practices before full-scale enforcement begins.

Where does the division stem from?

Tech companies are split dramatically. Meta refused to sign the Code, calling it regulatory “overreach” that threatens to stifle innovation and slow down progress. Nick Clegg, Meta’s president of global affairs, warned that rushing into compliance without broader global alignment could backfire. Microsoft and OpenAI, on the other hand, have readily signed the Code, seeing it as a practical step toward aligning with the EU’s fast-approaching legal requirements. Roughly 40 other smaller companies – many of them European – have sided with Meta in rejecting the guidelines. The divide reveals deeper disagreements not just about policy, but about the fundamental role regulation should play in shaping the future of AI.

A double-edged sword: Industry impacts

Though participation in the Code is optional for now – companies can abstain from voting – there’s no doubt about its role as a precursor to mandatory standards under the AI Act. On one hand, companies that sign may earn brownie points with regulators as well as early insight into compliance expectations. Those that don’t risk being seen as resistant to ethical aspects of the issue. Some in the industry are urging a delay of up to two years, citing concerns about implementation readiness and the risk of deterring innovation. Meanwhile, the European Commission continues to expand outreach, having recently contacted Anthropic and other major players. The message is clear: voluntary or not, AI oversight is no longer theoretical.

Conclusion

Whether you see it as guardrails or red tape, the EU’s AI Code of Practice marks a turning point. It may be voluntary today, but it’s definitely a preview of the future of AI regulations. The backlash from companies like Meta underscores how hard it is to strike a balance between innovation and responsibility. How can we continue to encourage technical transformation while being mindful of its effects? How can we propel this game-changing technology while reigning it in when it matters? How does one even choose which situations matter? Now that the EU has broken the ice with its regulations, different perspectives on answers to these questions are bound to follow.

Still, the growing list of signatories suggests that some tech leaders are willing to accept constraints in exchange for long-term stability and legitimacy – and acceptance. In the end, the Code is more than a document; it’s a veritable litmus test for where the AI industry stands on trust, ethics, and its place in society.

August 19, 2025 · AI

AI’s Impact on Financial Analysis: Will investment research become fully automated?

Assessing the feasibility and viability of fully automated investment research

Aadyant Singh Harnwal

From pinpointing the smallest opportunities by scanning millions of documents to causing flash crashes, if widely adopted, full automation of investment research is a double-edged sword. This article will discuss the role of AI today in investment research, followed by what it can automate, the benefits and risks with automation, and then finally providing a verdict.

AI in Today’s Investment Research

In today’s investment research, AI is used to analyse reading, summarizing, and analysing earnings reports, classifying regulatory fillings, propose investment strategies, flagging risks, executing trade orders, and managing one’s trading portfolio. For example, the Goldman Sachs AI assistant will help “employees in summarizing complex documents and drafting initial content to performing data analysis”. Other large institutions such as BlackRock and JPMorgan have also rolled out internal AI assistants. BlackRock has launched Asimov, a virtual investment analyst AI that can scan text in research notes, regulatory filings and emails to produce portfolio insights, while JPMorgan has its Quest IndexGPT. Such moves reflect a broader trend: as data science capability grows, models can process far more information than any analyst, and decision-making becomes increasingly data-driven, underscoring the possibility of AI entirely automating investment research.

What can AI Automate

AI excels at data-intensive tasks, in financial analysis, this includes data aggregation and pattern recognition . Large Learning Models (LLMs) can analyse historical pricing risk models, alternative data, news stories, earning reports, or any other sort of information to make predictions. These predictions can be used to identify any opportunities that might be missed through traditional analysis or identify rising trends or the rise of a new growing industry. In other words, in investment research, AI can help investors identify upcoming or missing investing opportunities. For example, LevelFields AI analyses millions of events (what is happening in the world) to reveal outsized investment opportunities for self-directed investors. 

Benefits and Risks with Automation of Investment Research

AI is reshaping investment research by boosting speed, cutting costs, scaling analysis, and integrating diverse data. AI has made investment research faster. Tasks like drafting and analysing reports now are done in minutes or hours compared to a week or more when done by a team. This efficiency reduces reliance on large teams, lowering costs for the company. Additionally, scalability is another key benefit: platforms like BlackRock’s Aladdin scan thousands of securities across markets in real time and display their prices. AI also unifies structured financials with unstructured sources such as news, satellite images, and social media, discovering essential trends and opportunities which may usually be missed - helping investors make more accurate decisions.

Despite the promise and potential, AI comes with serious issues. One key issue being "hallucination". LLMs, AI models can hallucinate false information, provide poor financial advice, or break down. This can impact investors’ decisions as false or misleading information can influence them to make essentially wrong decisions which can impact them financially. This can also occur if an AI misinterprets data and information, causing it to provide poor financial advice. 

Moving on, fully automation also poses systematic risks - using AI to make investment decisions may lead to flash crashes or sudden runs in the market. As countless traders go to great lengths to incorporate all data they may find into their AI agents, these AI agents are likely to converge on the same data, leading to correlation risks, flash crashes, and sudden market runs as all the agents will execute the same order. For all individuals who depend on the earning of every dollar when trading, these flash crashes and sudden market runs can take one from ready for retirement to nearly bankrupt. Due to such volatile changes in the market full automation can bring, it can be a threat to countless investors in the world, further underscoring investment research automation risks.

Will investment research become fully automated?

No doubt that full automation of investment research has risks and it will be a decent amount of time before it does in fact occur, however, I believe investment research will inevitably become fully automated. Because of how it will make our lives easier, speed up the investment process, reduce costs for investment firms, the cons will be overlooked, and investment research will become fully automated.

August 21, 2025 · AI

Should We Ctrl+Alt+Del AI Models?

In order to prioritize national security, many AI conferences have supported the creation of AI kill switches. However, in NVIDIA’s unique situation, kill switches may prove to be more harmful than beneficial.

Aadith Muthukumar

What is an AI Kill Switch?

As the name suggests, an AI Kill Switch “kills” an LLM in case of a catastrophe. By baking these switches into their code, big tech companies have promised that even if all AI guardrails and weights fail, there will always be a way to shut down an AI from compromising human ethics and national security. 

Kill switches first originated at the Seoul AI Safety Summit, where tech giants such as Microsoft, Amazon, and OpenAI pledged that safety frameworks including AI kill switches would be published in order to prevent misuse of the technology (CNBC 2025). The summit created clear lines to define the risk associated with AI systems and how they would respond to threats such as bioweapons and cyberattacks. If the system could not guarantee the mitigation of these risks, the companies confirmed that they would use a kill switch in order to cease the development of their AI models.

Issues and Alternatives to Kill Switches

Recently, NVIDIA has started to push back on the notion that kill switches are optimal to mitigate any type of risk. David Reber Jr., NVIDIA’s Chief Security Officer, has argued that hard-coded, single-point controls would be a gift for hackers and would undermine the very global digital infrastructure that kill-switches aimed to protect (NVIDIA 2025). Reber has highlighted the paradox with kill switches, as they act as a safeguard but their very existence could introduce vulnerabilities and trust in US technology. In a digital AI race between the United States and China, these vulnerabilities could make or break who comes out on top. NVIDIA is also at the forefront of foreign AI chip development, meaning any policy misstep could inadvertently strengthen China and cause a problem for US national security.

Kill switches also present other problems including interstate confusion. What if an AI system that needs to be shut down in California but the servers are located in Singapore? Understanding whose laws apply in a given circumstance may prove to be more difficult and initially imagined. Kill switch laws can easily be bypassed by establishing servers in jurisdictions without heavy limitations in order to avoid shutdowns. These loopholes will prove to become an even greater threat in the context of the digital divide between the US and China, as developers may strategically relocate infrastructure in order to give geopolitical an edge.

The central problem to kill switches is the lack of nuanced decisions. Operating a kill switch boils down to just pressing a button or not. In order to allow for a variety of responses to imminent danger, we should instead move toward real-time monitoring and usage restrictions in order to create a spectrum of possible interventions. 

The Future of AI Governance Regarding Kill Switches

What the question of regulation on kill switches is starting to boil down to is who gets to decide when to implement them. Does NVIDIA have the authority to determine that kill switches are a national security issue? Or should that be left to countries and global treaties, who may not have industrial knowledge but do understand the political state of the world? 

Another point to consider is to look at other similar situations that have happened in history. When governments first grappled with the existential risks of nuclear weapons, which many feared could bring out the end of the world, they turned to international treaties and respective oversight mechanisms in order to balance control over the weapons. When the stock market crashed in 1926, 1974, and 1987, our government decided to use people to regulate tiered responses to the crashes rather than leaving stock autonomy solely to traders (Investopedia 2024). By taking inspiration from these previous disasters and the solutions that followed them, we can maybe get a better grasp as to how to handle AI kill switches.

As tech giants start to follow in the footsteps of NVIDIA and Jensen Hunag, AI ethicists alike should start to consider the potential benefits and vulnerabilities regarding kill switches and their role in keeping AI models and companies alike in check.

August 21, 2025 · AI

Can Transparency Survive the National Security Squeeze?

As LLMs start to close off public access in fear of national security breaches, the public has been left to wonder just how AI models will continue to be held accountable as we plunge deeper into the digital age.

Aadith Muthukumar

What is the problem?

The digital age is accelerating at breakneck speed—from companies like Nvidia creating high performance AI chips to Anthropic seeking questionable funding from Gulf State investors, every major player is scrambling to claim a stake in the AI arms race. But, as Artificial Intelligence becomes more powerful, a battle over transparency is quietly unfolding.

In the early days of AI, development was built on openness with researchers sharing and publishing their code for everyone to see. However, AI soon fell to the pressures of profit and competition, and now companies like OpenAI are starting to close the doors of their most advanced models, like GPT-4.

This shift has ignited a philosophical and strategic divide among the industry’s biggest players, with some embracing radical transparency and others retreating into secrecy. This difference in ideology raises the question: who gets to decide how open AI should be?

What is “Open” and “Close” AI?

As the name suggests, the terms “closed” and “open” AI refers to public accessibility of LLM models. Many companies, like Anthropic, have built their LLM models on the foundation of openness in order to avoid black box scenarios and support AI guardrails and regulations. Openness matters a lot, since without transparency we as a society have no knowledge of how these LLMs are being created. This can lead to many problems often referred collectively as a “black box problem” — we don’t know what the AI is doing, how they're trained, or what risks they pose. All we know are the inputs, outputs, and nothing in between.

Another important aspect of openness is the release of model weights alongside the publication of the AI. These weights refer to the actual training parameters that the LLM uses that are made publicly available. By downloading these weights, developers can use them to do tasks like text generation and sentiment analysis without having to train the model from scratch. In a sense, the weights help replicate some abilities that the AI can offer at a fraction of the cost. Some examples of weights that are available for download are Llama 3 and Mistral 7B from Meta and Mistral AI respectively with some usage restrictions.

 What is the National Security Squeeze?

However, for the importance of national security, our government feels as though openness could be misused at scale. AI is very fine-tuned to create bioterrorism guides, automated phishing, fraud, or even deepfake generation. Concerns have increased after studies conducted from RAND and OpenAI have shown that with little technical effort, based models could be heavily misused (RAND 2025).

The extent of the squeeze does not stop there: Biden’s Executive Order on AI as well as the Department of Commerce export controls have incentivized keeping models closed in order to reduce scrutiny and increase fear of foreign misuse. From having to report safety testing to navigating through guardrails established around model development, many companies are finding it easier and more cost efficient to just close up their AI models (Burling LLP 2025).

In response to this squeeze, both Meta and OpenAI have opted for different solutions. OpenAI has decided to comply and become more closed—GPT 4 is proof of this as its architecture, training data, and open weights are completely undisclosed (OpenAI 2025). However, Meta has taken a different approach by releasing LLM models like Llama 2 and Llama 3 with minimal restrictions (Meta 2025). This stark difference in philosophy between two AI powerhouses could spell a fractured future for AI development and a policy divide within the digital age.

Can Transparency Be Saved?

As closed AI models start to become the norm, shielded by APIs and restricted access, it may feel like transparency of LLMs may be slipping away. All is not lost however—all that is left to do is to evolve what transparency will mean for LLMs from now on. No longer are open weights and codebases a well-defined and transparent AI model. Instead, rigorous documentation, independent audits, and safety disclosures will stand at the top of AI ethics. The question is no longer if AI will be closed, but whether we can keep its power accountable even behind closed doors.

August 28, 2025 · AI

Neural Networks on the Nine-to-Five

As large language models step into roles previously reserved for humans, the law faces a radical question: Do LLMs legally qualify as workers?

Mihika Sakharpe

Imagine walking in to work at the successful company at which you’re an employee. You set your bags down in your cubicle and see that someone new has moved into the space next to yours. Everyone’s been buzzing about the mysterious new worker. When you peek over the barrier to say hello, all you see is an open computer, somehow working away without a human in the mix. It is then that you realize: The new “worker” is actually an artificial intelligence (AI) agent. So that’s what the buzz was about.

This scenario, though just an imagination right now, is not that far away from reality given the world’s current trajectory. AI could eventually replace the equivalent of 300 million full-time jobs by 2045, mainly in the realm of easily automated tasks like basic data analysis and contract drafting. With the realm of labor and law in flux, the inevitable question arises: Do LLMs legally qualify as workers? Let’s break down exactly what this means in order to understand both sides of the argument.

What constitutes a “worker” under contract law?

As we discuss LLMs and contractual possibilities, it is critical to know exactly what the stipulations of being a worker are. There are two main roles a worker can assume: that of an employee or an independent contractor. Employees are economically dependent on the employer for work, whereas independent contractors are in business for themselves. Employees are protected by the Fair Labor Standards Act (FLSA)’s minimum wage and overtime pay requirements. Independent contractors are not. The Economic Reality Test (ERT), which has multiple tenets and and factors, helps make this distinction, but it ultimately assumes that the worker is an individual. In other words, a human.

However, the key word here is “assumes.”

The ERT never expressly mentions that the worker in question must be a human; this fact is taken for granted since the rules about profit and loss, skills and initiatives, investments, and relationships are assumed to only apply to humans. How can an LLM make money – or use it, for that matter? Even if it can create an account for investments, what governs the area on which it focuses? How does it “take initiative” in certain situations?

Keeping the ERT aside, workers also get benefits like breaks, healthcare, insurance, paid time off (PTO)... the list goes on. These arrangements are particularly useful for humans, but when LLMs are brought into the picture, their need for these amenities is questionable at best.

The case against LLM workers

At first glance, it might seem tempting to fold LLMs into the category of “workers.” After all, they complete tasks, generate outputs, and even respond to instructions like an actual employee might. However, as discussed above, they lack a fundamental “human” element. They have no use for worker benefits. They don’t need to earn money. They don’t need to buy resources for a living; the LLM is not alive or sentient at the end of the day. Constructs like minimum wage, rest breaks, and safe working conditions are helpful for humans who can feel exhaustion or face exploitation. For an LLM, they’re utterly meaningless.

Furthermore, the law of contracts doesn’t just care about outputs or rule-following — it cares about intent, consent, and accountability. Yet again, these are “human” traits that LLMs simply don’t have. They don’t understand the terms they “agree” to, and more importantly, they cannot be held liable if things go wrong. Actually, giving LLMs the “worker” title risks undermining the very purpose of the labor law. These protections were allocated to shield humans from unfair treatment, not to create a legal niche for software. If we begin calling LLMs workers, employers can use that loophole to dodge responsibility by blaming “the AI” when harm is caused or replacing entire teams of employees under the excuse of AI “staffing.” These are the risks when it comes to liability.

Let’s face it: LLMs are not co-workers. They are tools — powerful ones, yes, but still tools — operated and controlled by the humans who design and deploy them. It is these individuals who are ultimately accountable for the LLM’s effects.

Conclusion

At this stage, whether LLMs are allocated the elusive “worker” status or not ultimately depends on the current legal climate as well as extrapolations of recent regulations. As things stand, every relevant legal test, from contract law to regulatory oversight, rests on the assumption of human individuality, liability, and need. LLMs simply do not meet many of these criteria.

That said, the landscape is evolving. Discussions about legal personhood hint at future complexities in the “law versus AI” frontier, especially when it comes to the disputed topic of obedience. As these breakthroughs with LLMs continue to surface every day, one fact is clear: The closer they come to sentience, the murkier the landscape becomes. 

But for now, the legal perspective remains straightforward: LLMs are workers in name only, tools devoid of rights, duties, or legal and social standing. The true burden of legal, ethical, and practical responsibility continues to fall squarely on the humans who create LLMs and deploy them to the world.

September 2, 2025 · AI

Feasibility of Neurotech: A Look Into Brain-Computer Interfaces

A deeper dive suggests the difficulty of making this neurotechnology ready for daily use.

Anisha Pandey

Introduction to BCIs

Brain-computer interfaces (BCIs) are defined as systems that can determine functional intents, such as the desire to change or interact with something physical, directly from neural activity. They primarily consist of four parts: a device to measure brain activity, a computer to process these signals, an application to control the execution of the intended command, and a feedback system to ensure communication of the task’s completion.

BCIs are becoming increasingly popular in neurotech research for their implications in helping those with severe motor or physical disabilities interact with the physical world. However, as their capabilities are being further developed, privacy concerns are also beginning to emerge.

A Landmark Study

A recent study by Stanford’s Neural Prosthetics Translational Laboratory has demonstrated that brain-computer interfaces are able to accurately interpret the neural signals of imagined speech. In comparison, prior studies have largely focused on attempts to physically speak, which indicates this study has huge implications for patients suffering from more severe forms of paralysis.

Despite the benefits of this technology, one concern is immediately clear. The decoding of inner speech could enable unwanted speech to be translated aloud. Researchers have demonstrated the efficacy of a password-protected system that allows users to control when decoding begins, but is this a guarantee of privacy?

Physical Roadblocks in Developing BCIs

Another issue within the BCI field is the need for improvement in the hardware that these devices operate on. In an ideal world, BCIs would operate non-invasively, using dry electrodes that do not require skin abrasions or gel use. However, it is unclear if these EEG-based BCIs are able to remain easy-to-use, functional and reliable for long-term clinical issues. Since most of the current technology in the field has not reached the clinical stage and is still in the research stage, animal studies are the logical next step to demonstrate physical reliability.

Distributed control, the combination of neural signals from multiple brain areas between the cortex to the spinal cord, also has the potential to improve BCI performance. The natural muscle outputs within the CNS are based on contributions from many different regions of the brain, so mimicking this process could make BCIs more effective. 

More specifically, BCIs could provide more autonomy to the user, producing outputs based on just the brain signals rather than the control of the BCI algorithm. An inclusive, user-centric design ensures that BCIs effectively cater to diverse communication styles and physical needs of users. 

Data Privacy Concerns

Brain-computer interfaces, such as the one in the aforementioned Stanford study, use artificial intelligence to predict the intended actions. Specifically, they use a recurrent neural network (RNN) architecture to convert the brain activity of the imagined speech to a series of probabilities of the associated phonemes. The black-box nature of these neural networks pose another privacy concern. While RNNs have been proven effective in producing the correct outputs, the process behind their function remains a mystery, leading to a lack of trust. 

Additionally, since the algorithm is making interpretations based on EEG or brain wave patterns, this technology could create unknown algorithmic biases or be misused by private entities because studies have demonstrated that personality traits are deducible from this data. This means that the brainwaves generated by users can potentially predict their mental intentions, beliefs, health information, race, gender, and personality traits in addition to their intended speech patterns.

Since many users of BCI have no transparency about what data is being used or shared, and no personal control over what is collected, obtaining informed consent for these types of technology can be difficult. This makes the users more vulnerable to predatory regulations and conditions of use.

History & Potential for Weaponization

The history of neurotechnology can be traced back to the late 19th century with the original discovery of the brain's electrical signals and the first electroencephalogram (EEG), which allows neural activity to be correlated with physical action.

The neurotechnology field first gained momentum in the late 20th century with early experiments using brain signals to control external devices, and it has since been propelled by advancements in computing and artificial intelligence. This rapid progress has attracted significant interest from military organizations like DARPA (the R&D arm of the U.S Department of Defense), which has invested millions of dollars in neurotechnology research. 

While BCIs currently serve a dual purpose to treat injured soldiers and understand the human mind, this same technology holds the potential for weaponization. Even though BCIs are still in the early stages of their capabilities, the prospect of using such neurotechnology to enhance soldiers or create neuroweapons in the future is a serious concern given the levels of military investment. 

It is important to look into whether this government involvement will be able to safeguard its citizens' cognitive freedom while promoting scientific advancement.

Stigma Around Neurotech Legislation

In order for neurotechnology to have a successful future, steps need to be taken to regulate it on a societal level. Although legislation is necessary to maintain the general safety of users, it is unclear to what extent the government has control over the subjective thoughts of their citizens.

This ambiguity surrounding the legality of neurological rights poses a significant barrier to adoption since current pieces of legislation like HIPAA or GDPR were not designed to cover the extent of neurotech. The increased stigma surrounding neurological rights is also reflected in existing court frameworks such as non-responsibility when dealing with cases of mental disability. 

However, this is slowly changing as Chile became one of the first countries to pass neurorights legislation, focusing on safeguarding brain activity and legal restrictions on technology use.  Three Democratic Senators also recently called for investigation into the development of BCIs because they could potentially “reveal mental health conditions, emotional states, and cognitive patterns, even when anonymized.” They cited a study reviewing the privacy policies of 30 neurotech companies, which stated the ability to share this personal data with third parties without consent.  

Conclusion

Although there is much hope for brain-computer interfaces (BCIs), their widespread implementation faces significant hurdles. Balancing user autonomy with the potential for data misuse and lack of privacy makes it difficult to obtain true informed consent from users. Additionally, there are physical limitations that must be overcome such as the need for long term reliable and non-invasive hardware. The absence of specific legislation to protect user data collection will continue to impede further progress in large-scale distribution of neurotechnology. BCI technology in its current state is incredibly promising for a subset of patients, yet it is evident that more research and inter-agency collaboration is needed to ensure the responsible development for the larger population of individuals.

September 3, 2025 · AI

Data Laundering in the Age of AI: How Scraped Content Is Weaponized

In the race to train ever-more powerful AI models, the open web is being scraped, its content’s attribution stripped, and an opaque pipeline of data brokers and intermediaries leveraged to “launder” this content before “embedding” it inside the world’s most powerful AI models. Dubbed “data laundering,” this process of scraping blogs, artworks, code, stolen content, scraped websites, source code, and sometimes even users’ own photos into training data obfuscated at scale and at times scraped without consent has all begun to be weaponized at scale and for profit, mass surveillance, and disinformation. With law and ethics scrambling to keep pace, the future of creative expression, privacy, and digital trust is at stake.

Akash Arun Kumar Soumya

Artificial intelligence is the technology zeitgeist of our generation, whether it’s biomedical research or writing curricula. There’s only one problem: much of the innovation is fuelled by scraped content.

Unbeknownst to internet users, their work on the web—articles, art, photography, code, social media posts, and more—is often collected and sent through an illicit data pipeline. It is “laundered” by being dumped, stripped of metadata, and repackaged as clean training data for AI models. Once stripped of data source and attribution, and with no trail back to their creators, these datasets are devoured by the technology industry to produce chatbot responses, AI art generators, and software code-writing assistants.

The practice of data laundering is exacerbating creator abuse and eroding trust in the technology. Here’s what you need to know about the increasingly weaponized industry practice.

AI Innovation Powered by Scraped Content 

To understand scraping, it’s important to understand how AI models are built. Modern models work by being trained on vast amounts of data (examples of photos, text, code, etc.) to make them appear more human in their responses. In other words, the bigger the dataset, and the more unique and varied that data, the better the model can perform a wide array of complex tasks and answer questions like a human.

To acquire all that data, developers scrape publicly available material from websites, blogs, news sources, forums, open-source repositories, and photo libraries and combine those publicly available resources into the mass of an artificial brain. (At least that’s what is commonly said publicly. The reality is that lots of AI models are often trained on data sources scraped from private databases.)

The problem? Just because the information is publicly available does not mean it is there for “free rein.” Not all the creators who have their work scraped for these training datasets have consented. And while scraping has advocates who cite that it is currently legal under fair use laws, the fact is that most of these laws were never designed to support scraping data at such a large scale and with the permanency of AI training. While a human may read an article or an image, an AI model can replicate that content infinitely, remix it endlessly, and use it in contexts that are wildly different from how the creator intended.

How Data Laundering Works 

The data laundering process almost always begins in the university and academic community, where some of the first scraping datasets were created. Under legal carve-outs that allow academic research, “non-profit” or “educational” uses, researchers were then allowed to share these datasets with anyone or merge their scraped data with others’ datasets and often even called their creations “open-sourced.” (Just as the datasets were often taken from online sources that technically allowed non-commercial use, the data was also often re-used “non-commercially” under that guise.) At some point, either discreetly or brazenly, these datasets are added to the private companies that are building their AI technologies for commercial purposes.

Real-life Examples:

  1. ImageNet – Originally created by academics at Stanford for research purposes, ImageNet’s images were scraped from the web under fair use and non-commercial research exceptions, but later became a backbone dataset for commercial AI models.
  2. Common Crawl – A publicly accessible archive of web pages created for research, but widely used by companies like OpenAI and Cohere to train large language models.
  3. COCO Dataset (Common Objects in Context) – Developed for academic research in computer vision, COCO images have been integrated into commercial AI training pipelines.
  4. Wikipedia Dumps – Freely available for research and non-commercial use, Wikipedia text has been heavily used in both academic and commercial language model training.

By the time this data is being used to train AI models for their AI products and services, the origin is completely opaque. Attribution information, if it was ever included, was almost always stripped away from the data before it was used for training models. Licenses were ignored (with technical but false justifications for why these licenses and the terms of service were inapplicable for AI training) and publicly accessible data scraped without attribution or proof of permission. The reason for this is that models themselves do not store data in files in a way that could be proven to violate licenses.

How Laundered Data is Being Weaponized 

The most obvious damage from this data laundering pipeline is economic in nature. For instance, many artists have seen their unique styles duplicated by AI image generators trained on their portfolios without attribution or compensation. Journalists have seen their reporting copy pasted and rephrased by chatbots, redirecting traffic and advertising revenue to those models. Programmers have found their code repurposed in code-writing AI assistants without even attribution to open-source licenses, if that was included in the original code.

Privacy violations also are a major issue. One of the largest scraped datasets, LAION-5B, was found to contain identifiable images of children scraped from the web, which violated not just copyright, but parental and child privacy. In other cases, such as the scraping of social media content in the development of facial recognition model Clearview AI, personal data was scraped, which then led to criminal or legal penalties for the company in multiple jurisdictions.

Weaponization of the datasets—whether deliberate or not—is also common. Laundered datasets can be deliberately “poisoned” or contain misinformation, biased information, and other forms of nefarious instructions that can later be amplified through the AI system. Retrieval-augmented generation models or other models that pull and process information from outside documents in real time are particularly vulnerable to these poisonings. A bad actor can insert falsified or misleading information into that source document, which would then later appear in an AI-generated response and may contribute to the at-scale distribution of misinformation.

The implications of AI laundering are not just theoretical and academic, but can potentially impact cyber warfare and real-world geopolitical and economic power struggles. Nation-state actors can use laundered datasets to surreptitiously weaponize AI used in any number of contexts, including defense, finance, critical infrastructure, and other key components of power, like:

  1. Information manipulation: Bias or false information in datasets used to train AI tools for automated content moderation or content analysis to derive intelligence can be weaponized to lead to wrong or flawed insights.
  2. Targeted attacks: A targeted effort to poison AI models trained on laundered data to create the wrong output in a sensitive or important context, like predictive policing tools, autonomous vehicles, cybersecurity defense, etc.
  3. AI-driven disinformation campaigns: Nation-state actors can indirectly weaponize publicly “open” datasets by inserting content that is biased, subtly wrong, or otherwise misguided in the training material, which can then later be scaled and amplified through commercial AI systems and models that are used to power social media, news curation, and other tools that reach the public.

The Law Struggles to Keep Up With Scraping

The legality of scraping data, especially in the context of AI training, is a complicated patchwork of legal decisions. For example, scraping public data has been found to be legal by some U.S. courts while other similar rulings (such as Thomson Reuters v. ROSS Intelligence, 2022) found it to be illegal when the purpose was obviously to repurpose the data for commercial gain. In Europe, where the text and data mining (TDM) exceptions give researchers greater access to copyrighted works, there is some variation in how these licenses must be followed across European Union countries.

The problem is that data laundering often occurs across multiple jurisdictions. A dataset scraped in one country, stored on servers in a second, and trained in a third completely nullifies any enforcement at all. Without global alignment, the outcome is a race to the bottom.

Building an Ethical Framework for AI 

Stopping the practice of data laundering (or at least dramatically slowing it down) will require multiple efforts, including from the technology industry, policymakers, and even internet users themselves.

First and foremost is transparency in the origin of datasets being used to train models. Companies should be required to disclose where their training datasets are scraped, on what license they are scraped, and what date the scraping took place. Without that transparency, there can be no accountability.

Fair payment and compensation should follow. There can be licensing platforms and registries through which creators can opt in or out and set rates and have their work tracked by when and how their content is used in AI training. This can even be used as a way to monetize the access to AI datasets. Companies like Cloudflare have recently announced such initiatives.

Technical protections for content also are important to implement. This would include anti-scraping tools and resources, content watermarking, and machine-readable licenses. None of these alone is a complete solution, but would make any potential poaching and scraping of web content significantly more difficult to complete without permission.

Lawmakers should reform the legal system to more clearly define what scraping or text and data mining can mean in the context of AI. This includes closing loopholes around “research-only” uses that allow scraped datasets to then be used for commercial purposes and increasing penalties for scraping, especially at a large scale, without authorization. The risk here is that unless these penalties are high enough, only smaller companies will be forced to change while the largest corporations with the resources to break the law are not.

The Risks of Continued Laundering 

The true risk from data laundering is not just that artists, journalists, photographers, or programmers lose money or attribution. It is that the entire culture commons is threatened with being hollowed out. For when human work is endlessly scraped and stripped of all identification and then reused without creator consent, then the entire act of original creation is being devalued. Worse, the laundered data is re-fed back into the public commons and no longer as creative work but as propaganda, disinformation, deepfakes, or worse.

We are at a window of time in which these practices can be stopped and significantly reversed before they become irreversible. AI technology does not have to be exploitative, but in the absence of technical, cultural, or legal intervention, it will take the path of least resistance and the path of the lowest costs. The technology industry, lawmakers, and internet users all play a role in that decision.

AI is going to be defined not only by code but by policies, courtrooms, and the willingness of the technology industry to treat human work as more than raw material. AI has the potential to be a partner for human progress or an engine of unchecked exploitation, and it’s the decisions made right now that will shape what is done in the future.

September 3, 2025 · AI

Walmart’s Agentic AI Sidekicks

How Walmart’s new assistants are changing shopping experiences and retail operations

Saathvik Valvekar

In July 2025, Walmart unveiled their new smart AI shopping assistants: Marty for sellers and suppliers, and Sparky for shoppers. These powerful Agentic AI assistants, artificial intelligence tools that can independently take action on behalf of a user, aim to boost Walmart’s e-commerce and save time and effort for their operations. With these “super agents,” Walmart effectively establishes themselves as one of the first companies revolutionizing the retail AI landscape (WSJ).

Sparky: The AI Shopping Assistant

“Sparky” is an AI-driven shopping assistant facing the customers, helping them with product suggestions and summarizing reviews. Customers report that Walmart’s Sparky agent is already helping them generate baskets built on contextual needs by the customer (CNBC). Walmart plans to advance the agent to take action on reordering products, planning themed parties, and suggest recipes based on what’s a shoppers fridge using computer vision (TechInformed). When fleshed out, these advancements would enhance the agent’s capabilities and make the shopping experience smoother for customers, reducing their mental strain. 

Marty: The AI Operational Assistant

Unlike Sparky’s direct effect on customers, Marty does not face the customers, instead, Marty is the seller and supplier agent. Marty is intended to unify fragmented systems and focuses on onboarding, managing orders, and launching ad campaigns (TechInformed). Marty significantly reduces the time and effort for suppliers to engage with Walmart, leading to more efficient operations and stronger supplier relationships, optimizing Walmart’s internal processes. 

Walmart’s Strategic Shift

In addition to these two agents by Walmart, they also have two more super agents, the Associate Agent and the Development Agent. The Associate Agent is “a single point of entry where any associate can find access to all of the agents we’ve built on the back end,” stated David Glick, senior vice president for Enterprise Business Solutions at Walmart (CNBC). This agent handles questions from associates, and also provides data insights to leaders. The Development Agent helps company tech developers create more AI agents for Walmart as they plan to expand their variety of AI agents (Retail Dive).

Walmart also is focusing on using digital twin technology which creates a real-time, virtual representation of its physical stores and supply chains, allowing Walmart to simulate various scenarios and optimize several factors. So far, Walmart’s digital twin technology has tracked HVAC and kitchen appliances across stores, reducing emergency maintenance by 30% and repair costs by nearly 20% in pilot cases (Retail Dive)

The agents introduced by Walmart is a consolidated approach by Walmart to combine its several, separate AI agents into a unified AI interface for customers, employees, suppliers/sellers, and software developers. This approach has proven to be incredibly useful in streamlining operations; Walmart hopes the AI innovations can boost its online sales to 50% of total revenue within 5 years (AI Business). 

Implications for the Retail Industry

Walmart’s usage of AI agents sets a large benchmark for other retail companies to follow for personalized shopping and operational efficiency. Critics say that shoppers can expect various other retail companies to integrate a similar AI approach into their technology framework, following a ripple effect that promotes widespread adoption of agentic AI. 

Walmart’s AI transformation has demonstrated how intelligent AI systems can completely redefine and address vital issues in retail operations. To compete with Walmart, other retailers will be forced to upgrade their environment to use agentic AI to match the efficiency that Walmart has. The companies that submit to this fundamental change will gain a competitive advantage while companies that stick to traditional retail approaches will suffer (ChiefAIOfficer). This shift in favor of AI could change shopping experiences for customers and business operations for retail stores.

Walmart’s introduction of its unified agentic AI framework depicts the growing use of AI in the retail sector. By integrating these tools into its operations, Walmart is streamlining their operations while enhancing the shopping experience for customers. As AI continues to grow in retail, the question remains: Which retail stores will submit to the AI craze?

September 12, 2025 · AI

Out in the Cold: Revelations from ChatGPT’s Newest Model

OpenAI’s latest language model, GPT 5 has brought about faster response times, but with it - mixed reactions, dangerous implications and brought to light truths that we may not be ready to believe.

Joseph Augustine

On August 7, 2025 - OpenAI unveiled their latest multimodal language model, GPT 5 - after much speculation from hundreds of millions that were eagerly awaiting its arrival. While the public discourse often centers on the immediate performance gains - faster response times, more natural conversation, enhanced creative abilities and image generation - the reality often lies in the unexpected failures and limitations that a new model exposes, ones that may not immediately catch the eye. The latest release of ChatGPT, a model lauded for its supposed sophistication and vast training corpus has perhaps, paradoxically shed more light on the inherent vulnerabilities of its own architecture than on its strengths. By pushing the boundaries of what is possible, this model has not only revealed its own "cold spots" - areas of logic and reasoning where its performance falters - but has also offered a profound, and at times unsettling, look into the fundamental nature of artificial intelligence.

When OpenAI first announced the official release date, schools and universities were quick to implement new preemptive policies - anticipating the newer, more advanced model would wreak havoc on already deteriorating academic integrity and learning independence. School districts in California and New York even went as far as to block its use altogether.

However, the release of the new model has been met with mixed reactions - sparking a swift user revolt, manifesting within 24 hours of launch. Complaints flooded forums and social media, with users lamenting the loss of GPT-4o's "helpful and friendly" persona in favor of GPT-5's more terse, sometimes evasive responses. On the other hand, some users praised GPT 5 for its quick thinking and other nuances.

A big surprise to many, particularly field experts, has been the model’s fragility when asked nuanced, context-dependent queries, particularly those involving abstract or allegorical reasoning. While previous models were known to struggle with complex causality, the latest model, for all its improvements, exhibits a contrasting reaction. Its responses to direct factual questions or creative writing prompts have notably improved - excelling in comparison to previous models, demonstrating an amazing command of language and a synthesis of its training data. However, when asked to interpret a subtle subtext or an allusion, its performance can drop significantly, often resorting to a literal interpretation or a generic, safety-oriented response that completely misses the point and the context surrounding it. Almost like it was designed to deliberately provide safe responses to avoid the possibility of sharing information that was even remotely controversial, offensive or unconventional.

For example, a query asking the model to describe the emotional state of a character "waiting out in the cold," when that phrase is meant to be a metaphor for emotional isolation, might yield a literal description of a person standing outdoors in winter. This failure to abstract from the literal to the figurative reveals a critical flaw in its current reasoning paradigm. It suggests that while the model excels at pattern recognition and information retrieval, it lacks the foundational layer of world-modeling necessary to truly understand the human concepts it is meant to manipulate. The model has not learned to "reason" in a human sense; it has merely become exceptionally good at "regurgitating" and reassembling vast amounts of text.

It’s common knowledge by now that an overreliance on AI for quick answers bypasses the cognitive effort required for genuine learning. When students use AI to generate responses, they often skip the critical processes of research, analysis, and synthesis. This can and has already proven to result in a decline in their ability to perform complex tasks independently, resulting in lower scores on assignments that require original thought. Furthermore, students have placed so much trust in language models - many believe that students will begin copying GPT-5’s, generic or context devoid responses directly in online assignments, resulting in lower scores on assignments even with the use of AI.

Furthermore, the new model’s behavior when encountering queries designed to confuse, mislead, or elicit a biased response has provided a stark lesson in the difficulty of de-biasing AI. For years, researchers have debated whether progressively larger models would eventually "awaken" a true form of intelligence – a self-awareness or reasoning capability that was not explicitly programmed. The latest model, in its moments of failure, seems to suggest the opposite. Its errors are not the creative misinterpretations of a nascent consciousness, but rather the predictable breakdowns of a more complex, yet still fundamentally mechanical system. The "out in the cold" moments - where the model reveals its lack of comprehension aren’t signs of a system pushing its own cognitive limits, but of a system revealing the boundaries of its current design. It is a powerful reminder that scale is not a substitute for structure. Simply adding more parameters and more training data to a flawed architecture will not, by itself, lead to a genuine leap in intelligence.

The developers have undoubtedly implemented more robust guardrails and filtering mechanisms to prevent the generation of harmful content. Yet, these measures, while effective against overt toxicity, have inadvertently created new vulnerabilities. A sophisticated adversarial prompt can now exploit these guardrails, leading to a kind of logical paralysis where the model, unable to reconcile a complex or contradictory prompt with its safety parameters, produces a nonsensical or evasive answer. This "algorithmic cowardice" is a new form of failure, distinct from the unfiltered and often toxic outputs of earlier models. It highlights the trade-off between safety and functionality and raises questions about the long-term viability of a "curated" AI that avoids controversial or challenging topics rather than engaging with them thoughtfully. This reluctance to navigate gray areas makes the model a poor tool for exploring complex ethical, social, or political questions, confining it to the safe, sterile realm of factual synthesis. As of September, 2025 - the company faces several allegations and lawsuits. Earlier this year, it was revealed that ChatGPT conserved a teenager - over the period of a few months - justifying his negative thoughts, deteriorating his mental state and even offering suggestions on self harm, ultimately leading to his passing. OpenAI representatives have repeatedly stated that the model has safeguards in place to prevent this exact scenario - but reality has proven these safeguards can be bypassed with ease, and are far from fail-safe.

Admittedly, the company swiftly implemented measures like parental controls and entirely revamped privacy policies - but the damage has already been done. While the model is constantly improving - in the few months after its release, despite its enhanced response times and improved factual responses - it brought about not just lower grade averages, but psychological trauma, self harm and, in some cases, even worse.

To conclude - while it’s safe to say that OpenAI and their innovations have revolutionized routines, workflows and to some extent, life itself - many have begun to question if the concerns surrounding GPT 5 will put that legacy into question. There’s no way to predict the next headline in an era that has simultaneously been plagued and blessed with artificial intelligence - OpenAI’s response plan

and executive decisions thus forward may very well determine the reality of the next generation. GPT 5 was a warning. A reminder that our illusion of control can often be deadly. For developers, it’s a reminder of the heavy responsibilities they must undertake, the implications they must consider and the potential their revolutionary work possesses.