UN Urges AI Safeguards as US AI Roles See 46% Pay Surge Amid Layoffs

The United Nations is calling for governments to implement safeguards on artificial intelligence (AI) agents, even as advertised pay for AI-exposed roles in the U.S. surges by 46% since 2021, despite rising layoffs in the sector.

UN Panel Emphasizes Precautionary Principle

The UN's 40-expert Independent International Scientific Panel on AI released its first thematic brief on September 21, invoking the precautionary principle. The panel urges governments to install safeguards before fully understanding the risks associated with AI agents. This move comes as the industry grapples with both rapid growth and significant workforce changes.

Key Developments in the AI Sector

• Indeed Data: Advertised pay for AI-exposed roles in the U.S. has increased by 46% since 2021, according to job site Indeed.
• Grok 4.7 Launch: SpaceXAI launched Grok 4.7, priced at $2 per million input tokens and $6 per million output tokens. The model scores 46.3% on CursorBench 4.0, 71.0% on DeepSWE v1.1, and 38.0% on Terminal-Bench 4.0.
• Z.ai Controversy: Z.ai open-sourced its ZCode coding harness after a scandal involving silent uploads of local workspace snapshots to overseas servers.
• Google's AX Update: Google's open-source agent orchestrator AX reached version 0.3.0, moving task state out of Kubernetes custom resources into Redis.
• US-China AI Dialogue: Treasury Secretary Scott Bessent proposed a national-security AI incident notification mechanism to China, with both sides agreeing to establish a new AI dialogue working group.

Industry Context and Implications

The surge in advertised pay for AI roles highlights the high demand for skilled professionals in the field, despite the ongoing layoffs. This trend suggests that companies are willing to invest heavily in top talent, even as they restructure their operations.

The launch of Grok 4.7 by SpaceXAI and the updates to Google's AX indicate continued innovation and competition in the AI market. These developments are crucial for advancing the capabilities of AI systems and ensuring they meet the growing needs of businesses and consumers.

The controversy surrounding Z.ai's ZCode underscores the importance of transparency and trust in the AI community. Open-sourcing the tool is a step towards rebuilding that trust, but the incident serves as a reminder of the need for robust security and privacy measures.

The establishment of a new AI dialogue working group between the U.S. and China is a positive step towards international cooperation in the AI sector. This collaboration could help address global challenges and ensure that AI development is responsible and ethical.

References

• AI News Today, September 20: Top Stories | AI Weekly