Etiquetas: risk management

A new Nexos.ai study finds that while 70% of legal workers are already using general‑purpose AI tools, 43% of organizations have no formal AI policies or plans to create them. The biggest risk for small‑ and medium‑sized businesses (SMBs) is not reckless AI use but invisible workflow changes that leave sensitive data exposed. Researchers urge SMBs to adopt simple, clear policies that define approved tools, restrict sensitive data, and require human oversight before AI‑generated content is used in legal work. Leer más

Harper, an AI-native commercial insurance brokerage founded by Dakotah Rice and Tushar Nair, announced a $46.8 million combined Series A and seed round. Launched in 2024 as part of Y Combinator's W'25 batch, the company uses artificial intelligence to automate underwriting, document collection, and pipeline management, allowing it to serve more than 5,000 small- and mid-sized businesses across 160 carriers. Investors include Y Combinator, Peak XV Partners, and Emergence Capital. The new capital will expand Harper’s engineering team and brand, positioning the firm to become a central risk and compliance partner for entrepreneurs in middle America. Leer más

Two technology firms, Massive and Valere, have moved to restrict or ban the use of the AI-driven tool OpenClaw after internal security assessments revealed potential risks. Massive warned staff before any deployment, while Valere initially prohibited the tool, later permitting limited research under strict controls. Executives highlighted fears that the bot could access cloud services, credit‑card data, and code repositories, and noted its ability to conceal its actions. Researchers advised limiting command access and password‑protecting its control panel, emphasizing that users must accept the possibility of manipulation through malicious inputs. Leer más

Enterprises adopting AI agents are exposing gaps in conventional identity and access management. Unlike static rule‑based systems, AI agents reason about data to achieve outcomes, often bypassing predefined permissions. This creates a new risk where context and intent become the attack surface, rendering role‑based and attribute‑based controls insufficient. Experts suggest shifting security focus from static access to governing intent, employing dynamic authorization, provenance tracking, and human‑in‑the‑loop oversight to mitigate the emerging threat of contextual privilege escalation. Leer más

Enterprises are rapidly integrating AI agents into core functions, with more than half of companies already deploying them. Despite this swift adoption, systematic verification and oversight remain largely absent. The agents are being trusted with critical tasks in sectors such as banking and healthcare, raising concerns about safety, accuracy, and potential manipulation. Industry experts argue that without multi‑layered testing frameworks and clear exit strategies, organizations risk exposing themselves to costly errors and systemic failures. The need for structured guardrails is growing as AI agents take on increasingly high‑stakes roles. Leer más

OpenAI CEO Sam Altman revealed a new Head of Preparedness position with a salary of $555,000 plus equity. The role is described as high‑stress and will focus on understanding potential abuses of advanced AI models, guiding safety decisions, and securing OpenAI’s systems. Altman noted a preview of mental‑health impacts linked to AI use in 2025 and referenced a recent rollback of a GPT‑4o update after concerns about harmful user behavior. The position will lead a small, high‑impact team within OpenAI’s Preparedness framework, following previous occupants Aleksander Madry, Joaquin Quiñonero Candela, and Lilian Weng. Leer más

European banks could eliminate more than 200,000 jobs by 2030 as artificial intelligence reshapes back‑office, risk and compliance functions. The projected cuts represent roughly 10 percent of the workforce at 35 major banks, with efficiency gains of about 30 percent touted as the primary driver. Institutions such as AB Amro and Société Générale have already signaled aggressive staffing reductions, while some industry leaders warn that rapid automation may erode essential banking skills. The trend mirrors similar AI‑focused workforce strategies emerging in the United States. Leer más

Anthropic chief executive Dario Amodei told reporters that the AI sector faces a complex risk environment that could resemble a bubble. While bullish on the technology’s potential, he cautioned that some rivals may take imprudent bets, especially around the timing of economic value, data‑center investment, and chip depreciation. Amodei highlighted the uncertainty of revenue growth, the need for disciplined risk management, and the danger of “YOLO‑style” strategies that could jeopardize companies’ financial health. Leer más

Companies are confronting a new wave of expense fraud as artificial intelligence tools enable the creation of highly realistic receipt images. Demonstrations of AI‑produced receipts show detailed itemization, paper texture and signatures that can deceive human reviewers. Financial leaders report that a growing share of fraudulent expense submissions are AI‑generated, prompting firms to adopt AI‑based detection systems that examine metadata and contextual cues. Research indicates that many chief financial officers believe employees are using AI to falsify travel expenses, highlighting the expanding risk and the need for more sophisticated controls. Leer más

OpenAI and Anthropic are confronting high‑profile lawsuits alleging copyright infringement and wrongful death, while also exploring insurance solutions to manage emerging legal risks. OpenAI, which has raised nearly $60 billion, is evaluating structures such as captives but has not yet established one. Anthropic agreed to a $1.5 billion settlement in a class‑action suit over the use of pirated books. Both companies face the prospect of substantial statutory damages and are weighing the financial implications of potential future claims. Leer más

Financial experts caution retail investors about treating ChatGPT and similar AI chatbots as reliable stock‑selection tools. While AI models can offer insightful analysis, they often misquote figures, lean on outdated narratives, and lack access to premium research behind paywalls. The rise of AI‑driven investing follows decades of online trading evolution, from early broker platforms to robo‑advisors. Analysts stress that without proper risk management and a clear investment strategy, over‑reliance on generative AI could expose investors to significant losses, especially during market downturns. Leer más

Generative AI, once celebrated chiefly for speed and efficiency, is now being recognized for its ability to sharpen corporate decision‑making. Early gains such as time savings in coding and content creation have given way to deeper strategic uses, including market analysis, risk modeling, and merger‑acquisition insight. While the technology promises powerful forecasting and scenario planning, experts caution that proper training and skeptical oversight are essential to avoid misleading outputs. Companies that embed generative AI thoughtfully into existing workflows can unlock a strategic edge that goes far beyond mere productivity. Leer más

AI agents—autonomous, task‑driven models with tool access—are moving from experimental tools to integral teammates in enterprises. Companies are leveraging them for functions such as supplier negotiations, payment terms, and dynamic pricing, which were once handled by human analysts. This shift brings significant security and governance challenges, as agents require onboarding, risk thresholds, and clear escalation paths similar to human employees. Leaders are establishing AI steering committees and Chief AI Officer roles to embed organizational values and safeguards into agent behavior, aiming to balance rapid innovation with responsible oversight. Leer más