 
{"id":103422,"date":"2024-11-15T04:12:00","date_gmt":"2024-11-15T04:12:00","guid":{"rendered":"https:\/\/www.globallogic.com\/uki\/?post_type=news&#038;p=103422"},"modified":"2024-11-25T12:33:56","modified_gmt":"2024-11-25T12:33:56","slug":"operationalising-gen-ai-at-scale-responsibility-reliability-and-reusability-as-key-to-enterprise-grade-integrations","status":"publish","type":"news","link":"https:\/\/www.globallogic.com\/uki\/about\/press-room\/media-coverage\/operationalising-gen-ai-at-scale-responsibility-reliability-and-reusability-as-key-to-enterprise-grade-integrations\/","title":{"rendered":"Operationalising Gen AI at scale: Responsibility, reliability, and reusability as key to enterprise-grade integrations"},"content":{"rendered":"\n<p><em>Principal Consultant at GlobalLogic, Dr Caterina Constantinescu, shares her insights on the key challenges and how enterprises can overcome them when moving Gen AI from pilot projects to enterprise-scale deployment<\/em><\/p>\n\n\n\n<p>As the world hurtles towards a future shaped by artificial intelligence (AI), it&#8217;s becoming increasingly clear that using this technology requires more than just sending prompts to a large language model (LLM). Enterprises are grappling with the daunting task of scaling generative AI (Gen AI) from mere prototypes to fully-fledged, business-wide deployments, a challenge that demands their utmost attention and strategic solutions.<\/p>\n\n\n\n<p>The promise of Gen AI is not just enticing\u2014it&#8217;s truly inspiring. It holds potentially transformative capabilities that can revolutionise business processes, enhance customer experiences, and drive innovation. So much so, that in a recent report, McKinsey estimates <a rel=\"external nofollow\" target=\"_blank\" href=\"https:\/\/www.mckinsey.com\/capabilities\/mckinsey-digital\/our-insights\/the-economic-potential-of-generative-ai-the-next-productivity-frontier#key-insights\">Gen AI could add trillions of dollars in value to the global economy<\/a>.&nbsp;<\/p>\n\n\n\n<p>However, beneath the surface lies a complex landscape fraught with critical challenges and potential pitfalls that demand careful navigation and open conversations.<\/p>\n\n\n\n<p><strong>Challenges on the path to scale<\/strong><\/p>\n\n\n\n<p><strong>Data dilemmas: Safeguarding intellectual property (IP) and protecting privacy<\/strong><\/p>\n\n\n\n<p>At the heart of Gen AI lies data\u2014it is the lifeblood that powers its creative engines. Yet, this very data poses significant risks. Enterprises must grapple with the delicate balance between harnessing data for innovation and safeguarding IP and data privacy. <a rel=\"external nofollow\" target=\"_blank\" href=\"https:\/\/www.cisco.com\/c\/en\/us\/about\/trust-center\/data-privacy-benchmark-study.html#~responsible-innovation\">Cisco\u2019s 2024 Data Privacy Benchmark Study<\/a>, for example, reveals that seven in ten enterprises cite threats to legal and IP rights (69 per cent) and the risk of disclosure to the public or competitors (68 per cent) as their top concerns.&nbsp;<\/p>\n\n\n\n<p>Research also indicates that customer experience management (CXM) leaders share similar concerns. <a rel=\"external nofollow\" target=\"_blank\" href=\"https:\/\/assets.ctfassets.net\/3viuren4us1n\/5DxgHVhazZI6laS2jp8tAR\/721a29e76e58d7df94a15f6a5b12c2aa\/Enterprise_Readiness_for_Generative_AI_Adoption_in_CXM.pdf\">Ninety-four per cent say it\u2019s affecting their organisation\u2019s ability to adopt and implement Gen AI solutions<\/a>. It\u2019s safe to say that the fear of proprietary information and data leakage looms large, necessitating robust mechanisms to safeguard IP and protect privacy.&nbsp;<\/p>\n\n\n\n<p><strong>Navigating minefields: Governance, risk and compliance (GRC):&nbsp;<\/strong><\/p>\n\n\n\n<p>Gen AI\u2019s potential extends beyond business or technical metrics. It touches legal, ethical, and reputational realms. But, organisations must tread carefully, ensuring compliance with industry regulations and legal requirements.&nbsp;<\/p>\n\n\n\n<p>The cost of non-compliance is continuously growing in line with the introduction of legislation by various jurisdictions, such as the European Union\u2019s <a rel=\"external nofollow\" target=\"_blank\" href=\"https:\/\/artificialintelligenceact.eu\/ai-act-explorer\/\">EU AI Act<\/a>. Such sanctions intend to be effective, proportionate, and dissuasive. In other words, the larger the enterprise, the greater the penalty.&nbsp;<\/p>\n\n\n\n<p>The lowest infringement in the EU AI Act is providing incorrect, incomplete, or misleading information. Yet, this carries administrative fines of up to 1 per cent of total worldwide turnover, or \u20ac7.5 million, whichever is higher. Thus, the challenge lies in leveraging AI\u2019s power while avoiding GRC minefields.&nbsp;<\/p>\n\n\n\n<p><strong>Customisation complexity: Integrating and aligning with existing infrastructure&nbsp;<\/strong><\/p>\n\n\n\n<p>Achieving seamless coexistence between Gen AI and legacy systems or domain-specific models is a massive demand. Existing technology infrastructure, often the backbone of everyday operations, is designed for specific purposes only, meaning it can\u2019t necessarily fulfil state-of-the-art Gen AI requirements.&nbsp;<\/p>\n\n\n\n<p>Implementing Gen AI tools and platforms that feed on modern, adaptable, and scalable architectures, like microservices around legacy systems based on antiquated frameworks and programming languages, is a substantial task. So is reconciling the variations in data formats and standards generated by existing infrastructure so that Gen AI applications can interpret and process data effectively.&nbsp;<\/p>\n\n\n\n<p><strong>Change management: Minimising disruptions during transition<\/strong><\/p>\n\n\n\n<p>Transitioning from pilot projects to enterprise-wide Gen AI adoption requires considerable adaptation. Ensuring a smooth transition without compromising safety, productivity, user experience, or customer satisfaction is problematic.&nbsp;<\/p>\n\n\n\n<p>Gen AI necessitates reimagining an enterprise\u2019s policies, processes, and workflows. Employees, in particular, bear the brunt of this shift. Of the 750 global chief information officers (CIO) surveyed by <a rel=\"external nofollow\" target=\"_blank\" href=\"https:\/\/p4-ofp.static.pub\/ShareResource\/ww\/docs\/lenovo-global-cio-report-2024.pdf\">Lenovo<\/a>, only four in ten felt their organisation had sufficient operational understanding beyond the IT function to be AI-ready.&nbsp;<\/p>\n\n\n\n<p>As noted by the International Monetary Fund (IMF) <a rel=\"external nofollow\" target=\"_blank\" href=\"https:\/\/www.imf.org\/-\/media\/Files\/Publications\/SDN\/2024\/English\/SDNEA2024001.ashx\">Gen-AI: Artificial Intelligence and the Future of Work<\/a> report, older, less digitally savvy workers are particularly vulnerable to failure. Enterprises trying to implement change management that minimises disruption during transitions can, then, find themselves paddling against the tide.&nbsp;<\/p>\n\n\n\n<p><strong>Business alignment: Controlling costs and driving returns on investment (ROI)&nbsp;<\/strong><\/p>\n\n\n\n<p>The allure of Gen AI can blind organisations to practical considerations. ROI relies on controlling costs, maximising returns, and ensuring Gen AI initiatives positively contribute to strategic objectives. Yet, Lenovo also reports that 61 per cent of CIOs find it very or extremely difficult to demonstrate ROI from tech investments.&nbsp;<\/p>\n\n\n\n<p>Perhaps more noteworthy is that while almost all CIOs expect AI investments to increase, half say it is pulling attention and resources away from other key IT areas like cloud adoption (48 per cent), sustainability (38 per cent), and employee compensation (38 per cent). These findings suggest that many enterprises miscalculate costs, meaning they underestimate the impact on enterprise-wide ROI and fail to ensure total business alignment.<\/p>\n\n\n\n<p><strong>Successful architecture: Ensuring responsibility, reliability and reusability<\/strong><\/p>\n\n\n\n<p>Failing to overcome the challenges laid out above carries steep ethical, legal, and reputational risks. It\u2019s no wonder that many enterprises are hesitant to move Gen AI applications into production.&nbsp;<\/p>\n\n\n\n<p>At GlobalLogic, we recently unveiled a<a rel=\"external nofollow\" target=\"_blank\" href=\"https:\/\/markets.ft.com\/data\/announce\/detail?dockey=600-202404080837BIZWIRE_USPRX____20240408_BW417447-1\"> first-of-its-kind Platform-of-Platforms architecture designed to support the deployment of enterprise-grade AI.<\/a> To quote our Chief Operations Officer and Head of Engineering, Sumit Sood: \u201cWe understand what needs to be done to ensure responsibility, reliability and reusability in AI platforms.\u201d&nbsp;<\/p>\n\n\n\n<p>My extended experience working in AI and machine learning has led me to agree. Integration at scales relies on platform architecture that supports these three factors.&nbsp;<\/p>\n\n\n\n<p><strong>Responsibility<\/strong><\/p>\n\n\n\n<p>The responsibility tenet centres around ensuring Gen AI responses are accurate, lawful, and compliant with security and governance requirements. Transparency in data usage, explicit consent, and secure handling are non-negotiable. Responsibility isn\u2019t just a buzzword; it\u2019s imperative for building trust with users and stakeholders.&nbsp;<\/p>\n\n\n\n<p><strong>Reliability<\/strong><\/p>\n\n\n\n<p>Gen AI models have a tendency to drift, hallucinate, and fall prey to security threats over time. Enterprises need mechanisms to monitor and correct these deviations. Balancing the need for model creativity against use case requirements and wider context ensures reliability. Regular audits, security protocols, and vigilance against vulnerabilities are essential. As is close adherence to MLOps best practices, which is a key feature of our Platform-of-Platforms.<\/p>\n\n\n\n<p><strong>Reusability<\/strong><\/p>\n\n\n\n<p>When organisations reuse standardised approaches and best practices for data ingestion, preparation, and model training mechanisms, the impact of Gen AI multiplies, and the overhead for adoption decreases. Shared consumption ensures not only consistency but also efficiency. The reusability principle posits that rather than reinventing the wheel, enterprises should leverage industry-leading models and algorithms, as well as modern architectures built with reusability in mind\u2014for example, microservices\u2014all supported by expert partnerships.&nbsp;<\/p>\n\n\n\n<p><strong>The key to<\/strong> <strong>operationalising Gen AI at scale: Expert partnerships<\/strong><\/p>\n\n\n\n<p>It\u2019s hardly surprising that <a rel=\"external nofollow\" target=\"_blank\" href=\"https:\/\/www.telusinternational.com\/insights\/ai-data\/resource\/generative-ai-cxm-readiness\">over three-quarters of enterprises are considering outsourcing their Gen AI development to specialist third-party firms<\/a> to mitigate the risks\u2014but choosing the right partner is critical to success.<\/p>\n\n\n\n<p>Embarking on a Gen AI odyssey is no easy feat. If transformative journeys are to be successful, enterprises need expert guides\u2014seasoned specialists who understand the nuances of the terrain, know how to avoid the pitfalls and illuminate the path forward.&nbsp;<\/p>\n\n\n\n<p>What\u2019s needed are partners with a mature understanding of the cutting-edge solution ecosystem who balance tech prowess with an ethical ethos to ensure safeguarding, privacy, and trust in order to guide enterprises to a future where Gen AI powers better business outcomes. Through such partnerships, enterprises thrive, operationalising Gen AI at scale to shape a future where innovation coexists with responsibility, reliability, and reusability.&nbsp;<\/p>\n\n\n\n<p><strong>About <\/strong><strong>Dr Caterina Constantinescu<\/strong><\/p>\n\n\n\n<p>Former doctoral researcher turned data scientist, Caterina now works as Principal Data Consultant at GlobalLogic, where she advises on GenAI, data observability and business impact issues, as well as the custom applications of data science models to industry use cases.&nbsp;<\/p>\n\n\n\n<p><strong>About GlobalLogic<\/strong><\/p>\n\n\n\n<p><a rel=\"external nofollow\" target=\"_blank\" href=\"https:\/\/www.globallogic.com\" title=\"\">GlobalLogic<\/a> is a leader in digital engineering. We help brands across the globe design and build innovative products, platforms, and digital experiences for the modern world. By integrating experience design, complex engineering, and data expertise\u2014we help our clients imagine what\u2019s possible and accelerate their transition into tomorrow\u2019s digital businesses.\u00a0<\/p>\n\n\n\n<p>Headquartered in Silicon Valley, GlobalLogic operates design studios and engineering centers around the world, extending our deep expertise to customers in the automotive, communications, financial services, healthcare and life sciences, manufacturing, media and entertainment, semiconductor, and technology industries. GlobalLogic is a Hitachi Group Company operating under <a rel=\"external nofollow\" target=\"_blank\" href=\"https:\/\/www.hitachi.com\/\">Hitachi, Ltd.<\/a> (TSE: 6501), which contributes to a sustainable society with a higher quality of life by driving innovation through data and technology as the Social Innovation Business.<\/p>\n\n\n\n<p>Read the original article here.<\/p>\n\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Principal Consultant at GlobalLogic, Dr Caterina Constantinescu, shares her insights on the key challenges and how enterprises can overcome them when moving Gen AI from pilot projects to enterprise-scale deployment As the world hurtles towards a future shaped by artificial intelligence (AI), it&#8217;s becoming increasingly clear that using this technology requires more than just sending prompts to a large language model (LLM). Enterprises are grappling with the daunting task of scaling generative AI (Gen AI) from mere prototypes to fully-fledged, business-wide deployments, a challenge that demands their utmost attention and strategic solutions. The promise of Gen AI is not just enticing\u2014it&#8217;s truly inspiring. It holds potentially transformative capabilities that can revolutionise business processes, enhance customer experiences, and drive innovation. So much so, that in a recent report, McKinsey estimates Gen AI could add trillions of dollars in value to the global economy.&nbsp; However, beneath the surface lies a complex landscape fraught with critical challenges and potential pitfalls that demand careful navigation and open conversations. Challenges on the path to scale Data dilemmas: Safeguarding intellectual property (IP) and protecting privacy At the heart of Gen AI lies data\u2014it is the lifeblood that powers its creative engines. Yet, this very data poses&#8230;<\/p>\n","protected":false},"featured_media":103423,"parent":0,"menu_order":0,"template":"","meta":{"_acf_changed":false,"footnotes":""},"news-category":[772],"embedded-category":[],"class_list":["post-103422","news","type-news","status-publish","has-post-thumbnail","hentry","news-category-media-coverage"],"acf":[],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/www.globallogic.com\/uki\/wp-json\/wp\/v2\/news\/103422","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.globallogic.com\/uki\/wp-json\/wp\/v2\/news"}],"about":[{"href":"https:\/\/www.globallogic.com\/uki\/wp-json\/wp\/v2\/types\/news"}],"version-history":[{"count":1,"href":"https:\/\/www.globallogic.com\/uki\/wp-json\/wp\/v2\/news\/103422\/revisions"}],"predecessor-version":[{"id":103424,"href":"https:\/\/www.globallogic.com\/uki\/wp-json\/wp\/v2\/news\/103422\/revisions\/103424"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.globallogic.com\/uki\/wp-json\/wp\/v2\/media\/103423"}],"wp:attachment":[{"href":"https:\/\/www.globallogic.com\/uki\/wp-json\/wp\/v2\/media?parent=103422"}],"wp:term":[{"taxonomy":"news-category","embeddable":true,"href":"https:\/\/www.globallogic.com\/uki\/wp-json\/wp\/v2\/news-category?post=103422"},{"taxonomy":"embedded-category","embeddable":true,"href":"https:\/\/www.globallogic.com\/uki\/wp-json\/wp\/v2\/embedded-category?post=103422"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}