Strategies for Integrating Generative AI in Industrial Settings
  IJCTT-book-cover
 		          
 
© 2024 by IJCTT Journal
Volume-72 Issue-7
Year of Publication : 2024
Authors : Pan Singh Dhoni, Saurabh Shukla, Jagjot Bhardwaj
DOI :  10.14445/22312803/IJCTT-V72I7P112

How to Cite?

Pan Singh Dhoni, Saurabh Shukla, Jagjot Bhardwaj, "Strategies for Integrating Generative AI in Industrial Settings," International Journal of Computer Trends and Technology, vol. 72, no. 7, pp.93-100, 2024. Crossref, https://doi.org/10.14445/22312803/IJCTT-V72I7P112

Abstract
The evolution of ChatGPT has triggered anxiety across the globe, from industries to governments. There has been considerable discussion about this, from scholarly communities to social media and organizational forums. Leading technology companies have started investing heavily in artificial intelligence, which will broadly impact industry and society. The question now arises: how can industry leverage this capability for our betterment and the growth of industries? In this interpretative paper, the authors aim to highlight the best approach to implementing generative Artificial Intelligence in organizations, from small to large. The approach discussed advocates for a step-by-step, or ladder, method, ensuring that the models used yield better outcomes and reduce instances of hallucination. The results suggest that lowering hallucinations and being cost-effective can lead to better outcomes that accurately meet organizational needs. Additionally, the paper highlights the importance of generative AI model security and budget allocation to POCs, with a strong emphasis on the feedback loop to the production of the product, which provides reassurance and confidence in the system's reliability.

Keywords
AI, ChatGPT, Generative AI, LLM, Rag.

Reference

[1] Christof Ebert, and Panos Louridas, “Generative AI for Software Practitioners,” IEEE Software, vol. 40, no. 4, pp. 30-38, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[2] Kalyan Prasad Agrawal, “Towards Adoption of Generative AI in Organizational Settings,” Journal of Computer Information Systems, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[3] David Sweenor, and Kalyan Ramanathan, The CIO’s Guide to Adopting Generative AI: Five Keys to Success, TinyTechMedia LLC, 2023.
[Google Scholar]
[4] Cheonsu Jeong, “Generative AI Service Implementation Using LLM Application Architecture: Based on RAG Model and LangChain Framework,” Journal of Intelligence and Information Systems, vol. 29, no. 4, pp. 129-164, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[5] Shreekant Mandvikar, “Factors to Consider When Selecting a Large Language Model: A Comparative Analysis,” International Journal of Intelligent Automation and Computing, vol. 6, no. 3, pp. 37-40, 2023.
[Google Scholar] [Publisher Link]
[6] Cheonsu Jeong, “A Study on the Implementation of Generative AI Services Using an Enterprise Data-Based LLM Application Architecture,” arXiv, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[7] Andrew Burgess, “Starting an AI Journey,” The Executive Guide to Artificial Intelligence, pp. 91-116, 2017.
[CrossRef] [Google Scholar] [Publisher Link]
[8] Patrick Wendell et al., Lakehouse AI: A Data-Centric Approach to Building Generative AI Applications, 2023. [Online]. Available: https://www.databricks.com/blog/lakehouse-ai
[9] Sandra Durth et al., McKinsey and Company, The Organization of the Future: Enabled by Gen AI, Driven by People, 2023. [Online]. Available: https://www.mckinsey.com/capabilities/people-and-organizational-performance/our-insights/the-organization-of-the-future-enabled-by-gen-ai-driven-by-people
[10] François Candelon et al., BCG, The CEO’s Guide to the Generative AI Revolution, 2023. [Online]. Available: https://www.bcg.com/publications/2023/ceo-guide-to-ai-revolution
[11] Eric Breck et al., “Data Infrastructure for Machine Learning,” SysML Conference, 2018.
[Google Scholar]
[12] Wenqi Jiang et al., “FleetRec: Large-Scale Recommendation Inference on Hybrid GPU-FPGA Clusters,” Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, pp. 3097-3105, 2021.
[CrossRef] [Google Scholar] [Publisher Link]
[13] Alexander Borzunov et al., “Distributed Inference and Fine-tuning of Large Language Models Over the Internet,” Advances in Neural Information Processing Systems, 2024.
[Google Scholar] [Publisher Link]
[14] Bongsu Kang et al., “Prompt-RAG: Pioneering Vector Embedding-Free Retrieval-Augmented Generation in Niche Domains, Exemplified by Korean Medicine,” arXiv, 2024.
[CrossRef] [Google Scholar] [Publisher Link]
[15] Teven Le Scao, and Alexander M. Rush, “How Many Data Points is a Prompt Worth?,” arXiv, 2021.
[CrossRef] [Google Scholar] [Publisher Link]