모델 설명

This study explores the application of Large Language Models (LLMs) in the economics domain, an area where the use of LLMs is relatively unexplored compared to fields such as medicine, law, and education. Recognizing the potential for LLMs to interpret complex economic data and answer in-depth questions, we aimed to bridge the current gap by fine-tuning an open-source LLM, LLaMA, with domain-specific economic data. Our approach involved the use of the Direct Preference Optimization (DPO) method for fine-tuning a 7B model using a dataset constructed from National Bureau of Economic Research (NBER) Working Papers. We paired this with a novel application of Retrieval- Augmented Generation (RAG), where the model retrieves relevant information from the training data to minimize hallucination and ensure answer reliability.

By integrating model quantization and the Low-Rank Adaptation (LoRA) method, we optimized the model for reduced memory usage and inference time, making it suitable for use in resource-constrained environments. The study's results demonstrated that the fine-tuned model could provide concise, economically insightful answers, improving over the pre-tuned model in terms of efficiency and depth of analysis. These outcomes suggest that with careful domain-specific fine-tuning, LLMs can be invaluable tools for economic research, offering new possibilities for data interpretation and analytical depth with limited resources. This research not only highlights the feasibility of using LLMs in economics but also presents a methodological foundation for further exploration and application in domain-specific contexts.

URL

https://sgenkollama.streamlit.app/

(위 URL에서 사용 가능합니다.)

사용 예시

Input: What are the differences between Microeconomics and Macroeconomics?

Response:

Microeconomics and macroeconomics are two branches of economics that focus on different aspects of the economy. Microeconomics is concerned with the behavior and decision-making of individual consumers and firms, while macroeconomics focuses on the overall performance of the economy. In other words, microeconomics studies the actions of individual economic agents, such as households and firms, while macroeconomics examines the economy-wide aggregates, such as GDP, inflation, and unemployment. Both branches of economics use mathematical models and statistical analysis to understand economic phenomena, but they differ in their level of analysis and the types of questions they seek to answer. Microeconomics is more concerned with understanding the behavior of individual consumers and firms, while macroeconomics looks at the overall performance of the economy.