Full-Service Law Firm solving complex challenges through bold thinking, precise execution, and shared purpose.

Full Service Law Firm | Michael Best & Friedrich LLP

Specializing in the Intersection of Business &amp; Government

Meet our team of trusted advisors, strategic thinkers, and community builders dedicated to client success.

Learn about our full-service legal and business solutions, designed to address complex challenges for leading organizations across industries.

Access thought leadership, news, and resources to stay informed about the latest trends, legal developments, and industry innovations.

Discover how partnership, bold thinking, and precise execution drive results for clients nationwide.

Explore how our national reach and local expertise support clients across the United States and beyond.

Grow at a firm designed to bring out your best.

<p>When AI broke out of science fiction and into our everyday lives, it was Large Language Models (LLMs) that led the way. While LLMs may have gotten all the attention, small AI models are emerging as the next “big” thing. Big tech is still pumping billions into training and running large models. Meanwhile, some startups are embracing the more affordable approach of small models. Venture capital firms are taking notice of the potential of small models. Arcee.AI, which develops and applies these compact models, raised $24 million in Series A financing in July of this year.</p><p>LLMs are trained on large general data sets. They know a little about a lot of things. Small models are less expensive to build out and operate and are more easily adapted to specialized applications. Rather than try to do everything, small models are personalized to perform a more limited set of day-to-day tasks for a particular business need. For example, Arcee.AI trained a small model that can answer tax questions for Thomson Reuters and built a career coach chatbot for Guild, an upskilling company.</p><h2><strong>Why are small AI models gathering steam?</strong></h2><p>Small models have several advantages that may give them an edge over large models in the coming years. Their key advantage - their size - is in the name. LLMs have billions of parameters and require massive amounts of data and computational power to train and run. Small models, on the other hand, can be trained effectively with less data and require much less computing power (and therefore energy) to run. </p><h3><i><strong>Ease and Cost of Deployment</strong></i></h3><p>Their size makes small models more suitable for deployment on edge devices or in resource-constrained environments. For example, a small business could run its own custom-trained model locally on its own hardware. In some instances, that hardware could be portable devices, such as laptops, tablets, or even smart phones.</p><p>Small models are focused on a specific use case, and are typically faster to train than LLMs, which can take weeks or even months to train on a single GPU. Small models can be trained in hours or days, allowing for faster iteration and improvement of specialized applications. They also require less training data, making them more suitable for applications where high-quality training data is scarce. For example, a business may want to train a model to output documents in their preferred format, meaning their training data is limited to their internal data. With a small model, this may not be a problem.</p><h3><i><strong>Adaptability</strong></i></h3><p>Adapting an LLM may require significant changes to the model's architecture. However, because they learn from a smaller dataset, small models can be adapted to different tasks by changing a few parameters. Small models can be developed using transfer learning techniques, which enable them to leverage pre-trained knowledge and adapt it to new tasks and applications. This flexibility makes small models more appealing in situations where requirements change rapidly or the problem domain is complex and evolving, for example, in fast-paced small business environments and startup operations.</p><h3><i><strong>Interpretability</strong></i></h3><p>One disadvantage of LLMs is that it can be difficult or impossible to determine how a model arrived at its answer. However, small AI models are often more interpretable than large LLMs, making it easier to understand how they arrive at their decisions. This can be a critical distinction in fields like law, where how an answer is arrived at needs to be understood.</p><h2><strong>What are the risks?</strong></h2><p>As industries continue to explore the potential of small AI models, understanding how to protect intellectual property in this rapidly evolving space becomes critical. Small AI models offer unique advantages for businesses, but they also raise new challenges for IP protection. If a business provides training data, will it remain confidential to the business? Does incorporating it into a customized small model affect ownership of that data? Who owns the newly trained model, and can it be relicensed to others, either by the company that produced the model or the company that commissioned its production? Looking to small models may be a smart business move, but those who do so must be prepared to navigate the legal complexities involved to safeguard their businesses.</p><input type='hidden' id='passle-remote-hosting-tracking-shortcode' value='102jjeq'/><blockquote class="wp-block-quote passle-quote has-cite-link"><p>“You can be more narrow and focused with your model when it’s a smaller model and really zone in on the task and use case,” McQuade said, “as opposed to having a model that can do everything and anything you need to do.”</p><cite><a href="https://www.itprotoday.com/ai-machine-learning/move-over-llms-small-ai-models-are-the-next-big-thing" aria-label="www.itprotoday.com/..." title="https://www.itprotoday.com/ai-machine-learning/move-over-llms-small-ai-models-are-the-next-big-thing" target="_blank">www.itprotoday.com/...</a></cite></blockquote><div class="passle-featured-image passle-featured-image-position-bottom"><img src="https://images.passle.net/fit-in/400x400/filters:crop(0,0,2115,1187)/Passle/5f6edd8e8cb62a0bec3e5fd2/SearchServiceImages/2024-09-17-20-01-24-038-66e9e0147f335913a7369a3c.jpg" alt="Featured Image" /></div>

Will 2025 be the year of the small AI model?

Related People

You may also be interested in these

Michael Best Welcomes Dana Bell as Senior Counsel in Intellectual Property Practice

Copyright or Trade Secret? How Software Companies Should Decide What to Protect—and How

Seventh Circuit Grapples with BIPA Amendment.

Related People

You may also be interested in these

Michael Best Welcomes Dana Bell as Senior Counsel in Intellectual Property Practice

Copyright or Trade Secret? How Software Companies Should Decide What to Protect—and How

Seventh Circuit Grapples with BIPA Amendment.

Slide Menu

Slide Search