Highlights:
- Databricks developed a software engine known as DatabricksIQ using technologies from MosaicML.
- Databricks Assistant can simplify associated chores like refining an existing Python script that data scientists at a company use for analytics initiatives.
Data Intelligence Platform, a new product from Databricks Inc., leverages artificial intelligence to assist businesses in processing their data.
The platform is built on Databricks’ flagship product, data lakehouse, which combines data lakes and data warehouse features into one package. With access to SQL support and error prevention features, lakehouses provide a centralized environment for analyzing structured, unstructured, and semi-structured data.
The newly described Data Intelligence Platform combines Databricks’ data lakehouse with technology that the company got when it bought MosaicML Inc. for USD 1.3 billion in June. Naveen Rao, former Vice President of Intel Corp.’s AI products group, co-founded MosaicML and acquired capital from investors like General Analyst. It provided a set of pre-trained large language models and a platform for creating neural networks.
Databricks developed a software engine known as DatabricksIQ using technologies from MosaicML. This engine powers the new Data Intelligence Platform of the company. In the months before DatabricksIQ’s recent formal launch, Databricks provided details of several features.
Databricks Assistant is one component that enables users to query data with natural language prompts. The software automatically converts these prompts into Python code or SQL queries. Additionally, Databricks Assistant can simplify associated tasks like refining an existing Python script that data scientists at a company use for analytics initiatives.
Databricks CEO Ali Ghodsi, other Co-founders, and Rao reported, “Leveraging AI models, DI Platforms enable working with data in natural language, tailored to each organization’s jargon and acronyms. The platform observes how data is used in existing workloads to learn the organization’s terms and offers a tailored natural language interface to all users – from nonexperts to data engineers.”
Databricks explained that AI elements are also included in its current Unity Catalog tool. Using a centralized inventory of a company’s internal data assets, the tool makes it easier for employees to locate specific documents. Databricks claims that Unity Catalog uses artificial intelligence (AI) to automatically classify and describe data assets, making them easier to find.
The business is utilizing AI to optimize specific backend elements of its lakehouse platform in addition to user-facing capabilities. The company stated that a neural network powers the autoscaling technique of its Delta Live Tables extract, load tool, transformer, and Serverless Jobs feature. Additionally, the business is rewriting user inquiries using AI to speed them up.
A lot of CEOs and executives have already embraced the Data Intelligence Platform, according to Ghodsi, who spoke with Forbes. Healthcare practitioners are also taking advantage of the offer. Ghodsi claims that certain medical faculty members at Tufts University use the platform to examine patient information.
The executive continued by saying that Databricks is also witnessing high demand for the AI development tools on its platform. According to Ghodsi, the business has rented 15,000 cloud-based graphics cards to assist clients with AI projects. Due to heavy usage, some chips are currently at capacity. Thus, some customers will have to wait to use them.
Databricks is seeing tremendous revenue growth because of this demand. Following a September investment round of more than USD 500 million, the business revealed that its annualized revenue run rate now surpasses USD 1.5 billion. After surpassing 50% year-over-year sales growth in the second quarter, Databricks reached this milestone.