featureHow AI is impacting data governanceKey to the success of any large organization is effective governance of a vast, distributed landscape of data stores. AI can help.By Jozef de VriesJun 18, 20247 minsGenerative AIData GovernanceArtificial Intelligence analysis Microsoft Fabric evolves from data lake to application platformBy Simon BissonJun 13, 20247 minsMicrosoft AzureNatural Language ProcessingData Architecturenews Databricks races with Snowflake to open up data catalog source codeBy Anirban GhoshalJun 12, 20244 minsOpen SourceData Management featureSolving the data quality problem in generative AIBy Alex Watson Jun 11, 20247 minsGenerative AIData GovernanceData Quality featureHow a data exchange platform eases data integrationBy David Boskovic Jun 06, 20249 minsData IntegrationData Management newsDatabricks to acquire storage platform maker TabularBy Anirban Ghoshal Jun 04, 20245 minsTechnology IndustryOpen SourceData Management newsSnowflake adopts open source strategy to grab data catalog mind shareBy Anirban Ghoshal Jun 03, 20245 minsData WarehousingData Management newsMicrosoft Fabric adds real-time intelligence, workload development kitBy Anirban Ghoshal May 21, 20246 minsBusiness IntelligenceData IntegrationMachine Learning newsTeradata adds support for Apache Iceberg, Delta Lake tablesBy Anirban Ghoshal Apr 30, 20242 minsAnalyticsData Management ArticlesfeatureThe dawn of intelligent and automated data orchestrationEnterprise workflows desperately need what iPhone and Android users have enjoyed for years—ready access to files wherever and whenever they’re needed, regardless of where the files are physically located. By Trond Myklebust Apr 23, 2024 11 minsCloud StorageData ManagementanalysisData pipelines for the rest of usApache Airflow is a great data pipeline as code, but having most of its contributors work for Astronomer is another example of a problem with open source.By Matt Asay Apr 15, 2024 6 minsPythonData IntegrationOpen SourcefeatureExploring the Apache ecosystem for data analysisHow Apache Arrow, Apache Parquet, Arrow Flight, and DataFusion bring enhanced data processing capabilities to large volumes of time series and other data. By Anais Dotis-Georgiou Apr 11, 2024 8 minsOpen SourceAnalyticsData ManagementanalysisWhat is Apache Spark? The big data platform that crushed HadoopFast, flexible, and developer-friendly, Apache Spark is the leading platform for large-scale SQL, batch processing, stream processing, and machine learning.By Ian Pointer Apr 03, 2024 10 minsApache SparkHadoopMachine LearningnewsSnowflake’s Data Clean Room promises to ease analysis of PII dataFree Snowflake Native Application appears to eliminate the complexity of self-managing a data clean room for non-technical users, analysts said.By Anirban Ghoshal Mar 28, 2024 4 minsData GovernanceData ScienceMachine LearningnewsMicrosoft unveils Copilot for Azure SQL DatabaseAI assistant available in private preview provides natural language to SQL conversion and self-help for database administration.By Paul Krill Mar 27, 2024 2 minsMicrosoft AzureGenerative AIDatabasesfeatureThe world needs more (and better) open map dataThe best map data and the most advanced mapping features have been proprietary. The Overture Maps Foundation aims to change that. By Marc Prioleau Mar 25, 2024 8 minsOpen SourceAnalyticsData ManagementnewsDatabricks acquires Lilac AI to boost data quality for LLM trainingLilac AI’s suite of products when integrated with Databricks could help enterprises explore their unstructured data and use it to build generative AI applications.By Anirban Ghoshal Mar 20, 2024 3 minsGenerative AIData ManagementfeatureHow LLMs can help streamline business processesLarge language models can reshape business processes by automating substantial portions of complex tasks. But they can’t do it alone. By Manoj Chaudhary Mar 19, 2024 5 minsGenerative AIData IntegrationArtificial IntelligenceanalysisA change in the machine learning landscapeAI models that use data where it exists rather than centralizing it require stronger privacy and security measures. Introducing the RoPPFL framework.By David Linthicum Mar 19, 2024 5 minsMachine LearningArtificial IntelligenceCloud ComputingnewsAlation extends its Data Lineage capabilitiesThe new feature — business lineage — provides business users with a visual map of the metadata as it flows across enterprise systems.By Anirban Ghoshal Mar 11, 2024 4 minsData ManagementnewsLinkedIn open sources lakehouse tool OpenHouseThe tool is already in use at LinkedIn with more than 3,500 managed OpenHouse tables in production, serving more than 550 daily active users.By Anirban Ghoshal Mar 08, 2024 5 minsData Management Show more Show less View all Upcoming Events19/Sep conference The Official CIO Summit UKSep 19, 20249:00 AM – 17:30 PM GMTCounty Hall, London CIO 19/Sep awards CIO 100 Awards UKSep 19, 2024County Hall, London CIO 01/Oct conference DevOps Summit UKOct 01, 20249:00 AM – 17:30 PM GMTAndaz London Liverpool Street CIO View all events Video on demand videoHow to use dbm to stash data quickly in PythonSometimes with a program you just need a quick and dirty way to persist values across to disk. The dbm module in Python provides a native way to do this across platforms, with no more effort than you’d need to save values in a dictionary. Learn in this video the basics of how it works, and how it’s been updated to use SQLite as a storage backend. Jul 04, 2024 4 minsPython How to auto-generate Python type hints with Monkeytype Jun 11, 2024 5 minsPython How to make HTML GUIs in Python with NiceGUI Jun 04, 2024 5 minsPython Python 3.13’s new JIT and no-GIL modes May 23, 2024 7 minsPython See all videos Explore a topic Analytics Artificial Intelligence Careers Cloud Computing Databases Development Tools Devops Emerging Technology Generative AI Java JavaScript Microsoft .NET Open Source Programming Languages View all topics All topics Close Analytics Artificial Intelligence Careers Cloud Computing Databases Development Tools Devops Emerging Technology Generative AI Java JavaScript Microsoft .NET Open Source Programming Languages Python Security Software Development Technology Industry Show me moreLatestArticlesVideos analysis Beyond the usual suspects: 5 fresh data science tools to try today By Serdar Yegulalp Jul 12, 20242 mins PythonProgramming LanguagesSoftware Development analysis Generative AI won’t fix cloud migration By David Linthicum Jul 12, 20245 mins Generative AIArtificial IntelligenceCloud Computing news HR professionals trust AI recommendations By Paul Krill Jul 11, 20243 mins Technology IndustryCareers video How to use Cython for parallel operations in Numpy arrays May 14, 20246 mins Python video How to use Ibis, a universal Python dataframe library May 09, 20245 mins Python video Better async in Python with AnyIO May 02, 20245 mins Python