Databricks Fundamentals study notes

Lakehouse platform

• unify your data warehousing and AI use cases on a single platform
• built on open source and open standards

• one consistent data platform across clouds

  Key benefits

  • acid
  • schema enforcement
  • governance support
  • direct access to source data
  • fully scalable
  • open formats
  • structured, unstructured or semi-structured
  • realtime-data collection and reporting

  

  

  Datalakes

  pros:

  • flexible data storage
  • streaming suppor
  • cost efficient
  • support for AI / ML

cons:

• no transactional support
• poor data reliability
• slow analysis performance
• data governance concerns