SuperSkills Ep 2: Inside Unity Catalog Managed Tables

Unity Catalog managed tables run OPTIMIZE, VACUUM & ANALYZE for you automatically — no scheduled maintenance jobs, no manual tuning, and no vendor lock-in on your data. In this episode of SuperSkills, Databricks Developer Advocates Youssef Mrini and Oleksandra Bovkun break down what you actually get from Unity Catalog managed tables — and the one case where you shouldn't use them. What we cover: • Predictive Optimization — a serverless service reads your table metadata and decides when to run OPTIMIZE, VACUUM, and ANALYZE, so you stop scheduling maintenance pipelines. Every operation (and its cost) is tracked in a system table. • Automatic upgrades — safely turn on GA table features like deletion vectors across hundreds or thousands of tables without editing each one. Applied only when safe, only for GA features, after analyzing usage — and can be disabled and rolled back, with a full audit trail. • UNDROP — restore a table you dropped by accident within a graceful retention window (7 days by default; set it to zero to delete immediately). You need permission on the table. • No vendor lock-in — your data stays in open Delta Lake and Apache Iceberg formats in your own data lake, readable and writable from external engines. • SET MANAGED — convert an external table to a managed table in a single command, keeping the same table name, no script changes. • When NOT to use managed tables — the one anti-pattern: reading a table by its storage path, which bypasses Unity Catalog governance. (The full description in the file also embeds the chapter list and your two links.) (The full description in the file also embeds the chapter list and your two links.) Chapters 00:00 The maintenance you forget to run — OPTIMIZE, VACUUM, ANALYZE 00:23 Why managed tables are open (you own your data) 00:31 Predictive Optimization: automatic OPTIMIZE, VACUUM & ANALYZE 01:33 See maintenance operations and cost in system tables 02:04 Automatic upgrades: get features like deletion vectors, no ALTER TABLE 03:06 How automatic upgrades stay safe: GA-only, usage analysis, rollback 03:52 UNDROP: restore an accidentally dropped table 04:38 Drop retention: 7 days by default, zero to delete now 05:11 Are managed tables vendor lock-in? Delta Lake & Apache Iceberg 05:44 SET MANAGED: convert external tables in one command 06:17 When not to use managed tables: path-based access Connect with the community: 🚀 Subscribe to the NextGenLakehouse Newsletter: https://www.nextgenlakehouse.com/ 👥 Join our Reddit Community: https://www.reddit.com/r/databricks/ 🐦 Follow us on X: https://x.com/YoussefMrini 📸 Follow us on Instagram: https://www.instagram.com/nextgenlakehouse 🎥 Follow us on TikTok: https://www.tiktok.com/@nextgenlakehouse