#DataCatalog
LightNews LightNews
alextalksdatalakehouses.fyi
Data Catalog – A metadata management tool that organizes, indexes, and governs datasets for discoverability and compliance. #DataCatalog
February 24, 2025 at 8:53 PM
joker1007.bsky.social
Glue DataCatalogのicebergテーブルに対するマネージドコンパクションの挙動がどうもよく分からん。全体で256パーティションになる様にバケット分割してるんだが、各パーティションのファイル数を計測してると、どうも全体の1/3程度しかcompactionされてない様に見える。
October 12, 2025 at 6:46 AM
yinxisang.bsky.social
Ooops I thought I attached the link lol, turns out I didn't. Here you go: data.usgs.gov/datacatalog/...
They have data for 20 polar bears but I mapped only one of them (the most active one 🤣)
USGS Science Data Catalog
Author: Chirag H Shah, Publisher: Science Data Management, Keywords: SDC, Science Data Catalog, USGS Data
data.usgs.gov
November 12, 2024 at 4:00 AM
hubbucketnyc.bsky.social
U.S. Geological Survey | Science Data Catalog (SDC)

✅ USGS: data.usgs.gov/datacatalog/
January 25, 2025 at 4:13 PM
ssp.sh

> #DataOrchestrators: Automate pipeline workflows
> #DataCatalog: Asset inventory with metadata
> #DataContracts: Define data exchange agreements
> #DataGovernance: Manage data availability & security
> #Idempotency: Repeatable operations
> #GraphDatabases: DBs with graph structures
January 13, 2025 at 3:59 PM
azureweekly.endj.in
A Bird's Eye View with Microsoft Purview by Margaret Farmer #SharePoint #AzureDataFactory #DataCatalog #MicrosoftFabric techcommunity.microsoft.com/t5/nonprofit...
A Bird's Eye View with Microsoft Purview | Microsoft Community Hub
  image of Microsoft Purview Cloud platform integration. All credits and trademarks belonging to Microsoft. Compliance, Security, &...
techcommunity.microsoft.com
April 16, 2025 at 10:55 PM
tech-trending.bsky.social
データカタログ特集　データ利活用に向けたアーキテクチャ6選 - Findy Tools
https://findy-tools.io/articles/datacatalog/9
データカタログ特集　データ利活用に向けたアーキテクチャ6選 - Findy Tools
整備したデータ基盤を、事業部や会社全体で活用に持っていく中で「データカタログ」の必要性が増々注目を集めています。 今回は、データカタログを導入し、データ利活用に挑んでいる6社に、アーキテクチャの工夫ポイントからデータカタログ導入によって得られた効果などを伺いました。
findy-tools.io
April 4, 2024 at 12:10 AM
azureweekly.endj.in
People of Purview: Karen Lopez by Ren Woods #DataCatalog #AzureSQLDatabase #Azure techcommunity.microsoft.com/t5/microsoft...
People of Purview: Karen Lopez | Microsoft Community Hub
In this latest edition of People of Purview, we are excited to spotlight Karen Lopez. Karen is a seasoned data architect and passionate advocate for the...
techcommunity.microsoft.com
June 29, 2025 at 6:35 PM
thedatanista.bsky.social
𝐔𝐧𝐥𝐨𝐜𝐤𝐢𝐧𝐠 𝐄𝐟𝐟𝐢𝐜𝐢𝐞𝐧𝐜𝐲 𝐚𝐧𝐝 𝐈𝐧𝐬𝐢𝐠𝐡𝐭: 𝐓𝐡𝐞 𝐏𝐨𝐰𝐞𝐫 𝐨𝐟 𝐃𝐚𝐭𝐚 𝐈𝐧𝐯𝐞𝐧𝐭𝐨𝐫𝐲 𝐚𝐧𝐝 𝐂𝐚𝐭𝐚𝐥𝐨𝐠 𝐓𝐨𝐨𝐥𝐬

Enter data inventory and catalog tools—a beacon of order in the data chaos.

𝑪𝒐𝒎𝒑𝒍𝒆𝒕𝒆 𝒂𝒓𝒕𝒊𝒄𝒍𝒆:
www.foxconsulting.co/post/unlocki...

#datainventory #datacatalog #datadiscovery #dataquality #regulatorycompliance
February 22, 2024 at 2:44 AM
ssp.sh
The future of every #datalake, some kind of metastore for you data. Thanks to @lyfteng to open source their #datacatalog solution ❤️
#dataengineering #opensource #metadata #datamanagement #datagovernance #amundsen #bigdata https://link.medium.com/hU9IksJwd1
November 4, 2024 at 7:17 AM
egwada.bsky.social
I was asking me that question :
Can @duckdb be the portable #dataCatalog?
motherduck.com/blog/from-da...
From Data Lake to Lakehouse: Can DuckDB be the best portable catalog? - MotherDuck Blog
Discover how catalog became crucial for Lakehouse and how DuckDB can help as a catalog | Reading time: 12 min read
motherduck.com
November 16, 2024 at 7:53 AM
azureweekly.endj.in
Elevating Trust in Data through Data Quality in the AI Era by Shafiq Mannan #DataCatalog techcommunity.microsoft.com/t5/microsoft...
Elevating Trust in Data through Data Quality in the AI Era | Microsoft Community Hub
Data collection and utilization are growing rapidly, and organizations are increasingly relying on data as they transition into the era of AI. However, many...
techcommunity.microsoft.com
September 17, 2025 at 3:20 PM
jaypowerbi.bsky.social
First Look: #Azure #Data #Catalog #datacatalog http://dutchdatadude.com/first-look-azure-data-catalog/
December 13, 2024 at 7:33 PM
ssp.sh
I hope you find it useful. Let me know in the comments.

#spark #dagster #apacheairflow #amnundsen #apachedruid #parquet #notebooks #declarative #datacatalog #deltalake #machinelearning #ascendio
November 4, 2024 at 7:09 AM
azureweekly.endj.in
Microsoft Purview GA menus by James Serra #DataCatalog #Azure https://www.jamesserra.com/archive/2024/09/microsoft-purview-ga-menus/?utm_source=bluesky&utm_medium=social&utm_campaign=azureweekly
Microsoft Purview GA menu’s | James Serra's Blog
Big Data and Data Warehousing
www.jamesserra.com
September 24, 2024 at 6:35 PM
ssp.sh
#AzurePurview's new #datadiscovery feature including #datalineage looks pretty intriguing. Great to see they take #metadata very serious. I'm curious to find out more how much of it is #apacheatlas and what is built on top. https://youtu.be/27bA4KFiEKk #datamangement # #datacatalog
November 4, 2024 at 6:25 AM
ssp.sh
#dagster #airflow #amnundsen #druid #parquet #notebooks #datacatalog #ascendio #databricks
November 4, 2024 at 7:02 AM
bigdataprep.bsky.social
Need to fast-track your Qlik Talend Data Catalog Certified Implementer (TDCCI) prep? ⏱️ A complete study guide and practice questions are circulating.

www.bigdataprep.com/qlik-talend-...

#QlikTalend #DataCatalog #TDCCI #QlikCertification #QlikTalendDataCatalogImplementer
Qlik Talend TDCCI Study Guide & Practice Questions
Get tools, tips, and resources to ace the TDCCI exam and earn the Qlik Talend Data Catalog Certified Implementer credential with this guide
www.bigdataprep.com
November 1, 2025 at 7:33 AM
opentopography.org
NOAA Coastal Lidar & USGS 3DEP are available from OT:
portal.opentopography.org/dataCatalog?...
portal.opentopography.org/dataCatalog?...

We access via Amazon Registry of Open Data:
registry.opendata.aws/noaa-coastal...
registry.opendata.aws/usgs-lidar/

Feds publish data to the buckets.
January 28, 2025 at 8:10 PM
thedatanista.bsky.social
#DataDictionary vs. #DataCatalog

To use them effectively, it's important to grasp their unique roles, characteristics, and benefits: www.foxconsulting.co/post/data-di...

Ready to transform your data ecosystem? Start with the tool that aligns with your current goals—and grow from there.
January 3, 2025 at 9:28 PM
wstrasser.bsky.social
Browse your #MicrosoftFabric items in #MicrosoftPurview #DataCatalog

techcommunity.microsoft.com/t5/security-...
November 28, 2023 at 9:46 AM
ssp.sh
You often don't need a heavy #datacatalog tool; a simple list of your tables (s3, db), their columns, and maybe lineage might be enough.

The @dagster.bsky.social catalog looks great because of its rich metadata, such as owner, asset view. A nice showcase of a catalog within the orchestrator.
Dagster Data Catalog Demo
YouTube video by Dagster
youtu.be
November 4, 2024 at 12:33 PM
fabconeurope.bsky.social
🚀 #FabConEurope Session: (Almost) Everything You Wanted To Know About Purview Data Governance
📢 Speaker: @barneylawrence.bsky.social

Learn more 👉 ow.ly/HOCQ50WgRAC

#Microsoft #FabCon #MicrosoftPurview #DataGovernance #DataCatalog #UnifiedData #TrustedData #MicrosoftFabric
July 24, 2025 at 8:19 AM