The Index · Data pipelines

Data pipelines

'The pipeline' — ETL/ELT, ingestion, warehouse modelling. tashan measures 38 capabilities for this work and ranks them by tashan score — a transparent composite of upkeep, freshness and real adoption. How we measure ›

#CapabilitytashanEvidenceHealth
1
Daft server
Dev Tools & CI
78
6k ★active
2
Dev Tools & CI
74
498 ★active
3
Databricks server solid
Dev Tools & CI
72
228 ★active
4
Data Agent Kit Starter Pack server ✓ Google solid
Dev Tools & CI
71
151 ★active
5
Opendataloader PDF server thin
Productivity
70
700 ★active
6
Open Ontologies server solid
Dev Tools & CI
69
212 ★active
7
Datahub Skills server solid
Productivity
66
34 ★active
8
Dev Tools & CI
65
23 ★active
9
Snowflake Cortex Code server wrapper
Productivity
65
32 ★active
10
Sentio AI Kit server solid
Data & Analytics
65
100 ★active
11
Knowledge Catalog server ✓ Google thin
Data & Analytics
63
25 ★active
12
Atlan server
Data & Analytics
61
32 ★active
13
Bigtable server ✓ Google thin
Database
60
20 ★active
14
Versori Skills server thin
Dev Tools & CI
57
12 ★active
15
Orchestra server deep
Dev Tools & CI
56
9 ★active
16
Scylladb server thin
Dev Tools & CI
54
6 ★active
17
Dataproc server ✓ Google
Dev Tools & CI
50
1 ★active
18
Deepread server
Security
50
4 ★active
19
Marcopolo server
Dev Tools & CI
48
1 ★active
20
Finance & Crypto
48
3 ★active
21
Database
47
3 ★active
22
Dev Tools & CI
46
2 marketplacesactive
23
Data & Analytics
46
2 marketplaces
24
Dev Tools & CI
46
2 marketplacesactive
25
Dev Tools & CI
46
2 marketplaces
26
Dev Tools & CI
44
1 marketplacesactive
27
Honeydew server
Dev Tools & CI
44
1 marketplacesactive
28
Dev Tools & CI
44
1 marketplacesactive
29
AI & Agents
42
1 marketplaces
30
AI & Agents
42
1 marketplaces
31
AI & Agents
42
1 marketplaces
32
AI & Agents
42
1 marketplaces
33
Dev Tools & CI
40
0 ★active
·
Dev Tools & CI
not scored yet
23k ★active
·
Data & Analytics
not scored yet
23k ★active
·
Dev Tools & CI
not scored yet
23k ★active
·
Dev Tools & CI
not scored yet
23k ★active
·
Productivity
not scored yet
23k ★active

Who does this work

O*NET records this as a core process step for 16 occupations, including Appraisers of Personal and Business Property, Bioinformatics Scientists, Bioinformatics Technicians, Biostatisticians, Business Intelligence Analysts, Clinical Data Managers, Data Warehousing Specialists, Database Administrators, Database Architects, File Clerks and others.

Recorded there as: "Create databases to store electronic data" / "Develop data analysis or data management procedures" / "Develop technical or scientific databases". We publish it under the name practitioners use.

Other work

Agent configurationAgent developmentAnimation and generated imageryApplication developmentAttributionBookkeepingBrowser automationCode reviewContent marketingContract reviewCopy editingCopywritingDashboards and reportingData qualityDatabase accessDebuggingDesign critiqueDocument productionExploratory data analysisFinancial modellingIncident responseInfrastructure and deploymentKnowledge managementLiterature reviewMarket analysisMessaging and emailModel evaluationObservabilityPRDs and specsProcess automationProduct strategyProject managementPrompt engineeringQuery optimisationRegulatory complianceRetrieval systemsRisk assessmentSEOSales pipelineScientific researchSecurity reviewSoftware architectureStatistical modellingTechnical documentationTest automationTraining materialUser researchVideo editingVisual designWeb developmentWeb researchWeb scraping

Occupational data from the O*NET 30.3 Database by the U.S. Department of Labor, Employment and Training Administration, used under CC BY 4.0. tashan consolidated its process steps into the terms practitioners use; O*NET does not endorse this site.

See the full Index ›