Daten

training-data-annotation

Guides the design and improvement of human annotation programs for machine-learning datasets, covering labeling schemas, acquisition, annotator quality, disagreement, provenance, adjudication, and stopping criteria.

★ 88 GitHub Stars
93 Qualitätsbewertung
11 Dateien

About this Skill

Design and improve human annotation programs for machine-learning training, validation, and evaluation data, including task and label schemas, active acquisition, annotator guidance, calibration, disagreement, adjudication, provenance, and cost-quality stopping. Do not use for general statistical inference, data storage pipelines, model training, or annotation-interface implementation; route those concerns to data-scientist, data-engineering, ml-engineering, or product-design-and-ux.

Anwendungsfälle

  • Define task and label schemas
  • Create annotation guides and calibration processes
  • Design representative and targeted data acquisition
  • Analyze disagreement and adjudicate labels
  • Set quality, cost, and stopping criteria

Funktionen

  • Workflow for annotation program design
  • Active acquisition and sampling guardrails
  • Annotator qualification and quality measurement
  • Disagreement review and adjudication guidance
  • Annotation, planning, and quality report templates

Unterstützte Agents

Not specified

Skill files

Related Skills

estimate-online-covariance

Provides sklearn-style estimators for incrementally updating covariance, correlation, precision, and location matrices from streaming observations using constant work per observat…

microprediction/precise ★ 335
covariance correlation precision matrix online learning

precise

Enables Python agents to update, assess, compare, and select online covariance, correlation, and precision estimators for streaming or dynamic-universe data.

microprediction/precise ★ 335
python numpy covariance correlation

keyed-dynamic-universe

Wraps positional online covariance estimators to process keyed observations whose named series can remain fixed or change dynamically over time.

microprediction/precise ★ 335
covariance online statistics streaming data keyed data

choose-covariance-estimator

Recommends covariance estimator classes for a 2-D dataset using dimension, conditioning, rank, correlation, and tail-behavior features, and exposes those features for inspection.

microprediction/precise ★ 335
covariance estimator selection statistics machine learning

agentic-kaggle-skill

Guides an AI agent through end-to-end Kaggle competitions, including validation, modeling, OOF predictions, ensembling, remote notebook pipelines, artifact handoffs, submission sc…

FrankS-IntelLab/agentic-kaggle-skill ★ 185
kaggle machine learning competitions cross-validation

review-analyzer-skill

Analyzes e-commerce reviews using 22-dimension AI tagging to extract customer profiles, pain points, VOC, product opportunities, anomaly signals, reports, dashboards, and optional…

buluslan/review-analyzer-skill ★ 128
ecommerce review analysis voc customer insights

data-architect

Assesses, designs, and evolves data architectures through workload analysis, platform and modeling tradeoffs, governance, data products, data mesh, event-driven flows, and migrati…

magnus919/agent-skills ★ 88
data architecture data modeling data governance data mesh

openlibrary

Queries Open Library's public catalog for books, authors, works, editions, ISBNs, ratings, and cover URLs through a keyless Python CLI.

magnus919/agent-skills ★ 88
open library books authors isbn