拥抱人脸数据集创建器
- 作者仓库星标 0
- 作者仓库 FarmFriend-Terminal-React
- 领域
- 数据
- 作者声明的智能体
- 未找到明确声明;不据此推断已兼容或已测试
- 静态检查
- 88 / 100 · 启发式扫描,不代表运行安全
- 运行环境证据
- 未执行;当前没有隔离运行测试证据
- 作者 / 版本 / 许可证
- @0-CYBERDYNE-SYSTEMS-0 · 未声明许可证
- 上下文用量评级
- 低消耗
- 接入复杂程度
- 即装即用
- 是否需要外部接口密钥
- 不需要
- 兼容的系统
- 未声明(默认跨平台)
- 运行环境要求
- Python
- 检测到的文件与系统行为
-
- 只读
- 允许写入 / 修改
- 读取环境变量
- 网络行为
- 仅限本地
- 安装命令数
- 无(仅作为资料)
需要注意: 未声明工具权限范围;实际权限由运行环境决定。
第 2 步:准备数据
加载并验证您的农业数据:
第3步:创建数据集卡
生成全面的元数据:
第四步:上传数据集
将文件上传到 Hugging Face Hub:
# Hugging Face Dataset Creator for FF-Terminal
## Overview
This skill enables you to create, manage, and publish datasets on the Hugging Face Hub with a focus on agricultural and farm-related data. It provides tools for dataset initialization, configuration management, and efficient data uploads.
## When to Use This Skill
Use this skill when you need to:
- Create new datasets for agricultural research or farm management
- Upload sensor data, crop yield data, weather measurements, or soil analysis results
- Structure farm operational data for machine learning projects
- Publish datasets for collaboration with the agricultural research community
- Manage existing datasets on the Hugging Face Hub
## Key Capabilities
### 1. Dataset Types Supported
- **Sensor Data**: IoT sensor readings, soil moisture, temperature, humidity
- **Crop Data**: Yield measurements, growth stages, harvest records
- **Weather Data**: Historical weather patterns, forecasts, climate data
- **Soil Analysis**: pH levels, nutrient content, compaction measurements
- **Farm Operations**: Equipment usage, labor records, input applications
- **Economic Data**: Cost analysis, market prices, profitability metrics
### 2. Dataset Formats
- **Tabular/CSV**: Structured data with proper column headers
- **JSON**: Nested data structures for complex farm records
- **Time Series**: Temporal data with timestamps for trend analysis
- **Geospatial**: Location-based data with GPS coordinates
- **Image/Multimedia**: Field photos, drone imagery, sensor visualizations
### 3. Quality Assurance
- Data validation and format checking
- Duplicate detection and removal
- Missing data handling strategies
- Data type consistency verification
- Metadata completeness checks
## Prerequisites
- Hugging Face account with write permissions
- HF_TOKEN environment variable set
- Python packages: `huggingface_hub`, `pandas`, `pyarrow`
## Usage Workflow
### Step 1: Initialize Dataset
```python
from huggingface_hub import HfApi
api = HfApi()
api.create_repo(
repo_id="your-username/farm-dataset-name",
repo_type="dataset",
private=False,
token=your_hf_token
)
```
### Step 2: Prepare Data
Load and validate your agricultural data:
```python
import pandas as pd
# Load farm data
df = pd.read_csv("farm_sensor_data.csv")
# Validate data structure
required_columns = ["timestamp", "sensor_type", "value", "location"]
assert all(col in df.columns for col in required_columns)
# Clean and preprocess
df = df.dropna()
df["timestamp"] = pd.to_datetime(df["timestamp"])
```
### Step 3: Create Dataset Card
Generate comprehensive metadata:
```python
dataset_card = """
---
language: en
tags:
- agriculture
- farming
- sensor-data
- crop-yield
license: mit
---
# Farm Sensor Dataset
## Dataset Description
This dataset contains sensor readings from agricultural IoT devices...
## Dataset Structure
- `data/`: Main data files in CSV format
- `metadata/`: Sensor configuration and location data
- `README.md`: This file
"""
```
### Step 4: Upload Dataset
Upload files to Hugging Face Hub:
```python
from huggingface_hub import upload_file
upload_file(
path_or_fileobj="farm_sensor_data.csv",
path_in_repo="data/farm_sensor_data.csv",
repo_id="your-username/farm-dataset-name",
repo_type="dataset",
token=your_hf_token
)
```
## Best Practices for Agricultural Datasets
### Data Organization
- Use consistent column naming conventions
- Include proper units of measurement
- Add location metadata (GPS coordinates, field names)
- Document data collection methods and equipment used
- Include temporal information (growing season, planting dates)
### Metadata Standards
- Document data sources and collection methods
- Include information about sensor types and calibration
- Specify data frequency and resolution
- Add context about farming practices and crop varieties
- Provide data quality assessments and limitations
### Privacy and Security
- Remove or anonymize sensitive farm location data if needed
- Consider data licensing terms carefully
- Document any data restrictions or usage limitations
- Ensure compliance with agricultural data sharing agreements
## Integration with FF-Terminal Tools
This skill works seamlessly with other FF-Terminal capabilities:
- **Data Analysis**: Use `analyze_data` tool to explore dataset patterns
- **Visualization**: Create charts and graphs for data insights
- **Automation**: Schedule regular data uploads and updates
- **Monitoring**: Set up alerts for data quality issues
## Troubleshooting
### Common Issues
- **Authentication errors**: Verify HF_TOKEN is set correctly
- **Upload failures**: Check file size limits and internet connection
- **Format errors**: Ensure data files match expected schema
- **Permission issues**: Confirm repository access rights
### Error Recovery
- Use `api.repo_info()` to check repository status
- Validate data locally before uploading
- Implement retry logic for network issues
- Keep backup copies of important datasets
## Example Use Cases
### 1. IoT Sensor Data Pipeline
Upload real-time sensor data from farm IoT devices:
```python
# Process incoming sensor data
sensor_data = process_sensor_readings()
# Validate and format
validated_data = validate_agricultural_data(sensor_data)
# Upload to Hub
upload_to_huggingface(validated_data, "farm-iot-sensors")
```
### 2. Crop Yield Analysis
Create datasets for yield prediction models:
```python
# Combine yield data with weather and soil information
yield_dataset = combine_farm_data(
yield_data="crop_yields.csv",
weather_data="weather.csv",
soil_data="soil_analysis.csv"
)
# Create dataset for ML training
create_ml_dataset(yield_dataset, "crop-yield-prediction")
```
### 3. Research Collaboration
Share data with agricultural research community:
```python
# Prepare dataset for publication
research_dataset = prepare_for_publication(raw_farm_data)
# Add comprehensive documentation
add_research_metadata(research_dataset, methodology_info)
# Publish with appropriate license
publish_dataset(research_dataset, license="CC-BY-SA")
```
## Advanced Features
### Version Control
- Track dataset versions with git-like functionality
- Maintain changelog of data updates and modifications
- Support for dataset branching and merging
### Automation
- Schedule regular data uploads and updates
- Automate data quality checks and validation
- Set up notifications for dataset changes
### Integration
- Connect with farm management software APIs
- Import data from agricultural equipment systems
- Export datasets in various formats for different tools
## Resources
- [Hugging Face Datasets Documentation](https://huggingface.co/docs/datasets)
- [Agricultural Data Standards](https://example.com/ag-data-standards)
- [Farm Data Management Best Practices](https://example.com/farm-data-best-practices)
章节与文件索引
按说明文件中的顺序排列。
何时使用此技能
1. 支持的数据集类型
2. 数据集格式
3、质量保证
先决条件
文件/命令 -> huggingface_hub · pandas · pyarrow · data/ · metadata/ · README.md · analyze_data · api.repo_info()
内容校验值 -> 5f32d9165462
当前原文的自动摘译,尚未人工审校。
何时使用此技能
当您需要执行以下操作时,请使用此技能: 为农业研究或农场管理创建新数据集 上传传感器数据、作物产量数据、天气测量或土壤分析结果 为机器学习项目构建农场运营数据 发布数据集以与农业研究社区合作
1. 支持的数据集类型
传感器数据:物联网传感器读数、土壤湿度、温度、湿度 作物数据:产量测量、生长阶段、收获记录 天气数据:历史天气模式、预报、气候数据 土壤分析:pH 值、养分含量、压实测量 农场运营:设备使用情况、劳动力记录、输入应用
2. 数据集格式
表格/CSV:具有正确列标题的结构化数据 JSON:复杂农场记录的嵌套数据结构 时间序列:带有时间戳的时间数据,用于趋势分析 地理空间:带有 GPS 坐标的基于位置的数据 图像/多媒体:现场照片、无人机图像、传感器可视化
3、质量保证
数据验证和格式检查 重复检测和删除 缺失数据处理策略 数据类型一致性验证 元数据完整性检查
先决条件
抱脸账号有写权限 HF_TOKEN 环境变量设置 Python 包:
huggingface_hub、pandas、pyarrow