Objective
Sinbox.fun is developing a TikTok-style content platform that leverages AI for curating viral clips while integrating blockchain technology. We’re building community-owned datasets and AI models with a focus on video classification and content curation through fine-tuning visual language models (VLMs). Our platform incorporates smart contracts to incentivize content tagging and data labeling, creating a sustainable ecosystem for high-quality, community-labeled training data.
Methodology
-
Dual Model Fine-tuning Pipeline:
- Fine-tune the Florence-2 VLM for semantic understanding and content categorization
- Adapt the D-fine object detection model for precise video element identification and tagging
- Combine both models for enhanced content understanding and recommendation
-
Data Collection & Curation: Implement smart contracts on ORA to reward users for data labeling, creating verifiable AI-ready datasets
-
IPFS Integration: Store community-generated training data on IPFS with metadata verification via the ORA network
-
Verifiable AI Inference: Implement ORA’s AI Oracle to provide transparent, verifiable content recommendations and classifications
-
ERC7007 Integration: Allow creators to mint their most popular content as verifiable AI-curated NFTs
Timeline
- Month 1-2: Establish baseline Florence-2 VLM and D-fine object detection fine-tuning pipelines
- Month 3-4: Develop smart contracts for community data labeling and implement IPFS storage solutions
- Month 5-6: Complete model fine-tuning with ORA verification and deploy beta version of the platform
Resources Needed
We are requesting $50,000 to:
- Compute Resources: $25,000 for GPU resources needed for VLM and object detection model fine-tuning
- Development Costs: $15,000 for smart contract development and ORA network integration
- Data Acquisition: $10,000 for initial data labeling incentives and community building
ORA Network Integration & Value Proposition
Our project directly enhances the ORA ecosystem by:
-
Driving ORA Token Utility: Our platform will require ORA tokens for verifiable AI computations and model inference, creating sustained demand
-
Implementing ERC7641 Standard: We’ll tokenize our fine-tuned Florence-2 VLM and D-fine models using ORA’s Initial Model Offering framework, expanding their model marketplace
-
Building Verifiable Datasets: Creating community-labeled, verifiable AI training data that other ORA ecosystem projects can leverage
-
Demonstrating Real-World Use Cases: Showcasing how ORA’s verifiable AI oracles can power content recommendation in a consumer application
-
Creating New Economic Models: Our data labeling smart contracts demonstrate how AI agents can participate in tokenized economies
By funding Sinbox.fun, ORA will gain a showcase project demonstrating how verifiable AI can be applied to content curation while building valuable datasets and models that strengthen the broader ORA ecosystem. Our platform will serve as a reference implementation for trustless AI oracles in consumer applications, driving adoption of ORA’s core technologies.