dhravani / robots.txt
coild's picture
Upload 47 files
97e4a3b verified
raw
history blame contribute delete
356 Bytes
# Robots.txt for Dhravani - Speech Corpus Creation Tool
# Allow all crawlers access to most content
User-agent: *
Allow: /
Allow: /static/
# Disallow access to sensitive areas
Disallow: /auth/
Disallow: /admin/
Disallow: /api/
# Sitemap location (add your actual sitemap URL if you have one)
# Sitemap: https://your-domain.com/sitemap.xml