Storage & Migration

​

Vector Database Migration

​

Migrate from Weaviate to another database

1. Update configuration Source code deployment (.env):
   VECTOR_STORE=qdrant
   
   Docker Compose (docker-compose.yaml):
   VECTOR_STORE: qdrant
   
2. Run migration
   # Source code
   flask vdb-migrate
   
   # Docker
   docker exec -it docker-api-1 flask vdb-migrate
   

​

Storage Migration

​

Move from local to cloud storage

1. Configure cloud storage .env or docker-compose.yaml:
   STORAGE_TYPE=aliyun-oss
   # Add OSS credentials
   
2. Migrate data Source code:
   flask upload-private-key-file-to-cloud-storage
   flask upload-local-files-to-cloud-storage
   
   Docker:
   docker exec -it docker-api-1 flask upload-private-key-file-to-cloud-storage
   docker exec -it docker-api-1 flask upload-local-files-to-cloud-storage
   

​

Data Cleanup

​

Delete old logs

1. Get tenant ID
   docker exec -it docker-api-1 bash -c "echo 'from models import Tenant; db.session.query(Tenant.id, Tenant.name).all(); quit()' | flask shell"
   
2. Delete logs older than X days
   docker exec -it docker-api-1 flask clear-free-plan-tenant-expired-logs \
     --days 30 \
     --batch 100 \
     --tenant_ids 618b5d66-a1f5-4b6b-8d12-f171182a1cb2
   
3. Remove exported logs (optional)
   docker exec -it docker-api-1 bash -c 'rm -rf ${OPENDAL_FS_ROOT}/free_plan_tenant_expired_logs'
   

​

Remove orphaned files

1. Clean database records
   docker exec -it docker-api-1 flask clear-orphaned-file-records
   # Use -f flag to skip confirmation
   
2. Delete orphaned files from storage
   docker exec -it docker-api-1 flask remove-orphaned-files-on-storage
   # Use -f flag to skip confirmation
   

​

Backup & Recovery

​

Create backup before upgrade

cp -r dify "dify.bak.$(date +%Y%m%d%H%M%S)"

​

What to backup

• Entire dify/docker/volumes directory

• Database
• Storage configuration
• Vector database data
• Environment files

​

Database maintenance

VACUUM FULL;

​

Upgrade Process

​

Version upgrade

docker compose pull
docker compose up -d

git pull
cd api
flask db upgrade

​

Database schema migration

cd api
flask db upgrade