mirror of
https://github.com/kjanat/livedash-node.git
synced 2026-01-16 15:52:10 +01:00
Kaj Kowalski
1eea2cc3e4
- Fix 36+ biome linting issues reducing errors/warnings from 227 to 191 - Replace explicit 'any' types with proper TypeScript interfaces - Fix React hooks dependencies and useCallback patterns - Resolve unused variables and parameter assignment issues - Improve accessibility with proper label associations - Add comprehensive API documentation for admin and security features - Update README.md with accurate PostgreSQL setup and current tech stack - Create complete documentation for audit logging, CSP monitoring, and batch processing - Fix outdated project information and missing developer workflows
103 lines
3.0 KiB
Markdown
103 lines
3.0 KiB
Markdown
# Migration Scripts for tRPC and Batch API Integration
|
|
|
|
This directory contains comprehensive migration scripts for deploying the new architecture that includes tRPC implementation and OpenAI Batch API integration.
|
|
|
|
## Migration Components
|
|
|
|
### 1. Database Migrations
|
|
|
|
- `01-schema-migrations.sql` - Prisma database schema migrations
|
|
- `02-data-migrations.sql` - Data transformation scripts
|
|
- `validate-database.ts` - Database validation and health checks
|
|
|
|
### 2. Environment Configuration
|
|
|
|
- `environment-migration.ts` - Environment variable migration guide
|
|
- `config-validator.ts` - Configuration validation scripts
|
|
|
|
### 3. Deployment Scripts
|
|
|
|
- `deploy.ts` - Main deployment orchestrator
|
|
- `pre-deployment-checks.ts` - Pre-deployment validation
|
|
- `post-deployment-validation.ts` - Post-deployment verification
|
|
- `rollback.ts` - Rollback procedures
|
|
|
|
### 4. Health Checks
|
|
|
|
- `health-checks.ts` - Comprehensive system health validation
|
|
- `trpc-endpoint-tests.ts` - tRPC endpoint validation
|
|
- `batch-processing-tests.ts` - Batch processing system tests
|
|
|
|
### 5. Migration Utilities
|
|
|
|
- `backup-database.ts` - Database backup procedures
|
|
- `restore-database.ts` - Database restore procedures
|
|
- `migration-logger.ts` - Migration logging utilities
|
|
|
|
## Usage
|
|
|
|
### Pre-Migration
|
|
|
|
1. Run database backup: `pnpm migration:backup`
|
|
2. Validate environment: `pnpm migration:validate-env`
|
|
3. Run pre-deployment checks: `pnpm migration:pre-check`
|
|
|
|
### Migration
|
|
|
|
1. Run schema migrations: `pnpm migration:schema`
|
|
2. Run data migrations: `pnpm migration:data`
|
|
3. Deploy application: `pnpm migration:deploy`
|
|
|
|
### Post-Migration
|
|
|
|
1. Validate deployment: `pnpm migration:validate`
|
|
2. Run health checks: `pnpm migration:health-check`
|
|
3. Test critical paths: `pnpm migration:test`
|
|
|
|
### Rollback (if needed)
|
|
|
|
1. Rollback deployment: `pnpm migration:rollback`
|
|
2. Restore database: `pnpm migration:restore`
|
|
|
|
## Environment Variables
|
|
|
|
The migration requires these new environment variables:
|
|
|
|
```bash
|
|
# tRPC Configuration
|
|
TRPC_ENDPOINT_URL=http://localhost:3000/api/trpc
|
|
TRPC_BATCH_TIMEOUT=30000
|
|
|
|
# Batch Processing Configuration
|
|
BATCH_PROCESSING_ENABLED=true
|
|
BATCH_CREATE_INTERVAL="*/5 * * * *"
|
|
BATCH_STATUS_CHECK_INTERVAL="*/2 * * * *"
|
|
BATCH_RESULT_PROCESSING_INTERVAL="*/1 * * * *"
|
|
BATCH_MAX_REQUESTS=1000
|
|
BATCH_TIMEOUT_HOURS=24
|
|
|
|
# Migration Specific
|
|
MIGRATION_MODE=production
|
|
MIGRATION_BACKUP_ENABLED=true
|
|
MIGRATION_ROLLBACK_ENABLED=true
|
|
```
|
|
|
|
## Zero-Downtime Deployment Strategy
|
|
|
|
The migration implements a blue-green deployment strategy:
|
|
|
|
1. **Phase 1**: Deploy new code with feature flags disabled
|
|
2. **Phase 2**: Run database migrations
|
|
3. **Phase 3**: Enable tRPC endpoints progressively
|
|
4. **Phase 4**: Enable batch processing system
|
|
5. **Phase 5**: Full activation and old system decommission
|
|
|
|
## Safety Features
|
|
|
|
- Automatic database backups before migration
|
|
- Rollback scripts for quick recovery
|
|
- Health checks at each stage
|
|
- Progressive feature enablement
|
|
- Comprehensive logging and monitoring
|
|
- Backwards compatibility maintained during migration
|