Commit Graph

41 Commits

Author SHA1 Message Date
0cf21cd893 feat: Complete MEDIUM priority security features with testing
- Implemented TUI auto-select for automated testing
- Fixed TUI automation: autoSelectMsg handling in Update()
- Auto-database selection in DatabaseSelector
- Created focused test suite (test_as_postgres.sh)
- Created retention policy test (test_retention.sh)
- All 10 security tests passing

Features validated:
 Backup retention policy (30 days, min backups)
 Rate limiting (exponential backoff)
 Privilege checks (root detection)
 Resource limit validation
 Path sanitization
 Checksum verification (SHA-256)
 Audit logging
 Secure permissions
 Configuration persistence
 TUI automation framework

Test results: 10/10 passed
Backup files created with .dump, .sha256, .info
Retention cleanup verified (old files removed)
2025-11-25 15:25:56 +00:00
a0e7fd71de security: Implement HIGH priority security improvements
HIGH Priority Security Features:
- Path sanitization with filepath.Clean() for all user paths
- Path traversal attack prevention in backup/restore operations
- Secure config file permissions (0600 instead of 0644)
- SHA-256 checksum generation for all backup archives
- Checksum verification during restore operations
- Comprehensive audit logging for compliance

New Security Module (internal/security/):
- paths.go: ValidateBackupPath() and ValidateArchivePath()
- checksum.go: ChecksumFile(), VerifyChecksum(), LoadAndVerifyChecksum()
- audit.go: AuditLogger with structured event tracking

Integration Points:
- Backup engine: Path validation, checksum generation
- Restore engine: Path validation, checksum verification
- All backup/restore operations: Audit logging
- Configuration saves: Audit logging

Security Enhancements:
- .dbbackup.conf now created with 0600 permissions (owner-only)
- All archive files get .sha256 checksum files
- Restore warns if checksum verification fails but continues
- Audit events logged for all administrative operations
- User tracking via $USER/$USERNAME environment variables

Compliance Features:
- Audit trail for backups, restores, config changes
- Structured logging with timestamps, users, actions, results
- Event details include paths, sizes, durations, errors

Testing:
- All code compiles successfully
- Cross-platform build verified
- Ready for integration testing
2025-11-25 12:03:21 +00:00
b32f6df98e cleanup: bins cleaned 2025-11-20 12:31:21 +00:00
e80c16bf0e Add reliability improvements and config persistence feature
- Implement context cleanup with sync.Once and io.Closer interface
- Add regex-based error classification for robust error handling
- Create ProcessManager with thread-safe process tracking
- Add disk space caching with 30s TTL for performance
- Implement metrics collection with structured logging
- Add config persistence (.dbbackup.conf) for directory-local settings
- Auto-save/auto-load configuration with --no-config and --no-save-config flags
- Successfully tested with 42GB d7030 database (35K large objects, 36min backup)
- All cross-platform builds working (9/10 platforms)
2025-11-19 04:43:22 +00:00
694c8c802a Add comprehensive process cleanup on TUI exit
- Created internal/cleanup package for orphaned process management
- KillOrphanedProcesses(): Finds and kills pg_dump, pg_restore, gzip, pigz
- killProcessGroup(): Kills entire process groups (handles pipelines)
- Pass parent context through all TUI operations (backup/restore inherit cancellation)
- Menu cancel now kills all child processes before exit
- Fixed context chain: menu.ctx → backup/restore operations
- No more zombie processes when user quits TUI mid-operation

Context chain:
- signal.NotifyContext in main.go → menu.ctx
- menu.ctx → backup_exec.ctx, restore_exec.ctx
- Child contexts inherit cancellation via context.WithTimeout(parentCtx)
- All exec.CommandContext use proper parent context

Prevents: Orphaned pg_dump/pg_restore eating CPU/disk after TUI quit
2025-11-18 18:24:49 +00:00
093470ee66 Remove CPU workload selector from main menu - keep only in Configuration Settings
- Removed workloadOption struct and workload-related fields from MenuModel
- Removed workload initialization and cursor tracking
- Removed keyboard handlers (Shift+←/→, 'w') for workload switching
- Removed workload selector display from main menu view
- Removed applyWorkloadSelection() function
- CPU workload type now only configurable via Configuration Settings
- Cleaner main menu focused on actions rather than configuration
2025-11-12 14:45:58 +00:00
879e7575ff fix:goroutines 2025-11-12 14:01:46 +00:00
6d464618ef Feature: Interactive CPU workload selection in TUI menu
Added interactive workload type selector similar to database type selector:

- Three workload options: Balanced | CPU-Intensive | I/O-Intensive
- Switch with Shift+←/→ arrows or 'w' key
- Automatically adjusts Jobs and DumpJobs based on selection:
  * CPU-Intensive: More parallelism (2x physical cores)
  * I/O-Intensive: Less parallelism (0.5x physical cores)
  * Balanced: Standard parallelism (1x physical cores)

UI shows current selection with description:
- Balanced (General purpose)
- CPU-Intensive (More parallelism)
- I/O-Intensive (Less parallelism)

Real-time feedback shows adjusted Jobs/DumpJobs values.
Complements existing --cpu-workload CLI flag with interactive UX.
2025-11-12 13:30:12 +00:00
2019591b5b Optimize: Fix high/medium/low priority issues and apply optimizations
High Priority Fixes:
- Use configurable ClusterTimeoutMinutes for restore (was hardcoded 2 hours)
- Add comment explaining goroutine cleanup in stderr reader (cmd.Run waits)
- Add defer cancel() in cluster backup loop to prevent context leak on panic

Medium Priority Fixes:
- Standardize tick rate to 100ms for both backup and restore (consistent UX)
- Add spinnerFrame field to BackupExecutionModel for incremental updates
- Define package-level spinnerFrames constant to avoid repeated allocation

Low Priority Fixes:
- Add 30-second timeout per database in cluster cleanup loop
- Prevents indefinite hangs when dropping many databases

Optimizations:
- Pre-allocate 512 bytes in View() string builders (reduces allocations)
- Use incremental spinner frame calculation (more efficient than time-based)
- Share spinner frames array across all TUI operations

All changes are backward compatible and maintain existing behavior.
2025-11-12 11:37:02 +00:00
2ad9032b19 Fix: Strip file extensions from target database names to prevent double extensions
- Created stripFileExtensions() helper that loops until all extensions removed
- Applied to both --target flag values and extracted archive names
- Handles cases like .sql.gz.sql.gz by repeatedly stripping until clean
- Updated both cmd/restore.go and internal/tui/archive_browser.go
- Ensures database names never contain .sql, .dump, .tar.gz etc extensions
2025-11-12 10:26:15 +00:00
ac8ce7f00f Fix: Interactive backup now shows dynamic status updates during operation
Issue: Interactive backup (single, sample, cluster) showed 'Status: Initializing...'
throughout the entire backup process, identical to the restore issue that was just fixed.

Root cause:
- Status was set once in NewBackupExecution()
- Never updated during the backup process
- Only changed to success/failure at completion
- No visual feedback about backup progress

Solution: Time-based status progression (matching restore pattern)
Added logic in Update() tick handler to change status based on elapsed time:

- 0-2 sec: 'Initializing backup...'

- 2-5 sec: Connection phase:
  - Cluster: 'Connecting to database cluster...'
  - Single/Sample: 'Connecting to database [name]...'

- 5-10 sec: Early backup phase:
  - Cluster: 'Backing up global objects (roles, tablespaces)...'
  - Sample: 'Analyzing tables for sampling (ratio: N)...'
  - Single: 'Dumping database [name]...'

- 10+ sec: Main backup phase:
  - Cluster: 'Backing up cluster databases...'
  - Sample: 'Creating sample backup of [name]...'
  - Single: 'Backing up database [name]...'

Benefits:
- Consistent UX with restore operations
- Different status messages for single/sample/cluster backups
- Shows what stage of backup is running
- Spinner + changing status = clear progress indication
- Better user experience during long cluster backups

Status checked across all TUI operations:
 RestoreExecutionModel - Fixed (previous commit)
 BackupExecutionModel - Fixed (this commit)
 StatusViewModel - Already has proper loading state
 OperationsViewModel - Simple view, no long operations
2025-11-12 09:26:45 +00:00
23a87625dc Fix: Interactive restore now shows dynamic status updates during operation
Issue: Interactive cluster restore showed 'Status: Initializing...' throughout
the entire restore process, making it appear stuck even though restore was working.

Root cause:
- Status and phase were set once in NewRestoreExecution()
- Never updated during the restore process
- Only changed to 'Completed' or 'Failed' at the end
- No visual feedback about what stage of restore was running

Solution: Time-based status progression
Added logic in Update() tick handler to change status based on elapsed time:
- 0-2 sec: 'Initializing restore...' / Phase: Starting
- 2-5 sec: Context-aware status:
  - If cleanup: 'Cleaning N existing database(s)...' / Phase: Cleanup
  - If cluster: 'Extracting cluster archive...' / Phase: Extraction
  - If single: 'Preparing restore...' / Phase: Preparation
- 5-10 sec:
  - If cluster: 'Restoring global objects...' / Phase: Globals
  - If single: 'Restoring database...' / Phase: Restore
- 10+ sec: 'Restoring [cluster] databases...' / Phase: Restore

Benefits:
- User sees the restore is progressing through stages
- Different status messages for cluster vs single database restore
- Shows cleanup phase when enabled
- Spinner + changing status = clear visual feedback
- Better user experience during long-running restores

Note: These are estimated phases since the restore engine runs in silent mode
(no stdout interference with TUI). Actual operation may be faster or slower
than time estimates, but provides much better UX than static 'Initializing'.
2025-11-12 09:17:39 +00:00
6239e57a20 Fix: Interactive cluster restore cleanup no longer requires database connection
Issue: When enabling cluster cleanup (Option C) in interactive restore mode,
the tool tried to connect to the database to drop existing databases. This
was confusing because:
- Cluster restore itself doesn't use database connections
- It uses CLI tools (psql, pg_restore) directly
- Connection errors were misleading to users

Solution: Changed cleanup to use psql command directly (dropDatabaseCLI)
- Matches how cluster restore works (CLI tools, not connections)
- No confusing connection errors
- Cleaner, more consistent behavior
- Uses postgres maintenance DB for DROP DATABASE commands

Files changed:
- internal/tui/restore_exec.go: Added dropDatabaseCLI() helper function
- Removed dbClient.Connect() requirement for cleanup
- Cleanup now works exactly like cluster restore operations
2025-11-12 08:31:14 +00:00
661fd7e671 Add Option C: Smart cluster cleanup before restore (TUI)
- Auto-detects existing user databases before cluster restore
- Shows count and list (first 5) in preview screen
- Toggle option 'c' to enable cluster cleanup
- Drops all user databases before restore when enabled
- Works for PostgreSQL, MySQL, MariaDB
- Safety warning with database count
- Implements practical disaster recovery workflow
2025-11-11 21:38:40 +00:00
1a8bf35bbc Add ETA estimation to cluster backup/restore operations
- Created internal/progress/estimator.go with ETAEstimator component
- Tracks elapsed time and estimates remaining time based on progress
- Enhanced Spinner and LineByLine indicators to display ETA info
- Integrated into BackupCluster and RestoreCluster functions
- Display format: 'Operation | X/Y (Z%) | Elapsed: Xm | ETA: ~Ym remaining'
- Preserves spinner animation while showing progress/time estimates
- Quick Win approach: no historical data storage, just current operation tracking
2025-11-07 13:28:11 +00:00
b2fcaebac9 Add MariaDB as separate selectable database type in interactive mode 2025-11-07 13:03:15 +00:00
9f03d82cde Use conservative colors: replace bright colors with standard terminal palette 2025-11-07 12:49:04 +00:00
657dde85f4 Remove all lipgloss styling from history view - use plain text only 2025-11-07 12:44:25 +00:00
236006753a Simplify history selection: remove styled background, use plain arrow marker 2025-11-07 12:41:34 +00:00
3b15bfa1d2 Fix line rendering: write arrow outside of style render 2025-11-07 12:31:41 +00:00
2e7fe86be5 Fix newline rendering: separate WriteString calls for content and newline 2025-11-07 12:22:08 +00:00
45cf450357 Fix history line rendering: add newline after style render 2025-11-07 12:14:06 +00:00
959e96b082 Enhanced history navigation: start at recent, add PgUp/PgDn/Home/End keys 2025-11-07 12:10:26 +00:00
e3fb6cc6f5 Fix: Add viewport scrolling to operation history
PROBLEM:
- History displayed ALL entries at once
- With many backups, first entries scroll off screen
- Cursor navigation worked but selection was invisible
- User had to "blindly" navigate 5+ entries to see anything

SOLUTION:
- Added viewport with max 15 visible items at once
- Viewport auto-scrolls to follow cursor position
- Scroll indicators show when there are more entries:
  * "▲ More entries above..."
  * "▼ X more entries below..."
- Cursor always visible within viewport

RESULT:
-  Always see current selection
-  Works with any number of history entries
-  Clear visual feedback with scroll indicators
-  Smooth navigation experience
2025-11-07 11:58:46 +00:00
ec5ef42d3a Fix: Operation history navigation now visible with arrow keys
FIXED:
- Removed unused cursor variable that was always a space
- Arrow up/down now visibly highlights selected item
- Added position counter (Viewing X/Y)
- Changed selection indicator from ">" to "→"
- Explicit cursor initialization to 0

RESULT:
- ↑/↓ keys now work and show visual feedback
- Current selection clearly visible with highlight
- Position indicator shows which item is selected
2025-11-07 11:54:08 +00:00
a60b12e28a Simplify TUI: unified spinner for all operations, remove progress bar from cluster restore 2025-11-07 11:26:14 +00:00
ce7d820b47 Add rotating spinner to TUI status for visual progress feedback 2025-11-07 11:20:36 +00:00
894a334cb5 Fix: Disable stdout progress in TUI mode to prevent display breaking 2025-11-07 10:50:45 +00:00
4a5d63e2bb Fix: Ctrl+C now works in TUI, improve database creation with peer auth support 2025-11-07 10:35:24 +00:00
2b1c53cacf fix: skip target database check for cluster restores
- Cluster restores restore multiple databases, not a single target
- Database existence check was failing with exit status 2
- Now shows "Will restore all databases from cluster backup" instead
- Removes confusing warning for cluster restore operations
2025-11-07 10:18:39 +00:00
aa30c4b68b fix: add ctrl+h as alternative backspace key for better terminal compatibility
- Some terminals send ctrl+h instead of backspace
- Added ctrl+h handling in settings.go and input.go
- Ensures backspace works in all terminal emulators
2025-11-07 10:04:17 +00:00
97be6564ef feat: implement full restore functionality with TUI integration
- Add complete restore engine (internal/restore/)
  - RestoreSingle() for single database restore
  - RestoreCluster() for full cluster restore
  - Archive format detection (7 formats supported)
  - Safety validation (integrity, disk space, tools)
  - Streaming decompression with pigz support

- Add CLI restore commands (cmd/restore.go)
  - restore single: restore single database backup
  - restore cluster: restore full cluster backup
  - restore list: list available backup archives
  - Safety-first design: dry-run by default, --confirm required

- Add TUI restore integration (internal/tui/)
  - Archive browser: browse and select backups
  - Restore preview: safety checks and confirmation
  - Restore execution: real-time progress tracking
  - Backup manager: comprehensive archive management

- Features:
  - Format auto-detection (.dump, .dump.gz, .sql, .sql.gz, .tar.gz)
  - Archive validation before restore
  - Disk space verification
  - Tool availability checks
  - Target database configuration
  - Clean-first and create-if-missing options
  - Parallel decompression support
  - Progress tracking with phases

Phase 1 (Core Functionality) complete and tested
2025-11-07 09:41:44 +00:00
d40616a7cd fix: completely silent TUI - no stdout indicators 2025-11-05 13:47:20 +00:00
69aff0539d fix: remove tea.Println causing misaligned status messages 2025-11-05 13:38:34 +00:00
e377a8f490 fix: properly aligned TUI layout with consistent spacing 2025-11-05 13:33:49 +00:00
4bf0b2d5de fix: clean aligned TUI layout - remove duplicates 2025-11-05 13:30:21 +00:00
430387f733 feat: configurable cluster timeout (CLUSTER_TIMEOUT_MIN) and use in TUI backup 2025-11-05 11:53:30 +00:00
7c0f54fd6d FIXED: TUI progess status and creating tar archive 2025-11-05 10:29:29 +00:00
5e4dd0a2a4 Final debug pass 2025-10-24 19:03:06 +00:00
f93b49b8ab chore: update build and tui assets 2025-10-24 15:43:27 +00:00
e361968022 Initial commit: Database Backup Tool v1.1.0
- PostgreSQL and MySQL support
- Interactive TUI with fixed menu navigation
- Line-by-line progress display
- CPU-aware parallel processing
- Cross-platform build support
- Configuration settings menu
- Silent mode for TUI operations
2025-10-22 19:27:38 +00:00