🔥 Tremora del Terra: ultimate hmac-file-server fix – final push before the drop 💾🔐
This commit is contained in:
298
BUILD_GUIDE.md
298
BUILD_GUIDE.md
@ -1,298 +0,0 @@
|
|||||||
# Build Guide - HMAC File Server with Network Resilience
|
|
||||||
|
|
||||||
## ✅ Quick Build (Working)
|
|
||||||
|
|
||||||
### 1. Standard Build with Network Resilience
|
|
||||||
```bash
|
|
||||||
# Build with all features (including network resilience)
|
|
||||||
./buildgo.sh
|
|
||||||
```
|
|
||||||
|
|
||||||
**Output:**
|
|
||||||
```
|
|
||||||
[BUILD] Building HMAC File Server v3.2 with Network Resilience...
|
|
||||||
[INFO] Found network resilience: upload_session.go
|
|
||||||
[INFO] Found network resilience: network_resilience.go
|
|
||||||
[INFO] Found network resilience: chunked_upload_handler.go
|
|
||||||
[INFO] Found network resilience: integration.go
|
|
||||||
[BUILD] Build successful! Binary created: ./hmac-file-server
|
|
||||||
[INFO] Binary size: 16M
|
|
||||||
```
|
|
||||||
|
|
||||||
### 2. Manual Build (Alternative)
|
|
||||||
```bash
|
|
||||||
# Build manually with all network resilience features
|
|
||||||
go build -o hmac-file-server \
|
|
||||||
cmd/server/main.go \
|
|
||||||
cmd/server/helpers.go \
|
|
||||||
cmd/server/config_validator.go \
|
|
||||||
cmd/server/config_test_scenarios.go \
|
|
||||||
cmd/server/upload_session.go \
|
|
||||||
cmd/server/network_resilience.go \
|
|
||||||
cmd/server/chunked_upload_handler.go \
|
|
||||||
cmd/server/integration.go
|
|
||||||
```
|
|
||||||
|
|
||||||
## Build Requirements
|
|
||||||
|
|
||||||
### Prerequisites
|
|
||||||
- **Go 1.24+** (as specified in go.mod)
|
|
||||||
- **OpenSSL** (optional, for HMAC testing)
|
|
||||||
- **Redis** (optional, for session persistence)
|
|
||||||
|
|
||||||
### Dependencies
|
|
||||||
All dependencies are handled by Go modules:
|
|
||||||
```bash
|
|
||||||
# Download dependencies
|
|
||||||
go mod download
|
|
||||||
|
|
||||||
# Verify dependencies
|
|
||||||
go mod verify
|
|
||||||
|
|
||||||
# View dependency tree
|
|
||||||
go mod graph
|
|
||||||
```
|
|
||||||
|
|
||||||
## Build Options
|
|
||||||
|
|
||||||
### Development Build
|
|
||||||
```bash
|
|
||||||
# Build with debug information
|
|
||||||
go build -gcflags="all=-N -l" -o hmac-file-server-debug cmd/server/*.go
|
|
||||||
|
|
||||||
# Or use the build script in debug mode
|
|
||||||
DEBUG=1 ./buildgo.sh
|
|
||||||
```
|
|
||||||
|
|
||||||
### Production Build
|
|
||||||
```bash
|
|
||||||
# Optimized production build
|
|
||||||
go build -ldflags="-s -w" -o hmac-file-server cmd/server/*.go
|
|
||||||
|
|
||||||
# With version information
|
|
||||||
VERSION="3.2.1"
|
|
||||||
go build -ldflags="-s -w -X main.version=$VERSION" -o hmac-file-server cmd/server/*.go
|
|
||||||
```
|
|
||||||
|
|
||||||
### Cross-Platform Build
|
|
||||||
```bash
|
|
||||||
# Linux AMD64
|
|
||||||
GOOS=linux GOARCH=amd64 go build -o hmac-file-server-linux-amd64 cmd/server/*.go
|
|
||||||
|
|
||||||
# Linux ARM64 (for ARM servers/Raspberry Pi)
|
|
||||||
GOOS=linux GOARCH=arm64 go build -o hmac-file-server-linux-arm64 cmd/server/*.go
|
|
||||||
|
|
||||||
# Windows
|
|
||||||
GOOS=windows GOARCH=amd64 go build -o hmac-file-server.exe cmd/server/*.go
|
|
||||||
|
|
||||||
# macOS
|
|
||||||
GOOS=darwin GOARCH=amd64 go build -o hmac-file-server-macos cmd/server/*.go
|
|
||||||
```
|
|
||||||
|
|
||||||
## Configuration for Build
|
|
||||||
|
|
||||||
### Enable Network Resilience Features
|
|
||||||
Create or update your `config.toml`:
|
|
||||||
```toml
|
|
||||||
[server]
|
|
||||||
listen_address = ":8080"
|
|
||||||
enable_dynamic_workers = true # Enable dynamic scaling
|
|
||||||
worker_scale_up_thresh = 50 # Scale up threshold
|
|
||||||
worker_scale_down_thresh = 10 # Scale down threshold
|
|
||||||
deduplication_enabled = true # Enable deduplication
|
|
||||||
max_upload_size = "10GB" # Support large files
|
|
||||||
|
|
||||||
[uploads]
|
|
||||||
chunked_uploads_enabled = true # Enable chunked uploads
|
|
||||||
resumable_uploads_enabled = true # Enable resumable uploads
|
|
||||||
chunk_size = "10MB" # Optimal chunk size
|
|
||||||
max_resumable_age = "48h" # Session persistence
|
|
||||||
|
|
||||||
[timeouts]
|
|
||||||
readtimeout = "4800s" # 80 minutes for large files
|
|
||||||
writetimeout = "4800s" # 80 minutes for large files
|
|
||||||
idletimeout = "4800s" # 80 minutes for large files
|
|
||||||
|
|
||||||
[deduplication]
|
|
||||||
enabled = true
|
|
||||||
maxsize = "1GB" # Deduplicate files under 1GB
|
|
||||||
|
|
||||||
[security]
|
|
||||||
secret = "your-super-secret-hmac-key-minimum-64-characters-recommended"
|
|
||||||
```
|
|
||||||
|
|
||||||
## Testing the Build
|
|
||||||
|
|
||||||
### 1. Basic Functionality Test
|
|
||||||
```bash
|
|
||||||
# Test binary works
|
|
||||||
./hmac-file-server --help
|
|
||||||
|
|
||||||
# Test with config file
|
|
||||||
./hmac-file-server --config config.toml
|
|
||||||
```
|
|
||||||
|
|
||||||
### 2. Test Network Resilience Features
|
|
||||||
```bash
|
|
||||||
# Start server with chunked uploads enabled
|
|
||||||
./hmac-file-server --config config.toml
|
|
||||||
|
|
||||||
# In another terminal, test chunked upload endpoint
|
|
||||||
curl -X POST \
|
|
||||||
-H "X-Filename: test.txt" \
|
|
||||||
-H "X-Total-Size: 1024" \
|
|
||||||
-H "X-Signature: $(echo -n '/upload/chunked' | openssl dgst -sha256 -hmac 'your-secret' | cut -d' ' -f2)" \
|
|
||||||
http://localhost:8080/upload/chunked
|
|
||||||
```
|
|
||||||
|
|
||||||
### 3. Run Go Tests
|
|
||||||
```bash
|
|
||||||
# Run existing tests
|
|
||||||
go test ./test/...
|
|
||||||
|
|
||||||
# Run with verbose output
|
|
||||||
go test -v ./test/...
|
|
||||||
|
|
||||||
# Run specific tests
|
|
||||||
go test -run TestUpload ./test/
|
|
||||||
```
|
|
||||||
|
|
||||||
## Docker Build (Alternative)
|
|
||||||
|
|
||||||
### Using Existing Docker Setup
|
|
||||||
```bash
|
|
||||||
# Build Docker image
|
|
||||||
./builddocker.sh
|
|
||||||
|
|
||||||
# Or manually
|
|
||||||
docker build -t hmac-file-server .
|
|
||||||
```
|
|
||||||
|
|
||||||
### Run with Docker
|
|
||||||
```bash
|
|
||||||
# Start with docker-compose
|
|
||||||
cd dockerenv
|
|
||||||
docker-compose up -d
|
|
||||||
|
|
||||||
# Or run directly
|
|
||||||
docker run -d \
|
|
||||||
-p 8080:8080 \
|
|
||||||
-p 9090:9090 \
|
|
||||||
-v $(pwd)/config:/etc/hmac-file-server \
|
|
||||||
-v $(pwd)/data:/var/lib/hmac-file-server \
|
|
||||||
hmac-file-server
|
|
||||||
```
|
|
||||||
|
|
||||||
## Troubleshooting
|
|
||||||
|
|
||||||
### Build Issues
|
|
||||||
|
|
||||||
#### Missing Dependencies
|
|
||||||
```bash
|
|
||||||
# Clean module cache and re-download
|
|
||||||
go clean -modcache
|
|
||||||
go mod download
|
|
||||||
```
|
|
||||||
|
|
||||||
#### Go Version Issues
|
|
||||||
```bash
|
|
||||||
# Check Go version
|
|
||||||
go version
|
|
||||||
|
|
||||||
# Update Go if needed (Ubuntu/Debian)
|
|
||||||
sudo snap install go --classic
|
|
||||||
|
|
||||||
# Or download from https://golang.org/dl/
|
|
||||||
```
|
|
||||||
|
|
||||||
#### Network Resilience Files Missing
|
|
||||||
```bash
|
|
||||||
# Check if files exist
|
|
||||||
ls -la cmd/server/upload_session.go
|
|
||||||
ls -la cmd/server/network_resilience.go
|
|
||||||
ls -la cmd/server/chunked_upload_handler.go
|
|
||||||
ls -la cmd/server/integration.go
|
|
||||||
|
|
||||||
# If missing, the build will work but without network resilience features
|
|
||||||
# Core functionality remains unchanged
|
|
||||||
```
|
|
||||||
|
|
||||||
### Runtime Issues
|
|
||||||
|
|
||||||
#### Port Already in Use
|
|
||||||
```bash
|
|
||||||
# Check what's using port 8080
|
|
||||||
sudo netstat -tlnp | grep :8080
|
|
||||||
|
|
||||||
# Kill process if needed
|
|
||||||
sudo kill $(sudo lsof -t -i:8080)
|
|
||||||
```
|
|
||||||
|
|
||||||
#### Permission Issues
|
|
||||||
```bash
|
|
||||||
# Make binary executable
|
|
||||||
chmod +x hmac-file-server
|
|
||||||
|
|
||||||
# For system service installation
|
|
||||||
sudo chown root:root hmac-file-server
|
|
||||||
sudo chmod 755 hmac-file-server
|
|
||||||
```
|
|
||||||
|
|
||||||
#### Config File Issues
|
|
||||||
```bash
|
|
||||||
# Validate config syntax
|
|
||||||
./hmac-file-server --config config.toml --validate
|
|
||||||
|
|
||||||
# Use example config as starting point
|
|
||||||
cp config-example-xmpp.toml config.toml
|
|
||||||
```
|
|
||||||
|
|
||||||
## Build Performance
|
|
||||||
|
|
||||||
### Faster Builds
|
|
||||||
```bash
|
|
||||||
# Use build cache
|
|
||||||
export GOCACHE=$(go env GOCACHE)
|
|
||||||
|
|
||||||
# Parallel builds
|
|
||||||
go build -p 4 cmd/server/*.go
|
|
||||||
|
|
||||||
# Skip tests during development
|
|
||||||
go build -a cmd/server/*.go
|
|
||||||
```
|
|
||||||
|
|
||||||
### Smaller Binaries
|
|
||||||
```bash
|
|
||||||
# Strip debug info and symbol table
|
|
||||||
go build -ldflags="-s -w" cmd/server/*.go
|
|
||||||
|
|
||||||
# Use UPX compression (if installed)
|
|
||||||
upx --best hmac-file-server
|
|
||||||
```
|
|
||||||
|
|
||||||
## Deployment
|
|
||||||
|
|
||||||
### System Service
|
|
||||||
```bash
|
|
||||||
# Copy binary to system location
|
|
||||||
sudo cp hmac-file-server /usr/local/bin/
|
|
||||||
|
|
||||||
# Create systemd service
|
|
||||||
sudo cp hmac-file-server.service /etc/systemd/system/
|
|
||||||
sudo systemctl enable hmac-file-server
|
|
||||||
sudo systemctl start hmac-file-server
|
|
||||||
```
|
|
||||||
|
|
||||||
### Reverse Proxy Setup
|
|
||||||
```bash
|
|
||||||
# Nginx configuration
|
|
||||||
sudo cp nginx-hmac-file-server.conf /etc/nginx/sites-available/
|
|
||||||
sudo ln -s /etc/nginx/sites-available/hmac-file-server.conf /etc/nginx/sites-enabled/
|
|
||||||
sudo nginx -t && sudo systemctl reload nginx
|
|
||||||
```
|
|
||||||
|
|
||||||
This build process ensures that:
|
|
||||||
- ✅ **Backward Compatibility**: Works with or without network resilience files
|
|
||||||
- ✅ **Feature Detection**: Automatically includes available network resilience features
|
|
||||||
- ✅ **Zero Downtime**: Existing deployments continue working unchanged
|
|
||||||
- ✅ **Mobile Optimized**: New features specifically address network switching issues
|
|
||||||
21
LICENSE_NEW
Normal file
21
LICENSE_NEW
Normal file
@ -0,0 +1,21 @@
|
|||||||
|
MIT License
|
||||||
|
|
||||||
|
Copyright (c) 2025 Alexander Renz
|
||||||
|
|
||||||
|
Permission is hereby granted, free of charge, to any person obtaining a copy
|
||||||
|
of this software and associated documentation files (the "Software"), to deal
|
||||||
|
in the Software without restriction, including without limitation the rights
|
||||||
|
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
|
||||||
|
copies of the Software, and to permit persons to whom the Software is
|
||||||
|
furnished to do so, subject to the following conditions:
|
||||||
|
|
||||||
|
The above copyright notice and this permission notice shall be included in all
|
||||||
|
copies or substantial portions of the Software.
|
||||||
|
|
||||||
|
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
|
||||||
|
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
|
||||||
|
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
|
||||||
|
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
|
||||||
|
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
|
||||||
|
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
|
||||||
|
SOFTWARE.
|
||||||
Reference in New Issue
Block a user