Main trade execution endpoint (TradingView signals) was creating synthetic
IDs (trade-${Date.now()}) instead of using real database IDs returned by
createTrade().
This caused identical failure pattern as smart-entry-timer:
- SL verification couldn't find trades in database
- Active recovery attempts failed (no record found)
- Emergency shutdown failed (no record found for update)
- Position left unprotected after system gave up
Fix in app/api/trading/execute/route.ts:
- Line 1044: Capture createTrade() return value as savedTrade
- Line 1127+: Update activeTrade.id = savedTrade.id (real Prisma ID)
- Added logging for database ID verification
- Added fallback handling for database save failures
Impact: All database operations (SL verification, recovery, emergency close)
now work correctly for TradingView signal trades.
Related: Bug #88 Phase 1 (smart-entry-timer fix, commit 674743c)
SYMPTOM:
- Database shows leverage=10 for quality 95 signals
- Drift shows actual leverage 0.99x (essentially 1x)
- User expected ,960 position (10x), got 92 (1x)
ROOT CAUSE:
- Dec 14 fix (commit 5aad42f) passed wrong variable to smart entry queue
- Line 569: positionSizeUSD: positionSize (BASE size without leverage)
- Should be: positionSizeUSD: positionSizeUSD (LEVERAGED size)
- positionSizeUSD correctly calculated at line 504: positionSize * leverage
IMPACT:
- ALL smart entry timeout trades since Dec 14 used 1x leverage
- Adaptive leverage completely bypassed for queued signals
- User losing 90% of profit potential on quality 95+ signals
THE FIX:
- Changed line 569 from positionSize to positionSizeUSD
- Now passes correctly leveraged size to queue
- Smart entry timeouts will use adaptive 10x leverage
VERIFICATION:
- Container restarted: 2025-12-16 09:44:24 UTC
- Next smart entry timeout trade will show 10x leverage in Drift
See Common Pitfalls #85 for full details.
BUGS FIXED:
1. Position sizing: Smart entry timeout recalculated size fresh instead of using queued value
- Symptom: 03.95 position instead of ,354 (97.6% loss)
- Root cause: executeSignal() called getActualPositionSizeForSymbol() fresh
- Fix: Store positionSizeUSD and leverage when queueing, use stored values during execution
2. Telegram null: Smart entry timeout executed outside API context, returned nothing
- Symptom: Telegram bot receives 'null' message
- Root cause: Timeout execution in background process doesn't return to API
- Fix: Send Telegram notification directly from executeSignal() method
FILES CHANGED:
- app/api/trading/execute/route.ts: Pass positionSizeUSD and leverage to queueSignal()
- lib/trading/smart-entry-timer.ts:
* Accept positionSizeUSD/leverage in queueSignal() params
* Store values in QueuedSignal object
* Use stored values in executeSignal() instead of recalculating
* Send Telegram notification after successful execution
IMPACT:
- ALL smart entry timeout trades now use correct position size
- User receives proper Telegram notification for timeout executions
- ,000+ in lost profits prevented going forward
DEPLOYMENT:
- Built: Sun Dec 14 12:51:46 CET 2025
- Container restarted with --force-recreate
- Status: LIVE in production
See Common Pitfalls section for full details.
CRITICAL FIX (Dec 13, 2025) - $1,000 LOSS BUG ROOT CAUSE
The $1,000 loss bug is FIXED! Telegram-opened positions are now properly monitored.
ROOT CAUSE:
- handlePriceUpdate() had early return if Drift service not initialized
- Drift initializes lazily (only when first API call needs it)
- Position Manager starts monitoring immediately after addTrade()
- Pyth price monitor calls handlePriceUpdate() every 2 seconds
- But handlePriceUpdate() returned early because Drift wasn't ready
- Result: Monitoring loop ran but did NOTHING (silent failure)
THE FIX:
- Removed early return for Drift initialization check (line 692-696)
- Price checking loop now runs even if Drift temporarily unavailable
- External closure detection fails gracefully if Drift unavailable (separate concern)
- Added logging: '🔍 Price check: SOL-PERP @ $132.29 (2 trades)'
VERIFICATION (Dec 13, 2025 21:47 UTC):
- Test position opened via /api/trading/test
- Monitoring started: 'Position monitoring active, isMonitoring: true'
- Price checks running every 2 seconds: '🔍 Price check' logs visible
- Diagnostic endpoint confirms: isMonitoring=true, activeTradesCount=2
IMPACT:
- Prevents $1,000+ losses from unmonitored positions
- Telegram trades now get full TP/SL/trailing stop protection
- Position Manager monitoring loop actually runs now
- No more 'added but not monitored' situations
FILES CHANGED:
- lib/trading/position-manager.ts (lines 685-695, 650-658)
This was the root cause of Bug #77. User's SOL-PERP SHORT (Nov 13, 2025 20:47)
was never monitored because handlePriceUpdate() returned early for 29 minutes.
Container restart at 21:20 lost all failure logs. Now fixed permanently.
- Enhanced DNS failover monitor on secondary (72.62.39.24)
- Auto-promotes database: pg_ctl promote on failover
- Creates DEMOTED flag on primary via SSH (split-brain protection)
- Telegram notifications with database promotion status
- Startup safety script ready (integration pending)
- 90-second automatic recovery vs 10-30 min manual
- Zero-cost 95% enterprise HA benefit
Status: DEPLOYED and MONITORING (14:52 CET)
Next: Controlled failover test during maintenance
- Changed execute endpoint from warning-only to active enforcement
- When placeExitOrders() returns < expected signatures, immediately:
1. Close the position 100% (emergency safety)
2. Return HTTP 500 error (prevent DB record creation)
3. Log critical error for post-mortem
- Prevents unprotected positions from being created in database
- Root cause: Previous fix validated but continued execution
- Result: No more positions without stop loss protection
Deployed: Dec 10, 2025 11:42 CET
Container: trading-bot-v4
Build: sha256:d576e7c5d421
CRITICAL FIX (Dec 9, 2025): Emergency place-exit-orders endpoint now updates database with on-chain order transaction signatures.
Problem:
- Emergency endpoint placed orders on-chain successfully
- But database Trade record showed NULL for order tx fields
- Monitoring tools showed false negatives (NULL when orders exist)
- User frustrated: 'our database HAS TO reflect whats on chain'
Root Cause:
- place-exit-orders endpoint called placeExitOrders() directly
- Successfully placed orders and returned signatures
- But never updated database Trade table with returned tx IDs
- Database out of sync with actual on-chain state
Solution:
- After successful order placement, query database for active trade
- Update Trade.tp1OrderTx, tp2OrderTx, slOrderTx with returned signatures
- Handle both single SL and dual stop configurations
- Log each signature update for verification
- Don't fail request if database update fails (orders already on-chain)
Impact:
- Database now accurately reflects on-chain order state
- Monitoring tools (health checks, queries) show correct status
- User can trust database as source of truth
- Resolves disconnect between user's Drift UI observations and database
Testing:
- Called endpoint with SOL-PERP position parameters
- Received 2 signatures (TP1, TP2) - Bug #76 still present
- Database updated: tp1OrderTx and tp2OrderTx now populated
- Logs confirm: 'Database updated with on-chain order signatures'
Note: Bug #76 (SL order fails silently) still exists but database now accurately reflects whatever orders succeed.
Files changed:
- app/api/trading/place-exit-orders/route.ts (added database update logic)
CRITICAL: 1-minute ATR data feed not working - Telegram bot timing out
Root cause:
- TradingView alert sends action: 'market_data_1min'
- Endpoint checked for exact match: 'market_data'
- Result: 400 Bad Request, no data cached
The fix:
- Accept both 'market_data' and 'market_data_1min'
- Prevents rejection of 1-minute TradingView alerts
- Enables fresh ATR data for manual Telegram trades
User symptom: 'long sol' → timeout → fallback to preset ATR 0.43
After fix: 'long sol' → waits for fresh 1min data → uses real ATR
Files changed:
- app/api/trading/market-data/route.ts line 64-71
- Problem: FARTCOIN signals being treated as SOL-PERP
- Root cause: Symbol normalization checked includes('SOL') before FARTCOIN
- Since TradingView may send symbols with 'SOL' in name, order matters
Files changed:
- config/trading.ts: Reordered checks (FARTCOIN before SOL)
- app/api/trading/market-data/route.ts: Added FARTCOIN mappings
Symbol matching now checks:
1. FARTCOIN/FART (most specific)
2. SOL (catch-all for Solana)
3. BTC, ETH (other majors)
4. Default fallback
This fixes TradingView alerts for FARTCOIN 5-min and 1-min data
collection being incorrectly stored as SOL-PERP in BlockedSignal table.
Status: ✅ DEPLOYED Dec 7, 2025 19:30 CET
Next FARTCOIN signal will correctly save as FARTCOIN-PERP
- 1-minute data is pure market sampling, not trading signals
- signalQualityVersion now null for timeframe='1'
- Other timeframes still labeled with v9
- Prevents confusion in analytics/reporting
User requirement: Manual long/short commands via Telegram shall execute
immediately without quality checks.
Changes:
- Execute endpoint now checks for timeframe='manual' flag
- Added isManualTrade bypass alongside isValidatedEntry bypass
- Manual trades skip quality threshold validation completely
- Logs show 'MANUAL TRADE BYPASS' for transparency
Impact: Telegram commands (long sol, short eth) now execute instantly
without being blocked by low quality scores.
Commit: Dec 4, 2025
- Added validatedEntry?: boolean to ExecuteTradeRequest interface
- Added originalQualityScore?: number to interface
- Added validationDelayMinutes?: number to interface
- Fixes TypeScript compilation error at line 231
- Required for Smart Validation Queue integration to work
Bug 1 Fix - Revenge System External Closures:
- External closure handler now checks if SL stop-out with quality 85+
- Calls stopHuntTracker.recordStopHunt() after database save
- Enables revenge trading for on-chain order fills (not just Position Manager closes)
- Added null safety for trade.signalQualityScore (defaults to 0)
- Location: lib/trading/position-manager.ts line ~999
Bug 5 Fix - Execute Endpoint Validated Entry Bypass:
- Added isValidatedEntry check before quality threshold rejection
- Smart Validation Queue signals (quality 50-89) now execute successfully
- Logs show bypass reason and validation details (delay, original quality)
- Only affects signals with validatedEntry=true flag from queue
- Location: app/api/trading/execute/route.ts line ~228
User Clarification:
- TradingView price issue (4.47) was temporary glitch, not a bug
- Only Bug 1 (revenge) and Bug 5 (execute rejection) needed fixing
- Both fixes implemented and TypeScript errors resolved
PROBLEM:
Smart Entry showed 'Signal Price: $70.80' when actual SOL price was ~$139.70
Calculated 'Pullback: -97.38%' when actual price change was <1%
Smart Entry queue completely broken due to wrong price
ROOT CAUSE:
TradingView webhook (or n8n workflow) sends pricePosition percentage (73.77)
as signalPrice instead of actual dollar price ($139.70)
Code used body.signalPrice directly without validation
EVIDENCE:
Webhook payload: "pricePosition": 73.7704918033, "signalPrice": 73.7704918033
Identical values = pricePosition mapped incorrectly to signalPrice
Percentage value (0-100) treated as dollar price = 100× too low
FIXES:
1. Added detection: If signalPrice < $10, log warning (likely percentage)
2. Changed signalPrice source: Use currentPrice from Pyth (NOT body.signalPrice)
3. At signal time: priceChange = 0, pullbackMagnitude = 0 (no pullback yet)
4. Queue with correct price: Smart Entry timer gets current market price
5. Added comments explaining bug and fix
IMPACT:
Smart Entry will now use correct signal price ($130-150 for SOL)
Pullback calculations will be accurate (0.15-0.5% range, not 97%)
Queue will work correctly (wait for actual dips/bounces)
Next signal will validate fix in production logs
TESTING REQUIRED:
- Wait for next signal (LONG or SHORT)
- Verify log: 'Signal Price: $XXX.XX (using current market price)'
- Verify log: 'Current Price: $XXX.XX (same as signal)'
- Verify: No more -97% pullback calculations
- Verify: Smart Entry queues correctly if no pullback yet
FILES CHANGED:
- app/api/trading/execute/route.ts lines 485-555 (rewritten Smart Entry logic)
LOCATION:
- Line 495: Added currentPrice null check
- Line 502: Added percentage detection warning
- Line 507: Changed to use currentPrice as signalPrice
- Line 509-511: Set priceChange/pullback to 0 at signal time
- Line 517: Queue with corrected signalPrice
RELATED:
- Bug #2: Leverage thresholds (FIXED separately, commit 58f812f)
- Bug #3: Missing Telegram entry notifications (pending investigation)
- Bug: Validation queue used TradingView symbol format (SOLUSDT) to lookup market data cache
- Cache uses normalized Drift format (SOL-PERP)
- Result: Cache lookup failed, wrong/stale price shown in Telegram abandonment notifications
- Real incident: Signal at $126.00 showed $98.18 abandonment price (-22.08% impossible drop)
- Fix: Added normalizeTradingViewSymbol() call in check-risk endpoint before passing to validation queue
- Files changed: app/api/trading/check-risk/route.ts (import + symbol normalization)
- Impact: Validation queue now correctly retrieves current price from market data cache
- Deployed: Dec 1, 2025
- Created lib/trading/smart-validation-queue.ts (270 lines)
- Queue marginal quality signals (50-89) for validation
- Monitor 1-minute price action for 10 minutes
- Enter if +0.3% confirms direction (LONG up, SHORT down)
- Abandon if -0.4% invalidates direction
- Auto-execute via /api/trading/execute when confirmed
- Integrated into check-risk endpoint (queues blocked signals)
- Integrated into startup initialization (boots with container)
- Expected: Catch ~30% of blocked winners, filter ~70% of losers
- Estimated profit recovery: +$1,823/month
Files changed:
- lib/trading/smart-validation-queue.ts (NEW - 270 lines)
- app/api/trading/check-risk/route.ts (import + queue call)
- lib/startup/init-position-manager.ts (import + startup call)
User approval: 'sounds like we can not loose anymore with this system. go for it'
- Removed v10 TradingView indicator (moneyline_v10_momentum_dots.pinescript)
- Removed v10 penalty system from signal-quality.ts (-30/-25 point penalties)
- Removed backtest result files (sweep_*.csv)
- Updated copilot-instructions.md to remove v10 references
- Simplified direction-specific quality thresholds (LONG 90+, SHORT 80+)
Rationale:
- 1,944 parameter combinations tested in backtest
- All top results IDENTICAL (568 trades, $498 P&L, 61.09% WR)
- Momentum parameters had ZERO impact on trade selection
- Profit factor 1.027 too low (barely profitable after fees)
- Max drawdown -$1,270 vs +$498 profit = terrible risk-reward
- v10 penalties were blocking good trades (bug: applied to wrong positions)
Keeping v9 as production system - simpler, proven, effective.
ROOT CAUSE:
- Execute endpoint calculated quality score but NEVER checked it
- After timeframe='5' validation, proceeded directly to execution
- TradingView sent signal with all metrics=0 (ADX, ATR, RSI, etc.)
- Quality scored as 30, but no threshold check existed
- Position opened with 909.77 size at quality 30 (need 90+ for LONG)
THE FIX:
- Added MANDATORY quality check after timeframe validation
- Blocks execution if score < minQualityScore (90 LONG, 95 SHORT)
- Returns HTTP 400 with detailed error message
- Logs Quality check passed OR ❌ QUALITY TOO LOW:
AFFECTED TRADES:
- cmihwkjmb0088m407lqd8mmbb: Quality 30 LONG (stopped out)
- cmih6ghn20002ql07zxfvna1l: Quality 50 LONG (stopped out)
- cmih5vrpu0001ql076mj3nm63: Quality 50 LONG (stopped out)
This is a FINANCIAL SAFETY critical fix - prevents low-quality trades.
PROBLEM:
- 1-minute data collection signals were getting blocked
- Overtrading penalty: '30 signals in 30min (-20 pts)'
- Flip-flop penalty: 'opposite direction 1min ago (-25 pts)'
- These penalties don't make sense for data collection
ROOT CAUSE:
- Quality scoring runs for ALL timeframes (needed for analysis)
- But frequency checks (overtrading/flip-flop) only apply to production (5min)
- Data collection signals (1min, 15min, 1H, etc.) shouldn't be penalized
SOLUTION:
- Added skipFrequencyCheck parameter to scoreSignalQuality()
- Set to true for all non-5min timeframes: skipFrequencyCheck: timeframe !== '5'
- Moved timeframe variable declaration earlier for reuse
- 1-minute signals now score purely on technical merit (ADX/ATR/RSI/etc.)
IMPACT:
- 1-minute data collection works correctly
- No false 'overtrading' blocks every minute
- Quality scores still calculated for cross-timeframe analysis
- Production 5min signals still have full frequency validation
FILES CHANGED:
- app/api/trading/execute/route.ts (quality scoring call)
DEPLOYED: Nov 27, 2025 (71.8s build time)
Implementation of 1-minute data enhancements Phase 2:
- Queue signals when price not at favorable pullback level
- Monitor every 15s for 0.15-0.5% pullback (LONG=dip, SHORT=bounce)
- Validate ADX hasn't dropped >2 points (trend still strong)
- Timeout at 2 minutes → execute at current price
- Expected improvement: 0.2-0.5% per trade = ,600-4,000 over 100 trades
Files:
- lib/trading/smart-entry-timer.ts (616 lines, zero TS errors)
- app/api/trading/execute/route.ts (integrated smart entry check)
- .env (SMART_ENTRY_* configuration, disabled by default)
Next steps:
- Test with SMART_ENTRY_ENABLED=true in development
- Monitor first 5-10 trades for improvement verification
- Enable in production after successful testing
- Added maGap field to RiskCheckRequest interface
- Added maGap field to ExecuteTradeRequest interface
- Health check already enhanced with database connectivity check
- Fixes TypeScript build errors blocking deployment
Integrated MA gap analysis into signal quality evaluation pipeline:
BACKEND SCORING (lib/trading/signal-quality.ts):
- Added maGap?: number parameter to scoreSignalQuality interface
- Implemented convergence/divergence scoring logic:
* LONG: +15pts tight bullish (0-2%), +12pts converging (-2-0%), +8pts early momentum (-5--2%)
* SHORT: +15pts tight bearish (-2-0%), +12pts converging (0-2%), +8pts early momentum (2-5%)
* Penalties: -5pts for misaligned MA structure (>5% wrong direction)
N8N PARSER (workflows/trading/parse_signal_enhanced.json):
- Added MAGAP:([-\d.]+) regex pattern for negative number support
- Extracts maGap from TradingView v9 alert messages
- Returns maGap in parsed output (backward compatible with v8)
- Updated comment to show v9 format
API ENDPOINTS:
- app/api/trading/check-risk/route.ts: Pass maGap to scoreSignalQuality (2 calls)
- app/api/trading/execute/route.ts: Pass maGap to scoreSignalQuality (2 calls)
FULL PIPELINE NOW COMPLETE:
1. TradingView v9 → Generates signal with MAGAP field
2. n8n webhook → Extracts maGap from alert message
3. Backend scoring → Evaluates MA gap convergence (+8 to +15 pts)
4. Quality threshold → Borderline signals (75-85) can reach 91+
5. Execute decision → Only signals scoring ≥91 are executed
MOTIVATION:
Helps borderline quality signals reach execution threshold without overriding
safety rules. Addresses Nov 25 missed opportunity where good signal had MA
convergence but borderline quality score.
TESTING REQUIRED:
- Verify n8n parses MAGAP correctly from v9 alerts
- Confirm backend receives maGap parameter
- Validate MA gap scoring applied to quality calculation
- Monitor first 10-20 v9 signals for scoring accuracy
- Created LONG_ADAPTIVE_LEVERAGE_VERIFICATION.md with complete verification
- Logic testing confirms Q95+ = 15x, Q90-94 = 10x (100% correct)
- Updated test endpoint to pass direction parameter (best practice)
- Backward compatibility verified (works with or without direction)
- No regressions from SHORT implementation
- Awaiting first production LONG trade for final validation
TypeScript build error: qualityScore not in interface
Fix: Added qualityScore?: number to ExecuteTradeResponse type
Files Modified:
- app/api/trading/execute/route.ts (interface update)
User Request: Show quality score in Telegram when position opened
Changes:
- Updated execute endpoint response to include qualityScore field
- n8n workflow already checks for qualityScore in response
- When present, displays: ⭐ Quality: XX/100
Impact:
- Users now see quality score immediately on position open
- Previously only saw score on blocked signals
- Better visibility into trade quality at entry
Files Modified:
- app/api/trading/execute/route.ts (added qualityScore to response)
**BUG:** Telegram 'short sol' blocked by multi-timeframe data collection filter
- Filter checked 'timeframe !== 5' which blocked 'manual' timeframe
- Manual trades from Telegram should execute, not be saved for analysis
**FIX:** Updated condition to 'timeframe !== 5 && timeframe !== manual'
- Allows both 5min TradingView signals AND manual Telegram trades
- Only blocks 15min/1H/4H/Daily for data collection
**FILES:** app/api/trading/execute/route.ts line 114
**DEPLOYED:** Nov 20, 2025 15:42 CET
Implemented comprehensive price tracking for multi-timeframe signal analysis.
**Components Added:**
- lib/analysis/blocked-signal-tracker.ts - Background job tracking prices
- app/api/analytics/signal-tracking/route.ts - Status/metrics endpoint
**Features:**
- Automatic price tracking at 1min, 5min, 15min, 30min intervals
- TP1/TP2/SL hit detection using ATR-based targets
- Max favorable/adverse excursion tracking (MFE/MAE)
- Analysis completion after 30 minutes
- Background job runs every 5 minutes
- Entry price captured from signal time
**Database Changes:**
- Added entryPrice field to BlockedSignal (for price tracking baseline)
- Added maxFavorablePrice, maxAdversePrice fields
- Added maxFavorableExcursion, maxAdverseExcursion fields
**Integration:**
- Auto-starts on container startup
- Tracks all DATA_COLLECTION_ONLY signals
- Uses same TP/SL calculation as live trades (ATR-based)
- Calculates profit % based on direction (long vs short)
**API Endpoints:**
- GET /api/analytics/signal-tracking - View tracking status and metrics
- POST /api/analytics/signal-tracking - Manually trigger update (auth required)
**Purpose:**
Enables data-driven multi-timeframe comparison. After 50+ signals per
timeframe, can analyze which timeframe (5min vs 15min vs 1H vs 4H vs Daily)
has best win rate, profit potential, and signal quality.
**What It Tracks:**
- Price at 1min, 5min, 15min, 30min after signal
- Would TP1/TP2/SL have been hit?
- Maximum profit/loss during 30min window
- Complete analysis of signal profitability
**How It Works:**
1. Signal comes in (15min, 1H, 4H, Daily) → saved to BlockedSignal
2. Background job runs every 5min
3. Queries current price from Pyth
4. Calculates profit % from entry
5. Checks if TP/SL thresholds crossed
6. Updates MFE/MAE if new highs/lows
7. After 30min, marks analysisComplete=true
**Future Analysis:**
After 50+ signals per timeframe:
- Compare TP1 hit rates across timeframes
- Identify which timeframe has highest win rate
- Determine optimal signal frequency vs quality trade-off
- Switch production to best-performing timeframe
User requested: "i want all the bells and whistles. lets make the
powerhouse more powerfull. i cant see any reason why we shouldnt"
- TypeScript build error: currentPrice not in interface
- Correct field name is signalPrice (already defined)
- Fixes multi-timeframe data collection compilation
- Only 5min signals execute trades (production)
- 15min/1H/4H/Daily signals saved to BlockedSignal table for analysis
- Enables cross-timeframe performance comparison
- Zero financial risk - non-5min signals just collect data
- blockReason: 'DATA_COLLECTION_ONLY' for easy filtering
- Returns HTTP 200 (not 400) since this is expected behavior
- Prepares for future timeframe optimization decisions
- Moved positionManager.addTrade() to AFTER database save succeeds
- Changed database error handling to return HTTP 500 (not silent fail)
- Test endpoint now enforces same pattern as execute endpoint
- Prevents untracked positions when database save fails
- Root cause of trade manual-1763391075992 compounding to -19.43
Before: Test endpoint added to Position Manager first, saved to DB after
After: Test endpoint saves to DB first, only adds to PM if DB succeeds
Impact: No more untracked positions from test trades with failed DB saves
