Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...X....................X...X................X..............] duration: 6.45931188s FAIL (2025-08-15 15:28:15 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 15 15:16:22.685092094 (165h50m17.116172225s) [upload=172505]: Starting upload Aug 15 15:16:22.685142561 (165h50m17.116222692s) [upload=172505]: Done starting upload Aug 15 15:16:22.685325571 (165h50m17.116405703s) [upload=172505]: Uploading segments... Aug 15 15:16:22.685436684 (165h50m17.116516815s) [upload=172505]: Got next segment. Inline: false Aug 15 15:16:22.685470238 (165h50m17.116550369s) [upload=172505]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 15:16:22.685474446 (165h50m17.116554577s) [upload=172505]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 15 15:16:23.591082804 (165h50m18.022162945s) [seg_pos={0 0}, upload=172505]: Begin upload segment... Aug 15 15:16:23.591147928 (165h50m18.022228059s) [seg_pos={0 0}, upload=172505]: Done begin upload segment. Aug 15 15:16:23.591177995 (165h50m18.022258126s) [noise=true , address=104.36.82.18:4390 , piece_id=F6ETCYUTXLXZCH2ZZQ4Q73HNINZBINPNR6ZEGSOACBSDJS7N34BA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.591241937 (165h50m18.022322068s) [noise=true , address=104.36.82.60:4358 , piece_id=STJCTAGQOFXFQ7LTXAKG5PA7ZUK7OLJUFXADZRW4YXEXZJMIWGXQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.591778354 (165h50m18.022858485s) [noise=true , address=77.90.31.16:4740 , piece_id=MGTQCSACL7JQKXGD57P6NKCZOKUTIAIFF2YNBTEE7IYZZRCQ74TQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.591823260 (165h50m18.022903421s) [noise=true , address=77.90.31.13:4630 , piece_id=4ZGFWRPCU6LF34RSH22LHLDFFEICBZ3UKS2I43FMRDQAD5UTFWXA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.592211303 (165h50m18.023291434s) [noise=true , address=77.90.31.11:4580 , piece_id=O5D4EP4LUSSX6PTZTLRMCXEYIL6W2UXIHBNRDKN2VFVHGB5MFZGA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.592475017 (165h50m18.023555158s) [noise=true , address=77.90.31.18:4827 , piece_id=5DW7WZTN34P42BTTRUQ56LSFLBHS5QHO2HEKES2PT7ZHOSNQ72EA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.592996925 (165h50m18.024077056s) [noise=true , address=104.36.82.36:4626 , piece_id=X4U7SLWZRU5CL2T5IFC2HNOQ3D4HPUXA7TIFJUJYSUF3LMWDQNTA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.593335724 (165h50m18.024415855s) [noise=true , address=79.127.201.215:4343 , piece_id=MPMAQOMIURMVFNKXTJ5HLC5LJJCGOTY6HQPQCL2GH4YCMM2Q6FKQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.593672408 (165h50m18.024752539s) [noise=true , address=104.36.82.8:4974 , piece_id=2ZDFUCSOVMJHIGINANSMLVZVMZHM56XQ6OBJWUFDXONJ4D42XVPQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.594058457 (165h50m18.025138588s) [noise=true , address=104.36.82.23:4456 , piece_id=SX2YT3LIZ2MRT4DYRYZDKLO2ST4MHPNINCBTLGILGZWDO77FAQ3Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.594396543 (165h50m18.025476674s) [noise=true , address=79.127.220.101:4073 , piece_id=TJ26UR6WS6T6RBGA22EYWL33O2Z3IXPEVAOQVGDN5AUS4PDMDK7Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.594720794 (165h50m18.025800935s) [noise=true , address=77.90.31.17:4779 , piece_id=CYVPZUPZPHTUTH56H4GBMKBHFEXE7NWQZZJDPBKB2RWECBKUTT5A, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.595057868 (165h50m18.026137999s) [noise=true , address=45.91.116.6:4986 , piece_id=NHCYAM4OJSS6DBYNYWZCBG5QRHM5NUVI6UP5XNILC7F5GOOZ2W3Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.595398080 (165h50m18.026478211s) [noise=true , address=104.36.82.5:4864 , piece_id=WKB3ZBR6YDO2EUZKJFB42J6VFL3T6JYE652AYYOEQ6UMG5D3PINQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.595839625 (165h50m18.026919756s) [noise=true , address=104.36.82.44:4901 , piece_id=GF4LDYTH5Q4NS4PBIWBT4C4WBQ75ARYMJHOPO2XHXATDGMJ2AK6A, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.596180326 (165h50m18.027260457s) [noise=true , address=66.23.193.175:4557 , piece_id=2VQDLPFWGEOL63THQTDZJUSCZFQAUHL2AZLE6JYR6PJIVGV6VO2A, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.596567146 (165h50m18.027647287s) [noise=true , address=77.90.31.10:4523 , piece_id=D6D7XBHK3426ZA565EVVKLWTIA6LPL24QBGU5YH4BOXWJH6TE64Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.596896567 (165h50m18.027976698s) [noise=true , address=79.127.205.233:4628 , piece_id=WPIGFCQOIO7MSIJDR4RNO2ZYHBMVHTJQXRTOBP2JI3Z3M7ISILCA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:24.737329106 (165h50m19.168409237s) [upload=172505]: Next returned nil segment Aug 15 15:16:24.737345307 (165h50m19.168425438s) [upload=172505]: Waiting for error group managing segments... Aug 15 15:16:25.020682831 (165h50m19.451762962s) [noise=true , address=79.127.205.233:4628 , piece_id=WPIGFCQOIO7MSIJDR4RNO2ZYHBMVHTJQXRTOBP2JI3Z3M7ISILCA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.098977978 (165h50m19.530058109s) [noise=true , address=66.23.193.175:4557 , piece_id=2VQDLPFWGEOL63THQTDZJUSCZFQAUHL2AZLE6JYR6PJIVGV6VO2A, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.449295087 (165h50m19.880375218s) [noise=true , address=79.127.220.101:4073 , piece_id=TJ26UR6WS6T6RBGA22EYWL33O2Z3IXPEVAOQVGDN5AUS4PDMDK7Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.657174453 (165h50m20.088254574s) [noise=true , address=79.127.201.215:4343 , piece_id=MPMAQOMIURMVFNKXTJ5HLC5LJJCGOTY6HQPQCL2GH4YCMM2Q6FKQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.908657128 (165h50m20.339737249s) [noise=true , address=104.36.82.36:4626 , piece_id=X4U7SLWZRU5CL2T5IFC2HNOQ3D4HPUXA7TIFJUJYSUF3LMWDQNTA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.921525419 (165h50m20.35260555s) [noise=true , address=45.91.116.6:4986 , piece_id=NHCYAM4OJSS6DBYNYWZCBG5QRHM5NUVI6UP5XNILC7F5GOOZ2W3Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.937876515 (165h50m20.368956636s) [noise=true , address=104.36.82.8:4974 , piece_id=2ZDFUCSOVMJHIGINANSMLVZVMZHM56XQ6OBJWUFDXONJ4D42XVPQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.975679856 (165h50m20.406759977s) [noise=true , address=104.36.82.60:4358 , piece_id=STJCTAGQOFXFQ7LTXAKG5PA7ZUK7OLJUFXADZRW4YXEXZJMIWGXQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.125861536 (165h50m20.556941667s) [noise=true , address=77.90.31.18:4827 , piece_id=5DW7WZTN34P42BTTRUQ56LSFLBHS5QHO2HEKES2PT7ZHOSNQ72EA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.168492634 (165h50m20.599572826s) [noise=true , address=77.90.31.17:4779 , piece_id=CYVPZUPZPHTUTH56H4GBMKBHFEXE7NWQZZJDPBKB2RWECBKUTT5A, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.246449022 (165h50m20.677529153s) [noise=true , address=77.90.31.11:4580 , piece_id=O5D4EP4LUSSX6PTZTLRMCXEYIL6W2UXIHBNRDKN2VFVHGB5MFZGA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.380000574 (165h50m20.811080705s) [noise=true , address=77.90.31.16:4740 , piece_id=MGTQCSACL7JQKXGD57P6NKCZOKUTIAIFF2YNBTEE7IYZZRCQ74TQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.680781293 (165h50m21.111861484s) [noise=true , address=77.90.31.13:4630 , piece_id=4ZGFWRPCU6LF34RSH22LHLDFFEICBZ3UKS2I43FMRDQAD5UTFWXA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:27.013998946 (165h50m21.445079077s) [noise=true , address=104.36.82.44:4901 , piece_id=GF4LDYTH5Q4NS4PBIWBT4C4WBQ75ARYMJHOPO2XHXATDGMJ2AK6A, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:27.014022972 (165h50m21.445103103s) [seg_pos={0 0}, upload=172505]: Segment reached optimal threshold of 14 pieces. Aug 15 15:16:27.014278842 (165h50m21.445358973s) [noise=true , address=104.36.82.23:4456 , piece_id=SX2YT3LIZ2MRT4DYRYZDKLO2ST4MHPNINCBTLGILGZWDO77FAQ3Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XUZ2ggL9Q4V8uyJdwvwztqCTvj1DFGRWGtYzKJiaRVaByhfTx): protocol: rpc: dial tcp 104.36.82.23:4456: operation was canceled; conn closed: op Aug 15 15:16:27.014306455 (165h50m21.445386586s) [noise=true , address=104.36.82.5:4864 , piece_id=WKB3ZBR6YDO2EUZKJFB42J6VFL3T6JYE652AYYOEQ6UMG5D3PINQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XXH8TYK6Qfma867943QYYXycyL6osQhcQYEjdMdJVTUDfda2u): protocol: write tcp 188.166.225.170:40092->104.36.82.5:4864: use of closed network connection; write tcp 188.166.225.170:40092->104.36.82.5:4864: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40092->104.36.82.5:4864: use of closed network connection Aug 15 15:16:27.014375847 (165h50m21.445455978s) [noise=true , address=77.90.31.10:4523 , piece_id=D6D7XBHK3426ZA565EVVKLWTIA6LPL24QBGU5YH4BOXWJH6TE64Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LifXs8irH3dbLrzPnXzoCfaFyuUJxsN4rfyLEwTKGXSPxotPa): protocol: expected piece hash; context canceled; EOF Aug 15 15:16:27.014445771 (165h50m21.445525902s) [noise=true , address=104.36.82.18:4390 , piece_id=F6ETCYUTXLXZCH2ZZQ4Q73HNINZBINPNR6ZEGSOACBSDJS7N34BA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AZCJHCR7rF4r62Bg7NcBkpNoLb6r6rEN2a5hZ9KNxJTtjV8jp): protocol: write tcp 188.166.225.170:43784->104.36.82.18:4390: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 15:16:27.014470900 (165h50m21.445551031s) [seg_pos={0 0}, upload=172505]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 15 15:16:27.014539270 (165h50m21.445619401s) [upload=172505]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 15 15:16:27.014543768 (165h50m21.445623899s) [upload=172505]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 15:16:27.420799899 (165h50m21.85188003s) [upload=172505]: Done uploading segments... Aug 15 15:16:27.420818816 (165h50m21.851898937s) [upload=172505]: Upload finished. err: <nil> Duration: 6.4593331s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [...........................X....XX.........................X] duration: 872.638302ms FAIL (2025-08-15 15:28:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 15:28:13.354726990 (166h2m7.785807121s) [upload=172721]: Starting upload Aug 15 15:28:13.354779821 (166h2m7.785859942s) [upload=172721]: Done starting upload Aug 15 15:28:13.354838834 (166h2m7.785918965s) [upload=172721]: Uploading segments... Aug 15 15:28:13.354871616 (166h2m7.785951747s) [upload=172721]: Got next segment. Inline: true Aug 15 15:28:13.354875554 (166h2m7.785955675s) [upload=172721]: Waiting for error group managing segments... Aug 15 15:28:13.354908316 (166h2m7.785988447s) [upload=172721]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 15:28:13.354912695 (166h2m7.785992826s) [upload=172721]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 15:28:13.354915501 (166h2m7.785995632s) [upload=172721]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 15:28:13.572444759 (166h2m8.00352489s) [upload=172721]: Done uploading segments... Aug 15 15:28:13.572460630 (166h2m8.003540761s) [upload=172721]: Upload finished. err: metaclient: Too Many Requests Duration:* 872.656387ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [....X....................X...X................X.............] duration: 8.559268726s FAIL (2025-08-15 15:27:55 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 15 15:16:22.685092094 (165h50m17.116172225s) [upload=172505]: Starting upload Aug 15 15:16:22.685142561 (165h50m17.116222692s) [upload=172505]: Done starting upload Aug 15 15:16:22.685325571 (165h50m17.116405703s) [upload=172505]: Uploading segments... Aug 15 15:16:22.685436684 (165h50m17.116516815s) [upload=172505]: Got next segment. Inline: false Aug 15 15:16:22.685470238 (165h50m17.116550369s) [upload=172505]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 15:16:22.685474446 (165h50m17.116554577s) [upload=172505]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 15 15:16:23.591082804 (165h50m18.022162945s) [seg_pos={0 0}, upload=172505]: Begin upload segment... Aug 15 15:16:23.591147928 (165h50m18.022228059s) [seg_pos={0 0}, upload=172505]: Done begin upload segment. Aug 15 15:16:23.591177995 (165h50m18.022258126s) [noise=true , address=104.36.82.18:4390 , piece_id=F6ETCYUTXLXZCH2ZZQ4Q73HNINZBINPNR6ZEGSOACBSDJS7N34BA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.591241937 (165h50m18.022322068s) [noise=true , address=104.36.82.60:4358 , piece_id=STJCTAGQOFXFQ7LTXAKG5PA7ZUK7OLJUFXADZRW4YXEXZJMIWGXQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.591778354 (165h50m18.022858485s) [noise=true , address=77.90.31.16:4740 , piece_id=MGTQCSACL7JQKXGD57P6NKCZOKUTIAIFF2YNBTEE7IYZZRCQ74TQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.591823260 (165h50m18.022903421s) [noise=true , address=77.90.31.13:4630 , piece_id=4ZGFWRPCU6LF34RSH22LHLDFFEICBZ3UKS2I43FMRDQAD5UTFWXA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.592211303 (165h50m18.023291434s) [noise=true , address=77.90.31.11:4580 , piece_id=O5D4EP4LUSSX6PTZTLRMCXEYIL6W2UXIHBNRDKN2VFVHGB5MFZGA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.592475017 (165h50m18.023555158s) [noise=true , address=77.90.31.18:4827 , piece_id=5DW7WZTN34P42BTTRUQ56LSFLBHS5QHO2HEKES2PT7ZHOSNQ72EA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.592996925 (165h50m18.024077056s) [noise=true , address=104.36.82.36:4626 , piece_id=X4U7SLWZRU5CL2T5IFC2HNOQ3D4HPUXA7TIFJUJYSUF3LMWDQNTA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.593335724 (165h50m18.024415855s) [noise=true , address=79.127.201.215:4343 , piece_id=MPMAQOMIURMVFNKXTJ5HLC5LJJCGOTY6HQPQCL2GH4YCMM2Q6FKQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.593672408 (165h50m18.024752539s) [noise=true , address=104.36.82.8:4974 , piece_id=2ZDFUCSOVMJHIGINANSMLVZVMZHM56XQ6OBJWUFDXONJ4D42XVPQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.594058457 (165h50m18.025138588s) [noise=true , address=104.36.82.23:4456 , piece_id=SX2YT3LIZ2MRT4DYRYZDKLO2ST4MHPNINCBTLGILGZWDO77FAQ3Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.594396543 (165h50m18.025476674s) [noise=true , address=79.127.220.101:4073 , piece_id=TJ26UR6WS6T6RBGA22EYWL33O2Z3IXPEVAOQVGDN5AUS4PDMDK7Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.594720794 (165h50m18.025800935s) [noise=true , address=77.90.31.17:4779 , piece_id=CYVPZUPZPHTUTH56H4GBMKBHFEXE7NWQZZJDPBKB2RWECBKUTT5A, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.595057868 (165h50m18.026137999s) [noise=true , address=45.91.116.6:4986 , piece_id=NHCYAM4OJSS6DBYNYWZCBG5QRHM5NUVI6UP5XNILC7F5GOOZ2W3Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.595398080 (165h50m18.026478211s) [noise=true , address=104.36.82.5:4864 , piece_id=WKB3ZBR6YDO2EUZKJFB42J6VFL3T6JYE652AYYOEQ6UMG5D3PINQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.595839625 (165h50m18.026919756s) [noise=true , address=104.36.82.44:4901 , piece_id=GF4LDYTH5Q4NS4PBIWBT4C4WBQ75ARYMJHOPO2XHXATDGMJ2AK6A, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.596180326 (165h50m18.027260457s) [noise=true , address=66.23.193.175:4557 , piece_id=2VQDLPFWGEOL63THQTDZJUSCZFQAUHL2AZLE6JYR6PJIVGV6VO2A, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.596567146 (165h50m18.027647287s) [noise=true , address=77.90.31.10:4523 , piece_id=D6D7XBHK3426ZA565EVVKLWTIA6LPL24QBGU5YH4BOXWJH6TE64Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.596896567 (165h50m18.027976698s) [noise=true , address=79.127.205.233:4628 , piece_id=WPIGFCQOIO7MSIJDR4RNO2ZYHBMVHTJQXRTOBP2JI3Z3M7ISILCA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:24.737329106 (165h50m19.168409237s) [upload=172505]: Next returned nil segment Aug 15 15:16:24.737345307 (165h50m19.168425438s) [upload=172505]: Waiting for error group managing segments... Aug 15 15:16:25.020682831 (165h50m19.451762962s) [noise=true , address=79.127.205.233:4628 , piece_id=WPIGFCQOIO7MSIJDR4RNO2ZYHBMVHTJQXRTOBP2JI3Z3M7ISILCA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.098977978 (165h50m19.530058109s) [noise=true , address=66.23.193.175:4557 , piece_id=2VQDLPFWGEOL63THQTDZJUSCZFQAUHL2AZLE6JYR6PJIVGV6VO2A, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.449295087 (165h50m19.880375218s) [noise=true , address=79.127.220.101:4073 , piece_id=TJ26UR6WS6T6RBGA22EYWL33O2Z3IXPEVAOQVGDN5AUS4PDMDK7Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.657174453 (165h50m20.088254574s) [noise=true , address=79.127.201.215:4343 , piece_id=MPMAQOMIURMVFNKXTJ5HLC5LJJCGOTY6HQPQCL2GH4YCMM2Q6FKQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.908657128 (165h50m20.339737249s) [noise=true , address=104.36.82.36:4626 , piece_id=X4U7SLWZRU5CL2T5IFC2HNOQ3D4HPUXA7TIFJUJYSUF3LMWDQNTA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.921525419 (165h50m20.35260555s) [noise=true , address=45.91.116.6:4986 , piece_id=NHCYAM4OJSS6DBYNYWZCBG5QRHM5NUVI6UP5XNILC7F5GOOZ2W3Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.937876515 (165h50m20.368956636s) [noise=true , address=104.36.82.8:4974 , piece_id=2ZDFUCSOVMJHIGINANSMLVZVMZHM56XQ6OBJWUFDXONJ4D42XVPQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.975679856 (165h50m20.406759977s) [noise=true , address=104.36.82.60:4358 , piece_id=STJCTAGQOFXFQ7LTXAKG5PA7ZUK7OLJUFXADZRW4YXEXZJMIWGXQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.125861536 (165h50m20.556941667s) [noise=true , address=77.90.31.18:4827 , piece_id=5DW7WZTN34P42BTTRUQ56LSFLBHS5QHO2HEKES2PT7ZHOSNQ72EA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.168492634 (165h50m20.599572826s) [noise=true , address=77.90.31.17:4779 , piece_id=CYVPZUPZPHTUTH56H4GBMKBHFEXE7NWQZZJDPBKB2RWECBKUTT5A, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.246449022 (165h50m20.677529153s) [noise=true , address=77.90.31.11:4580 , piece_id=O5D4EP4LUSSX6PTZTLRMCXEYIL6W2UXIHBNRDKN2VFVHGB5MFZGA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.380000574 (165h50m20.811080705s) [noise=true , address=77.90.31.16:4740 , piece_id=MGTQCSACL7JQKXGD57P6NKCZOKUTIAIFF2YNBTEE7IYZZRCQ74TQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.680781293 (165h50m21.111861484s) [noise=true , address=77.90.31.13:4630 , piece_id=4ZGFWRPCU6LF34RSH22LHLDFFEICBZ3UKS2I43FMRDQAD5UTFWXA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:27.013998946 (165h50m21.445079077s) [noise=true , address=104.36.82.44:4901 , piece_id=GF4LDYTH5Q4NS4PBIWBT4C4WBQ75ARYMJHOPO2XHXATDGMJ2AK6A, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:27.014022972 (165h50m21.445103103s) [seg_pos={0 0}, upload=172505]: Segment reached optimal threshold of 14 pieces. Aug 15 15:16:27.014278842 (165h50m21.445358973s) [noise=true , address=104.36.82.23:4456 , piece_id=SX2YT3LIZ2MRT4DYRYZDKLO2ST4MHPNINCBTLGILGZWDO77FAQ3Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XUZ2ggL9Q4V8uyJdwvwztqCTvj1DFGRWGtYzKJiaRVaByhfTx): protocol: rpc: dial tcp 104.36.82.23:4456: operation was canceled; conn closed: op Aug 15 15:16:27.014306455 (165h50m21.445386586s) [noise=true , address=104.36.82.5:4864 , piece_id=WKB3ZBR6YDO2EUZKJFB42J6VFL3T6JYE652AYYOEQ6UMG5D3PINQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XXH8TYK6Qfma867943QYYXycyL6osQhcQYEjdMdJVTUDfda2u): protocol: write tcp 188.166.225.170:40092->104.36.82.5:4864: use of closed network connection; write tcp 188.166.225.170:40092->104.36.82.5:4864: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40092->104.36.82.5:4864: use of closed network connection Aug 15 15:16:27.014375847 (165h50m21.445455978s) [noise=true , address=77.90.31.10:4523 , piece_id=D6D7XBHK3426ZA565EVVKLWTIA6LPL24QBGU5YH4BOXWJH6TE64Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LifXs8irH3dbLrzPnXzoCfaFyuUJxsN4rfyLEwTKGXSPxotPa): protocol: expected piece hash; context canceled; EOF Aug 15 15:16:27.014445771 (165h50m21.445525902s) [noise=true , address=104.36.82.18:4390 , piece_id=F6ETCYUTXLXZCH2ZZQ4Q73HNINZBINPNR6ZEGSOACBSDJS7N34BA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AZCJHCR7rF4r62Bg7NcBkpNoLb6r6rEN2a5hZ9KNxJTtjV8jp): protocol: write tcp 188.166.225.170:43784->104.36.82.18:4390: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 15:16:27.014470900 (165h50m21.445551031s) [seg_pos={0 0}, upload=172505]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 15 15:16:27.014539270 (165h50m21.445619401s) [upload=172505]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 15 15:16:27.014543768 (165h50m21.445623899s) [upload=172505]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 15:16:27.420799899 (165h50m21.85188003s) [upload=172505]: Done uploading segments... Aug 15 15:16:27.420818816 (165h50m21.851898937s) [upload=172505]: Upload finished. err: <nil> Duration: 8.559293746s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.....X....................X...X................X............] duration: 7.573181661s FAIL (2025-08-15 15:27:10 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 15 15:16:22.685092094 (165h50m17.116172225s) [upload=172505]: Starting upload Aug 15 15:16:22.685142561 (165h50m17.116222692s) [upload=172505]: Done starting upload Aug 15 15:16:22.685325571 (165h50m17.116405703s) [upload=172505]: Uploading segments... Aug 15 15:16:22.685436684 (165h50m17.116516815s) [upload=172505]: Got next segment. Inline: false Aug 15 15:16:22.685470238 (165h50m17.116550369s) [upload=172505]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 15:16:22.685474446 (165h50m17.116554577s) [upload=172505]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 15 15:16:23.591082804 (165h50m18.022162945s) [seg_pos={0 0}, upload=172505]: Begin upload segment... Aug 15 15:16:23.591147928 (165h50m18.022228059s) [seg_pos={0 0}, upload=172505]: Done begin upload segment. Aug 15 15:16:23.591177995 (165h50m18.022258126s) [noise=true , address=104.36.82.18:4390 , piece_id=F6ETCYUTXLXZCH2ZZQ4Q73HNINZBINPNR6ZEGSOACBSDJS7N34BA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.591241937 (165h50m18.022322068s) [noise=true , address=104.36.82.60:4358 , piece_id=STJCTAGQOFXFQ7LTXAKG5PA7ZUK7OLJUFXADZRW4YXEXZJMIWGXQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.591778354 (165h50m18.022858485s) [noise=true , address=77.90.31.16:4740 , piece_id=MGTQCSACL7JQKXGD57P6NKCZOKUTIAIFF2YNBTEE7IYZZRCQ74TQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.591823260 (165h50m18.022903421s) [noise=true , address=77.90.31.13:4630 , piece_id=4ZGFWRPCU6LF34RSH22LHLDFFEICBZ3UKS2I43FMRDQAD5UTFWXA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.592211303 (165h50m18.023291434s) [noise=true , address=77.90.31.11:4580 , piece_id=O5D4EP4LUSSX6PTZTLRMCXEYIL6W2UXIHBNRDKN2VFVHGB5MFZGA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.592475017 (165h50m18.023555158s) [noise=true , address=77.90.31.18:4827 , piece_id=5DW7WZTN34P42BTTRUQ56LSFLBHS5QHO2HEKES2PT7ZHOSNQ72EA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.592996925 (165h50m18.024077056s) [noise=true , address=104.36.82.36:4626 , piece_id=X4U7SLWZRU5CL2T5IFC2HNOQ3D4HPUXA7TIFJUJYSUF3LMWDQNTA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.593335724 (165h50m18.024415855s) [noise=true , address=79.127.201.215:4343 , piece_id=MPMAQOMIURMVFNKXTJ5HLC5LJJCGOTY6HQPQCL2GH4YCMM2Q6FKQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.593672408 (165h50m18.024752539s) [noise=true , address=104.36.82.8:4974 , piece_id=2ZDFUCSOVMJHIGINANSMLVZVMZHM56XQ6OBJWUFDXONJ4D42XVPQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.594058457 (165h50m18.025138588s) [noise=true , address=104.36.82.23:4456 , piece_id=SX2YT3LIZ2MRT4DYRYZDKLO2ST4MHPNINCBTLGILGZWDO77FAQ3Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.594396543 (165h50m18.025476674s) [noise=true , address=79.127.220.101:4073 , piece_id=TJ26UR6WS6T6RBGA22EYWL33O2Z3IXPEVAOQVGDN5AUS4PDMDK7Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.594720794 (165h50m18.025800935s) [noise=true , address=77.90.31.17:4779 , piece_id=CYVPZUPZPHTUTH56H4GBMKBHFEXE7NWQZZJDPBKB2RWECBKUTT5A, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.595057868 (165h50m18.026137999s) [noise=true , address=45.91.116.6:4986 , piece_id=NHCYAM4OJSS6DBYNYWZCBG5QRHM5NUVI6UP5XNILC7F5GOOZ2W3Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.595398080 (165h50m18.026478211s) [noise=true , address=104.36.82.5:4864 , piece_id=WKB3ZBR6YDO2EUZKJFB42J6VFL3T6JYE652AYYOEQ6UMG5D3PINQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.595839625 (165h50m18.026919756s) [noise=true , address=104.36.82.44:4901 , piece_id=GF4LDYTH5Q4NS4PBIWBT4C4WBQ75ARYMJHOPO2XHXATDGMJ2AK6A, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.596180326 (165h50m18.027260457s) [noise=true , address=66.23.193.175:4557 , piece_id=2VQDLPFWGEOL63THQTDZJUSCZFQAUHL2AZLE6JYR6PJIVGV6VO2A, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.596567146 (165h50m18.027647287s) [noise=true , address=77.90.31.10:4523 , piece_id=D6D7XBHK3426ZA565EVVKLWTIA6LPL24QBGU5YH4BOXWJH6TE64Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.596896567 (165h50m18.027976698s) [noise=true , address=79.127.205.233:4628 , piece_id=WPIGFCQOIO7MSIJDR4RNO2ZYHBMVHTJQXRTOBP2JI3Z3M7ISILCA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:24.737329106 (165h50m19.168409237s) [upload=172505]: Next returned nil segment Aug 15 15:16:24.737345307 (165h50m19.168425438s) [upload=172505]: Waiting for error group managing segments... Aug 15 15:16:25.020682831 (165h50m19.451762962s) [noise=true , address=79.127.205.233:4628 , piece_id=WPIGFCQOIO7MSIJDR4RNO2ZYHBMVHTJQXRTOBP2JI3Z3M7ISILCA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.098977978 (165h50m19.530058109s) [noise=true , address=66.23.193.175:4557 , piece_id=2VQDLPFWGEOL63THQTDZJUSCZFQAUHL2AZLE6JYR6PJIVGV6VO2A, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.449295087 (165h50m19.880375218s) [noise=true , address=79.127.220.101:4073 , piece_id=TJ26UR6WS6T6RBGA22EYWL33O2Z3IXPEVAOQVGDN5AUS4PDMDK7Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.657174453 (165h50m20.088254574s) [noise=true , address=79.127.201.215:4343 , piece_id=MPMAQOMIURMVFNKXTJ5HLC5LJJCGOTY6HQPQCL2GH4YCMM2Q6FKQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.908657128 (165h50m20.339737249s) [noise=true , address=104.36.82.36:4626 , piece_id=X4U7SLWZRU5CL2T5IFC2HNOQ3D4HPUXA7TIFJUJYSUF3LMWDQNTA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.921525419 (165h50m20.35260555s) [noise=true , address=45.91.116.6:4986 , piece_id=NHCYAM4OJSS6DBYNYWZCBG5QRHM5NUVI6UP5XNILC7F5GOOZ2W3Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.937876515 (165h50m20.368956636s) [noise=true , address=104.36.82.8:4974 , piece_id=2ZDFUCSOVMJHIGINANSMLVZVMZHM56XQ6OBJWUFDXONJ4D42XVPQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.975679856 (165h50m20.406759977s) [noise=true , address=104.36.82.60:4358 , piece_id=STJCTAGQOFXFQ7LTXAKG5PA7ZUK7OLJUFXADZRW4YXEXZJMIWGXQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.125861536 (165h50m20.556941667s) [noise=true , address=77.90.31.18:4827 , piece_id=5DW7WZTN34P42BTTRUQ56LSFLBHS5QHO2HEKES2PT7ZHOSNQ72EA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.168492634 (165h50m20.599572826s) [noise=true , address=77.90.31.17:4779 , piece_id=CYVPZUPZPHTUTH56H4GBMKBHFEXE7NWQZZJDPBKB2RWECBKUTT5A, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.246449022 (165h50m20.677529153s) [noise=true , address=77.90.31.11:4580 , piece_id=O5D4EP4LUSSX6PTZTLRMCXEYIL6W2UXIHBNRDKN2VFVHGB5MFZGA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.380000574 (165h50m20.811080705s) [noise=true , address=77.90.31.16:4740 , piece_id=MGTQCSACL7JQKXGD57P6NKCZOKUTIAIFF2YNBTEE7IYZZRCQ74TQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.680781293 (165h50m21.111861484s) [noise=true , address=77.90.31.13:4630 , piece_id=4ZGFWRPCU6LF34RSH22LHLDFFEICBZ3UKS2I43FMRDQAD5UTFWXA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:27.013998946 (165h50m21.445079077s) [noise=true , address=104.36.82.44:4901 , piece_id=GF4LDYTH5Q4NS4PBIWBT4C4WBQ75ARYMJHOPO2XHXATDGMJ2AK6A, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:27.014022972 (165h50m21.445103103s) [seg_pos={0 0}, upload=172505]: Segment reached optimal threshold of 14 pieces. Aug 15 15:16:27.014278842 (165h50m21.445358973s) [noise=true , address=104.36.82.23:4456 , piece_id=SX2YT3LIZ2MRT4DYRYZDKLO2ST4MHPNINCBTLGILGZWDO77FAQ3Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XUZ2ggL9Q4V8uyJdwvwztqCTvj1DFGRWGtYzKJiaRVaByhfTx): protocol: rpc: dial tcp 104.36.82.23:4456: operation was canceled; conn closed: op Aug 15 15:16:27.014306455 (165h50m21.445386586s) [noise=true , address=104.36.82.5:4864 , piece_id=WKB3ZBR6YDO2EUZKJFB42J6VFL3T6JYE652AYYOEQ6UMG5D3PINQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XXH8TYK6Qfma867943QYYXycyL6osQhcQYEjdMdJVTUDfda2u): protocol: write tcp 188.166.225.170:40092->104.36.82.5:4864: use of closed network connection; write tcp 188.166.225.170:40092->104.36.82.5:4864: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40092->104.36.82.5:4864: use of closed network connection Aug 15 15:16:27.014375847 (165h50m21.445455978s) [noise=true , address=77.90.31.10:4523 , piece_id=D6D7XBHK3426ZA565EVVKLWTIA6LPL24QBGU5YH4BOXWJH6TE64Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LifXs8irH3dbLrzPnXzoCfaFyuUJxsN4rfyLEwTKGXSPxotPa): protocol: expected piece hash; context canceled; EOF Aug 15 15:16:27.014445771 (165h50m21.445525902s) [noise=true , address=104.36.82.18:4390 , piece_id=F6ETCYUTXLXZCH2ZZQ4Q73HNINZBINPNR6ZEGSOACBSDJS7N34BA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AZCJHCR7rF4r62Bg7NcBkpNoLb6r6rEN2a5hZ9KNxJTtjV8jp): protocol: write tcp 188.166.225.170:43784->104.36.82.18:4390: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 15:16:27.014470900 (165h50m21.445551031s) [seg_pos={0 0}, upload=172505]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 15 15:16:27.014539270 (165h50m21.445619401s) [upload=172505]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 15 15:16:27.014543768 (165h50m21.445623899s) [upload=172505]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 15:16:27.420799899 (165h50m21.85188003s) [upload=172505]: Done uploading segments... Aug 15 15:16:27.420818816 (165h50m21.851898937s) [upload=172505]: Upload finished. err: <nil> Duration: 7.573208282s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [............................X....XX.........................] duration: 1.88533465s FAIL (2025-08-15 15:26:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 15:08:23.568800831 (165h42m17.999880962s) [upload=172360]: Starting upload Aug 15 15:08:23.568843131 (165h42m17.999923262s) [upload=172360]: Done starting upload Aug 15 15:08:23.568892736 (165h42m17.999972868s) [upload=172360]: Uploading segments... Aug 15 15:08:23.568932031 (165h42m18.000012162s) [upload=172360]: Got next segment. Inline: true Aug 15 15:08:23.568936339 (165h42m18.00001647s) [upload=172360]: Waiting for error group managing segments... Aug 15 15:08:23.568970776 (165h42m18.000050897s) [upload=172360]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 15:08:23.568974854 (165h42m18.000054985s) [upload=172360]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 15:08:23.568977499 (165h42m18.00005763s) [upload=172360]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 15:08:23.783715648 (165h42m18.214795779s) [upload=172360]: Done uploading segments... Aug 15 15:08:23.783733201 (165h42m18.214813332s) [upload=172360]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.885362271s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.............................X....XX........................] duration: 1.826476604s FAIL (2025-08-15 15:26:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 15:08:23.568800831 (165h42m17.999880962s) [upload=172360]: Starting upload Aug 15 15:08:23.568843131 (165h42m17.999923262s) [upload=172360]: Done starting upload Aug 15 15:08:23.568892736 (165h42m17.999972868s) [upload=172360]: Uploading segments... Aug 15 15:08:23.568932031 (165h42m18.000012162s) [upload=172360]: Got next segment. Inline: true Aug 15 15:08:23.568936339 (165h42m18.00001647s) [upload=172360]: Waiting for error group managing segments... Aug 15 15:08:23.568970776 (165h42m18.000050897s) [upload=172360]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 15:08:23.568974854 (165h42m18.000054985s) [upload=172360]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 15:08:23.568977499 (165h42m18.00005763s) [upload=172360]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 15:08:23.783715648 (165h42m18.214795779s) [upload=172360]: Done uploading segments... Aug 15 15:08:23.783733201 (165h42m18.214813332s) [upload=172360]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.826503015s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [......X....................X...X................X...........] duration: 6.854269205s FAIL (2025-08-15 15:25:58 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 15 15:16:22.685092094 (165h50m17.116172225s) [upload=172505]: Starting upload Aug 15 15:16:22.685142561 (165h50m17.116222692s) [upload=172505]: Done starting upload Aug 15 15:16:22.685325571 (165h50m17.116405703s) [upload=172505]: Uploading segments... Aug 15 15:16:22.685436684 (165h50m17.116516815s) [upload=172505]: Got next segment. Inline: false Aug 15 15:16:22.685470238 (165h50m17.116550369s) [upload=172505]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 15:16:22.685474446 (165h50m17.116554577s) [upload=172505]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 15 15:16:23.591082804 (165h50m18.022162945s) [seg_pos={0 0}, upload=172505]: Begin upload segment... Aug 15 15:16:23.591147928 (165h50m18.022228059s) [seg_pos={0 0}, upload=172505]: Done begin upload segment. Aug 15 15:16:23.591177995 (165h50m18.022258126s) [noise=true , address=104.36.82.18:4390 , piece_id=F6ETCYUTXLXZCH2ZZQ4Q73HNINZBINPNR6ZEGSOACBSDJS7N34BA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.591241937 (165h50m18.022322068s) [noise=true , address=104.36.82.60:4358 , piece_id=STJCTAGQOFXFQ7LTXAKG5PA7ZUK7OLJUFXADZRW4YXEXZJMIWGXQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.591778354 (165h50m18.022858485s) [noise=true , address=77.90.31.16:4740 , piece_id=MGTQCSACL7JQKXGD57P6NKCZOKUTIAIFF2YNBTEE7IYZZRCQ74TQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.591823260 (165h50m18.022903421s) [noise=true , address=77.90.31.13:4630 , piece_id=4ZGFWRPCU6LF34RSH22LHLDFFEICBZ3UKS2I43FMRDQAD5UTFWXA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.592211303 (165h50m18.023291434s) [noise=true , address=77.90.31.11:4580 , piece_id=O5D4EP4LUSSX6PTZTLRMCXEYIL6W2UXIHBNRDKN2VFVHGB5MFZGA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.592475017 (165h50m18.023555158s) [noise=true , address=77.90.31.18:4827 , piece_id=5DW7WZTN34P42BTTRUQ56LSFLBHS5QHO2HEKES2PT7ZHOSNQ72EA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.592996925 (165h50m18.024077056s) [noise=true , address=104.36.82.36:4626 , piece_id=X4U7SLWZRU5CL2T5IFC2HNOQ3D4HPUXA7TIFJUJYSUF3LMWDQNTA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.593335724 (165h50m18.024415855s) [noise=true , address=79.127.201.215:4343 , piece_id=MPMAQOMIURMVFNKXTJ5HLC5LJJCGOTY6HQPQCL2GH4YCMM2Q6FKQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.593672408 (165h50m18.024752539s) [noise=true , address=104.36.82.8:4974 , piece_id=2ZDFUCSOVMJHIGINANSMLVZVMZHM56XQ6OBJWUFDXONJ4D42XVPQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.594058457 (165h50m18.025138588s) [noise=true , address=104.36.82.23:4456 , piece_id=SX2YT3LIZ2MRT4DYRYZDKLO2ST4MHPNINCBTLGILGZWDO77FAQ3Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.594396543 (165h50m18.025476674s) [noise=true , address=79.127.220.101:4073 , piece_id=TJ26UR6WS6T6RBGA22EYWL33O2Z3IXPEVAOQVGDN5AUS4PDMDK7Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.594720794 (165h50m18.025800935s) [noise=true , address=77.90.31.17:4779 , piece_id=CYVPZUPZPHTUTH56H4GBMKBHFEXE7NWQZZJDPBKB2RWECBKUTT5A, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.595057868 (165h50m18.026137999s) [noise=true , address=45.91.116.6:4986 , piece_id=NHCYAM4OJSS6DBYNYWZCBG5QRHM5NUVI6UP5XNILC7F5GOOZ2W3Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.595398080 (165h50m18.026478211s) [noise=true , address=104.36.82.5:4864 , piece_id=WKB3ZBR6YDO2EUZKJFB42J6VFL3T6JYE652AYYOEQ6UMG5D3PINQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.595839625 (165h50m18.026919756s) [noise=true , address=104.36.82.44:4901 , piece_id=GF4LDYTH5Q4NS4PBIWBT4C4WBQ75ARYMJHOPO2XHXATDGMJ2AK6A, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.596180326 (165h50m18.027260457s) [noise=true , address=66.23.193.175:4557 , piece_id=2VQDLPFWGEOL63THQTDZJUSCZFQAUHL2AZLE6JYR6PJIVGV6VO2A, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.596567146 (165h50m18.027647287s) [noise=true , address=77.90.31.10:4523 , piece_id=D6D7XBHK3426ZA565EVVKLWTIA6LPL24QBGU5YH4BOXWJH6TE64Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.596896567 (165h50m18.027976698s) [noise=true , address=79.127.205.233:4628 , piece_id=WPIGFCQOIO7MSIJDR4RNO2ZYHBMVHTJQXRTOBP2JI3Z3M7ISILCA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:24.737329106 (165h50m19.168409237s) [upload=172505]: Next returned nil segment Aug 15 15:16:24.737345307 (165h50m19.168425438s) [upload=172505]: Waiting for error group managing segments... Aug 15 15:16:25.020682831 (165h50m19.451762962s) [noise=true , address=79.127.205.233:4628 , piece_id=WPIGFCQOIO7MSIJDR4RNO2ZYHBMVHTJQXRTOBP2JI3Z3M7ISILCA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.098977978 (165h50m19.530058109s) [noise=true , address=66.23.193.175:4557 , piece_id=2VQDLPFWGEOL63THQTDZJUSCZFQAUHL2AZLE6JYR6PJIVGV6VO2A, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.449295087 (165h50m19.880375218s) [noise=true , address=79.127.220.101:4073 , piece_id=TJ26UR6WS6T6RBGA22EYWL33O2Z3IXPEVAOQVGDN5AUS4PDMDK7Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.657174453 (165h50m20.088254574s) [noise=true , address=79.127.201.215:4343 , piece_id=MPMAQOMIURMVFNKXTJ5HLC5LJJCGOTY6HQPQCL2GH4YCMM2Q6FKQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.908657128 (165h50m20.339737249s) [noise=true , address=104.36.82.36:4626 , piece_id=X4U7SLWZRU5CL2T5IFC2HNOQ3D4HPUXA7TIFJUJYSUF3LMWDQNTA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.921525419 (165h50m20.35260555s) [noise=true , address=45.91.116.6:4986 , piece_id=NHCYAM4OJSS6DBYNYWZCBG5QRHM5NUVI6UP5XNILC7F5GOOZ2W3Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.937876515 (165h50m20.368956636s) [noise=true , address=104.36.82.8:4974 , piece_id=2ZDFUCSOVMJHIGINANSMLVZVMZHM56XQ6OBJWUFDXONJ4D42XVPQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.975679856 (165h50m20.406759977s) [noise=true , address=104.36.82.60:4358 , piece_id=STJCTAGQOFXFQ7LTXAKG5PA7ZUK7OLJUFXADZRW4YXEXZJMIWGXQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.125861536 (165h50m20.556941667s) [noise=true , address=77.90.31.18:4827 , piece_id=5DW7WZTN34P42BTTRUQ56LSFLBHS5QHO2HEKES2PT7ZHOSNQ72EA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.168492634 (165h50m20.599572826s) [noise=true , address=77.90.31.17:4779 , piece_id=CYVPZUPZPHTUTH56H4GBMKBHFEXE7NWQZZJDPBKB2RWECBKUTT5A, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.246449022 (165h50m20.677529153s) [noise=true , address=77.90.31.11:4580 , piece_id=O5D4EP4LUSSX6PTZTLRMCXEYIL6W2UXIHBNRDKN2VFVHGB5MFZGA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.380000574 (165h50m20.811080705s) [noise=true , address=77.90.31.16:4740 , piece_id=MGTQCSACL7JQKXGD57P6NKCZOKUTIAIFF2YNBTEE7IYZZRCQ74TQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.680781293 (165h50m21.111861484s) [noise=true , address=77.90.31.13:4630 , piece_id=4ZGFWRPCU6LF34RSH22LHLDFFEICBZ3UKS2I43FMRDQAD5UTFWXA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:27.013998946 (165h50m21.445079077s) [noise=true , address=104.36.82.44:4901 , piece_id=GF4LDYTH5Q4NS4PBIWBT4C4WBQ75ARYMJHOPO2XHXATDGMJ2AK6A, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:27.014022972 (165h50m21.445103103s) [seg_pos={0 0}, upload=172505]: Segment reached optimal threshold of 14 pieces. Aug 15 15:16:27.014278842 (165h50m21.445358973s) [noise=true , address=104.36.82.23:4456 , piece_id=SX2YT3LIZ2MRT4DYRYZDKLO2ST4MHPNINCBTLGILGZWDO77FAQ3Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XUZ2ggL9Q4V8uyJdwvwztqCTvj1DFGRWGtYzKJiaRVaByhfTx): protocol: rpc: dial tcp 104.36.82.23:4456: operation was canceled; conn closed: op Aug 15 15:16:27.014306455 (165h50m21.445386586s) [noise=true , address=104.36.82.5:4864 , piece_id=WKB3ZBR6YDO2EUZKJFB42J6VFL3T6JYE652AYYOEQ6UMG5D3PINQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XXH8TYK6Qfma867943QYYXycyL6osQhcQYEjdMdJVTUDfda2u): protocol: write tcp 188.166.225.170:40092->104.36.82.5:4864: use of closed network connection; write tcp 188.166.225.170:40092->104.36.82.5:4864: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40092->104.36.82.5:4864: use of closed network connection Aug 15 15:16:27.014375847 (165h50m21.445455978s) [noise=true , address=77.90.31.10:4523 , piece_id=D6D7XBHK3426ZA565EVVKLWTIA6LPL24QBGU5YH4BOXWJH6TE64Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LifXs8irH3dbLrzPnXzoCfaFyuUJxsN4rfyLEwTKGXSPxotPa): protocol: expected piece hash; context canceled; EOF Aug 15 15:16:27.014445771 (165h50m21.445525902s) [noise=true , address=104.36.82.18:4390 , piece_id=F6ETCYUTXLXZCH2ZZQ4Q73HNINZBINPNR6ZEGSOACBSDJS7N34BA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AZCJHCR7rF4r62Bg7NcBkpNoLb6r6rEN2a5hZ9KNxJTtjV8jp): protocol: write tcp 188.166.225.170:43784->104.36.82.18:4390: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 15:16:27.014470900 (165h50m21.445551031s) [seg_pos={0 0}, upload=172505]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 15 15:16:27.014539270 (165h50m21.445619401s) [upload=172505]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 15 15:16:27.014543768 (165h50m21.445623899s) [upload=172505]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 15:16:27.420799899 (165h50m21.85188003s) [upload=172505]: Done uploading segments... Aug 15 15:16:27.420818816 (165h50m21.851898937s) [upload=172505]: Upload finished. err: <nil> Duration: 6.854288882s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..............................X....XX.......................] duration: 1.873979622s FAIL (2025-08-15 15:25:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 15:08:23.568800831 (165h42m17.999880962s) [upload=172360]: Starting upload Aug 15 15:08:23.568843131 (165h42m17.999923262s) [upload=172360]: Done starting upload Aug 15 15:08:23.568892736 (165h42m17.999972868s) [upload=172360]: Uploading segments... Aug 15 15:08:23.568932031 (165h42m18.000012162s) [upload=172360]: Got next segment. Inline: true Aug 15 15:08:23.568936339 (165h42m18.00001647s) [upload=172360]: Waiting for error group managing segments... Aug 15 15:08:23.568970776 (165h42m18.000050897s) [upload=172360]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 15:08:23.568974854 (165h42m18.000054985s) [upload=172360]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 15:08:23.568977499 (165h42m18.00005763s) [upload=172360]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 15:08:23.783715648 (165h42m18.214795779s) [upload=172360]: Done uploading segments... Aug 15 15:08:23.783733201 (165h42m18.214813332s) [upload=172360]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.874000642s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.......X....................X...X................X..........] duration: 7.041786321s FAIL (2025-08-15 15:24:51 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 15 15:16:22.685092094 (165h50m17.116172225s) [upload=172505]: Starting upload Aug 15 15:16:22.685142561 (165h50m17.116222692s) [upload=172505]: Done starting upload Aug 15 15:16:22.685325571 (165h50m17.116405703s) [upload=172505]: Uploading segments... Aug 15 15:16:22.685436684 (165h50m17.116516815s) [upload=172505]: Got next segment. Inline: false Aug 15 15:16:22.685470238 (165h50m17.116550369s) [upload=172505]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 15:16:22.685474446 (165h50m17.116554577s) [upload=172505]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 15 15:16:23.591082804 (165h50m18.022162945s) [seg_pos={0 0}, upload=172505]: Begin upload segment... Aug 15 15:16:23.591147928 (165h50m18.022228059s) [seg_pos={0 0}, upload=172505]: Done begin upload segment. Aug 15 15:16:23.591177995 (165h50m18.022258126s) [noise=true , address=104.36.82.18:4390 , piece_id=F6ETCYUTXLXZCH2ZZQ4Q73HNINZBINPNR6ZEGSOACBSDJS7N34BA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.591241937 (165h50m18.022322068s) [noise=true , address=104.36.82.60:4358 , piece_id=STJCTAGQOFXFQ7LTXAKG5PA7ZUK7OLJUFXADZRW4YXEXZJMIWGXQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.591778354 (165h50m18.022858485s) [noise=true , address=77.90.31.16:4740 , piece_id=MGTQCSACL7JQKXGD57P6NKCZOKUTIAIFF2YNBTEE7IYZZRCQ74TQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.591823260 (165h50m18.022903421s) [noise=true , address=77.90.31.13:4630 , piece_id=4ZGFWRPCU6LF34RSH22LHLDFFEICBZ3UKS2I43FMRDQAD5UTFWXA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.592211303 (165h50m18.023291434s) [noise=true , address=77.90.31.11:4580 , piece_id=O5D4EP4LUSSX6PTZTLRMCXEYIL6W2UXIHBNRDKN2VFVHGB5MFZGA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.592475017 (165h50m18.023555158s) [noise=true , address=77.90.31.18:4827 , piece_id=5DW7WZTN34P42BTTRUQ56LSFLBHS5QHO2HEKES2PT7ZHOSNQ72EA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.592996925 (165h50m18.024077056s) [noise=true , address=104.36.82.36:4626 , piece_id=X4U7SLWZRU5CL2T5IFC2HNOQ3D4HPUXA7TIFJUJYSUF3LMWDQNTA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.593335724 (165h50m18.024415855s) [noise=true , address=79.127.201.215:4343 , piece_id=MPMAQOMIURMVFNKXTJ5HLC5LJJCGOTY6HQPQCL2GH4YCMM2Q6FKQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.593672408 (165h50m18.024752539s) [noise=true , address=104.36.82.8:4974 , piece_id=2ZDFUCSOVMJHIGINANSMLVZVMZHM56XQ6OBJWUFDXONJ4D42XVPQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.594058457 (165h50m18.025138588s) [noise=true , address=104.36.82.23:4456 , piece_id=SX2YT3LIZ2MRT4DYRYZDKLO2ST4MHPNINCBTLGILGZWDO77FAQ3Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.594396543 (165h50m18.025476674s) [noise=true , address=79.127.220.101:4073 , piece_id=TJ26UR6WS6T6RBGA22EYWL33O2Z3IXPEVAOQVGDN5AUS4PDMDK7Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.594720794 (165h50m18.025800935s) [noise=true , address=77.90.31.17:4779 , piece_id=CYVPZUPZPHTUTH56H4GBMKBHFEXE7NWQZZJDPBKB2RWECBKUTT5A, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.595057868 (165h50m18.026137999s) [noise=true , address=45.91.116.6:4986 , piece_id=NHCYAM4OJSS6DBYNYWZCBG5QRHM5NUVI6UP5XNILC7F5GOOZ2W3Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.595398080 (165h50m18.026478211s) [noise=true , address=104.36.82.5:4864 , piece_id=WKB3ZBR6YDO2EUZKJFB42J6VFL3T6JYE652AYYOEQ6UMG5D3PINQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.595839625 (165h50m18.026919756s) [noise=true , address=104.36.82.44:4901 , piece_id=GF4LDYTH5Q4NS4PBIWBT4C4WBQ75ARYMJHOPO2XHXATDGMJ2AK6A, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.596180326 (165h50m18.027260457s) [noise=true , address=66.23.193.175:4557 , piece_id=2VQDLPFWGEOL63THQTDZJUSCZFQAUHL2AZLE6JYR6PJIVGV6VO2A, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.596567146 (165h50m18.027647287s) [noise=true , address=77.90.31.10:4523 , piece_id=D6D7XBHK3426ZA565EVVKLWTIA6LPL24QBGU5YH4BOXWJH6TE64Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.596896567 (165h50m18.027976698s) [noise=true , address=79.127.205.233:4628 , piece_id=WPIGFCQOIO7MSIJDR4RNO2ZYHBMVHTJQXRTOBP2JI3Z3M7ISILCA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:24.737329106 (165h50m19.168409237s) [upload=172505]: Next returned nil segment Aug 15 15:16:24.737345307 (165h50m19.168425438s) [upload=172505]: Waiting for error group managing segments... Aug 15 15:16:25.020682831 (165h50m19.451762962s) [noise=true , address=79.127.205.233:4628 , piece_id=WPIGFCQOIO7MSIJDR4RNO2ZYHBMVHTJQXRTOBP2JI3Z3M7ISILCA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.098977978 (165h50m19.530058109s) [noise=true , address=66.23.193.175:4557 , piece_id=2VQDLPFWGEOL63THQTDZJUSCZFQAUHL2AZLE6JYR6PJIVGV6VO2A, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.449295087 (165h50m19.880375218s) [noise=true , address=79.127.220.101:4073 , piece_id=TJ26UR6WS6T6RBGA22EYWL33O2Z3IXPEVAOQVGDN5AUS4PDMDK7Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.657174453 (165h50m20.088254574s) [noise=true , address=79.127.201.215:4343 , piece_id=MPMAQOMIURMVFNKXTJ5HLC5LJJCGOTY6HQPQCL2GH4YCMM2Q6FKQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.908657128 (165h50m20.339737249s) [noise=true , address=104.36.82.36:4626 , piece_id=X4U7SLWZRU5CL2T5IFC2HNOQ3D4HPUXA7TIFJUJYSUF3LMWDQNTA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.921525419 (165h50m20.35260555s) [noise=true , address=45.91.116.6:4986 , piece_id=NHCYAM4OJSS6DBYNYWZCBG5QRHM5NUVI6UP5XNILC7F5GOOZ2W3Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.937876515 (165h50m20.368956636s) [noise=true , address=104.36.82.8:4974 , piece_id=2ZDFUCSOVMJHIGINANSMLVZVMZHM56XQ6OBJWUFDXONJ4D42XVPQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.975679856 (165h50m20.406759977s) [noise=true , address=104.36.82.60:4358 , piece_id=STJCTAGQOFXFQ7LTXAKG5PA7ZUK7OLJUFXADZRW4YXEXZJMIWGXQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.125861536 (165h50m20.556941667s) [noise=true , address=77.90.31.18:4827 , piece_id=5DW7WZTN34P42BTTRUQ56LSFLBHS5QHO2HEKES2PT7ZHOSNQ72EA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.168492634 (165h50m20.599572826s) [noise=true , address=77.90.31.17:4779 , piece_id=CYVPZUPZPHTUTH56H4GBMKBHFEXE7NWQZZJDPBKB2RWECBKUTT5A, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.246449022 (165h50m20.677529153s) [noise=true , address=77.90.31.11:4580 , piece_id=O5D4EP4LUSSX6PTZTLRMCXEYIL6W2UXIHBNRDKN2VFVHGB5MFZGA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.380000574 (165h50m20.811080705s) [noise=true , address=77.90.31.16:4740 , piece_id=MGTQCSACL7JQKXGD57P6NKCZOKUTIAIFF2YNBTEE7IYZZRCQ74TQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.680781293 (165h50m21.111861484s) [noise=true , address=77.90.31.13:4630 , piece_id=4ZGFWRPCU6LF34RSH22LHLDFFEICBZ3UKS2I43FMRDQAD5UTFWXA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:27.013998946 (165h50m21.445079077s) [noise=true , address=104.36.82.44:4901 , piece_id=GF4LDYTH5Q4NS4PBIWBT4C4WBQ75ARYMJHOPO2XHXATDGMJ2AK6A, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:27.014022972 (165h50m21.445103103s) [seg_pos={0 0}, upload=172505]: Segment reached optimal threshold of 14 pieces. Aug 15 15:16:27.014278842 (165h50m21.445358973s) [noise=true , address=104.36.82.23:4456 , piece_id=SX2YT3LIZ2MRT4DYRYZDKLO2ST4MHPNINCBTLGILGZWDO77FAQ3Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XUZ2ggL9Q4V8uyJdwvwztqCTvj1DFGRWGtYzKJiaRVaByhfTx): protocol: rpc: dial tcp 104.36.82.23:4456: operation was canceled; conn closed: op Aug 15 15:16:27.014306455 (165h50m21.445386586s) [noise=true , address=104.36.82.5:4864 , piece_id=WKB3ZBR6YDO2EUZKJFB42J6VFL3T6JYE652AYYOEQ6UMG5D3PINQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XXH8TYK6Qfma867943QYYXycyL6osQhcQYEjdMdJVTUDfda2u): protocol: write tcp 188.166.225.170:40092->104.36.82.5:4864: use of closed network connection; write tcp 188.166.225.170:40092->104.36.82.5:4864: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40092->104.36.82.5:4864: use of closed network connection Aug 15 15:16:27.014375847 (165h50m21.445455978s) [noise=true , address=77.90.31.10:4523 , piece_id=D6D7XBHK3426ZA565EVVKLWTIA6LPL24QBGU5YH4BOXWJH6TE64Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LifXs8irH3dbLrzPnXzoCfaFyuUJxsN4rfyLEwTKGXSPxotPa): protocol: expected piece hash; context canceled; EOF Aug 15 15:16:27.014445771 (165h50m21.445525902s) [noise=true , address=104.36.82.18:4390 , piece_id=F6ETCYUTXLXZCH2ZZQ4Q73HNINZBINPNR6ZEGSOACBSDJS7N34BA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AZCJHCR7rF4r62Bg7NcBkpNoLb6r6rEN2a5hZ9KNxJTtjV8jp): protocol: write tcp 188.166.225.170:43784->104.36.82.18:4390: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 15:16:27.014470900 (165h50m21.445551031s) [seg_pos={0 0}, upload=172505]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 15 15:16:27.014539270 (165h50m21.445619401s) [upload=172505]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 15 15:16:27.014543768 (165h50m21.445623899s) [upload=172505]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 15:16:27.420799899 (165h50m21.85188003s) [upload=172505]: Done uploading segments... Aug 15 15:16:27.420818816 (165h50m21.851898937s) [upload=172505]: Upload finished. err: <nil> Duration: 7.041814466s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...............................X....XX......................] duration: 1.893224644s FAIL (2025-08-15 15:24:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 15:08:23.568800831 (165h42m17.999880962s) [upload=172360]: Starting upload Aug 15 15:08:23.568843131 (165h42m17.999923262s) [upload=172360]: Done starting upload Aug 15 15:08:23.568892736 (165h42m17.999972868s) [upload=172360]: Uploading segments... Aug 15 15:08:23.568932031 (165h42m18.000012162s) [upload=172360]: Got next segment. Inline: true Aug 15 15:08:23.568936339 (165h42m18.00001647s) [upload=172360]: Waiting for error group managing segments... Aug 15 15:08:23.568970776 (165h42m18.000050897s) [upload=172360]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 15:08:23.568974854 (165h42m18.000054985s) [upload=172360]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 15:08:23.568977499 (165h42m18.00005763s) [upload=172360]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 15:08:23.783715648 (165h42m18.214795779s) [upload=172360]: Done uploading segments... Aug 15 15:08:23.783733201 (165h42m18.214813332s) [upload=172360]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.893247118s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [........X....................X...X................X.........] duration: 7.856730581s FAIL (2025-08-15 15:24:19 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 15 15:16:22.685092094 (165h50m17.116172225s) [upload=172505]: Starting upload Aug 15 15:16:22.685142561 (165h50m17.116222692s) [upload=172505]: Done starting upload Aug 15 15:16:22.685325571 (165h50m17.116405703s) [upload=172505]: Uploading segments... Aug 15 15:16:22.685436684 (165h50m17.116516815s) [upload=172505]: Got next segment. Inline: false Aug 15 15:16:22.685470238 (165h50m17.116550369s) [upload=172505]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 15:16:22.685474446 (165h50m17.116554577s) [upload=172505]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 15 15:16:23.591082804 (165h50m18.022162945s) [seg_pos={0 0}, upload=172505]: Begin upload segment... Aug 15 15:16:23.591147928 (165h50m18.022228059s) [seg_pos={0 0}, upload=172505]: Done begin upload segment. Aug 15 15:16:23.591177995 (165h50m18.022258126s) [noise=true , address=104.36.82.18:4390 , piece_id=F6ETCYUTXLXZCH2ZZQ4Q73HNINZBINPNR6ZEGSOACBSDJS7N34BA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.591241937 (165h50m18.022322068s) [noise=true , address=104.36.82.60:4358 , piece_id=STJCTAGQOFXFQ7LTXAKG5PA7ZUK7OLJUFXADZRW4YXEXZJMIWGXQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.591778354 (165h50m18.022858485s) [noise=true , address=77.90.31.16:4740 , piece_id=MGTQCSACL7JQKXGD57P6NKCZOKUTIAIFF2YNBTEE7IYZZRCQ74TQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.591823260 (165h50m18.022903421s) [noise=true , address=77.90.31.13:4630 , piece_id=4ZGFWRPCU6LF34RSH22LHLDFFEICBZ3UKS2I43FMRDQAD5UTFWXA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.592211303 (165h50m18.023291434s) [noise=true , address=77.90.31.11:4580 , piece_id=O5D4EP4LUSSX6PTZTLRMCXEYIL6W2UXIHBNRDKN2VFVHGB5MFZGA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.592475017 (165h50m18.023555158s) [noise=true , address=77.90.31.18:4827 , piece_id=5DW7WZTN34P42BTTRUQ56LSFLBHS5QHO2HEKES2PT7ZHOSNQ72EA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.592996925 (165h50m18.024077056s) [noise=true , address=104.36.82.36:4626 , piece_id=X4U7SLWZRU5CL2T5IFC2HNOQ3D4HPUXA7TIFJUJYSUF3LMWDQNTA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.593335724 (165h50m18.024415855s) [noise=true , address=79.127.201.215:4343 , piece_id=MPMAQOMIURMVFNKXTJ5HLC5LJJCGOTY6HQPQCL2GH4YCMM2Q6FKQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.593672408 (165h50m18.024752539s) [noise=true , address=104.36.82.8:4974 , piece_id=2ZDFUCSOVMJHIGINANSMLVZVMZHM56XQ6OBJWUFDXONJ4D42XVPQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.594058457 (165h50m18.025138588s) [noise=true , address=104.36.82.23:4456 , piece_id=SX2YT3LIZ2MRT4DYRYZDKLO2ST4MHPNINCBTLGILGZWDO77FAQ3Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.594396543 (165h50m18.025476674s) [noise=true , address=79.127.220.101:4073 , piece_id=TJ26UR6WS6T6RBGA22EYWL33O2Z3IXPEVAOQVGDN5AUS4PDMDK7Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.594720794 (165h50m18.025800935s) [noise=true , address=77.90.31.17:4779 , piece_id=CYVPZUPZPHTUTH56H4GBMKBHFEXE7NWQZZJDPBKB2RWECBKUTT5A, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.595057868 (165h50m18.026137999s) [noise=true , address=45.91.116.6:4986 , piece_id=NHCYAM4OJSS6DBYNYWZCBG5QRHM5NUVI6UP5XNILC7F5GOOZ2W3Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.595398080 (165h50m18.026478211s) [noise=true , address=104.36.82.5:4864 , piece_id=WKB3ZBR6YDO2EUZKJFB42J6VFL3T6JYE652AYYOEQ6UMG5D3PINQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.595839625 (165h50m18.026919756s) [noise=true , address=104.36.82.44:4901 , piece_id=GF4LDYTH5Q4NS4PBIWBT4C4WBQ75ARYMJHOPO2XHXATDGMJ2AK6A, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.596180326 (165h50m18.027260457s) [noise=true , address=66.23.193.175:4557 , piece_id=2VQDLPFWGEOL63THQTDZJUSCZFQAUHL2AZLE6JYR6PJIVGV6VO2A, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.596567146 (165h50m18.027647287s) [noise=true , address=77.90.31.10:4523 , piece_id=D6D7XBHK3426ZA565EVVKLWTIA6LPL24QBGU5YH4BOXWJH6TE64Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.596896567 (165h50m18.027976698s) [noise=true , address=79.127.205.233:4628 , piece_id=WPIGFCQOIO7MSIJDR4RNO2ZYHBMVHTJQXRTOBP2JI3Z3M7ISILCA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:24.737329106 (165h50m19.168409237s) [upload=172505]: Next returned nil segment Aug 15 15:16:24.737345307 (165h50m19.168425438s) [upload=172505]: Waiting for error group managing segments... Aug 15 15:16:25.020682831 (165h50m19.451762962s) [noise=true , address=79.127.205.233:4628 , piece_id=WPIGFCQOIO7MSIJDR4RNO2ZYHBMVHTJQXRTOBP2JI3Z3M7ISILCA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.098977978 (165h50m19.530058109s) [noise=true , address=66.23.193.175:4557 , piece_id=2VQDLPFWGEOL63THQTDZJUSCZFQAUHL2AZLE6JYR6PJIVGV6VO2A, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.449295087 (165h50m19.880375218s) [noise=true , address=79.127.220.101:4073 , piece_id=TJ26UR6WS6T6RBGA22EYWL33O2Z3IXPEVAOQVGDN5AUS4PDMDK7Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.657174453 (165h50m20.088254574s) [noise=true , address=79.127.201.215:4343 , piece_id=MPMAQOMIURMVFNKXTJ5HLC5LJJCGOTY6HQPQCL2GH4YCMM2Q6FKQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.908657128 (165h50m20.339737249s) [noise=true , address=104.36.82.36:4626 , piece_id=X4U7SLWZRU5CL2T5IFC2HNOQ3D4HPUXA7TIFJUJYSUF3LMWDQNTA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.921525419 (165h50m20.35260555s) [noise=true , address=45.91.116.6:4986 , piece_id=NHCYAM4OJSS6DBYNYWZCBG5QRHM5NUVI6UP5XNILC7F5GOOZ2W3Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.937876515 (165h50m20.368956636s) [noise=true , address=104.36.82.8:4974 , piece_id=2ZDFUCSOVMJHIGINANSMLVZVMZHM56XQ6OBJWUFDXONJ4D42XVPQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.975679856 (165h50m20.406759977s) [noise=true , address=104.36.82.60:4358 , piece_id=STJCTAGQOFXFQ7LTXAKG5PA7ZUK7OLJUFXADZRW4YXEXZJMIWGXQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.125861536 (165h50m20.556941667s) [noise=true , address=77.90.31.18:4827 , piece_id=5DW7WZTN34P42BTTRUQ56LSFLBHS5QHO2HEKES2PT7ZHOSNQ72EA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.168492634 (165h50m20.599572826s) [noise=true , address=77.90.31.17:4779 , piece_id=CYVPZUPZPHTUTH56H4GBMKBHFEXE7NWQZZJDPBKB2RWECBKUTT5A, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.246449022 (165h50m20.677529153s) [noise=true , address=77.90.31.11:4580 , piece_id=O5D4EP4LUSSX6PTZTLRMCXEYIL6W2UXIHBNRDKN2VFVHGB5MFZGA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.380000574 (165h50m20.811080705s) [noise=true , address=77.90.31.16:4740 , piece_id=MGTQCSACL7JQKXGD57P6NKCZOKUTIAIFF2YNBTEE7IYZZRCQ74TQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.680781293 (165h50m21.111861484s) [noise=true , address=77.90.31.13:4630 , piece_id=4ZGFWRPCU6LF34RSH22LHLDFFEICBZ3UKS2I43FMRDQAD5UTFWXA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:27.013998946 (165h50m21.445079077s) [noise=true , address=104.36.82.44:4901 , piece_id=GF4LDYTH5Q4NS4PBIWBT4C4WBQ75ARYMJHOPO2XHXATDGMJ2AK6A, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:27.014022972 (165h50m21.445103103s) [seg_pos={0 0}, upload=172505]: Segment reached optimal threshold of 14 pieces. Aug 15 15:16:27.014278842 (165h50m21.445358973s) [noise=true , address=104.36.82.23:4456 , piece_id=SX2YT3LIZ2MRT4DYRYZDKLO2ST4MHPNINCBTLGILGZWDO77FAQ3Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XUZ2ggL9Q4V8uyJdwvwztqCTvj1DFGRWGtYzKJiaRVaByhfTx): protocol: rpc: dial tcp 104.36.82.23:4456: operation was canceled; conn closed: op Aug 15 15:16:27.014306455 (165h50m21.445386586s) [noise=true , address=104.36.82.5:4864 , piece_id=WKB3ZBR6YDO2EUZKJFB42J6VFL3T6JYE652AYYOEQ6UMG5D3PINQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XXH8TYK6Qfma867943QYYXycyL6osQhcQYEjdMdJVTUDfda2u): protocol: write tcp 188.166.225.170:40092->104.36.82.5:4864: use of closed network connection; write tcp 188.166.225.170:40092->104.36.82.5:4864: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40092->104.36.82.5:4864: use of closed network connection Aug 15 15:16:27.014375847 (165h50m21.445455978s) [noise=true , address=77.90.31.10:4523 , piece_id=D6D7XBHK3426ZA565EVVKLWTIA6LPL24QBGU5YH4BOXWJH6TE64Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LifXs8irH3dbLrzPnXzoCfaFyuUJxsN4rfyLEwTKGXSPxotPa): protocol: expected piece hash; context canceled; EOF Aug 15 15:16:27.014445771 (165h50m21.445525902s) [noise=true , address=104.36.82.18:4390 , piece_id=F6ETCYUTXLXZCH2ZZQ4Q73HNINZBINPNR6ZEGSOACBSDJS7N34BA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AZCJHCR7rF4r62Bg7NcBkpNoLb6r6rEN2a5hZ9KNxJTtjV8jp): protocol: write tcp 188.166.225.170:43784->104.36.82.18:4390: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 15:16:27.014470900 (165h50m21.445551031s) [seg_pos={0 0}, upload=172505]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 15 15:16:27.014539270 (165h50m21.445619401s) [upload=172505]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 15 15:16:27.014543768 (165h50m21.445623899s) [upload=172505]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 15:16:27.420799899 (165h50m21.85188003s) [upload=172505]: Done uploading segments... Aug 15 15:16:27.420818816 (165h50m21.851898937s) [upload=172505]: Upload finished. err: <nil> Duration: 7.856755939s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.........X....................X...X................X........] duration: 7.730922593s FAIL (2025-08-15 15:23:51 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 15 15:16:22.685092094 (165h50m17.116172225s) [upload=172505]: Starting upload Aug 15 15:16:22.685142561 (165h50m17.116222692s) [upload=172505]: Done starting upload Aug 15 15:16:22.685325571 (165h50m17.116405703s) [upload=172505]: Uploading segments... Aug 15 15:16:22.685436684 (165h50m17.116516815s) [upload=172505]: Got next segment. Inline: false Aug 15 15:16:22.685470238 (165h50m17.116550369s) [upload=172505]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 15:16:22.685474446 (165h50m17.116554577s) [upload=172505]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 15 15:16:23.591082804 (165h50m18.022162945s) [seg_pos={0 0}, upload=172505]: Begin upload segment... Aug 15 15:16:23.591147928 (165h50m18.022228059s) [seg_pos={0 0}, upload=172505]: Done begin upload segment. Aug 15 15:16:23.591177995 (165h50m18.022258126s) [noise=true , address=104.36.82.18:4390 , piece_id=F6ETCYUTXLXZCH2ZZQ4Q73HNINZBINPNR6ZEGSOACBSDJS7N34BA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.591241937 (165h50m18.022322068s) [noise=true , address=104.36.82.60:4358 , piece_id=STJCTAGQOFXFQ7LTXAKG5PA7ZUK7OLJUFXADZRW4YXEXZJMIWGXQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.591778354 (165h50m18.022858485s) [noise=true , address=77.90.31.16:4740 , piece_id=MGTQCSACL7JQKXGD57P6NKCZOKUTIAIFF2YNBTEE7IYZZRCQ74TQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.591823260 (165h50m18.022903421s) [noise=true , address=77.90.31.13:4630 , piece_id=4ZGFWRPCU6LF34RSH22LHLDFFEICBZ3UKS2I43FMRDQAD5UTFWXA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.592211303 (165h50m18.023291434s) [noise=true , address=77.90.31.11:4580 , piece_id=O5D4EP4LUSSX6PTZTLRMCXEYIL6W2UXIHBNRDKN2VFVHGB5MFZGA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.592475017 (165h50m18.023555158s) [noise=true , address=77.90.31.18:4827 , piece_id=5DW7WZTN34P42BTTRUQ56LSFLBHS5QHO2HEKES2PT7ZHOSNQ72EA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.592996925 (165h50m18.024077056s) [noise=true , address=104.36.82.36:4626 , piece_id=X4U7SLWZRU5CL2T5IFC2HNOQ3D4HPUXA7TIFJUJYSUF3LMWDQNTA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.593335724 (165h50m18.024415855s) [noise=true , address=79.127.201.215:4343 , piece_id=MPMAQOMIURMVFNKXTJ5HLC5LJJCGOTY6HQPQCL2GH4YCMM2Q6FKQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.593672408 (165h50m18.024752539s) [noise=true , address=104.36.82.8:4974 , piece_id=2ZDFUCSOVMJHIGINANSMLVZVMZHM56XQ6OBJWUFDXONJ4D42XVPQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.594058457 (165h50m18.025138588s) [noise=true , address=104.36.82.23:4456 , piece_id=SX2YT3LIZ2MRT4DYRYZDKLO2ST4MHPNINCBTLGILGZWDO77FAQ3Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.594396543 (165h50m18.025476674s) [noise=true , address=79.127.220.101:4073 , piece_id=TJ26UR6WS6T6RBGA22EYWL33O2Z3IXPEVAOQVGDN5AUS4PDMDK7Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.594720794 (165h50m18.025800935s) [noise=true , address=77.90.31.17:4779 , piece_id=CYVPZUPZPHTUTH56H4GBMKBHFEXE7NWQZZJDPBKB2RWECBKUTT5A, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.595057868 (165h50m18.026137999s) [noise=true , address=45.91.116.6:4986 , piece_id=NHCYAM4OJSS6DBYNYWZCBG5QRHM5NUVI6UP5XNILC7F5GOOZ2W3Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.595398080 (165h50m18.026478211s) [noise=true , address=104.36.82.5:4864 , piece_id=WKB3ZBR6YDO2EUZKJFB42J6VFL3T6JYE652AYYOEQ6UMG5D3PINQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.595839625 (165h50m18.026919756s) [noise=true , address=104.36.82.44:4901 , piece_id=GF4LDYTH5Q4NS4PBIWBT4C4WBQ75ARYMJHOPO2XHXATDGMJ2AK6A, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.596180326 (165h50m18.027260457s) [noise=true , address=66.23.193.175:4557 , piece_id=2VQDLPFWGEOL63THQTDZJUSCZFQAUHL2AZLE6JYR6PJIVGV6VO2A, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.596567146 (165h50m18.027647287s) [noise=true , address=77.90.31.10:4523 , piece_id=D6D7XBHK3426ZA565EVVKLWTIA6LPL24QBGU5YH4BOXWJH6TE64Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.596896567 (165h50m18.027976698s) [noise=true , address=79.127.205.233:4628 , piece_id=WPIGFCQOIO7MSIJDR4RNO2ZYHBMVHTJQXRTOBP2JI3Z3M7ISILCA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:24.737329106 (165h50m19.168409237s) [upload=172505]: Next returned nil segment Aug 15 15:16:24.737345307 (165h50m19.168425438s) [upload=172505]: Waiting for error group managing segments... Aug 15 15:16:25.020682831 (165h50m19.451762962s) [noise=true , address=79.127.205.233:4628 , piece_id=WPIGFCQOIO7MSIJDR4RNO2ZYHBMVHTJQXRTOBP2JI3Z3M7ISILCA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.098977978 (165h50m19.530058109s) [noise=true , address=66.23.193.175:4557 , piece_id=2VQDLPFWGEOL63THQTDZJUSCZFQAUHL2AZLE6JYR6PJIVGV6VO2A, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.449295087 (165h50m19.880375218s) [noise=true , address=79.127.220.101:4073 , piece_id=TJ26UR6WS6T6RBGA22EYWL33O2Z3IXPEVAOQVGDN5AUS4PDMDK7Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.657174453 (165h50m20.088254574s) [noise=true , address=79.127.201.215:4343 , piece_id=MPMAQOMIURMVFNKXTJ5HLC5LJJCGOTY6HQPQCL2GH4YCMM2Q6FKQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.908657128 (165h50m20.339737249s) [noise=true , address=104.36.82.36:4626 , piece_id=X4U7SLWZRU5CL2T5IFC2HNOQ3D4HPUXA7TIFJUJYSUF3LMWDQNTA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.921525419 (165h50m20.35260555s) [noise=true , address=45.91.116.6:4986 , piece_id=NHCYAM4OJSS6DBYNYWZCBG5QRHM5NUVI6UP5XNILC7F5GOOZ2W3Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.937876515 (165h50m20.368956636s) [noise=true , address=104.36.82.8:4974 , piece_id=2ZDFUCSOVMJHIGINANSMLVZVMZHM56XQ6OBJWUFDXONJ4D42XVPQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.975679856 (165h50m20.406759977s) [noise=true , address=104.36.82.60:4358 , piece_id=STJCTAGQOFXFQ7LTXAKG5PA7ZUK7OLJUFXADZRW4YXEXZJMIWGXQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.125861536 (165h50m20.556941667s) [noise=true , address=77.90.31.18:4827 , piece_id=5DW7WZTN34P42BTTRUQ56LSFLBHS5QHO2HEKES2PT7ZHOSNQ72EA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.168492634 (165h50m20.599572826s) [noise=true , address=77.90.31.17:4779 , piece_id=CYVPZUPZPHTUTH56H4GBMKBHFEXE7NWQZZJDPBKB2RWECBKUTT5A, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.246449022 (165h50m20.677529153s) [noise=true , address=77.90.31.11:4580 , piece_id=O5D4EP4LUSSX6PTZTLRMCXEYIL6W2UXIHBNRDKN2VFVHGB5MFZGA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.380000574 (165h50m20.811080705s) [noise=true , address=77.90.31.16:4740 , piece_id=MGTQCSACL7JQKXGD57P6NKCZOKUTIAIFF2YNBTEE7IYZZRCQ74TQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.680781293 (165h50m21.111861484s) [noise=true , address=77.90.31.13:4630 , piece_id=4ZGFWRPCU6LF34RSH22LHLDFFEICBZ3UKS2I43FMRDQAD5UTFWXA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:27.013998946 (165h50m21.445079077s) [noise=true , address=104.36.82.44:4901 , piece_id=GF4LDYTH5Q4NS4PBIWBT4C4WBQ75ARYMJHOPO2XHXATDGMJ2AK6A, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:27.014022972 (165h50m21.445103103s) [seg_pos={0 0}, upload=172505]: Segment reached optimal threshold of 14 pieces. Aug 15 15:16:27.014278842 (165h50m21.445358973s) [noise=true , address=104.36.82.23:4456 , piece_id=SX2YT3LIZ2MRT4DYRYZDKLO2ST4MHPNINCBTLGILGZWDO77FAQ3Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XUZ2ggL9Q4V8uyJdwvwztqCTvj1DFGRWGtYzKJiaRVaByhfTx): protocol: rpc: dial tcp 104.36.82.23:4456: operation was canceled; conn closed: op Aug 15 15:16:27.014306455 (165h50m21.445386586s) [noise=true , address=104.36.82.5:4864 , piece_id=WKB3ZBR6YDO2EUZKJFB42J6VFL3T6JYE652AYYOEQ6UMG5D3PINQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XXH8TYK6Qfma867943QYYXycyL6osQhcQYEjdMdJVTUDfda2u): protocol: write tcp 188.166.225.170:40092->104.36.82.5:4864: use of closed network connection; write tcp 188.166.225.170:40092->104.36.82.5:4864: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40092->104.36.82.5:4864: use of closed network connection Aug 15 15:16:27.014375847 (165h50m21.445455978s) [noise=true , address=77.90.31.10:4523 , piece_id=D6D7XBHK3426ZA565EVVKLWTIA6LPL24QBGU5YH4BOXWJH6TE64Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LifXs8irH3dbLrzPnXzoCfaFyuUJxsN4rfyLEwTKGXSPxotPa): protocol: expected piece hash; context canceled; EOF Aug 15 15:16:27.014445771 (165h50m21.445525902s) [noise=true , address=104.36.82.18:4390 , piece_id=F6ETCYUTXLXZCH2ZZQ4Q73HNINZBINPNR6ZEGSOACBSDJS7N34BA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AZCJHCR7rF4r62Bg7NcBkpNoLb6r6rEN2a5hZ9KNxJTtjV8jp): protocol: write tcp 188.166.225.170:43784->104.36.82.18:4390: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 15:16:27.014470900 (165h50m21.445551031s) [seg_pos={0 0}, upload=172505]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 15 15:16:27.014539270 (165h50m21.445619401s) [upload=172505]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 15 15:16:27.014543768 (165h50m21.445623899s) [upload=172505]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 15:16:27.420799899 (165h50m21.85188003s) [upload=172505]: Done uploading segments... Aug 15 15:16:27.420818816 (165h50m21.851898937s) [upload=172505]: Upload finished. err: <nil> Duration: 7.730945636s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [................................X....XX.....................] duration: 2.05047476s FAIL (2025-08-15 15:23:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 15:08:23.568800831 (165h42m17.999880962s) [upload=172360]: Starting upload Aug 15 15:08:23.568843131 (165h42m17.999923262s) [upload=172360]: Done starting upload Aug 15 15:08:23.568892736 (165h42m17.999972868s) [upload=172360]: Uploading segments... Aug 15 15:08:23.568932031 (165h42m18.000012162s) [upload=172360]: Got next segment. Inline: true Aug 15 15:08:23.568936339 (165h42m18.00001647s) [upload=172360]: Waiting for error group managing segments... Aug 15 15:08:23.568970776 (165h42m18.000050897s) [upload=172360]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 15:08:23.568974854 (165h42m18.000054985s) [upload=172360]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 15:08:23.568977499 (165h42m18.00005763s) [upload=172360]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 15:08:23.783715648 (165h42m18.214795779s) [upload=172360]: Done uploading segments... Aug 15 15:08:23.783733201 (165h42m18.214813332s) [upload=172360]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.050499507s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.................................X....XX....................] duration: 2.139144186s FAIL (2025-08-15 15:23:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 15:08:23.568800831 (165h42m17.999880962s) [upload=172360]: Starting upload Aug 15 15:08:23.568843131 (165h42m17.999923262s) [upload=172360]: Done starting upload Aug 15 15:08:23.568892736 (165h42m17.999972868s) [upload=172360]: Uploading segments... Aug 15 15:08:23.568932031 (165h42m18.000012162s) [upload=172360]: Got next segment. Inline: true Aug 15 15:08:23.568936339 (165h42m18.00001647s) [upload=172360]: Waiting for error group managing segments... Aug 15 15:08:23.568970776 (165h42m18.000050897s) [upload=172360]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 15:08:23.568974854 (165h42m18.000054985s) [upload=172360]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 15:08:23.568977499 (165h42m18.00005763s) [upload=172360]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 15:08:23.783715648 (165h42m18.214795779s) [upload=172360]: Done uploading segments... Aug 15 15:08:23.783733201 (165h42m18.214813332s) [upload=172360]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.139245258s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..........X....................X...X................X.......] duration: 6.955827924s FAIL (2025-08-15 15:22:56 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 15 15:16:22.685092094 (165h50m17.116172225s) [upload=172505]: Starting upload Aug 15 15:16:22.685142561 (165h50m17.116222692s) [upload=172505]: Done starting upload Aug 15 15:16:22.685325571 (165h50m17.116405703s) [upload=172505]: Uploading segments... Aug 15 15:16:22.685436684 (165h50m17.116516815s) [upload=172505]: Got next segment. Inline: false Aug 15 15:16:22.685470238 (165h50m17.116550369s) [upload=172505]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 15:16:22.685474446 (165h50m17.116554577s) [upload=172505]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 15 15:16:23.591082804 (165h50m18.022162945s) [seg_pos={0 0}, upload=172505]: Begin upload segment... Aug 15 15:16:23.591147928 (165h50m18.022228059s) [seg_pos={0 0}, upload=172505]: Done begin upload segment. Aug 15 15:16:23.591177995 (165h50m18.022258126s) [noise=true , address=104.36.82.18:4390 , piece_id=F6ETCYUTXLXZCH2ZZQ4Q73HNINZBINPNR6ZEGSOACBSDJS7N34BA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.591241937 (165h50m18.022322068s) [noise=true , address=104.36.82.60:4358 , piece_id=STJCTAGQOFXFQ7LTXAKG5PA7ZUK7OLJUFXADZRW4YXEXZJMIWGXQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.591778354 (165h50m18.022858485s) [noise=true , address=77.90.31.16:4740 , piece_id=MGTQCSACL7JQKXGD57P6NKCZOKUTIAIFF2YNBTEE7IYZZRCQ74TQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.591823260 (165h50m18.022903421s) [noise=true , address=77.90.31.13:4630 , piece_id=4ZGFWRPCU6LF34RSH22LHLDFFEICBZ3UKS2I43FMRDQAD5UTFWXA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.592211303 (165h50m18.023291434s) [noise=true , address=77.90.31.11:4580 , piece_id=O5D4EP4LUSSX6PTZTLRMCXEYIL6W2UXIHBNRDKN2VFVHGB5MFZGA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.592475017 (165h50m18.023555158s) [noise=true , address=77.90.31.18:4827 , piece_id=5DW7WZTN34P42BTTRUQ56LSFLBHS5QHO2HEKES2PT7ZHOSNQ72EA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.592996925 (165h50m18.024077056s) [noise=true , address=104.36.82.36:4626 , piece_id=X4U7SLWZRU5CL2T5IFC2HNOQ3D4HPUXA7TIFJUJYSUF3LMWDQNTA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.593335724 (165h50m18.024415855s) [noise=true , address=79.127.201.215:4343 , piece_id=MPMAQOMIURMVFNKXTJ5HLC5LJJCGOTY6HQPQCL2GH4YCMM2Q6FKQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.593672408 (165h50m18.024752539s) [noise=true , address=104.36.82.8:4974 , piece_id=2ZDFUCSOVMJHIGINANSMLVZVMZHM56XQ6OBJWUFDXONJ4D42XVPQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.594058457 (165h50m18.025138588s) [noise=true , address=104.36.82.23:4456 , piece_id=SX2YT3LIZ2MRT4DYRYZDKLO2ST4MHPNINCBTLGILGZWDO77FAQ3Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.594396543 (165h50m18.025476674s) [noise=true , address=79.127.220.101:4073 , piece_id=TJ26UR6WS6T6RBGA22EYWL33O2Z3IXPEVAOQVGDN5AUS4PDMDK7Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.594720794 (165h50m18.025800935s) [noise=true , address=77.90.31.17:4779 , piece_id=CYVPZUPZPHTUTH56H4GBMKBHFEXE7NWQZZJDPBKB2RWECBKUTT5A, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.595057868 (165h50m18.026137999s) [noise=true , address=45.91.116.6:4986 , piece_id=NHCYAM4OJSS6DBYNYWZCBG5QRHM5NUVI6UP5XNILC7F5GOOZ2W3Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.595398080 (165h50m18.026478211s) [noise=true , address=104.36.82.5:4864 , piece_id=WKB3ZBR6YDO2EUZKJFB42J6VFL3T6JYE652AYYOEQ6UMG5D3PINQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.595839625 (165h50m18.026919756s) [noise=true , address=104.36.82.44:4901 , piece_id=GF4LDYTH5Q4NS4PBIWBT4C4WBQ75ARYMJHOPO2XHXATDGMJ2AK6A, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.596180326 (165h50m18.027260457s) [noise=true , address=66.23.193.175:4557 , piece_id=2VQDLPFWGEOL63THQTDZJUSCZFQAUHL2AZLE6JYR6PJIVGV6VO2A, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.596567146 (165h50m18.027647287s) [noise=true , address=77.90.31.10:4523 , piece_id=D6D7XBHK3426ZA565EVVKLWTIA6LPL24QBGU5YH4BOXWJH6TE64Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.596896567 (165h50m18.027976698s) [noise=true , address=79.127.205.233:4628 , piece_id=WPIGFCQOIO7MSIJDR4RNO2ZYHBMVHTJQXRTOBP2JI3Z3M7ISILCA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:24.737329106 (165h50m19.168409237s) [upload=172505]: Next returned nil segment Aug 15 15:16:24.737345307 (165h50m19.168425438s) [upload=172505]: Waiting for error group managing segments... Aug 15 15:16:25.020682831 (165h50m19.451762962s) [noise=true , address=79.127.205.233:4628 , piece_id=WPIGFCQOIO7MSIJDR4RNO2ZYHBMVHTJQXRTOBP2JI3Z3M7ISILCA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.098977978 (165h50m19.530058109s) [noise=true , address=66.23.193.175:4557 , piece_id=2VQDLPFWGEOL63THQTDZJUSCZFQAUHL2AZLE6JYR6PJIVGV6VO2A, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.449295087 (165h50m19.880375218s) [noise=true , address=79.127.220.101:4073 , piece_id=TJ26UR6WS6T6RBGA22EYWL33O2Z3IXPEVAOQVGDN5AUS4PDMDK7Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.657174453 (165h50m20.088254574s) [noise=true , address=79.127.201.215:4343 , piece_id=MPMAQOMIURMVFNKXTJ5HLC5LJJCGOTY6HQPQCL2GH4YCMM2Q6FKQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.908657128 (165h50m20.339737249s) [noise=true , address=104.36.82.36:4626 , piece_id=X4U7SLWZRU5CL2T5IFC2HNOQ3D4HPUXA7TIFJUJYSUF3LMWDQNTA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.921525419 (165h50m20.35260555s) [noise=true , address=45.91.116.6:4986 , piece_id=NHCYAM4OJSS6DBYNYWZCBG5QRHM5NUVI6UP5XNILC7F5GOOZ2W3Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.937876515 (165h50m20.368956636s) [noise=true , address=104.36.82.8:4974 , piece_id=2ZDFUCSOVMJHIGINANSMLVZVMZHM56XQ6OBJWUFDXONJ4D42XVPQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.975679856 (165h50m20.406759977s) [noise=true , address=104.36.82.60:4358 , piece_id=STJCTAGQOFXFQ7LTXAKG5PA7ZUK7OLJUFXADZRW4YXEXZJMIWGXQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.125861536 (165h50m20.556941667s) [noise=true , address=77.90.31.18:4827 , piece_id=5DW7WZTN34P42BTTRUQ56LSFLBHS5QHO2HEKES2PT7ZHOSNQ72EA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.168492634 (165h50m20.599572826s) [noise=true , address=77.90.31.17:4779 , piece_id=CYVPZUPZPHTUTH56H4GBMKBHFEXE7NWQZZJDPBKB2RWECBKUTT5A, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.246449022 (165h50m20.677529153s) [noise=true , address=77.90.31.11:4580 , piece_id=O5D4EP4LUSSX6PTZTLRMCXEYIL6W2UXIHBNRDKN2VFVHGB5MFZGA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.380000574 (165h50m20.811080705s) [noise=true , address=77.90.31.16:4740 , piece_id=MGTQCSACL7JQKXGD57P6NKCZOKUTIAIFF2YNBTEE7IYZZRCQ74TQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.680781293 (165h50m21.111861484s) [noise=true , address=77.90.31.13:4630 , piece_id=4ZGFWRPCU6LF34RSH22LHLDFFEICBZ3UKS2I43FMRDQAD5UTFWXA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:27.013998946 (165h50m21.445079077s) [noise=true , address=104.36.82.44:4901 , piece_id=GF4LDYTH5Q4NS4PBIWBT4C4WBQ75ARYMJHOPO2XHXATDGMJ2AK6A, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:27.014022972 (165h50m21.445103103s) [seg_pos={0 0}, upload=172505]: Segment reached optimal threshold of 14 pieces. Aug 15 15:16:27.014278842 (165h50m21.445358973s) [noise=true , address=104.36.82.23:4456 , piece_id=SX2YT3LIZ2MRT4DYRYZDKLO2ST4MHPNINCBTLGILGZWDO77FAQ3Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XUZ2ggL9Q4V8uyJdwvwztqCTvj1DFGRWGtYzKJiaRVaByhfTx): protocol: rpc: dial tcp 104.36.82.23:4456: operation was canceled; conn closed: op Aug 15 15:16:27.014306455 (165h50m21.445386586s) [noise=true , address=104.36.82.5:4864 , piece_id=WKB3ZBR6YDO2EUZKJFB42J6VFL3T6JYE652AYYOEQ6UMG5D3PINQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XXH8TYK6Qfma867943QYYXycyL6osQhcQYEjdMdJVTUDfda2u): protocol: write tcp 188.166.225.170:40092->104.36.82.5:4864: use of closed network connection; write tcp 188.166.225.170:40092->104.36.82.5:4864: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40092->104.36.82.5:4864: use of closed network connection Aug 15 15:16:27.014375847 (165h50m21.445455978s) [noise=true , address=77.90.31.10:4523 , piece_id=D6D7XBHK3426ZA565EVVKLWTIA6LPL24QBGU5YH4BOXWJH6TE64Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LifXs8irH3dbLrzPnXzoCfaFyuUJxsN4rfyLEwTKGXSPxotPa): protocol: expected piece hash; context canceled; EOF Aug 15 15:16:27.014445771 (165h50m21.445525902s) [noise=true , address=104.36.82.18:4390 , piece_id=F6ETCYUTXLXZCH2ZZQ4Q73HNINZBINPNR6ZEGSOACBSDJS7N34BA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AZCJHCR7rF4r62Bg7NcBkpNoLb6r6rEN2a5hZ9KNxJTtjV8jp): protocol: write tcp 188.166.225.170:43784->104.36.82.18:4390: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 15:16:27.014470900 (165h50m21.445551031s) [seg_pos={0 0}, upload=172505]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 15 15:16:27.014539270 (165h50m21.445619401s) [upload=172505]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 15 15:16:27.014543768 (165h50m21.445623899s) [upload=172505]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 15:16:27.420799899 (165h50m21.85188003s) [upload=172505]: Done uploading segments... Aug 15 15:16:27.420818816 (165h50m21.851898937s) [upload=172505]: Upload finished. err: <nil> Duration: 6.955858274s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..................................X....XX...................] duration: 3.232232809s FAIL (2025-08-15 15:22:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 15:08:23.568800831 (165h42m17.999880962s) [upload=172360]: Starting upload Aug 15 15:08:23.568843131 (165h42m17.999923262s) [upload=172360]: Done starting upload Aug 15 15:08:23.568892736 (165h42m17.999972868s) [upload=172360]: Uploading segments... Aug 15 15:08:23.568932031 (165h42m18.000012162s) [upload=172360]: Got next segment. Inline: true Aug 15 15:08:23.568936339 (165h42m18.00001647s) [upload=172360]: Waiting for error group managing segments... Aug 15 15:08:23.568970776 (165h42m18.000050897s) [upload=172360]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 15:08:23.568974854 (165h42m18.000054985s) [upload=172360]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 15:08:23.568977499 (165h42m18.00005763s) [upload=172360]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 15:08:23.783715648 (165h42m18.214795779s) [upload=172360]: Done uploading segments... Aug 15 15:08:23.783733201 (165h42m18.214813332s) [upload=172360]: Upload finished. err: metaclient: Too Many Requests Duration:* 3.232253368s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...........X....................X...X................X......] duration: 7.277680373s FAIL (2025-08-15 15:22:01 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 15 15:16:22.685092094 (165h50m17.116172225s) [upload=172505]: Starting upload Aug 15 15:16:22.685142561 (165h50m17.116222692s) [upload=172505]: Done starting upload Aug 15 15:16:22.685325571 (165h50m17.116405703s) [upload=172505]: Uploading segments... Aug 15 15:16:22.685436684 (165h50m17.116516815s) [upload=172505]: Got next segment. Inline: false Aug 15 15:16:22.685470238 (165h50m17.116550369s) [upload=172505]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 15:16:22.685474446 (165h50m17.116554577s) [upload=172505]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 15 15:16:23.591082804 (165h50m18.022162945s) [seg_pos={0 0}, upload=172505]: Begin upload segment... Aug 15 15:16:23.591147928 (165h50m18.022228059s) [seg_pos={0 0}, upload=172505]: Done begin upload segment. Aug 15 15:16:23.591177995 (165h50m18.022258126s) [noise=true , address=104.36.82.18:4390 , piece_id=F6ETCYUTXLXZCH2ZZQ4Q73HNINZBINPNR6ZEGSOACBSDJS7N34BA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.591241937 (165h50m18.022322068s) [noise=true , address=104.36.82.60:4358 , piece_id=STJCTAGQOFXFQ7LTXAKG5PA7ZUK7OLJUFXADZRW4YXEXZJMIWGXQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.591778354 (165h50m18.022858485s) [noise=true , address=77.90.31.16:4740 , piece_id=MGTQCSACL7JQKXGD57P6NKCZOKUTIAIFF2YNBTEE7IYZZRCQ74TQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.591823260 (165h50m18.022903421s) [noise=true , address=77.90.31.13:4630 , piece_id=4ZGFWRPCU6LF34RSH22LHLDFFEICBZ3UKS2I43FMRDQAD5UTFWXA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.592211303 (165h50m18.023291434s) [noise=true , address=77.90.31.11:4580 , piece_id=O5D4EP4LUSSX6PTZTLRMCXEYIL6W2UXIHBNRDKN2VFVHGB5MFZGA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.592475017 (165h50m18.023555158s) [noise=true , address=77.90.31.18:4827 , piece_id=5DW7WZTN34P42BTTRUQ56LSFLBHS5QHO2HEKES2PT7ZHOSNQ72EA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.592996925 (165h50m18.024077056s) [noise=true , address=104.36.82.36:4626 , piece_id=X4U7SLWZRU5CL2T5IFC2HNOQ3D4HPUXA7TIFJUJYSUF3LMWDQNTA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.593335724 (165h50m18.024415855s) [noise=true , address=79.127.201.215:4343 , piece_id=MPMAQOMIURMVFNKXTJ5HLC5LJJCGOTY6HQPQCL2GH4YCMM2Q6FKQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.593672408 (165h50m18.024752539s) [noise=true , address=104.36.82.8:4974 , piece_id=2ZDFUCSOVMJHIGINANSMLVZVMZHM56XQ6OBJWUFDXONJ4D42XVPQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.594058457 (165h50m18.025138588s) [noise=true , address=104.36.82.23:4456 , piece_id=SX2YT3LIZ2MRT4DYRYZDKLO2ST4MHPNINCBTLGILGZWDO77FAQ3Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.594396543 (165h50m18.025476674s) [noise=true , address=79.127.220.101:4073 , piece_id=TJ26UR6WS6T6RBGA22EYWL33O2Z3IXPEVAOQVGDN5AUS4PDMDK7Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.594720794 (165h50m18.025800935s) [noise=true , address=77.90.31.17:4779 , piece_id=CYVPZUPZPHTUTH56H4GBMKBHFEXE7NWQZZJDPBKB2RWECBKUTT5A, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.595057868 (165h50m18.026137999s) [noise=true , address=45.91.116.6:4986 , piece_id=NHCYAM4OJSS6DBYNYWZCBG5QRHM5NUVI6UP5XNILC7F5GOOZ2W3Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.595398080 (165h50m18.026478211s) [noise=true , address=104.36.82.5:4864 , piece_id=WKB3ZBR6YDO2EUZKJFB42J6VFL3T6JYE652AYYOEQ6UMG5D3PINQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.595839625 (165h50m18.026919756s) [noise=true , address=104.36.82.44:4901 , piece_id=GF4LDYTH5Q4NS4PBIWBT4C4WBQ75ARYMJHOPO2XHXATDGMJ2AK6A, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.596180326 (165h50m18.027260457s) [noise=true , address=66.23.193.175:4557 , piece_id=2VQDLPFWGEOL63THQTDZJUSCZFQAUHL2AZLE6JYR6PJIVGV6VO2A, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.596567146 (165h50m18.027647287s) [noise=true , address=77.90.31.10:4523 , piece_id=D6D7XBHK3426ZA565EVVKLWTIA6LPL24QBGU5YH4BOXWJH6TE64Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.596896567 (165h50m18.027976698s) [noise=true , address=79.127.205.233:4628 , piece_id=WPIGFCQOIO7MSIJDR4RNO2ZYHBMVHTJQXRTOBP2JI3Z3M7ISILCA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:24.737329106 (165h50m19.168409237s) [upload=172505]: Next returned nil segment Aug 15 15:16:24.737345307 (165h50m19.168425438s) [upload=172505]: Waiting for error group managing segments... Aug 15 15:16:25.020682831 (165h50m19.451762962s) [noise=true , address=79.127.205.233:4628 , piece_id=WPIGFCQOIO7MSIJDR4RNO2ZYHBMVHTJQXRTOBP2JI3Z3M7ISILCA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.098977978 (165h50m19.530058109s) [noise=true , address=66.23.193.175:4557 , piece_id=2VQDLPFWGEOL63THQTDZJUSCZFQAUHL2AZLE6JYR6PJIVGV6VO2A, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.449295087 (165h50m19.880375218s) [noise=true , address=79.127.220.101:4073 , piece_id=TJ26UR6WS6T6RBGA22EYWL33O2Z3IXPEVAOQVGDN5AUS4PDMDK7Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.657174453 (165h50m20.088254574s) [noise=true , address=79.127.201.215:4343 , piece_id=MPMAQOMIURMVFNKXTJ5HLC5LJJCGOTY6HQPQCL2GH4YCMM2Q6FKQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.908657128 (165h50m20.339737249s) [noise=true , address=104.36.82.36:4626 , piece_id=X4U7SLWZRU5CL2T5IFC2HNOQ3D4HPUXA7TIFJUJYSUF3LMWDQNTA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.921525419 (165h50m20.35260555s) [noise=true , address=45.91.116.6:4986 , piece_id=NHCYAM4OJSS6DBYNYWZCBG5QRHM5NUVI6UP5XNILC7F5GOOZ2W3Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.937876515 (165h50m20.368956636s) [noise=true , address=104.36.82.8:4974 , piece_id=2ZDFUCSOVMJHIGINANSMLVZVMZHM56XQ6OBJWUFDXONJ4D42XVPQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.975679856 (165h50m20.406759977s) [noise=true , address=104.36.82.60:4358 , piece_id=STJCTAGQOFXFQ7LTXAKG5PA7ZUK7OLJUFXADZRW4YXEXZJMIWGXQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.125861536 (165h50m20.556941667s) [noise=true , address=77.90.31.18:4827 , piece_id=5DW7WZTN34P42BTTRUQ56LSFLBHS5QHO2HEKES2PT7ZHOSNQ72EA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.168492634 (165h50m20.599572826s) [noise=true , address=77.90.31.17:4779 , piece_id=CYVPZUPZPHTUTH56H4GBMKBHFEXE7NWQZZJDPBKB2RWECBKUTT5A, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.246449022 (165h50m20.677529153s) [noise=true , address=77.90.31.11:4580 , piece_id=O5D4EP4LUSSX6PTZTLRMCXEYIL6W2UXIHBNRDKN2VFVHGB5MFZGA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.380000574 (165h50m20.811080705s) [noise=true , address=77.90.31.16:4740 , piece_id=MGTQCSACL7JQKXGD57P6NKCZOKUTIAIFF2YNBTEE7IYZZRCQ74TQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.680781293 (165h50m21.111861484s) [noise=true , address=77.90.31.13:4630 , piece_id=4ZGFWRPCU6LF34RSH22LHLDFFEICBZ3UKS2I43FMRDQAD5UTFWXA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:27.013998946 (165h50m21.445079077s) [noise=true , address=104.36.82.44:4901 , piece_id=GF4LDYTH5Q4NS4PBIWBT4C4WBQ75ARYMJHOPO2XHXATDGMJ2AK6A, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:27.014022972 (165h50m21.445103103s) [seg_pos={0 0}, upload=172505]: Segment reached optimal threshold of 14 pieces. Aug 15 15:16:27.014278842 (165h50m21.445358973s) [noise=true , address=104.36.82.23:4456 , piece_id=SX2YT3LIZ2MRT4DYRYZDKLO2ST4MHPNINCBTLGILGZWDO77FAQ3Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XUZ2ggL9Q4V8uyJdwvwztqCTvj1DFGRWGtYzKJiaRVaByhfTx): protocol: rpc: dial tcp 104.36.82.23:4456: operation was canceled; conn closed: op Aug 15 15:16:27.014306455 (165h50m21.445386586s) [noise=true , address=104.36.82.5:4864 , piece_id=WKB3ZBR6YDO2EUZKJFB42J6VFL3T6JYE652AYYOEQ6UMG5D3PINQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XXH8TYK6Qfma867943QYYXycyL6osQhcQYEjdMdJVTUDfda2u): protocol: write tcp 188.166.225.170:40092->104.36.82.5:4864: use of closed network connection; write tcp 188.166.225.170:40092->104.36.82.5:4864: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40092->104.36.82.5:4864: use of closed network connection Aug 15 15:16:27.014375847 (165h50m21.445455978s) [noise=true , address=77.90.31.10:4523 , piece_id=D6D7XBHK3426ZA565EVVKLWTIA6LPL24QBGU5YH4BOXWJH6TE64Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LifXs8irH3dbLrzPnXzoCfaFyuUJxsN4rfyLEwTKGXSPxotPa): protocol: expected piece hash; context canceled; EOF Aug 15 15:16:27.014445771 (165h50m21.445525902s) [noise=true , address=104.36.82.18:4390 , piece_id=F6ETCYUTXLXZCH2ZZQ4Q73HNINZBINPNR6ZEGSOACBSDJS7N34BA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AZCJHCR7rF4r62Bg7NcBkpNoLb6r6rEN2a5hZ9KNxJTtjV8jp): protocol: write tcp 188.166.225.170:43784->104.36.82.18:4390: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 15:16:27.014470900 (165h50m21.445551031s) [seg_pos={0 0}, upload=172505]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 15 15:16:27.014539270 (165h50m21.445619401s) [upload=172505]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 15 15:16:27.014543768 (165h50m21.445623899s) [upload=172505]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 15:16:27.420799899 (165h50m21.85188003s) [upload=172505]: Done uploading segments... Aug 15 15:16:27.420818816 (165h50m21.851898937s) [upload=172505]: Upload finished. err: <nil> Duration: 7.277701263s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...................................X....XX..................] duration: 1.903668347s FAIL (2025-08-15 15:21:53 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 15:08:23.568800831 (165h42m17.999880962s) [upload=172360]: Starting upload Aug 15 15:08:23.568843131 (165h42m17.999923262s) [upload=172360]: Done starting upload Aug 15 15:08:23.568892736 (165h42m17.999972868s) [upload=172360]: Uploading segments... Aug 15 15:08:23.568932031 (165h42m18.000012162s) [upload=172360]: Got next segment. Inline: true Aug 15 15:08:23.568936339 (165h42m18.00001647s) [upload=172360]: Waiting for error group managing segments... Aug 15 15:08:23.568970776 (165h42m18.000050897s) [upload=172360]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 15:08:23.568974854 (165h42m18.000054985s) [upload=172360]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 15:08:23.568977499 (165h42m18.00005763s) [upload=172360]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 15:08:23.783715648 (165h42m18.214795779s) [upload=172360]: Done uploading segments... Aug 15 15:08:23.783733201 (165h42m18.214813332s) [upload=172360]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.90370636s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [............X....................X...X................X.....] duration: 8.231488472s FAIL (2025-08-15 15:21:04 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 15 15:16:22.685092094 (165h50m17.116172225s) [upload=172505]: Starting upload Aug 15 15:16:22.685142561 (165h50m17.116222692s) [upload=172505]: Done starting upload Aug 15 15:16:22.685325571 (165h50m17.116405703s) [upload=172505]: Uploading segments... Aug 15 15:16:22.685436684 (165h50m17.116516815s) [upload=172505]: Got next segment. Inline: false Aug 15 15:16:22.685470238 (165h50m17.116550369s) [upload=172505]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 15:16:22.685474446 (165h50m17.116554577s) [upload=172505]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 15 15:16:23.591082804 (165h50m18.022162945s) [seg_pos={0 0}, upload=172505]: Begin upload segment... Aug 15 15:16:23.591147928 (165h50m18.022228059s) [seg_pos={0 0}, upload=172505]: Done begin upload segment. Aug 15 15:16:23.591177995 (165h50m18.022258126s) [noise=true , address=104.36.82.18:4390 , piece_id=F6ETCYUTXLXZCH2ZZQ4Q73HNINZBINPNR6ZEGSOACBSDJS7N34BA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.591241937 (165h50m18.022322068s) [noise=true , address=104.36.82.60:4358 , piece_id=STJCTAGQOFXFQ7LTXAKG5PA7ZUK7OLJUFXADZRW4YXEXZJMIWGXQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.591778354 (165h50m18.022858485s) [noise=true , address=77.90.31.16:4740 , piece_id=MGTQCSACL7JQKXGD57P6NKCZOKUTIAIFF2YNBTEE7IYZZRCQ74TQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.591823260 (165h50m18.022903421s) [noise=true , address=77.90.31.13:4630 , piece_id=4ZGFWRPCU6LF34RSH22LHLDFFEICBZ3UKS2I43FMRDQAD5UTFWXA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.592211303 (165h50m18.023291434s) [noise=true , address=77.90.31.11:4580 , piece_id=O5D4EP4LUSSX6PTZTLRMCXEYIL6W2UXIHBNRDKN2VFVHGB5MFZGA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.592475017 (165h50m18.023555158s) [noise=true , address=77.90.31.18:4827 , piece_id=5DW7WZTN34P42BTTRUQ56LSFLBHS5QHO2HEKES2PT7ZHOSNQ72EA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.592996925 (165h50m18.024077056s) [noise=true , address=104.36.82.36:4626 , piece_id=X4U7SLWZRU5CL2T5IFC2HNOQ3D4HPUXA7TIFJUJYSUF3LMWDQNTA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.593335724 (165h50m18.024415855s) [noise=true , address=79.127.201.215:4343 , piece_id=MPMAQOMIURMVFNKXTJ5HLC5LJJCGOTY6HQPQCL2GH4YCMM2Q6FKQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.593672408 (165h50m18.024752539s) [noise=true , address=104.36.82.8:4974 , piece_id=2ZDFUCSOVMJHIGINANSMLVZVMZHM56XQ6OBJWUFDXONJ4D42XVPQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.594058457 (165h50m18.025138588s) [noise=true , address=104.36.82.23:4456 , piece_id=SX2YT3LIZ2MRT4DYRYZDKLO2ST4MHPNINCBTLGILGZWDO77FAQ3Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.594396543 (165h50m18.025476674s) [noise=true , address=79.127.220.101:4073 , piece_id=TJ26UR6WS6T6RBGA22EYWL33O2Z3IXPEVAOQVGDN5AUS4PDMDK7Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.594720794 (165h50m18.025800935s) [noise=true , address=77.90.31.17:4779 , piece_id=CYVPZUPZPHTUTH56H4GBMKBHFEXE7NWQZZJDPBKB2RWECBKUTT5A, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.595057868 (165h50m18.026137999s) [noise=true , address=45.91.116.6:4986 , piece_id=NHCYAM4OJSS6DBYNYWZCBG5QRHM5NUVI6UP5XNILC7F5GOOZ2W3Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.595398080 (165h50m18.026478211s) [noise=true , address=104.36.82.5:4864 , piece_id=WKB3ZBR6YDO2EUZKJFB42J6VFL3T6JYE652AYYOEQ6UMG5D3PINQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.595839625 (165h50m18.026919756s) [noise=true , address=104.36.82.44:4901 , piece_id=GF4LDYTH5Q4NS4PBIWBT4C4WBQ75ARYMJHOPO2XHXATDGMJ2AK6A, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.596180326 (165h50m18.027260457s) [noise=true , address=66.23.193.175:4557 , piece_id=2VQDLPFWGEOL63THQTDZJUSCZFQAUHL2AZLE6JYR6PJIVGV6VO2A, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.596567146 (165h50m18.027647287s) [noise=true , address=77.90.31.10:4523 , piece_id=D6D7XBHK3426ZA565EVVKLWTIA6LPL24QBGU5YH4BOXWJH6TE64Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.596896567 (165h50m18.027976698s) [noise=true , address=79.127.205.233:4628 , piece_id=WPIGFCQOIO7MSIJDR4RNO2ZYHBMVHTJQXRTOBP2JI3Z3M7ISILCA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:24.737329106 (165h50m19.168409237s) [upload=172505]: Next returned nil segment Aug 15 15:16:24.737345307 (165h50m19.168425438s) [upload=172505]: Waiting for error group managing segments... Aug 15 15:16:25.020682831 (165h50m19.451762962s) [noise=true , address=79.127.205.233:4628 , piece_id=WPIGFCQOIO7MSIJDR4RNO2ZYHBMVHTJQXRTOBP2JI3Z3M7ISILCA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.098977978 (165h50m19.530058109s) [noise=true , address=66.23.193.175:4557 , piece_id=2VQDLPFWGEOL63THQTDZJUSCZFQAUHL2AZLE6JYR6PJIVGV6VO2A, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.449295087 (165h50m19.880375218s) [noise=true , address=79.127.220.101:4073 , piece_id=TJ26UR6WS6T6RBGA22EYWL33O2Z3IXPEVAOQVGDN5AUS4PDMDK7Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.657174453 (165h50m20.088254574s) [noise=true , address=79.127.201.215:4343 , piece_id=MPMAQOMIURMVFNKXTJ5HLC5LJJCGOTY6HQPQCL2GH4YCMM2Q6FKQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.908657128 (165h50m20.339737249s) [noise=true , address=104.36.82.36:4626 , piece_id=X4U7SLWZRU5CL2T5IFC2HNOQ3D4HPUXA7TIFJUJYSUF3LMWDQNTA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.921525419 (165h50m20.35260555s) [noise=true , address=45.91.116.6:4986 , piece_id=NHCYAM4OJSS6DBYNYWZCBG5QRHM5NUVI6UP5XNILC7F5GOOZ2W3Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.937876515 (165h50m20.368956636s) [noise=true , address=104.36.82.8:4974 , piece_id=2ZDFUCSOVMJHIGINANSMLVZVMZHM56XQ6OBJWUFDXONJ4D42XVPQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.975679856 (165h50m20.406759977s) [noise=true , address=104.36.82.60:4358 , piece_id=STJCTAGQOFXFQ7LTXAKG5PA7ZUK7OLJUFXADZRW4YXEXZJMIWGXQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.125861536 (165h50m20.556941667s) [noise=true , address=77.90.31.18:4827 , piece_id=5DW7WZTN34P42BTTRUQ56LSFLBHS5QHO2HEKES2PT7ZHOSNQ72EA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.168492634 (165h50m20.599572826s) [noise=true , address=77.90.31.17:4779 , piece_id=CYVPZUPZPHTUTH56H4GBMKBHFEXE7NWQZZJDPBKB2RWECBKUTT5A, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.246449022 (165h50m20.677529153s) [noise=true , address=77.90.31.11:4580 , piece_id=O5D4EP4LUSSX6PTZTLRMCXEYIL6W2UXIHBNRDKN2VFVHGB5MFZGA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.380000574 (165h50m20.811080705s) [noise=true , address=77.90.31.16:4740 , piece_id=MGTQCSACL7JQKXGD57P6NKCZOKUTIAIFF2YNBTEE7IYZZRCQ74TQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.680781293 (165h50m21.111861484s) [noise=true , address=77.90.31.13:4630 , piece_id=4ZGFWRPCU6LF34RSH22LHLDFFEICBZ3UKS2I43FMRDQAD5UTFWXA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:27.013998946 (165h50m21.445079077s) [noise=true , address=104.36.82.44:4901 , piece_id=GF4LDYTH5Q4NS4PBIWBT4C4WBQ75ARYMJHOPO2XHXATDGMJ2AK6A, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:27.014022972 (165h50m21.445103103s) [seg_pos={0 0}, upload=172505]: Segment reached optimal threshold of 14 pieces. Aug 15 15:16:27.014278842 (165h50m21.445358973s) [noise=true , address=104.36.82.23:4456 , piece_id=SX2YT3LIZ2MRT4DYRYZDKLO2ST4MHPNINCBTLGILGZWDO77FAQ3Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XUZ2ggL9Q4V8uyJdwvwztqCTvj1DFGRWGtYzKJiaRVaByhfTx): protocol: rpc: dial tcp 104.36.82.23:4456: operation was canceled; conn closed: op Aug 15 15:16:27.014306455 (165h50m21.445386586s) [noise=true , address=104.36.82.5:4864 , piece_id=WKB3ZBR6YDO2EUZKJFB42J6VFL3T6JYE652AYYOEQ6UMG5D3PINQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XXH8TYK6Qfma867943QYYXycyL6osQhcQYEjdMdJVTUDfda2u): protocol: write tcp 188.166.225.170:40092->104.36.82.5:4864: use of closed network connection; write tcp 188.166.225.170:40092->104.36.82.5:4864: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40092->104.36.82.5:4864: use of closed network connection Aug 15 15:16:27.014375847 (165h50m21.445455978s) [noise=true , address=77.90.31.10:4523 , piece_id=D6D7XBHK3426ZA565EVVKLWTIA6LPL24QBGU5YH4BOXWJH6TE64Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LifXs8irH3dbLrzPnXzoCfaFyuUJxsN4rfyLEwTKGXSPxotPa): protocol: expected piece hash; context canceled; EOF Aug 15 15:16:27.014445771 (165h50m21.445525902s) [noise=true , address=104.36.82.18:4390 , piece_id=F6ETCYUTXLXZCH2ZZQ4Q73HNINZBINPNR6ZEGSOACBSDJS7N34BA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AZCJHCR7rF4r62Bg7NcBkpNoLb6r6rEN2a5hZ9KNxJTtjV8jp): protocol: write tcp 188.166.225.170:43784->104.36.82.18:4390: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 15:16:27.014470900 (165h50m21.445551031s) [seg_pos={0 0}, upload=172505]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 15 15:16:27.014539270 (165h50m21.445619401s) [upload=172505]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 15 15:16:27.014543768 (165h50m21.445623899s) [upload=172505]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 15:16:27.420799899 (165h50m21.85188003s) [upload=172505]: Done uploading segments... Aug 15 15:16:27.420818816 (165h50m21.851898937s) [upload=172505]: Upload finished. err: <nil> Duration: 8.231508832s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [....................................X....XX.................] duration: 1.970243578s FAIL (2025-08-15 15:20:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 15:08:23.568800831 (165h42m17.999880962s) [upload=172360]: Starting upload Aug 15 15:08:23.568843131 (165h42m17.999923262s) [upload=172360]: Done starting upload Aug 15 15:08:23.568892736 (165h42m17.999972868s) [upload=172360]: Uploading segments... Aug 15 15:08:23.568932031 (165h42m18.000012162s) [upload=172360]: Got next segment. Inline: true Aug 15 15:08:23.568936339 (165h42m18.00001647s) [upload=172360]: Waiting for error group managing segments... Aug 15 15:08:23.568970776 (165h42m18.000050897s) [upload=172360]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 15:08:23.568974854 (165h42m18.000054985s) [upload=172360]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 15:08:23.568977499 (165h42m18.00005763s) [upload=172360]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 15:08:23.783715648 (165h42m18.214795779s) [upload=172360]: Done uploading segments... Aug 15 15:08:23.783733201 (165h42m18.214813332s) [upload=172360]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.970271561s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.............X....................X...X................X....] duration: 6.25446886s FAIL (2025-08-15 15:20:19 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 15 15:16:22.685092094 (165h50m17.116172225s) [upload=172505]: Starting upload Aug 15 15:16:22.685142561 (165h50m17.116222692s) [upload=172505]: Done starting upload Aug 15 15:16:22.685325571 (165h50m17.116405703s) [upload=172505]: Uploading segments... Aug 15 15:16:22.685436684 (165h50m17.116516815s) [upload=172505]: Got next segment. Inline: false Aug 15 15:16:22.685470238 (165h50m17.116550369s) [upload=172505]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 15:16:22.685474446 (165h50m17.116554577s) [upload=172505]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 15 15:16:23.591082804 (165h50m18.022162945s) [seg_pos={0 0}, upload=172505]: Begin upload segment... Aug 15 15:16:23.591147928 (165h50m18.022228059s) [seg_pos={0 0}, upload=172505]: Done begin upload segment. Aug 15 15:16:23.591177995 (165h50m18.022258126s) [noise=true , address=104.36.82.18:4390 , piece_id=F6ETCYUTXLXZCH2ZZQ4Q73HNINZBINPNR6ZEGSOACBSDJS7N34BA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.591241937 (165h50m18.022322068s) [noise=true , address=104.36.82.60:4358 , piece_id=STJCTAGQOFXFQ7LTXAKG5PA7ZUK7OLJUFXADZRW4YXEXZJMIWGXQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.591778354 (165h50m18.022858485s) [noise=true , address=77.90.31.16:4740 , piece_id=MGTQCSACL7JQKXGD57P6NKCZOKUTIAIFF2YNBTEE7IYZZRCQ74TQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.591823260 (165h50m18.022903421s) [noise=true , address=77.90.31.13:4630 , piece_id=4ZGFWRPCU6LF34RSH22LHLDFFEICBZ3UKS2I43FMRDQAD5UTFWXA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.592211303 (165h50m18.023291434s) [noise=true , address=77.90.31.11:4580 , piece_id=O5D4EP4LUSSX6PTZTLRMCXEYIL6W2UXIHBNRDKN2VFVHGB5MFZGA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.592475017 (165h50m18.023555158s) [noise=true , address=77.90.31.18:4827 , piece_id=5DW7WZTN34P42BTTRUQ56LSFLBHS5QHO2HEKES2PT7ZHOSNQ72EA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.592996925 (165h50m18.024077056s) [noise=true , address=104.36.82.36:4626 , piece_id=X4U7SLWZRU5CL2T5IFC2HNOQ3D4HPUXA7TIFJUJYSUF3LMWDQNTA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.593335724 (165h50m18.024415855s) [noise=true , address=79.127.201.215:4343 , piece_id=MPMAQOMIURMVFNKXTJ5HLC5LJJCGOTY6HQPQCL2GH4YCMM2Q6FKQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.593672408 (165h50m18.024752539s) [noise=true , address=104.36.82.8:4974 , piece_id=2ZDFUCSOVMJHIGINANSMLVZVMZHM56XQ6OBJWUFDXONJ4D42XVPQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.594058457 (165h50m18.025138588s) [noise=true , address=104.36.82.23:4456 , piece_id=SX2YT3LIZ2MRT4DYRYZDKLO2ST4MHPNINCBTLGILGZWDO77FAQ3Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.594396543 (165h50m18.025476674s) [noise=true , address=79.127.220.101:4073 , piece_id=TJ26UR6WS6T6RBGA22EYWL33O2Z3IXPEVAOQVGDN5AUS4PDMDK7Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.594720794 (165h50m18.025800935s) [noise=true , address=77.90.31.17:4779 , piece_id=CYVPZUPZPHTUTH56H4GBMKBHFEXE7NWQZZJDPBKB2RWECBKUTT5A, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.595057868 (165h50m18.026137999s) [noise=true , address=45.91.116.6:4986 , piece_id=NHCYAM4OJSS6DBYNYWZCBG5QRHM5NUVI6UP5XNILC7F5GOOZ2W3Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.595398080 (165h50m18.026478211s) [noise=true , address=104.36.82.5:4864 , piece_id=WKB3ZBR6YDO2EUZKJFB42J6VFL3T6JYE652AYYOEQ6UMG5D3PINQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.595839625 (165h50m18.026919756s) [noise=true , address=104.36.82.44:4901 , piece_id=GF4LDYTH5Q4NS4PBIWBT4C4WBQ75ARYMJHOPO2XHXATDGMJ2AK6A, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.596180326 (165h50m18.027260457s) [noise=true , address=66.23.193.175:4557 , piece_id=2VQDLPFWGEOL63THQTDZJUSCZFQAUHL2AZLE6JYR6PJIVGV6VO2A, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.596567146 (165h50m18.027647287s) [noise=true , address=77.90.31.10:4523 , piece_id=D6D7XBHK3426ZA565EVVKLWTIA6LPL24QBGU5YH4BOXWJH6TE64Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.596896567 (165h50m18.027976698s) [noise=true , address=79.127.205.233:4628 , piece_id=WPIGFCQOIO7MSIJDR4RNO2ZYHBMVHTJQXRTOBP2JI3Z3M7ISILCA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:24.737329106 (165h50m19.168409237s) [upload=172505]: Next returned nil segment Aug 15 15:16:24.737345307 (165h50m19.168425438s) [upload=172505]: Waiting for error group managing segments... Aug 15 15:16:25.020682831 (165h50m19.451762962s) [noise=true , address=79.127.205.233:4628 , piece_id=WPIGFCQOIO7MSIJDR4RNO2ZYHBMVHTJQXRTOBP2JI3Z3M7ISILCA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.098977978 (165h50m19.530058109s) [noise=true , address=66.23.193.175:4557 , piece_id=2VQDLPFWGEOL63THQTDZJUSCZFQAUHL2AZLE6JYR6PJIVGV6VO2A, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.449295087 (165h50m19.880375218s) [noise=true , address=79.127.220.101:4073 , piece_id=TJ26UR6WS6T6RBGA22EYWL33O2Z3IXPEVAOQVGDN5AUS4PDMDK7Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.657174453 (165h50m20.088254574s) [noise=true , address=79.127.201.215:4343 , piece_id=MPMAQOMIURMVFNKXTJ5HLC5LJJCGOTY6HQPQCL2GH4YCMM2Q6FKQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.908657128 (165h50m20.339737249s) [noise=true , address=104.36.82.36:4626 , piece_id=X4U7SLWZRU5CL2T5IFC2HNOQ3D4HPUXA7TIFJUJYSUF3LMWDQNTA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.921525419 (165h50m20.35260555s) [noise=true , address=45.91.116.6:4986 , piece_id=NHCYAM4OJSS6DBYNYWZCBG5QRHM5NUVI6UP5XNILC7F5GOOZ2W3Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.937876515 (165h50m20.368956636s) [noise=true , address=104.36.82.8:4974 , piece_id=2ZDFUCSOVMJHIGINANSMLVZVMZHM56XQ6OBJWUFDXONJ4D42XVPQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.975679856 (165h50m20.406759977s) [noise=true , address=104.36.82.60:4358 , piece_id=STJCTAGQOFXFQ7LTXAKG5PA7ZUK7OLJUFXADZRW4YXEXZJMIWGXQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.125861536 (165h50m20.556941667s) [noise=true , address=77.90.31.18:4827 , piece_id=5DW7WZTN34P42BTTRUQ56LSFLBHS5QHO2HEKES2PT7ZHOSNQ72EA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.168492634 (165h50m20.599572826s) [noise=true , address=77.90.31.17:4779 , piece_id=CYVPZUPZPHTUTH56H4GBMKBHFEXE7NWQZZJDPBKB2RWECBKUTT5A, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.246449022 (165h50m20.677529153s) [noise=true , address=77.90.31.11:4580 , piece_id=O5D4EP4LUSSX6PTZTLRMCXEYIL6W2UXIHBNRDKN2VFVHGB5MFZGA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.380000574 (165h50m20.811080705s) [noise=true , address=77.90.31.16:4740 , piece_id=MGTQCSACL7JQKXGD57P6NKCZOKUTIAIFF2YNBTEE7IYZZRCQ74TQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.680781293 (165h50m21.111861484s) [noise=true , address=77.90.31.13:4630 , piece_id=4ZGFWRPCU6LF34RSH22LHLDFFEICBZ3UKS2I43FMRDQAD5UTFWXA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:27.013998946 (165h50m21.445079077s) [noise=true , address=104.36.82.44:4901 , piece_id=GF4LDYTH5Q4NS4PBIWBT4C4WBQ75ARYMJHOPO2XHXATDGMJ2AK6A, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:27.014022972 (165h50m21.445103103s) [seg_pos={0 0}, upload=172505]: Segment reached optimal threshold of 14 pieces. Aug 15 15:16:27.014278842 (165h50m21.445358973s) [noise=true , address=104.36.82.23:4456 , piece_id=SX2YT3LIZ2MRT4DYRYZDKLO2ST4MHPNINCBTLGILGZWDO77FAQ3Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XUZ2ggL9Q4V8uyJdwvwztqCTvj1DFGRWGtYzKJiaRVaByhfTx): protocol: rpc: dial tcp 104.36.82.23:4456: operation was canceled; conn closed: op Aug 15 15:16:27.014306455 (165h50m21.445386586s) [noise=true , address=104.36.82.5:4864 , piece_id=WKB3ZBR6YDO2EUZKJFB42J6VFL3T6JYE652AYYOEQ6UMG5D3PINQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XXH8TYK6Qfma867943QYYXycyL6osQhcQYEjdMdJVTUDfda2u): protocol: write tcp 188.166.225.170:40092->104.36.82.5:4864: use of closed network connection; write tcp 188.166.225.170:40092->104.36.82.5:4864: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40092->104.36.82.5:4864: use of closed network connection Aug 15 15:16:27.014375847 (165h50m21.445455978s) [noise=true , address=77.90.31.10:4523 , piece_id=D6D7XBHK3426ZA565EVVKLWTIA6LPL24QBGU5YH4BOXWJH6TE64Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LifXs8irH3dbLrzPnXzoCfaFyuUJxsN4rfyLEwTKGXSPxotPa): protocol: expected piece hash; context canceled; EOF Aug 15 15:16:27.014445771 (165h50m21.445525902s) [noise=true , address=104.36.82.18:4390 , piece_id=F6ETCYUTXLXZCH2ZZQ4Q73HNINZBINPNR6ZEGSOACBSDJS7N34BA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AZCJHCR7rF4r62Bg7NcBkpNoLb6r6rEN2a5hZ9KNxJTtjV8jp): protocol: write tcp 188.166.225.170:43784->104.36.82.18:4390: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 15:16:27.014470900 (165h50m21.445551031s) [seg_pos={0 0}, upload=172505]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 15 15:16:27.014539270 (165h50m21.445619401s) [upload=172505]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 15 15:16:27.014543768 (165h50m21.445623899s) [upload=172505]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 15:16:27.420799899 (165h50m21.85188003s) [upload=172505]: Done uploading segments... Aug 15 15:16:27.420818816 (165h50m21.851898937s) [upload=172505]: Upload finished. err: <nil> Duration: 6.254492133s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.....................................X....XX................] duration: 1.930027362s FAIL (2025-08-15 15:19:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 15:08:23.568800831 (165h42m17.999880962s) [upload=172360]: Starting upload Aug 15 15:08:23.568843131 (165h42m17.999923262s) [upload=172360]: Done starting upload Aug 15 15:08:23.568892736 (165h42m17.999972868s) [upload=172360]: Uploading segments... Aug 15 15:08:23.568932031 (165h42m18.000012162s) [upload=172360]: Got next segment. Inline: true Aug 15 15:08:23.568936339 (165h42m18.00001647s) [upload=172360]: Waiting for error group managing segments... Aug 15 15:08:23.568970776 (165h42m18.000050897s) [upload=172360]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 15:08:23.568974854 (165h42m18.000054985s) [upload=172360]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 15:08:23.568977499 (165h42m18.00005763s) [upload=172360]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 15:08:23.783715648 (165h42m18.214795779s) [upload=172360]: Done uploading segments... Aug 15 15:08:23.783733201 (165h42m18.214813332s) [upload=172360]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.930045776s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..............X....................X...X................X...] duration: 7.733090051s FAIL (2025-08-15 15:19:07 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 15 15:16:22.685092094 (165h50m17.116172225s) [upload=172505]: Starting upload Aug 15 15:16:22.685142561 (165h50m17.116222692s) [upload=172505]: Done starting upload Aug 15 15:16:22.685325571 (165h50m17.116405703s) [upload=172505]: Uploading segments... Aug 15 15:16:22.685436684 (165h50m17.116516815s) [upload=172505]: Got next segment. Inline: false Aug 15 15:16:22.685470238 (165h50m17.116550369s) [upload=172505]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 15:16:22.685474446 (165h50m17.116554577s) [upload=172505]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 15 15:16:23.591082804 (165h50m18.022162945s) [seg_pos={0 0}, upload=172505]: Begin upload segment... Aug 15 15:16:23.591147928 (165h50m18.022228059s) [seg_pos={0 0}, upload=172505]: Done begin upload segment. Aug 15 15:16:23.591177995 (165h50m18.022258126s) [noise=true , address=104.36.82.18:4390 , piece_id=F6ETCYUTXLXZCH2ZZQ4Q73HNINZBINPNR6ZEGSOACBSDJS7N34BA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.591241937 (165h50m18.022322068s) [noise=true , address=104.36.82.60:4358 , piece_id=STJCTAGQOFXFQ7LTXAKG5PA7ZUK7OLJUFXADZRW4YXEXZJMIWGXQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.591778354 (165h50m18.022858485s) [noise=true , address=77.90.31.16:4740 , piece_id=MGTQCSACL7JQKXGD57P6NKCZOKUTIAIFF2YNBTEE7IYZZRCQ74TQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.591823260 (165h50m18.022903421s) [noise=true , address=77.90.31.13:4630 , piece_id=4ZGFWRPCU6LF34RSH22LHLDFFEICBZ3UKS2I43FMRDQAD5UTFWXA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.592211303 (165h50m18.023291434s) [noise=true , address=77.90.31.11:4580 , piece_id=O5D4EP4LUSSX6PTZTLRMCXEYIL6W2UXIHBNRDKN2VFVHGB5MFZGA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.592475017 (165h50m18.023555158s) [noise=true , address=77.90.31.18:4827 , piece_id=5DW7WZTN34P42BTTRUQ56LSFLBHS5QHO2HEKES2PT7ZHOSNQ72EA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.592996925 (165h50m18.024077056s) [noise=true , address=104.36.82.36:4626 , piece_id=X4U7SLWZRU5CL2T5IFC2HNOQ3D4HPUXA7TIFJUJYSUF3LMWDQNTA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.593335724 (165h50m18.024415855s) [noise=true , address=79.127.201.215:4343 , piece_id=MPMAQOMIURMVFNKXTJ5HLC5LJJCGOTY6HQPQCL2GH4YCMM2Q6FKQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.593672408 (165h50m18.024752539s) [noise=true , address=104.36.82.8:4974 , piece_id=2ZDFUCSOVMJHIGINANSMLVZVMZHM56XQ6OBJWUFDXONJ4D42XVPQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.594058457 (165h50m18.025138588s) [noise=true , address=104.36.82.23:4456 , piece_id=SX2YT3LIZ2MRT4DYRYZDKLO2ST4MHPNINCBTLGILGZWDO77FAQ3Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.594396543 (165h50m18.025476674s) [noise=true , address=79.127.220.101:4073 , piece_id=TJ26UR6WS6T6RBGA22EYWL33O2Z3IXPEVAOQVGDN5AUS4PDMDK7Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.594720794 (165h50m18.025800935s) [noise=true , address=77.90.31.17:4779 , piece_id=CYVPZUPZPHTUTH56H4GBMKBHFEXE7NWQZZJDPBKB2RWECBKUTT5A, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.595057868 (165h50m18.026137999s) [noise=true , address=45.91.116.6:4986 , piece_id=NHCYAM4OJSS6DBYNYWZCBG5QRHM5NUVI6UP5XNILC7F5GOOZ2W3Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.595398080 (165h50m18.026478211s) [noise=true , address=104.36.82.5:4864 , piece_id=WKB3ZBR6YDO2EUZKJFB42J6VFL3T6JYE652AYYOEQ6UMG5D3PINQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.595839625 (165h50m18.026919756s) [noise=true , address=104.36.82.44:4901 , piece_id=GF4LDYTH5Q4NS4PBIWBT4C4WBQ75ARYMJHOPO2XHXATDGMJ2AK6A, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.596180326 (165h50m18.027260457s) [noise=true , address=66.23.193.175:4557 , piece_id=2VQDLPFWGEOL63THQTDZJUSCZFQAUHL2AZLE6JYR6PJIVGV6VO2A, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.596567146 (165h50m18.027647287s) [noise=true , address=77.90.31.10:4523 , piece_id=D6D7XBHK3426ZA565EVVKLWTIA6LPL24QBGU5YH4BOXWJH6TE64Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.596896567 (165h50m18.027976698s) [noise=true , address=79.127.205.233:4628 , piece_id=WPIGFCQOIO7MSIJDR4RNO2ZYHBMVHTJQXRTOBP2JI3Z3M7ISILCA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:24.737329106 (165h50m19.168409237s) [upload=172505]: Next returned nil segment Aug 15 15:16:24.737345307 (165h50m19.168425438s) [upload=172505]: Waiting for error group managing segments... Aug 15 15:16:25.020682831 (165h50m19.451762962s) [noise=true , address=79.127.205.233:4628 , piece_id=WPIGFCQOIO7MSIJDR4RNO2ZYHBMVHTJQXRTOBP2JI3Z3M7ISILCA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.098977978 (165h50m19.530058109s) [noise=true , address=66.23.193.175:4557 , piece_id=2VQDLPFWGEOL63THQTDZJUSCZFQAUHL2AZLE6JYR6PJIVGV6VO2A, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.449295087 (165h50m19.880375218s) [noise=true , address=79.127.220.101:4073 , piece_id=TJ26UR6WS6T6RBGA22EYWL33O2Z3IXPEVAOQVGDN5AUS4PDMDK7Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.657174453 (165h50m20.088254574s) [noise=true , address=79.127.201.215:4343 , piece_id=MPMAQOMIURMVFNKXTJ5HLC5LJJCGOTY6HQPQCL2GH4YCMM2Q6FKQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.908657128 (165h50m20.339737249s) [noise=true , address=104.36.82.36:4626 , piece_id=X4U7SLWZRU5CL2T5IFC2HNOQ3D4HPUXA7TIFJUJYSUF3LMWDQNTA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.921525419 (165h50m20.35260555s) [noise=true , address=45.91.116.6:4986 , piece_id=NHCYAM4OJSS6DBYNYWZCBG5QRHM5NUVI6UP5XNILC7F5GOOZ2W3Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.937876515 (165h50m20.368956636s) [noise=true , address=104.36.82.8:4974 , piece_id=2ZDFUCSOVMJHIGINANSMLVZVMZHM56XQ6OBJWUFDXONJ4D42XVPQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.975679856 (165h50m20.406759977s) [noise=true , address=104.36.82.60:4358 , piece_id=STJCTAGQOFXFQ7LTXAKG5PA7ZUK7OLJUFXADZRW4YXEXZJMIWGXQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.125861536 (165h50m20.556941667s) [noise=true , address=77.90.31.18:4827 , piece_id=5DW7WZTN34P42BTTRUQ56LSFLBHS5QHO2HEKES2PT7ZHOSNQ72EA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.168492634 (165h50m20.599572826s) [noise=true , address=77.90.31.17:4779 , piece_id=CYVPZUPZPHTUTH56H4GBMKBHFEXE7NWQZZJDPBKB2RWECBKUTT5A, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.246449022 (165h50m20.677529153s) [noise=true , address=77.90.31.11:4580 , piece_id=O5D4EP4LUSSX6PTZTLRMCXEYIL6W2UXIHBNRDKN2VFVHGB5MFZGA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.380000574 (165h50m20.811080705s) [noise=true , address=77.90.31.16:4740 , piece_id=MGTQCSACL7JQKXGD57P6NKCZOKUTIAIFF2YNBTEE7IYZZRCQ74TQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.680781293 (165h50m21.111861484s) [noise=true , address=77.90.31.13:4630 , piece_id=4ZGFWRPCU6LF34RSH22LHLDFFEICBZ3UKS2I43FMRDQAD5UTFWXA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:27.013998946 (165h50m21.445079077s) [noise=true , address=104.36.82.44:4901 , piece_id=GF4LDYTH5Q4NS4PBIWBT4C4WBQ75ARYMJHOPO2XHXATDGMJ2AK6A, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:27.014022972 (165h50m21.445103103s) [seg_pos={0 0}, upload=172505]: Segment reached optimal threshold of 14 pieces. Aug 15 15:16:27.014278842 (165h50m21.445358973s) [noise=true , address=104.36.82.23:4456 , piece_id=SX2YT3LIZ2MRT4DYRYZDKLO2ST4MHPNINCBTLGILGZWDO77FAQ3Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XUZ2ggL9Q4V8uyJdwvwztqCTvj1DFGRWGtYzKJiaRVaByhfTx): protocol: rpc: dial tcp 104.36.82.23:4456: operation was canceled; conn closed: op Aug 15 15:16:27.014306455 (165h50m21.445386586s) [noise=true , address=104.36.82.5:4864 , piece_id=WKB3ZBR6YDO2EUZKJFB42J6VFL3T6JYE652AYYOEQ6UMG5D3PINQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XXH8TYK6Qfma867943QYYXycyL6osQhcQYEjdMdJVTUDfda2u): protocol: write tcp 188.166.225.170:40092->104.36.82.5:4864: use of closed network connection; write tcp 188.166.225.170:40092->104.36.82.5:4864: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40092->104.36.82.5:4864: use of closed network connection Aug 15 15:16:27.014375847 (165h50m21.445455978s) [noise=true , address=77.90.31.10:4523 , piece_id=D6D7XBHK3426ZA565EVVKLWTIA6LPL24QBGU5YH4BOXWJH6TE64Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LifXs8irH3dbLrzPnXzoCfaFyuUJxsN4rfyLEwTKGXSPxotPa): protocol: expected piece hash; context canceled; EOF Aug 15 15:16:27.014445771 (165h50m21.445525902s) [noise=true , address=104.36.82.18:4390 , piece_id=F6ETCYUTXLXZCH2ZZQ4Q73HNINZBINPNR6ZEGSOACBSDJS7N34BA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AZCJHCR7rF4r62Bg7NcBkpNoLb6r6rEN2a5hZ9KNxJTtjV8jp): protocol: write tcp 188.166.225.170:43784->104.36.82.18:4390: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 15:16:27.014470900 (165h50m21.445551031s) [seg_pos={0 0}, upload=172505]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 15 15:16:27.014539270 (165h50m21.445619401s) [upload=172505]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 15 15:16:27.014543768 (165h50m21.445623899s) [upload=172505]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 15:16:27.420799899 (165h50m21.85188003s) [upload=172505]: Done uploading segments... Aug 15 15:16:27.420818816 (165h50m21.851898937s) [upload=172505]: Upload finished. err: <nil> Duration: 7.733142942s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [......................................X....XX...............] duration: 1.915642027s FAIL (2025-08-15 15:18:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 15:08:23.568800831 (165h42m17.999880962s) [upload=172360]: Starting upload Aug 15 15:08:23.568843131 (165h42m17.999923262s) [upload=172360]: Done starting upload Aug 15 15:08:23.568892736 (165h42m17.999972868s) [upload=172360]: Uploading segments... Aug 15 15:08:23.568932031 (165h42m18.000012162s) [upload=172360]: Got next segment. Inline: true Aug 15 15:08:23.568936339 (165h42m18.00001647s) [upload=172360]: Waiting for error group managing segments... Aug 15 15:08:23.568970776 (165h42m18.000050897s) [upload=172360]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 15:08:23.568974854 (165h42m18.000054985s) [upload=172360]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 15:08:23.568977499 (165h42m18.00005763s) [upload=172360]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 15:08:23.783715648 (165h42m18.214795779s) [upload=172360]: Done uploading segments... Aug 15 15:08:23.783733201 (165h42m18.214813332s) [upload=172360]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.915669752s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.......................................X....XX..............] duration: 2.021198023s FAIL (2025-08-15 15:18:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 15:08:23.568800831 (165h42m17.999880962s) [upload=172360]: Starting upload Aug 15 15:08:23.568843131 (165h42m17.999923262s) [upload=172360]: Done starting upload Aug 15 15:08:23.568892736 (165h42m17.999972868s) [upload=172360]: Uploading segments... Aug 15 15:08:23.568932031 (165h42m18.000012162s) [upload=172360]: Got next segment. Inline: true Aug 15 15:08:23.568936339 (165h42m18.00001647s) [upload=172360]: Waiting for error group managing segments... Aug 15 15:08:23.568970776 (165h42m18.000050897s) [upload=172360]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 15:08:23.568974854 (165h42m18.000054985s) [upload=172360]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 15:08:23.568977499 (165h42m18.00005763s) [upload=172360]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 15:08:23.783715648 (165h42m18.214795779s) [upload=172360]: Done uploading segments... Aug 15 15:08:23.783733201 (165h42m18.214813332s) [upload=172360]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.021227147s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...............X....................X...X................X..] duration: 6.224807578s FAIL (2025-08-15 15:18:20 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 15 15:16:22.685092094 (165h50m17.116172225s) [upload=172505]: Starting upload Aug 15 15:16:22.685142561 (165h50m17.116222692s) [upload=172505]: Done starting upload Aug 15 15:16:22.685325571 (165h50m17.116405703s) [upload=172505]: Uploading segments... Aug 15 15:16:22.685436684 (165h50m17.116516815s) [upload=172505]: Got next segment. Inline: false Aug 15 15:16:22.685470238 (165h50m17.116550369s) [upload=172505]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 15:16:22.685474446 (165h50m17.116554577s) [upload=172505]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 15 15:16:23.591082804 (165h50m18.022162945s) [seg_pos={0 0}, upload=172505]: Begin upload segment... Aug 15 15:16:23.591147928 (165h50m18.022228059s) [seg_pos={0 0}, upload=172505]: Done begin upload segment. Aug 15 15:16:23.591177995 (165h50m18.022258126s) [noise=true , address=104.36.82.18:4390 , piece_id=F6ETCYUTXLXZCH2ZZQ4Q73HNINZBINPNR6ZEGSOACBSDJS7N34BA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.591241937 (165h50m18.022322068s) [noise=true , address=104.36.82.60:4358 , piece_id=STJCTAGQOFXFQ7LTXAKG5PA7ZUK7OLJUFXADZRW4YXEXZJMIWGXQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.591778354 (165h50m18.022858485s) [noise=true , address=77.90.31.16:4740 , piece_id=MGTQCSACL7JQKXGD57P6NKCZOKUTIAIFF2YNBTEE7IYZZRCQ74TQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.591823260 (165h50m18.022903421s) [noise=true , address=77.90.31.13:4630 , piece_id=4ZGFWRPCU6LF34RSH22LHLDFFEICBZ3UKS2I43FMRDQAD5UTFWXA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.592211303 (165h50m18.023291434s) [noise=true , address=77.90.31.11:4580 , piece_id=O5D4EP4LUSSX6PTZTLRMCXEYIL6W2UXIHBNRDKN2VFVHGB5MFZGA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.592475017 (165h50m18.023555158s) [noise=true , address=77.90.31.18:4827 , piece_id=5DW7WZTN34P42BTTRUQ56LSFLBHS5QHO2HEKES2PT7ZHOSNQ72EA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.592996925 (165h50m18.024077056s) [noise=true , address=104.36.82.36:4626 , piece_id=X4U7SLWZRU5CL2T5IFC2HNOQ3D4HPUXA7TIFJUJYSUF3LMWDQNTA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.593335724 (165h50m18.024415855s) [noise=true , address=79.127.201.215:4343 , piece_id=MPMAQOMIURMVFNKXTJ5HLC5LJJCGOTY6HQPQCL2GH4YCMM2Q6FKQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.593672408 (165h50m18.024752539s) [noise=true , address=104.36.82.8:4974 , piece_id=2ZDFUCSOVMJHIGINANSMLVZVMZHM56XQ6OBJWUFDXONJ4D42XVPQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.594058457 (165h50m18.025138588s) [noise=true , address=104.36.82.23:4456 , piece_id=SX2YT3LIZ2MRT4DYRYZDKLO2ST4MHPNINCBTLGILGZWDO77FAQ3Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.594396543 (165h50m18.025476674s) [noise=true , address=79.127.220.101:4073 , piece_id=TJ26UR6WS6T6RBGA22EYWL33O2Z3IXPEVAOQVGDN5AUS4PDMDK7Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.594720794 (165h50m18.025800935s) [noise=true , address=77.90.31.17:4779 , piece_id=CYVPZUPZPHTUTH56H4GBMKBHFEXE7NWQZZJDPBKB2RWECBKUTT5A, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.595057868 (165h50m18.026137999s) [noise=true , address=45.91.116.6:4986 , piece_id=NHCYAM4OJSS6DBYNYWZCBG5QRHM5NUVI6UP5XNILC7F5GOOZ2W3Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.595398080 (165h50m18.026478211s) [noise=true , address=104.36.82.5:4864 , piece_id=WKB3ZBR6YDO2EUZKJFB42J6VFL3T6JYE652AYYOEQ6UMG5D3PINQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.595839625 (165h50m18.026919756s) [noise=true , address=104.36.82.44:4901 , piece_id=GF4LDYTH5Q4NS4PBIWBT4C4WBQ75ARYMJHOPO2XHXATDGMJ2AK6A, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.596180326 (165h50m18.027260457s) [noise=true , address=66.23.193.175:4557 , piece_id=2VQDLPFWGEOL63THQTDZJUSCZFQAUHL2AZLE6JYR6PJIVGV6VO2A, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.596567146 (165h50m18.027647287s) [noise=true , address=77.90.31.10:4523 , piece_id=D6D7XBHK3426ZA565EVVKLWTIA6LPL24QBGU5YH4BOXWJH6TE64Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.596896567 (165h50m18.027976698s) [noise=true , address=79.127.205.233:4628 , piece_id=WPIGFCQOIO7MSIJDR4RNO2ZYHBMVHTJQXRTOBP2JI3Z3M7ISILCA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:24.737329106 (165h50m19.168409237s) [upload=172505]: Next returned nil segment Aug 15 15:16:24.737345307 (165h50m19.168425438s) [upload=172505]: Waiting for error group managing segments... Aug 15 15:16:25.020682831 (165h50m19.451762962s) [noise=true , address=79.127.205.233:4628 , piece_id=WPIGFCQOIO7MSIJDR4RNO2ZYHBMVHTJQXRTOBP2JI3Z3M7ISILCA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.098977978 (165h50m19.530058109s) [noise=true , address=66.23.193.175:4557 , piece_id=2VQDLPFWGEOL63THQTDZJUSCZFQAUHL2AZLE6JYR6PJIVGV6VO2A, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.449295087 (165h50m19.880375218s) [noise=true , address=79.127.220.101:4073 , piece_id=TJ26UR6WS6T6RBGA22EYWL33O2Z3IXPEVAOQVGDN5AUS4PDMDK7Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.657174453 (165h50m20.088254574s) [noise=true , address=79.127.201.215:4343 , piece_id=MPMAQOMIURMVFNKXTJ5HLC5LJJCGOTY6HQPQCL2GH4YCMM2Q6FKQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.908657128 (165h50m20.339737249s) [noise=true , address=104.36.82.36:4626 , piece_id=X4U7SLWZRU5CL2T5IFC2HNOQ3D4HPUXA7TIFJUJYSUF3LMWDQNTA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.921525419 (165h50m20.35260555s) [noise=true , address=45.91.116.6:4986 , piece_id=NHCYAM4OJSS6DBYNYWZCBG5QRHM5NUVI6UP5XNILC7F5GOOZ2W3Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.937876515 (165h50m20.368956636s) [noise=true , address=104.36.82.8:4974 , piece_id=2ZDFUCSOVMJHIGINANSMLVZVMZHM56XQ6OBJWUFDXONJ4D42XVPQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.975679856 (165h50m20.406759977s) [noise=true , address=104.36.82.60:4358 , piece_id=STJCTAGQOFXFQ7LTXAKG5PA7ZUK7OLJUFXADZRW4YXEXZJMIWGXQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.125861536 (165h50m20.556941667s) [noise=true , address=77.90.31.18:4827 , piece_id=5DW7WZTN34P42BTTRUQ56LSFLBHS5QHO2HEKES2PT7ZHOSNQ72EA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.168492634 (165h50m20.599572826s) [noise=true , address=77.90.31.17:4779 , piece_id=CYVPZUPZPHTUTH56H4GBMKBHFEXE7NWQZZJDPBKB2RWECBKUTT5A, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.246449022 (165h50m20.677529153s) [noise=true , address=77.90.31.11:4580 , piece_id=O5D4EP4LUSSX6PTZTLRMCXEYIL6W2UXIHBNRDKN2VFVHGB5MFZGA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.380000574 (165h50m20.811080705s) [noise=true , address=77.90.31.16:4740 , piece_id=MGTQCSACL7JQKXGD57P6NKCZOKUTIAIFF2YNBTEE7IYZZRCQ74TQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.680781293 (165h50m21.111861484s) [noise=true , address=77.90.31.13:4630 , piece_id=4ZGFWRPCU6LF34RSH22LHLDFFEICBZ3UKS2I43FMRDQAD5UTFWXA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:27.013998946 (165h50m21.445079077s) [noise=true , address=104.36.82.44:4901 , piece_id=GF4LDYTH5Q4NS4PBIWBT4C4WBQ75ARYMJHOPO2XHXATDGMJ2AK6A, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:27.014022972 (165h50m21.445103103s) [seg_pos={0 0}, upload=172505]: Segment reached optimal threshold of 14 pieces. Aug 15 15:16:27.014278842 (165h50m21.445358973s) [noise=true , address=104.36.82.23:4456 , piece_id=SX2YT3LIZ2MRT4DYRYZDKLO2ST4MHPNINCBTLGILGZWDO77FAQ3Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XUZ2ggL9Q4V8uyJdwvwztqCTvj1DFGRWGtYzKJiaRVaByhfTx): protocol: rpc: dial tcp 104.36.82.23:4456: operation was canceled; conn closed: op Aug 15 15:16:27.014306455 (165h50m21.445386586s) [noise=true , address=104.36.82.5:4864 , piece_id=WKB3ZBR6YDO2EUZKJFB42J6VFL3T6JYE652AYYOEQ6UMG5D3PINQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XXH8TYK6Qfma867943QYYXycyL6osQhcQYEjdMdJVTUDfda2u): protocol: write tcp 188.166.225.170:40092->104.36.82.5:4864: use of closed network connection; write tcp 188.166.225.170:40092->104.36.82.5:4864: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40092->104.36.82.5:4864: use of closed network connection Aug 15 15:16:27.014375847 (165h50m21.445455978s) [noise=true , address=77.90.31.10:4523 , piece_id=D6D7XBHK3426ZA565EVVKLWTIA6LPL24QBGU5YH4BOXWJH6TE64Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LifXs8irH3dbLrzPnXzoCfaFyuUJxsN4rfyLEwTKGXSPxotPa): protocol: expected piece hash; context canceled; EOF Aug 15 15:16:27.014445771 (165h50m21.445525902s) [noise=true , address=104.36.82.18:4390 , piece_id=F6ETCYUTXLXZCH2ZZQ4Q73HNINZBINPNR6ZEGSOACBSDJS7N34BA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AZCJHCR7rF4r62Bg7NcBkpNoLb6r6rEN2a5hZ9KNxJTtjV8jp): protocol: write tcp 188.166.225.170:43784->104.36.82.18:4390: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 15:16:27.014470900 (165h50m21.445551031s) [seg_pos={0 0}, upload=172505]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 15 15:16:27.014539270 (165h50m21.445619401s) [upload=172505]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 15 15:16:27.014543768 (165h50m21.445623899s) [upload=172505]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 15:16:27.420799899 (165h50m21.85188003s) [upload=172505]: Done uploading segments... Aug 15 15:16:27.420818816 (165h50m21.851898937s) [upload=172505]: Upload finished. err: <nil> Duration: 6.224834732s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [................X....................X...X................X.] duration: 6.622602335s FAIL (2025-08-15 15:17:38 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 15 15:16:22.685092094 (165h50m17.116172225s) [upload=172505]: Starting upload Aug 15 15:16:22.685142561 (165h50m17.116222692s) [upload=172505]: Done starting upload Aug 15 15:16:22.685325571 (165h50m17.116405703s) [upload=172505]: Uploading segments... Aug 15 15:16:22.685436684 (165h50m17.116516815s) [upload=172505]: Got next segment. Inline: false Aug 15 15:16:22.685470238 (165h50m17.116550369s) [upload=172505]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 15:16:22.685474446 (165h50m17.116554577s) [upload=172505]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 15 15:16:23.591082804 (165h50m18.022162945s) [seg_pos={0 0}, upload=172505]: Begin upload segment... Aug 15 15:16:23.591147928 (165h50m18.022228059s) [seg_pos={0 0}, upload=172505]: Done begin upload segment. Aug 15 15:16:23.591177995 (165h50m18.022258126s) [noise=true , address=104.36.82.18:4390 , piece_id=F6ETCYUTXLXZCH2ZZQ4Q73HNINZBINPNR6ZEGSOACBSDJS7N34BA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.591241937 (165h50m18.022322068s) [noise=true , address=104.36.82.60:4358 , piece_id=STJCTAGQOFXFQ7LTXAKG5PA7ZUK7OLJUFXADZRW4YXEXZJMIWGXQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.591778354 (165h50m18.022858485s) [noise=true , address=77.90.31.16:4740 , piece_id=MGTQCSACL7JQKXGD57P6NKCZOKUTIAIFF2YNBTEE7IYZZRCQ74TQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.591823260 (165h50m18.022903421s) [noise=true , address=77.90.31.13:4630 , piece_id=4ZGFWRPCU6LF34RSH22LHLDFFEICBZ3UKS2I43FMRDQAD5UTFWXA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.592211303 (165h50m18.023291434s) [noise=true , address=77.90.31.11:4580 , piece_id=O5D4EP4LUSSX6PTZTLRMCXEYIL6W2UXIHBNRDKN2VFVHGB5MFZGA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.592475017 (165h50m18.023555158s) [noise=true , address=77.90.31.18:4827 , piece_id=5DW7WZTN34P42BTTRUQ56LSFLBHS5QHO2HEKES2PT7ZHOSNQ72EA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.592996925 (165h50m18.024077056s) [noise=true , address=104.36.82.36:4626 , piece_id=X4U7SLWZRU5CL2T5IFC2HNOQ3D4HPUXA7TIFJUJYSUF3LMWDQNTA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.593335724 (165h50m18.024415855s) [noise=true , address=79.127.201.215:4343 , piece_id=MPMAQOMIURMVFNKXTJ5HLC5LJJCGOTY6HQPQCL2GH4YCMM2Q6FKQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.593672408 (165h50m18.024752539s) [noise=true , address=104.36.82.8:4974 , piece_id=2ZDFUCSOVMJHIGINANSMLVZVMZHM56XQ6OBJWUFDXONJ4D42XVPQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.594058457 (165h50m18.025138588s) [noise=true , address=104.36.82.23:4456 , piece_id=SX2YT3LIZ2MRT4DYRYZDKLO2ST4MHPNINCBTLGILGZWDO77FAQ3Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.594396543 (165h50m18.025476674s) [noise=true , address=79.127.220.101:4073 , piece_id=TJ26UR6WS6T6RBGA22EYWL33O2Z3IXPEVAOQVGDN5AUS4PDMDK7Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.594720794 (165h50m18.025800935s) [noise=true , address=77.90.31.17:4779 , piece_id=CYVPZUPZPHTUTH56H4GBMKBHFEXE7NWQZZJDPBKB2RWECBKUTT5A, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.595057868 (165h50m18.026137999s) [noise=true , address=45.91.116.6:4986 , piece_id=NHCYAM4OJSS6DBYNYWZCBG5QRHM5NUVI6UP5XNILC7F5GOOZ2W3Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.595398080 (165h50m18.026478211s) [noise=true , address=104.36.82.5:4864 , piece_id=WKB3ZBR6YDO2EUZKJFB42J6VFL3T6JYE652AYYOEQ6UMG5D3PINQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.595839625 (165h50m18.026919756s) [noise=true , address=104.36.82.44:4901 , piece_id=GF4LDYTH5Q4NS4PBIWBT4C4WBQ75ARYMJHOPO2XHXATDGMJ2AK6A, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.596180326 (165h50m18.027260457s) [noise=true , address=66.23.193.175:4557 , piece_id=2VQDLPFWGEOL63THQTDZJUSCZFQAUHL2AZLE6JYR6PJIVGV6VO2A, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.596567146 (165h50m18.027647287s) [noise=true , address=77.90.31.10:4523 , piece_id=D6D7XBHK3426ZA565EVVKLWTIA6LPL24QBGU5YH4BOXWJH6TE64Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.596896567 (165h50m18.027976698s) [noise=true , address=79.127.205.233:4628 , piece_id=WPIGFCQOIO7MSIJDR4RNO2ZYHBMVHTJQXRTOBP2JI3Z3M7ISILCA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:24.737329106 (165h50m19.168409237s) [upload=172505]: Next returned nil segment Aug 15 15:16:24.737345307 (165h50m19.168425438s) [upload=172505]: Waiting for error group managing segments... Aug 15 15:16:25.020682831 (165h50m19.451762962s) [noise=true , address=79.127.205.233:4628 , piece_id=WPIGFCQOIO7MSIJDR4RNO2ZYHBMVHTJQXRTOBP2JI3Z3M7ISILCA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.098977978 (165h50m19.530058109s) [noise=true , address=66.23.193.175:4557 , piece_id=2VQDLPFWGEOL63THQTDZJUSCZFQAUHL2AZLE6JYR6PJIVGV6VO2A, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.449295087 (165h50m19.880375218s) [noise=true , address=79.127.220.101:4073 , piece_id=TJ26UR6WS6T6RBGA22EYWL33O2Z3IXPEVAOQVGDN5AUS4PDMDK7Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.657174453 (165h50m20.088254574s) [noise=true , address=79.127.201.215:4343 , piece_id=MPMAQOMIURMVFNKXTJ5HLC5LJJCGOTY6HQPQCL2GH4YCMM2Q6FKQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.908657128 (165h50m20.339737249s) [noise=true , address=104.36.82.36:4626 , piece_id=X4U7SLWZRU5CL2T5IFC2HNOQ3D4HPUXA7TIFJUJYSUF3LMWDQNTA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.921525419 (165h50m20.35260555s) [noise=true , address=45.91.116.6:4986 , piece_id=NHCYAM4OJSS6DBYNYWZCBG5QRHM5NUVI6UP5XNILC7F5GOOZ2W3Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.937876515 (165h50m20.368956636s) [noise=true , address=104.36.82.8:4974 , piece_id=2ZDFUCSOVMJHIGINANSMLVZVMZHM56XQ6OBJWUFDXONJ4D42XVPQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.975679856 (165h50m20.406759977s) [noise=true , address=104.36.82.60:4358 , piece_id=STJCTAGQOFXFQ7LTXAKG5PA7ZUK7OLJUFXADZRW4YXEXZJMIWGXQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.125861536 (165h50m20.556941667s) [noise=true , address=77.90.31.18:4827 , piece_id=5DW7WZTN34P42BTTRUQ56LSFLBHS5QHO2HEKES2PT7ZHOSNQ72EA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.168492634 (165h50m20.599572826s) [noise=true , address=77.90.31.17:4779 , piece_id=CYVPZUPZPHTUTH56H4GBMKBHFEXE7NWQZZJDPBKB2RWECBKUTT5A, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.246449022 (165h50m20.677529153s) [noise=true , address=77.90.31.11:4580 , piece_id=O5D4EP4LUSSX6PTZTLRMCXEYIL6W2UXIHBNRDKN2VFVHGB5MFZGA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.380000574 (165h50m20.811080705s) [noise=true , address=77.90.31.16:4740 , piece_id=MGTQCSACL7JQKXGD57P6NKCZOKUTIAIFF2YNBTEE7IYZZRCQ74TQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.680781293 (165h50m21.111861484s) [noise=true , address=77.90.31.13:4630 , piece_id=4ZGFWRPCU6LF34RSH22LHLDFFEICBZ3UKS2I43FMRDQAD5UTFWXA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:27.013998946 (165h50m21.445079077s) [noise=true , address=104.36.82.44:4901 , piece_id=GF4LDYTH5Q4NS4PBIWBT4C4WBQ75ARYMJHOPO2XHXATDGMJ2AK6A, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:27.014022972 (165h50m21.445103103s) [seg_pos={0 0}, upload=172505]: Segment reached optimal threshold of 14 pieces. Aug 15 15:16:27.014278842 (165h50m21.445358973s) [noise=true , address=104.36.82.23:4456 , piece_id=SX2YT3LIZ2MRT4DYRYZDKLO2ST4MHPNINCBTLGILGZWDO77FAQ3Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XUZ2ggL9Q4V8uyJdwvwztqCTvj1DFGRWGtYzKJiaRVaByhfTx): protocol: rpc: dial tcp 104.36.82.23:4456: operation was canceled; conn closed: op Aug 15 15:16:27.014306455 (165h50m21.445386586s) [noise=true , address=104.36.82.5:4864 , piece_id=WKB3ZBR6YDO2EUZKJFB42J6VFL3T6JYE652AYYOEQ6UMG5D3PINQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XXH8TYK6Qfma867943QYYXycyL6osQhcQYEjdMdJVTUDfda2u): protocol: write tcp 188.166.225.170:40092->104.36.82.5:4864: use of closed network connection; write tcp 188.166.225.170:40092->104.36.82.5:4864: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40092->104.36.82.5:4864: use of closed network connection Aug 15 15:16:27.014375847 (165h50m21.445455978s) [noise=true , address=77.90.31.10:4523 , piece_id=D6D7XBHK3426ZA565EVVKLWTIA6LPL24QBGU5YH4BOXWJH6TE64Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LifXs8irH3dbLrzPnXzoCfaFyuUJxsN4rfyLEwTKGXSPxotPa): protocol: expected piece hash; context canceled; EOF Aug 15 15:16:27.014445771 (165h50m21.445525902s) [noise=true , address=104.36.82.18:4390 , piece_id=F6ETCYUTXLXZCH2ZZQ4Q73HNINZBINPNR6ZEGSOACBSDJS7N34BA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AZCJHCR7rF4r62Bg7NcBkpNoLb6r6rEN2a5hZ9KNxJTtjV8jp): protocol: write tcp 188.166.225.170:43784->104.36.82.18:4390: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 15:16:27.014470900 (165h50m21.445551031s) [seg_pos={0 0}, upload=172505]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 15 15:16:27.014539270 (165h50m21.445619401s) [upload=172505]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 15 15:16:27.014543768 (165h50m21.445623899s) [upload=172505]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 15:16:27.420799899 (165h50m21.85188003s) [upload=172505]: Done uploading segments... Aug 15 15:16:27.420818816 (165h50m21.851898937s) [upload=172505]: Upload finished. err: <nil> Duration: 6.622624939s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [........................................X....XX.............] duration: 1.967097269s FAIL (2025-08-15 15:17:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 15:08:23.568800831 (165h42m17.999880962s) [upload=172360]: Starting upload Aug 15 15:08:23.568843131 (165h42m17.999923262s) [upload=172360]: Done starting upload Aug 15 15:08:23.568892736 (165h42m17.999972868s) [upload=172360]: Uploading segments... Aug 15 15:08:23.568932031 (165h42m18.000012162s) [upload=172360]: Got next segment. Inline: true Aug 15 15:08:23.568936339 (165h42m18.00001647s) [upload=172360]: Waiting for error group managing segments... Aug 15 15:08:23.568970776 (165h42m18.000050897s) [upload=172360]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 15:08:23.568974854 (165h42m18.000054985s) [upload=172360]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 15:08:23.568977499 (165h42m18.00005763s) [upload=172360]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 15:08:23.783715648 (165h42m18.214795779s) [upload=172360]: Done uploading segments... Aug 15 15:08:23.783733201 (165h42m18.214813332s) [upload=172360]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.967123339s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.........................................X....XX............] duration: 1.88621831s FAIL (2025-08-15 15:16:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 15:08:23.568800831 (165h42m17.999880962s) [upload=172360]: Starting upload Aug 15 15:08:23.568843131 (165h42m17.999923262s) [upload=172360]: Done starting upload Aug 15 15:08:23.568892736 (165h42m17.999972868s) [upload=172360]: Uploading segments... Aug 15 15:08:23.568932031 (165h42m18.000012162s) [upload=172360]: Got next segment. Inline: true Aug 15 15:08:23.568936339 (165h42m18.00001647s) [upload=172360]: Waiting for error group managing segments... Aug 15 15:08:23.568970776 (165h42m18.000050897s) [upload=172360]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 15:08:23.568974854 (165h42m18.000054985s) [upload=172360]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 15:08:23.568977499 (165h42m18.00005763s) [upload=172360]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 15:08:23.783715648 (165h42m18.214795779s) [upload=172360]: Done uploading segments... Aug 15 15:08:23.783733201 (165h42m18.214813332s) [upload=172360]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.886250461s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.................X....................X...X................X] duration: 5.901872389s FAIL (2025-08-15 15:16:27 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 15 15:16:22.685092094 (165h50m17.116172225s) [upload=172505]: Starting upload Aug 15 15:16:22.685142561 (165h50m17.116222692s) [upload=172505]: Done starting upload Aug 15 15:16:22.685325571 (165h50m17.116405703s) [upload=172505]: Uploading segments... Aug 15 15:16:22.685436684 (165h50m17.116516815s) [upload=172505]: Got next segment. Inline: false Aug 15 15:16:22.685470238 (165h50m17.116550369s) [upload=172505]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 15:16:22.685474446 (165h50m17.116554577s) [upload=172505]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 15 15:16:23.591082804 (165h50m18.022162945s) [seg_pos={0 0}, upload=172505]: Begin upload segment... Aug 15 15:16:23.591147928 (165h50m18.022228059s) [seg_pos={0 0}, upload=172505]: Done begin upload segment. Aug 15 15:16:23.591177995 (165h50m18.022258126s) [noise=true , address=104.36.82.18:4390 , piece_id=F6ETCYUTXLXZCH2ZZQ4Q73HNINZBINPNR6ZEGSOACBSDJS7N34BA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.591241937 (165h50m18.022322068s) [noise=true , address=104.36.82.60:4358 , piece_id=STJCTAGQOFXFQ7LTXAKG5PA7ZUK7OLJUFXADZRW4YXEXZJMIWGXQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.591778354 (165h50m18.022858485s) [noise=true , address=77.90.31.16:4740 , piece_id=MGTQCSACL7JQKXGD57P6NKCZOKUTIAIFF2YNBTEE7IYZZRCQ74TQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.591823260 (165h50m18.022903421s) [noise=true , address=77.90.31.13:4630 , piece_id=4ZGFWRPCU6LF34RSH22LHLDFFEICBZ3UKS2I43FMRDQAD5UTFWXA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.592211303 (165h50m18.023291434s) [noise=true , address=77.90.31.11:4580 , piece_id=O5D4EP4LUSSX6PTZTLRMCXEYIL6W2UXIHBNRDKN2VFVHGB5MFZGA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.592475017 (165h50m18.023555158s) [noise=true , address=77.90.31.18:4827 , piece_id=5DW7WZTN34P42BTTRUQ56LSFLBHS5QHO2HEKES2PT7ZHOSNQ72EA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.592996925 (165h50m18.024077056s) [noise=true , address=104.36.82.36:4626 , piece_id=X4U7SLWZRU5CL2T5IFC2HNOQ3D4HPUXA7TIFJUJYSUF3LMWDQNTA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.593335724 (165h50m18.024415855s) [noise=true , address=79.127.201.215:4343 , piece_id=MPMAQOMIURMVFNKXTJ5HLC5LJJCGOTY6HQPQCL2GH4YCMM2Q6FKQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.593672408 (165h50m18.024752539s) [noise=true , address=104.36.82.8:4974 , piece_id=2ZDFUCSOVMJHIGINANSMLVZVMZHM56XQ6OBJWUFDXONJ4D42XVPQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.594058457 (165h50m18.025138588s) [noise=true , address=104.36.82.23:4456 , piece_id=SX2YT3LIZ2MRT4DYRYZDKLO2ST4MHPNINCBTLGILGZWDO77FAQ3Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.594396543 (165h50m18.025476674s) [noise=true , address=79.127.220.101:4073 , piece_id=TJ26UR6WS6T6RBGA22EYWL33O2Z3IXPEVAOQVGDN5AUS4PDMDK7Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.594720794 (165h50m18.025800935s) [noise=true , address=77.90.31.17:4779 , piece_id=CYVPZUPZPHTUTH56H4GBMKBHFEXE7NWQZZJDPBKB2RWECBKUTT5A, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.595057868 (165h50m18.026137999s) [noise=true , address=45.91.116.6:4986 , piece_id=NHCYAM4OJSS6DBYNYWZCBG5QRHM5NUVI6UP5XNILC7F5GOOZ2W3Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.595398080 (165h50m18.026478211s) [noise=true , address=104.36.82.5:4864 , piece_id=WKB3ZBR6YDO2EUZKJFB42J6VFL3T6JYE652AYYOEQ6UMG5D3PINQ, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.595839625 (165h50m18.026919756s) [noise=true , address=104.36.82.44:4901 , piece_id=GF4LDYTH5Q4NS4PBIWBT4C4WBQ75ARYMJHOPO2XHXATDGMJ2AK6A, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.596180326 (165h50m18.027260457s) [noise=true , address=66.23.193.175:4557 , piece_id=2VQDLPFWGEOL63THQTDZJUSCZFQAUHL2AZLE6JYR6PJIVGV6VO2A, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.596567146 (165h50m18.027647287s) [noise=true , address=77.90.31.10:4523 , piece_id=D6D7XBHK3426ZA565EVVKLWTIA6LPL24QBGU5YH4BOXWJH6TE64Q, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:23.596896567 (165h50m18.027976698s) [noise=true , address=79.127.205.233:4628 , piece_id=WPIGFCQOIO7MSIJDR4RNO2ZYHBMVHTJQXRTOBP2JI3Z3M7ISILCA, seg_pos={0 0}, upload=172505]: Uploading piece... Aug 15 15:16:24.737329106 (165h50m19.168409237s) [upload=172505]: Next returned nil segment Aug 15 15:16:24.737345307 (165h50m19.168425438s) [upload=172505]: Waiting for error group managing segments... Aug 15 15:16:25.020682831 (165h50m19.451762962s) [noise=true , address=79.127.205.233:4628 , piece_id=WPIGFCQOIO7MSIJDR4RNO2ZYHBMVHTJQXRTOBP2JI3Z3M7ISILCA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.098977978 (165h50m19.530058109s) [noise=true , address=66.23.193.175:4557 , piece_id=2VQDLPFWGEOL63THQTDZJUSCZFQAUHL2AZLE6JYR6PJIVGV6VO2A, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.449295087 (165h50m19.880375218s) [noise=true , address=79.127.220.101:4073 , piece_id=TJ26UR6WS6T6RBGA22EYWL33O2Z3IXPEVAOQVGDN5AUS4PDMDK7Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.657174453 (165h50m20.088254574s) [noise=true , address=79.127.201.215:4343 , piece_id=MPMAQOMIURMVFNKXTJ5HLC5LJJCGOTY6HQPQCL2GH4YCMM2Q6FKQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.908657128 (165h50m20.339737249s) [noise=true , address=104.36.82.36:4626 , piece_id=X4U7SLWZRU5CL2T5IFC2HNOQ3D4HPUXA7TIFJUJYSUF3LMWDQNTA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.921525419 (165h50m20.35260555s) [noise=true , address=45.91.116.6:4986 , piece_id=NHCYAM4OJSS6DBYNYWZCBG5QRHM5NUVI6UP5XNILC7F5GOOZ2W3Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.937876515 (165h50m20.368956636s) [noise=true , address=104.36.82.8:4974 , piece_id=2ZDFUCSOVMJHIGINANSMLVZVMZHM56XQ6OBJWUFDXONJ4D42XVPQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:25.975679856 (165h50m20.406759977s) [noise=true , address=104.36.82.60:4358 , piece_id=STJCTAGQOFXFQ7LTXAKG5PA7ZUK7OLJUFXADZRW4YXEXZJMIWGXQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.125861536 (165h50m20.556941667s) [noise=true , address=77.90.31.18:4827 , piece_id=5DW7WZTN34P42BTTRUQ56LSFLBHS5QHO2HEKES2PT7ZHOSNQ72EA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.168492634 (165h50m20.599572826s) [noise=true , address=77.90.31.17:4779 , piece_id=CYVPZUPZPHTUTH56H4GBMKBHFEXE7NWQZZJDPBKB2RWECBKUTT5A, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.246449022 (165h50m20.677529153s) [noise=true , address=77.90.31.11:4580 , piece_id=O5D4EP4LUSSX6PTZTLRMCXEYIL6W2UXIHBNRDKN2VFVHGB5MFZGA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.380000574 (165h50m20.811080705s) [noise=true , address=77.90.31.16:4740 , piece_id=MGTQCSACL7JQKXGD57P6NKCZOKUTIAIFF2YNBTEE7IYZZRCQ74TQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:26.680781293 (165h50m21.111861484s) [noise=true , address=77.90.31.13:4630 , piece_id=4ZGFWRPCU6LF34RSH22LHLDFFEICBZ3UKS2I43FMRDQAD5UTFWXA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:27.013998946 (165h50m21.445079077s) [noise=true , address=104.36.82.44:4901 , piece_id=GF4LDYTH5Q4NS4PBIWBT4C4WBQ75ARYMJHOPO2XHXATDGMJ2AK6A, seg_pos={0 0}, upload=172505]: Done uploading piece. err: <nil> Aug 15 15:16:27.014022972 (165h50m21.445103103s) [seg_pos={0 0}, upload=172505]: Segment reached optimal threshold of 14 pieces. Aug 15 15:16:27.014278842 (165h50m21.445358973s) [noise=true , address=104.36.82.23:4456 , piece_id=SX2YT3LIZ2MRT4DYRYZDKLO2ST4MHPNINCBTLGILGZWDO77FAQ3Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XUZ2ggL9Q4V8uyJdwvwztqCTvj1DFGRWGtYzKJiaRVaByhfTx): protocol: rpc: dial tcp 104.36.82.23:4456: operation was canceled; conn closed: op Aug 15 15:16:27.014306455 (165h50m21.445386586s) [noise=true , address=104.36.82.5:4864 , piece_id=WKB3ZBR6YDO2EUZKJFB42J6VFL3T6JYE652AYYOEQ6UMG5D3PINQ, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XXH8TYK6Qfma867943QYYXycyL6osQhcQYEjdMdJVTUDfda2u): protocol: write tcp 188.166.225.170:40092->104.36.82.5:4864: use of closed network connection; write tcp 188.166.225.170:40092->104.36.82.5:4864: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40092->104.36.82.5:4864: use of closed network connection Aug 15 15:16:27.014375847 (165h50m21.445455978s) [noise=true , address=77.90.31.10:4523 , piece_id=D6D7XBHK3426ZA565EVVKLWTIA6LPL24QBGU5YH4BOXWJH6TE64Q, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LifXs8irH3dbLrzPnXzoCfaFyuUJxsN4rfyLEwTKGXSPxotPa): protocol: expected piece hash; context canceled; EOF Aug 15 15:16:27.014445771 (165h50m21.445525902s) [noise=true , address=104.36.82.18:4390 , piece_id=F6ETCYUTXLXZCH2ZZQ4Q73HNINZBINPNR6ZEGSOACBSDJS7N34BA, seg_pos={0 0}, upload=172505]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AZCJHCR7rF4r62Bg7NcBkpNoLb6r6rEN2a5hZ9KNxJTtjV8jp): protocol: write tcp 188.166.225.170:43784->104.36.82.18:4390: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 15 15:16:27.014470900 (165h50m21.445551031s) [seg_pos={0 0}, upload=172505]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 15 15:16:27.014539270 (165h50m21.445619401s) [upload=172505]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 15 15:16:27.014543768 (165h50m21.445623899s) [upload=172505]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 15:16:27.420799899 (165h50m21.85188003s) [upload=172505]: Done uploading segments... Aug 15 15:16:27.420818816 (165h50m21.851898937s) [upload=172505]: Upload finished. err: <nil> Duration: 5.901896794s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [X.........................................X....XX...........] duration: 2.064402278s FAIL (2025-08-15 15:16:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 15:08:23.568800831 (165h42m17.999880962s) [upload=172360]: Starting upload Aug 15 15:08:23.568843131 (165h42m17.999923262s) [upload=172360]: Done starting upload Aug 15 15:08:23.568892736 (165h42m17.999972868s) [upload=172360]: Uploading segments... Aug 15 15:08:23.568932031 (165h42m18.000012162s) [upload=172360]: Got next segment. Inline: true Aug 15 15:08:23.568936339 (165h42m18.00001647s) [upload=172360]: Waiting for error group managing segments... Aug 15 15:08:23.568970776 (165h42m18.000050897s) [upload=172360]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 15:08:23.568974854 (165h42m18.000054985s) [upload=172360]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 15:08:23.568977499 (165h42m18.00005763s) [upload=172360]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 15:08:23.783715648 (165h42m18.214795779s) [upload=172360]: Done uploading segments... Aug 15 15:08:23.783733201 (165h42m18.214813332s) [upload=172360]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.064441653s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..................X....................X...X................] duration: 8.40055552s FAIL (2025-08-15 15:15:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 15:05:12.280486036 (165h39m6.711566167s) [upload=172296]: Starting upload Aug 15 15:05:12.280532676 (165h39m6.711612807s) [upload=172296]: Done starting upload Aug 15 15:05:12.280600255 (165h39m6.711680416s) [upload=172296]: Uploading segments... Aug 15 15:05:12.280702601 (165h39m6.711782732s) [upload=172296]: Got next segment. Inline: false Aug 15 15:05:12.280728590 (165h39m6.711808721s) [upload=172296]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 15:05:12.280732418 (165h39m6.711812549s) [upload=172296]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 15 15:05:12.498125127 (165h39m6.929205258s) [upload=172296]: Next segment err: metaclient: Too Many Requests Aug 15 15:05:12.498144233 (165h39m6.929224364s) [upload=172296]: Done uploading segments... Aug 15 15:05:12.498157829 (165h39m6.92923796s) [upload=172296]: Upload finished. err: metaclient: Too Many Requests Duration: 8.40059231s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.X.........................................X....XX..........] duration: 2.085186046s FAIL (2025-08-15 15:15:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 15:08:23.568800831 (165h42m17.999880962s) [upload=172360]: Starting upload Aug 15 15:08:23.568843131 (165h42m17.999923262s) [upload=172360]: Done starting upload Aug 15 15:08:23.568892736 (165h42m17.999972868s) [upload=172360]: Uploading segments... Aug 15 15:08:23.568932031 (165h42m18.000012162s) [upload=172360]: Got next segment. Inline: true Aug 15 15:08:23.568936339 (165h42m18.00001647s) [upload=172360]: Waiting for error group managing segments... Aug 15 15:08:23.568970776 (165h42m18.000050897s) [upload=172360]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 15:08:23.568974854 (165h42m18.000054985s) [upload=172360]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 15:08:23.568977499 (165h42m18.00005763s) [upload=172360]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 15:08:23.783715648 (165h42m18.214795779s) [upload=172360]: Done uploading segments... Aug 15 15:08:23.783733201 (165h42m18.214813332s) [upload=172360]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.085210704s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...................X....................X...X...............] duration: 8.319664695s FAIL (2025-08-15 15:15:25 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 15:05:12.280486036 (165h39m6.711566167s) [upload=172296]: Starting upload Aug 15 15:05:12.280532676 (165h39m6.711612807s) [upload=172296]: Done starting upload Aug 15 15:05:12.280600255 (165h39m6.711680416s) [upload=172296]: Uploading segments... Aug 15 15:05:12.280702601 (165h39m6.711782732s) [upload=172296]: Got next segment. Inline: false Aug 15 15:05:12.280728590 (165h39m6.711808721s) [upload=172296]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 15:05:12.280732418 (165h39m6.711812549s) [upload=172296]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 15 15:05:12.498125127 (165h39m6.929205258s) [upload=172296]: Next segment err: metaclient: Too Many Requests Aug 15 15:05:12.498144233 (165h39m6.929224364s) [upload=172296]: Done uploading segments... Aug 15 15:05:12.498157829 (165h39m6.92923796s) [upload=172296]: Upload finished. err: metaclient: Too Many Requests Duration: 8.319691887s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [..X.........................................X....XX.........] duration: 2.784099571s FAIL (2025-08-15 15:14:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 15:08:23.568800831 (165h42m17.999880962s) [upload=172360]: Starting upload Aug 15 15:08:23.568843131 (165h42m17.999923262s) [upload=172360]: Done starting upload Aug 15 15:08:23.568892736 (165h42m17.999972868s) [upload=172360]: Uploading segments... Aug 15 15:08:23.568932031 (165h42m18.000012162s) [upload=172360]: Got next segment. Inline: true Aug 15 15:08:23.568936339 (165h42m18.00001647s) [upload=172360]: Waiting for error group managing segments... Aug 15 15:08:23.568970776 (165h42m18.000050897s) [upload=172360]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 15:08:23.568974854 (165h42m18.000054985s) [upload=172360]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 15:08:23.568977499 (165h42m18.00005763s) [upload=172360]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 15:08:23.783715648 (165h42m18.214795779s) [upload=172360]: Done uploading segments... Aug 15 15:08:23.783733201 (165h42m18.214813332s) [upload=172360]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.784134499s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [X...................X....................X...X..............] duration: 12.631607477s FAIL (2025-08-15 15:14:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 15:05:12.280486036 (165h39m6.711566167s) [upload=172296]: Starting upload Aug 15 15:05:12.280532676 (165h39m6.711612807s) [upload=172296]: Done starting upload Aug 15 15:05:12.280600255 (165h39m6.711680416s) [upload=172296]: Uploading segments... Aug 15 15:05:12.280702601 (165h39m6.711782732s) [upload=172296]: Got next segment. Inline: false Aug 15 15:05:12.280728590 (165h39m6.711808721s) [upload=172296]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 15:05:12.280732418 (165h39m6.711812549s) [upload=172296]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 15 15:05:12.498125127 (165h39m6.929205258s) [upload=172296]: Next segment err: metaclient: Too Many Requests Aug 15 15:05:12.498144233 (165h39m6.929224364s) [upload=172296]: Done uploading segments... Aug 15 15:05:12.498157829 (165h39m6.92923796s) [upload=172296]: Upload finished. err: metaclient: Too Many Requests Duration: 12.631632875s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [...X.........................................X....XX........] duration: 10.287091367s FAIL (2025-08-15 15:13:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 15:08:23.568800831 (165h42m17.999880962s) [upload=172360]: Starting upload Aug 15 15:08:23.568843131 (165h42m17.999923262s) [upload=172360]: Done starting upload Aug 15 15:08:23.568892736 (165h42m17.999972868s) [upload=172360]: Uploading segments... Aug 15 15:08:23.568932031 (165h42m18.000012162s) [upload=172360]: Got next segment. Inline: true Aug 15 15:08:23.568936339 (165h42m18.00001647s) [upload=172360]: Waiting for error group managing segments... Aug 15 15:08:23.568970776 (165h42m18.000050897s) [upload=172360]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 15:08:23.568974854 (165h42m18.000054985s) [upload=172360]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 15:08:23.568977499 (165h42m18.00005763s) [upload=172360]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 15:08:23.783715648 (165h42m18.214795779s) [upload=172360]: Done uploading segments... Aug 15 15:08:23.783733201 (165h42m18.214813332s) [upload=172360]: Upload finished. err: metaclient: Too Many Requests Duration:* 10.287167382s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.X...................X....................X...X.............] duration: 11.05170844s FAIL (2025-08-15 15:13:18 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 15:05:12.280486036 (165h39m6.711566167s) [upload=172296]: Starting upload Aug 15 15:05:12.280532676 (165h39m6.711612807s) [upload=172296]: Done starting upload Aug 15 15:05:12.280600255 (165h39m6.711680416s) [upload=172296]: Uploading segments... Aug 15 15:05:12.280702601 (165h39m6.711782732s) [upload=172296]: Got next segment. Inline: false Aug 15 15:05:12.280728590 (165h39m6.711808721s) [upload=172296]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 15:05:12.280732418 (165h39m6.711812549s) [upload=172296]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 15 15:05:12.498125127 (165h39m6.929205258s) [upload=172296]: Next segment err: metaclient: Too Many Requests Aug 15 15:05:12.498144233 (165h39m6.929224364s) [upload=172296]: Done uploading segments... Aug 15 15:05:12.498157829 (165h39m6.92923796s) [upload=172296]: Upload finished. err: metaclient: Too Many Requests Duration: 11.051744538s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [....X.........................................X....XX.......] duration: 5.885445599s FAIL (2025-08-15 15:13:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 15:08:23.568800831 (165h42m17.999880962s) [upload=172360]: Starting upload Aug 15 15:08:23.568843131 (165h42m17.999923262s) [upload=172360]: Done starting upload Aug 15 15:08:23.568892736 (165h42m17.999972868s) [upload=172360]: Uploading segments... Aug 15 15:08:23.568932031 (165h42m18.000012162s) [upload=172360]: Got next segment. Inline: true Aug 15 15:08:23.568936339 (165h42m18.00001647s) [upload=172360]: Waiting for error group managing segments... Aug 15 15:08:23.568970776 (165h42m18.000050897s) [upload=172360]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 15:08:23.568974854 (165h42m18.000054985s) [upload=172360]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 15:08:23.568977499 (165h42m18.00005763s) [upload=172360]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 15:08:23.783715648 (165h42m18.214795779s) [upload=172360]: Done uploading segments... Aug 15 15:08:23.783733201 (165h42m18.214813332s) [upload=172360]: Upload finished. err: metaclient: Too Many Requests Duration:* 5.885472019s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..X...................X....................X...X............] duration: 10.937275772s FAIL (2025-08-15 15:12:55 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 15:05:12.280486036 (165h39m6.711566167s) [upload=172296]: Starting upload Aug 15 15:05:12.280532676 (165h39m6.711612807s) [upload=172296]: Done starting upload Aug 15 15:05:12.280600255 (165h39m6.711680416s) [upload=172296]: Uploading segments... Aug 15 15:05:12.280702601 (165h39m6.711782732s) [upload=172296]: Got next segment. Inline: false Aug 15 15:05:12.280728590 (165h39m6.711808721s) [upload=172296]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 15:05:12.280732418 (165h39m6.711812549s) [upload=172296]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 15 15:05:12.498125127 (165h39m6.929205258s) [upload=172296]: Next segment err: metaclient: Too Many Requests Aug 15 15:05:12.498144233 (165h39m6.929224364s) [upload=172296]: Done uploading segments... Aug 15 15:05:12.498157829 (165h39m6.92923796s) [upload=172296]: Upload finished. err: metaclient: Too Many Requests Duration: 10.937297754s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.....X.........................................X....XX......] duration: 4.105644573s FAIL (2025-08-15 15:12:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 15:08:23.568800831 (165h42m17.999880962s) [upload=172360]: Starting upload Aug 15 15:08:23.568843131 (165h42m17.999923262s) [upload=172360]: Done starting upload Aug 15 15:08:23.568892736 (165h42m17.999972868s) [upload=172360]: Uploading segments... Aug 15 15:08:23.568932031 (165h42m18.000012162s) [upload=172360]: Got next segment. Inline: true Aug 15 15:08:23.568936339 (165h42m18.00001647s) [upload=172360]: Waiting for error group managing segments... Aug 15 15:08:23.568970776 (165h42m18.000050897s) [upload=172360]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 15:08:23.568974854 (165h42m18.000054985s) [upload=172360]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 15:08:23.568977499 (165h42m18.00005763s) [upload=172360]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 15:08:23.783715648 (165h42m18.214795779s) [upload=172360]: Done uploading segments... Aug 15 15:08:23.783733201 (165h42m18.214813332s) [upload=172360]: Upload finished. err: metaclient: Too Many Requests Duration:* 4.105670092s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...X...................X....................X...X...........] duration: 17.838882544s FAIL (2025-08-15 15:11:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 15:05:12.280486036 (165h39m6.711566167s) [upload=172296]: Starting upload Aug 15 15:05:12.280532676 (165h39m6.711612807s) [upload=172296]: Done starting upload Aug 15 15:05:12.280600255 (165h39m6.711680416s) [upload=172296]: Uploading segments... Aug 15 15:05:12.280702601 (165h39m6.711782732s) [upload=172296]: Got next segment. Inline: false Aug 15 15:05:12.280728590 (165h39m6.711808721s) [upload=172296]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 15:05:12.280732418 (165h39m6.711812549s) [upload=172296]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 15 15:05:12.498125127 (165h39m6.929205258s) [upload=172296]: Next segment err: metaclient: Too Many Requests Aug 15 15:05:12.498144233 (165h39m6.929224364s) [upload=172296]: Done uploading segments... Aug 15 15:05:12.498157829 (165h39m6.92923796s) [upload=172296]: Upload finished. err: metaclient: Too Many Requests Duration: 17.8389108s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [......X.........................................X....XX.....] duration: 3.170797078s FAIL (2025-08-15 15:11:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 15:08:23.568800831 (165h42m17.999880962s) [upload=172360]: Starting upload Aug 15 15:08:23.568843131 (165h42m17.999923262s) [upload=172360]: Done starting upload Aug 15 15:08:23.568892736 (165h42m17.999972868s) [upload=172360]: Uploading segments... Aug 15 15:08:23.568932031 (165h42m18.000012162s) [upload=172360]: Got next segment. Inline: true Aug 15 15:08:23.568936339 (165h42m18.00001647s) [upload=172360]: Waiting for error group managing segments... Aug 15 15:08:23.568970776 (165h42m18.000050897s) [upload=172360]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 15:08:23.568974854 (165h42m18.000054985s) [upload=172360]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 15:08:23.568977499 (165h42m18.00005763s) [upload=172360]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 15:08:23.783715648 (165h42m18.214795779s) [upload=172360]: Done uploading segments... Aug 15 15:08:23.783733201 (165h42m18.214813332s) [upload=172360]: Upload finished. err: metaclient: Too Many Requests Duration:* 3.170824931s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [....X...................X....................X...X..........] duration: 25.109654907s FAIL (2025-08-15 15:11:21 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 15:05:12.280486036 (165h39m6.711566167s) [upload=172296]: Starting upload Aug 15 15:05:12.280532676 (165h39m6.711612807s) [upload=172296]: Done starting upload Aug 15 15:05:12.280600255 (165h39m6.711680416s) [upload=172296]: Uploading segments... Aug 15 15:05:12.280702601 (165h39m6.711782732s) [upload=172296]: Got next segment. Inline: false Aug 15 15:05:12.280728590 (165h39m6.711808721s) [upload=172296]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 15:05:12.280732418 (165h39m6.711812549s) [upload=172296]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 15 15:05:12.498125127 (165h39m6.929205258s) [upload=172296]: Next segment err: metaclient: Too Many Requests Aug 15 15:05:12.498144233 (165h39m6.929224364s) [upload=172296]: Done uploading segments... Aug 15 15:05:12.498157829 (165h39m6.92923796s) [upload=172296]: Upload finished. err: metaclient: Too Many Requests Duration: 25.109689724s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.......X.........................................X....XX....] duration: 11.383047117s FAIL (2025-08-15 15:10:53 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 15:08:23.568800831 (165h42m17.999880962s) [upload=172360]: Starting upload Aug 15 15:08:23.568843131 (165h42m17.999923262s) [upload=172360]: Done starting upload Aug 15 15:08:23.568892736 (165h42m17.999972868s) [upload=172360]: Uploading segments... Aug 15 15:08:23.568932031 (165h42m18.000012162s) [upload=172360]: Got next segment. Inline: true Aug 15 15:08:23.568936339 (165h42m18.00001647s) [upload=172360]: Waiting for error group managing segments... Aug 15 15:08:23.568970776 (165h42m18.000050897s) [upload=172360]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 15:08:23.568974854 (165h42m18.000054985s) [upload=172360]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 15:08:23.568977499 (165h42m18.00005763s) [upload=172360]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 15:08:23.783715648 (165h42m18.214795779s) [upload=172360]: Done uploading segments... Aug 15 15:08:23.783733201 (165h42m18.214813332s) [upload=172360]: Upload finished. err: metaclient: Too Many Requests Duration:* 11.383075081s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [........X.........................................X....XX...] duration: 3.082729045s FAIL (2025-08-15 15:10:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 15:08:23.568800831 (165h42m17.999880962s) [upload=172360]: Starting upload Aug 15 15:08:23.568843131 (165h42m17.999923262s) [upload=172360]: Done starting upload Aug 15 15:08:23.568892736 (165h42m17.999972868s) [upload=172360]: Uploading segments... Aug 15 15:08:23.568932031 (165h42m18.000012162s) [upload=172360]: Got next segment. Inline: true Aug 15 15:08:23.568936339 (165h42m18.00001647s) [upload=172360]: Waiting for error group managing segments... Aug 15 15:08:23.568970776 (165h42m18.000050897s) [upload=172360]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 15:08:23.568974854 (165h42m18.000054985s) [upload=172360]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 15:08:23.568977499 (165h42m18.00005763s) [upload=172360]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 15:08:23.783715648 (165h42m18.214795779s) [upload=172360]: Done uploading segments... Aug 15 15:08:23.783733201 (165h42m18.214813332s) [upload=172360]: Upload finished. err: metaclient: Too Many Requests Duration:* 3.082756627s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.....X...................X....................X...X.........] duration: 9.042058567s FAIL (2025-08-15 15:10:21 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 15:05:12.280486036 (165h39m6.711566167s) [upload=172296]: Starting upload Aug 15 15:05:12.280532676 (165h39m6.711612807s) [upload=172296]: Done starting upload Aug 15 15:05:12.280600255 (165h39m6.711680416s) [upload=172296]: Uploading segments... Aug 15 15:05:12.280702601 (165h39m6.711782732s) [upload=172296]: Got next segment. Inline: false Aug 15 15:05:12.280728590 (165h39m6.711808721s) [upload=172296]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 15:05:12.280732418 (165h39m6.711812549s) [upload=172296]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 15 15:05:12.498125127 (165h39m6.929205258s) [upload=172296]: Next segment err: metaclient: Too Many Requests Aug 15 15:05:12.498144233 (165h39m6.929224364s) [upload=172296]: Done uploading segments... Aug 15 15:05:12.498157829 (165h39m6.92923796s) [upload=172296]: Upload finished. err: metaclient: Too Many Requests Duration: 9.042082183s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.........X.........................................X....XX..] duration: 1.982143879s FAIL (2025-08-15 15:10:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 15:08:23.568800831 (165h42m17.999880962s) [upload=172360]: Starting upload Aug 15 15:08:23.568843131 (165h42m17.999923262s) [upload=172360]: Done starting upload Aug 15 15:08:23.568892736 (165h42m17.999972868s) [upload=172360]: Uploading segments... Aug 15 15:08:23.568932031 (165h42m18.000012162s) [upload=172360]: Got next segment. Inline: true Aug 15 15:08:23.568936339 (165h42m18.00001647s) [upload=172360]: Waiting for error group managing segments... Aug 15 15:08:23.568970776 (165h42m18.000050897s) [upload=172360]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 15:08:23.568974854 (165h42m18.000054985s) [upload=172360]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 15:08:23.568977499 (165h42m18.00005763s) [upload=172360]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 15:08:23.783715648 (165h42m18.214795779s) [upload=172360]: Done uploading segments... Aug 15 15:08:23.783733201 (165h42m18.214813332s) [upload=172360]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.982168537s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [......X...................X....................X...X........] duration: 8.773048918s FAIL (2025-08-15 15:09:42 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 15:05:12.280486036 (165h39m6.711566167s) [upload=172296]: Starting upload Aug 15 15:05:12.280532676 (165h39m6.711612807s) [upload=172296]: Done starting upload Aug 15 15:05:12.280600255 (165h39m6.711680416s) [upload=172296]: Uploading segments... Aug 15 15:05:12.280702601 (165h39m6.711782732s) [upload=172296]: Got next segment. Inline: false Aug 15 15:05:12.280728590 (165h39m6.711808721s) [upload=172296]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 15:05:12.280732418 (165h39m6.711812549s) [upload=172296]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 15 15:05:12.498125127 (165h39m6.929205258s) [upload=172296]: Next segment err: metaclient: Too Many Requests Aug 15 15:05:12.498144233 (165h39m6.929224364s) [upload=172296]: Done uploading segments... Aug 15 15:05:12.498157829 (165h39m6.92923796s) [upload=172296]: Upload finished. err: metaclient: Too Many Requests Duration: 8.773072913s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [..........X.........................................X....XX.] duration: 4.782043265s FAIL (2025-08-15 15:09:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 15:08:23.568800831 (165h42m17.999880962s) [upload=172360]: Starting upload Aug 15 15:08:23.568843131 (165h42m17.999923262s) [upload=172360]: Done starting upload Aug 15 15:08:23.568892736 (165h42m17.999972868s) [upload=172360]: Uploading segments... Aug 15 15:08:23.568932031 (165h42m18.000012162s) [upload=172360]: Got next segment. Inline: true Aug 15 15:08:23.568936339 (165h42m18.00001647s) [upload=172360]: Waiting for error group managing segments... Aug 15 15:08:23.568970776 (165h42m18.000050897s) [upload=172360]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 15 15:08:23.568974854 (165h42m18.000054985s) [upload=172360]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 15 15:08:23.568977499 (165h42m18.00005763s) [upload=172360]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 15 15:08:23.783715648 (165h42m18.214795779s) [upload=172360]: Done uploading segments... Aug 15 15:08:23.783733201 (165h42m18.214813332s) [upload=172360]: Upload finished. err: metaclient: Too Many Requests Duration:* 4.78229252s core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)