Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 5.911561026s FAIL (2025-10-27 11:57:26 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 5.911593598s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 5.940248406s FAIL (2025-10-27 11:56:42 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 5.940279615s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 6.053524318s FAIL (2025-10-27 11:56:25 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 6.053555528s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 6.085873628s FAIL (2025-10-27 11:55:52 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 6.085905088s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 5.96679072s FAIL (2025-10-27 11:55:32 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 5.966823053s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 5.885936709s FAIL (2025-10-27 11:54:59 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 5.88596825s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 5.789620882s FAIL (2025-10-27 11:54:23 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 5.789650788s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 5.895062302s FAIL (2025-10-27 11:53:41 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 5.895103571s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 6.016571712s FAIL (2025-10-27 11:52:59 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 6.016602981s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 6.102249323s FAIL (2025-10-27 11:52:35 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 6.102287145s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 6.01581508s FAIL (2025-10-27 11:52:07 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 6.015847271s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 5.86875582s FAIL (2025-10-27 11:51:44 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 5.868790777s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 5.985237268s FAIL (2025-10-27 11:50:51 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 5.985298043s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 5.871671788s FAIL (2025-10-27 11:50:24 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 5.871701424s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 6.02670638s FAIL (2025-10-27 11:49:44 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 6.026755174s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 5.814262392s FAIL (2025-10-27 11:48:39 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 5.814298711s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 6.11078794s FAIL (2025-10-27 11:47:41 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 6.11081973s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 6.141361315s FAIL (2025-10-27 11:46:36 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 6.141392002s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 5.958541545s FAIL (2025-10-27 11:45:37 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 5.958655361s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 6.007009617s FAIL (2025-10-27 11:44:47 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 6.007047339s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 5.971728269s FAIL (2025-10-27 11:43:35 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 5.97176008s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 5.735662515s FAIL (2025-10-27 11:42:56 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 5.735697702s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 6.731801909s FAIL (2025-10-27 11:42:36 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 6.731831857s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 5.89998927s FAIL (2025-10-27 11:41:37 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 5.900020218s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 6.021493178s FAIL (2025-10-27 11:40:30 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 6.021524888s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 5.892596292s FAIL (2025-10-27 11:39:48 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 5.892637612s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 5.853935266s FAIL (2025-10-27 11:38:44 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 5.853959983s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 5.953177791s FAIL (2025-10-27 11:38:20 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 5.95320894s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.00216535s FAIL (2025-10-27 11:38:05 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 30.002191541s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.066559154s FAIL (2025-10-27 09:29:17 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.066591896s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.089670813s FAIL (2025-10-27 09:28:45 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.089697624s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.035737792s FAIL (2025-10-27 09:27:58 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.035758641s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 2.004937122s FAIL (2025-10-27 09:27:24 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.00497269s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 5.855665892s FAIL (2025-10-27 09:26:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments... Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment... Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment. Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments... Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces. Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments... Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.85570243s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 2.26009451s FAIL (2025-10-27 09:26:21 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.26012652s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.063924996s FAIL (2025-10-27 09:26:05 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.063962647s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 6.04636094s FAIL (2025-10-27 09:25:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments... Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment... Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment. Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments... Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces. Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments... Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.046413291s core uplink us-select-1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 624.140016ms remote: "tcp:34.173.164.90:443" target: https://version.storj.io/ FAIL (2025-10-27 09:25:50 UTC) orbiter warning: Get "https://version.storj.io/": EOF Duration: 624.176656ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 5.996654789s FAIL (2025-10-27 09:25:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments... Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment... Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment. Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments... Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces. Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments... Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.996689314s core uplink us-select-1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 623.76004ms remote: "tcp:34.173.164.90:443" target: https://version.storj.io/ FAIL (2025-10-27 09:25:24 UTC) orbiter warning: Get "https://version.storj.io/": EOF Duration: 623.795298ms core website
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 612.711772ms remote: "tcp:34.173.164.90:443" target: https://version.storj.io/ FAIL (2025-10-27 09:25:08 UTC) orbiter warning: Get "https://version.storj.io/": EOF Duration: 612.729326ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.066328184s FAIL (2025-10-27 09:24:54 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.066358011s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 5.916552732s FAIL (2025-10-27 09:24:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments... Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment... Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment. Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments... Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces. Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments... Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.916584293s core uplink us-select-1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 615.21085ms remote: "tcp:34.173.164.90:443" target: https://version.storj.io/ FAIL (2025-10-27 09:23:56 UTC) orbiter warning: Get "https://version.storj.io/": EOF Duration: 615.250756ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 1.999630955s FAIL (2025-10-27 09:23:46 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 1.999668378s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 6.132605095s FAIL (2025-10-27 09:23:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments... Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment... Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment. Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments... Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces. Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments... Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.132643618s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 1.999587254s FAIL (2025-10-27 09:23:17 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 1.999620878s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 5.921116058s FAIL (2025-10-27 09:23:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments... Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment... Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment. Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments... Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces. Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments... Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.921139083s core uplink us-select-1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 652.494487ms remote: "tcp:34.173.164.90:443" target: https://version.storj.io/ FAIL (2025-10-27 09:22:45 UTC) orbiter warning: Get "https://version.storj.io/": EOF Duration: 652.545894ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 2.022211866s FAIL (2025-10-27 09:22:28 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.022268523s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)