Orbiter History

checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 2.260587892s FAIL (2025-10-27 13:57:53 UTC) orbiter warning: operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 429, RequestID: 18725DA00518FD33, HostID: , api error SlowDown: Please reduce your request rate. Duration: 2.260611015s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 2.435849942s FAIL (2025-10-27 13:57:18 UTC) orbiter warning: operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 429, RequestID: 18725DA00518FD33, HostID: , api error SlowDown: Please reduce your request rate. Duration: 2.435876673s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 2.288667651s FAIL (2025-10-27 13:56:10 UTC) orbiter warning: operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 429, RequestID: 18725DA00518FD33, HostID: , api error SlowDown: Please reduce your request rate. Duration: 2.288695442s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 2.557523213s FAIL (2025-10-27 13:55:46 UTC) orbiter warning: operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 429, RequestID: 18725DA00518FD33, HostID: , api error SlowDown: Please reduce your request rate. Duration: 2.557544103s edge gateway us-select-1
checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io) antiblip: 1 out of 15 is failed (threshold=6) [X..............] duration: 66.052136ms remote: "tcp:34.120.119.150:443" target: https://www.tardigrade.io/ FAIL (2025-10-27 12:41:29 UTC) orbiter warning: Get "https://www.tardigrade.io/": EOF Duration: 66.121037ms core website
checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io) antiblip: 1 out of 15 is failed (threshold=6) [.X.............] duration: 80.294367ms remote: "tcp:34.120.119.150:443" target: https://www.tardigrade.io/ FAIL (2025-10-27 12:41:00 UTC) orbiter warning: Get "https://www.tardigrade.io/": EOF Duration: 80.325256ms core website
checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io) antiblip: 1 out of 15 is failed (threshold=6) [..X............] duration: 67.516975ms remote: "tcp:34.120.119.150:443" target: https://www.tardigrade.io/ FAIL (2025-10-27 12:40:42 UTC) orbiter warning: Get "https://www.tardigrade.io/": EOF Duration: 67.549798ms core website
checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io) antiblip: 1 out of 15 is failed (threshold=6) [...X...........] duration: 66.232961ms remote: "tcp:34.120.119.150:443" target: https://www.tardigrade.io/ FAIL (2025-10-27 12:39:58 UTC) orbiter warning: Get "https://www.tardigrade.io/": EOF Duration: 66.255333ms core website
checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io) antiblip: 1 out of 15 is failed (threshold=6) [....X..........] duration: 70.282515ms remote: "tcp:34.120.119.150:443" target: https://www.tardigrade.io/ FAIL (2025-10-27 12:39:37 UTC) orbiter warning: Get "https://www.tardigrade.io/": EOF Duration: 70.331508ms core website
checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io) antiblip: 1 out of 15 is failed (threshold=6) [.....X.........] duration: 67.626343ms remote: "tcp:34.120.119.150:443" target: https://www.tardigrade.io/ FAIL (2025-10-27 12:39:11 UTC) orbiter warning: Get "https://www.tardigrade.io/": EOF Duration: 67.69739ms core website
checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io) antiblip: 1 out of 15 is failed (threshold=6) [......X........] duration: 73.588167ms remote: "tcp:34.120.119.150:443" target: https://www.tardigrade.io/ FAIL (2025-10-27 12:38:38 UTC) orbiter warning: Get "https://www.tardigrade.io/": EOF Duration: 73.638423ms core website
checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io) antiblip: 1 out of 15 is failed (threshold=6) [.......X.......] duration: 67.321406ms remote: "tcp:34.120.119.150:443" target: https://www.tardigrade.io/ FAIL (2025-10-27 12:37:55 UTC) orbiter warning: Get "https://www.tardigrade.io/": EOF Duration: 67.352484ms core website
checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io) antiblip: 1 out of 15 is failed (threshold=6) [........X......] duration: 77.611448ms remote: "tcp:34.120.119.150:443" target: https://www.tardigrade.io/ FAIL (2025-10-27 12:37:34 UTC) orbiter warning: Get "https://www.tardigrade.io/": EOF Duration: 77.63885ms core website
checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io) antiblip: 1 out of 15 is failed (threshold=6) [.........X.....] duration: 73.667547ms remote: "tcp:34.120.119.150:443" target: https://www.tardigrade.io/ FAIL (2025-10-27 12:36:53 UTC) orbiter warning: Get "https://www.tardigrade.io/": EOF Duration: 73.693769ms core website
checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io) antiblip: 1 out of 15 is failed (threshold=6) [..........X....] duration: 78.911365ms remote: "tcp:34.120.119.150:443" target: https://www.tardigrade.io/ FAIL (2025-10-27 12:35:56 UTC) orbiter warning: Get "https://www.tardigrade.io/": EOF Duration: 78.945661ms core website
checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io) antiblip: 1 out of 15 is failed (threshold=6) [...........X...] duration: 75.664681ms remote: "tcp:34.120.119.150:443" target: https://www.tardigrade.io/ FAIL (2025-10-27 12:34:50 UTC) orbiter warning: Get "https://www.tardigrade.io/": EOF Duration: 75.684699ms core website
checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io) antiblip: 1 out of 15 is failed (threshold=6) [............X..] duration: 73.497796ms remote: "tcp:34.120.119.150:443" target: https://www.tardigrade.io/ FAIL (2025-10-27 12:34:16 UTC) orbiter warning: Get "https://www.tardigrade.io/": EOF Duration: 73.538344ms core website
checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io) antiblip: 1 out of 15 is failed (threshold=6) [.............X.] duration: 80.567547ms remote: "tcp:34.120.119.150:443" target: https://www.tardigrade.io/ FAIL (2025-10-27 12:33:27 UTC) orbiter warning: Get "https://www.tardigrade.io/": EOF Duration: 80.596973ms core website
checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io) antiblip: 1 out of 15 is failed (threshold=6) [..............X] duration: 3.39692941s remote: "tcp:34.120.119.150:443" target: https://www.tardigrade.io/ FAIL (2025-10-27 12:32:37 UTC) orbiter warning: Get "https://www.tardigrade.io/": EOF Duration: 3.396956481s core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 8.653646204s FAIL (2025-10-27 12:19:19 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 8.653669238s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 8.504684566s FAIL (2025-10-27 12:18:05 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 8.50471767s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 6.413966709s FAIL (2025-10-27 12:17:16 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 6.414062301s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 5.889590057s FAIL (2025-10-27 12:16:35 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 5.889620574s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 5.855468529s FAIL (2025-10-27 12:16:13 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 5.855501332s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 5.864224409s FAIL (2025-10-27 12:15:21 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 5.864282298s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 5.969626847s FAIL (2025-10-27 12:14:19 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 5.969650892s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 7.598687707s FAIL (2025-10-27 12:13:45 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 7.598749616s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 8.096541054s FAIL (2025-10-27 12:13:23 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 8.096573645s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 6.141997722s FAIL (2025-10-27 12:12:44 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 6.142033991s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 5.994545815s FAIL (2025-10-27 12:11:42 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 5.994574299s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 8.674155714s FAIL (2025-10-27 12:10:50 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 8.674200268s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 6.877686544s FAIL (2025-10-27 12:10:23 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 6.877724815s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 6.038923008s FAIL (2025-10-27 12:09:58 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 6.038954217s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 6.652469205s FAIL (2025-10-27 12:09:35 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 6.652493542s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 6.008762884s FAIL (2025-10-27 12:09:00 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 6.008795045s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 5.942112214s FAIL (2025-10-27 12:07:47 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 5.942144856s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 5.866762991s FAIL (2025-10-27 12:07:12 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 5.866793299s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 5.917874758s FAIL (2025-10-27 12:05:57 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 5.917908422s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 5.936190275s FAIL (2025-10-27 12:04:57 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 5.936228156s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 6.112060435s FAIL (2025-10-27 12:04:15 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 6.112096404s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 5.915384572s FAIL (2025-10-27 12:03:51 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 5.915415992s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 6.198411721s FAIL (2025-10-27 12:03:32 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 6.198441688s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 6.11669557s FAIL (2025-10-27 12:02:48 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 6.116731347s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 6.298815981s FAIL (2025-10-27 12:02:28 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 6.298852391s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 5.953949809s FAIL (2025-10-27 12:02:02 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 5.953983734s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 5.988554502s FAIL (2025-10-27 12:01:06 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 5.988592374s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 6.138106232s FAIL (2025-10-27 12:00:05 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 6.138135798s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 5.94535407s FAIL (2025-10-27 11:58:52 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 5.945390349s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 5.928373896s FAIL (2025-10-27 11:58:37 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 5.92840742s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 5.94189235s FAIL (2025-10-27 11:57:52 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 11:37:36.413534920 (814h6m21.875627393s) [upload=716059]: Starting upload Oct 27 11:37:36.413644749 (814h6m21.875737222s) [upload=716059]: Done starting upload Oct 27 11:37:36.413720033 (814h6m21.875812516s) [upload=716059]: Uploading segments... Oct 27 11:37:36.413966732 (814h6m21.876059216s) [upload=716059]: Got next segment. Inline: false Oct 27 11:37:36.414008372 (814h6m21.876100845s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 11:37:36.414014483 (814h6m21.876106956s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 11:37:36.668152654 (814h6m22.130245137s) [seg_pos={0 0}, upload=716059]: Begin upload segment... Oct 27 11:37:36.668223881 (814h6m22.130316364s) [seg_pos={0 0}, upload=716059]: Done begin upload segment. Oct 27 11:37:36.668273395 (814h6m22.130365888s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668281961 (814h6m22.130374434s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.668391159 (814h6m22.130483652s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669518195 (814h6m22.131610678s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.669682307 (814h6m22.13177478s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670125000 (814h6m22.132217473s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670136432 (814h6m22.132228905s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670556202 (814h6m22.132648685s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670607740 (814h6m22.132700223s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.670993374 (814h6m22.133085857s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.671537410 (814h6m22.133629893s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672272270 (814h6m22.134364743s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.672818580 (814h6m22.134911063s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673099244 (814h6m22.135191738s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.673667576 (814h6m22.135760059s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:36.674141700 (814h6m22.136234173s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Uploading piece... Oct 27 11:37:38.418632975 (814h6m23.880725448s) [upload=716059]: Next returned nil segment Oct 27 11:37:38.418651110 (814h6m23.880743593s) [upload=716059]: Waiting for error group managing segments... Oct 27 11:37:38.697230752 (814h6m24.159323235s) [noise=true , address=145.79.227.10:4401 , piece_id=S66C6YTBQPHUZBACOBJ4NHT7HMXWICSPCPKT5UNOIUBSH6OF2ZEQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.701316752 (814h6m24.163409236s) [noise=true , address=145.79.227.3:4151 , piece_id=KTVXG4TSXADV76AYBEVFO64B75CSOGAOYQLVBXPUPDXWT3OMSXMA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.702855313 (814h6m24.164947796s) [noise=true , address=145.79.227.5:4222 , piece_id=EUWXELVPN67TAUPUMIUFQFRDTXLSMPZ4OVWVPP6I6SUDZN7YG62Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.706308628 (814h6m24.168401112s) [noise=true , address=145.79.227.16:4912 , piece_id=UE6XBXO6SPHDOTXBEOEOS2AK4RADRHRNIGHZ4TSL4PYLBVOQPG3Q, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.714619554 (814h6m24.176712037s) [noise=true , address=145.79.227.2:4115 , piece_id=UNLX3IVZOXHW6VQZZ4Y2VISA3MR6AWH4PHK4KKNHLAOF754WTGFQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.723406266 (814h6m24.185498749s) [noise=true , address=145.79.227.20:4437 , piece_id=AT5OAWC2XDS3KVYGEINSPGSITNHBF7WML7GVY6FEB6CLDZMLOMOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.725115601 (814h6m24.187208074s) [noise=true , address=145.79.227.25:4619 , piece_id=PQD4REJHD3DI2G6LBKAB6PORRIT6EFH7SK6DF2QTYD3B6JMUZ5PA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.750422601 (814h6m24.212515074s) [noise=true , address=145.79.227.22:4511 , piece_id=U3BUOXERKK6HMN4DBIHCGYGKPE52ZXGMVSE23REXSRLZVEVHYLKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.798852250 (814h6m24.260944723s) [noise=true , address=145.79.227.11:4731 , piece_id=ZLSP3GUMTWVGOOPSM2LSRVHCGZCJZSAIUUBABRC4O2SQ3KMDT3CQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.885081498 (814h6m24.347173971s) [noise=true , address=77.90.31.10:4520 , piece_id=FEBTNCH4KMC6WJBG4V3XS5R76VQMEDOI33QQOTZHQHCPMVZJZHRA, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.974981706 (814h6m24.437074189s) [noise=true , address=77.90.31.11:4553 , piece_id=J6QYSFV6KIOCFTQNY7H77JCKMJ7D23UGRANKO55SARTF6E6KNXDQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:38.993758581 (814h6m24.455851064s) [noise=true , address=77.90.31.14:4663 , piece_id=T25VAPDL7A3TMFRE4FUU24PWP4B6KV63CGRVNPOXA3UYTEXZJWHQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023869759 (814h6m24.485962242s) [noise=true , address=77.90.31.15:4698 , piece_id=3SHNL3Q5YD4M3WMAILERANAA3CHTJEQFJBHFN47QFVZ4BFDVEKOQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: <nil> Oct 27 11:37:39.023903023 (814h6m24.485995496s) [seg_pos={0 0}, upload=716059]: Segment reached optimal threshold of 13 pieces. Oct 27 11:37:39.024033491 (814h6m24.486125974s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024040494 (814h6m24.486132977s) [noise=true , address=77.90.31.18:4805 , piece_id=JSOTCMA6XHCDGIW3O46X5ABTTZOM67ZWIZGDAPRILTASBMAADCMQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024105258 (814h6m24.486197751s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024111069 (814h6m24.486203552s) [noise=true , address=77.90.31.11:4555 , piece_id=66FY64AWO2TFJ565FE46ESN5K4P4DE4VT5TOUKUK7LQJTYYVSQCQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024158890 (814h6m24.486251363s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Oct 27 11:37:39.024176333 (814h6m24.486268816s) [noise=true , address=45.91.116.5:4297 , piece_id=LHH53BTGVNIRWUXSQB3UJLP4UOCAYSYR2ADTHMCBNDMCACBZIOKQ, seg_pos={0 0}, upload=716059]: Long tail cancellation due to optimal threshold Oct 27 11:37:39.024201561 (814h6m24.486294045s) [seg_pos={0 0}, upload=716059]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 11:37:39.024277336 (814h6m24.486369809s) [upload=716059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 11:37:39.024282575 (814h6m24.486375058s) [upload=716059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 11:37:39.340856386 (814h6m24.802948869s) [upload=716059]: Done uploading segments... Oct 27 11:37:39.340878699 (814h6m24.802971172s) [upload=716059]: Upload finished. err: <nil> Duration: 5.941922008s core uplink us-select-1

Orbiter Check History

checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io)

checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io)

checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io)

checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io)

checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io)

checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io)

checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io)

checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io)

checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io)

checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io)

checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io)

checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io)

checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io)

checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io)

checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)