Orbiter History

checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=3) [........X........................X................X.........] duration: 3.424786523s FAIL (2025-10-27 20:49:13 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.424822563s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=3) [.........X........................X................X........] duration: 3.410571765s FAIL (2025-10-27 20:48:55 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.410597573s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=3) [..........X........................X................X.......] duration: 3.639640369s FAIL (2025-10-27 20:47:44 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.639718859s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=3) [...........X........................X................X......] duration: 3.389266889s FAIL (2025-10-27 20:47:11 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.389290594s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=3) [............X........................X................X.....] duration: 3.425478773s FAIL (2025-10-27 20:46:16 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.425501136s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=3) [.............X........................X................X....] duration: 3.383684145s FAIL (2025-10-27 20:45:33 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.383705957s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=3) [..............X........................X................X...] duration: 3.52483616s FAIL (2025-10-27 20:44:34 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.524853292s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=3) [...............X........................X................X..] duration: 4.162879671s FAIL (2025-10-27 20:44:18 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 4.162944464s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=3) [................X........................X................X.] duration: 4.614847426s FAIL (2025-10-27 20:43:54 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 4.614871842s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=3) [.................X........................X................X] duration: 5.001881597s FAIL (2025-10-27 20:43:38 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001907598s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=3) [..................X........................X................] duration: 3.430984927s FAIL (2025-10-27 20:42:35 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.431008452s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=3) [...................X........................X...............] duration: 3.375373721s FAIL (2025-10-27 20:41:57 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.375472708s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=3) [....................X........................X..............] duration: 3.457403755s FAIL (2025-10-27 20:41:40 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.457432641s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=3) [.....................X........................X.............] duration: 3.483149731s FAIL (2025-10-27 20:41:02 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.483178407s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=3) [......................X........................X............] duration: 3.468870657s FAIL (2025-10-27 20:40:01 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.468896206s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=3) [.......................X........................X...........] duration: 3.362069758s FAIL (2025-10-27 20:38:54 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.362095046s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 4.972590867s FAIL (2025-10-27 20:38:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== eg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577374904 (5h14m15.926682211s) [noise=true , address=89.149.201.147:4020 , piece_id=7O5NTDXJMZL7XX7EJJZMSCLQPS2KBXW2ASVMGFKBKDASUOJ5KYQA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577388009 (5h14m15.926695285s) [noise=true , address=185.167.204.206:4052 , piece_id=RTBLKXBTFLJOSBGSMSZ6HJNPDSM5GPO67VVRHP3OAK5DF5QFAVCQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577699713 (5h14m15.927006989s) [noise=true , address=89.149.201.147:4012 , piece_id=VGEAVYUXQB6F4OF7BCCCZGGI4S2OT5BXXDFSEMHGLMOUAPFCPXDQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577834229 (5h14m15.927141505s) [noise=true , address=89.149.201.147:4017 , piece_id=Q4AHXE26ASEWAANQIW55O433TDNA3RPYX7KCEZVPDET264I5DV3Q, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578014502 (5h14m15.927321778s) [noise=true , address=89.149.201.147:4007 , piece_id=6YAZLKZQ3IRZ3KU4M2MVAAOBEPJZGLFJAS6A4BPSNUPCNNVQHDDQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578280880 (5h14m15.927588156s) [noise=true , address=185.167.204.205:4001 , piece_id=Z22S36XDBYL5COSP36N575LMSLJVC6AP4ZXFNXNMRTVN23HTP5XA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578608904 (5h14m15.92791618s) [noise=true , address=185.167.204.205:4012 , piece_id=JKUFH3UD6ACMEQWRFYJ2F5P5ZJQKYCA6E7FXTHBF7MNQA6EKLXGA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578935426 (5h14m15.928242712s) [noise=true , address=185.167.204.206:4048 , piece_id=HD65TI6UG22CW34RKIVC5RMYIOUIYHL72BJZYL55XHCX3HQMZYHA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579041648 (5h14m15.928348924s) [noise=true , address=185.167.204.205:4002 , piece_id=U57ZVYRVT2L35FNA2N6ODTLEP3PN3TPP5ZYSONBXJYXWE5K43S6A, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579222723 (5h14m15.928529999s) [noise=true , address=185.167.204.206:4040 , piece_id=PDSOHIACMQCDA6NQQZWS4YUI57BMU4DJY5GKRPR7JVLLFVZXDJXQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579486625 (5h14m15.928793901s) [noise=true , address=185.167.204.205:4010 , piece_id=Q35AS6W5CQL2OMHIEPI7GVR6NS7IEJ6LCFXZEWGFEWL6XENNNVIA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579780545 (5h14m15.929087821s) [noise=true , address=81.171.14.70:4039 , piece_id=S5634HCFPYT7SJGH5BPZ3OJZDIAJ5YYSXCUWGIYVIJ2WPQAEWEPQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.580102097 (5h14m15.929409403s) [noise=true , address=89.149.201.147:4005 , piece_id=27IBEU4BYZCGDNOUDCRTQZFZ35W3BLQGERULMCKVWFGWZ7676RPQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:59.402940250 (5h14m16.752247547s) [upload=4621]: Next returned nil segment Oct 27 19:56:59.402970929 (5h14m16.752278235s) [upload=4621]: Waiting for error group managing segments... Oct 27 19:56:59.801926071 (5h14m17.151233347s) [noise=true , address=81.171.14.70:4034 , piece_id=QQXBWVXWX24ETMCIFZ7LTONF3LVGL3RLDXXSIQGX62PLWPJSFM5A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.811249835 (5h14m17.160557121s) [noise=true , address=81.171.14.70:4048 , piece_id=PR2HDQTP5VKTMF7HG6VNKKUJD66LC2HKQVAZUGEZKKZNKH2QCZFQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.858197924 (5h14m17.20750521s) [noise=true , address=89.149.201.147:4007 , piece_id=6YAZLKZQ3IRZ3KU4M2MVAAOBEPJZGLFJAS6A4BPSNUPCNNVQHDDQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.897902089 (5h14m17.247209375s) [noise=true , address=89.149.201.147:4023 , piece_id=LEEWZDLYWPSSUDRIPEQK4NKC4PFF6JVLEBPZMQJLWCG4YZHRFQ3A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.901773520 (5h14m17.251080806s) [noise=true , address=89.149.201.147:4010 , piece_id=TRY6HG262YJRDUVNLLHRYG554BVP4J5TWPGHJUVN5N55WHU3C4ZA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.902238556 (5h14m17.251545842s) [noise=true , address=89.149.201.147:4005 , piece_id=27IBEU4BYZCGDNOUDCRTQZFZ35W3BLQGERULMCKVWFGWZ7676RPQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.902438327 (5h14m17.251745603s) [noise=true , address=81.171.14.70:4039 , piece_id=S5634HCFPYT7SJGH5BPZ3OJZDIAJ5YYSXCUWGIYVIJ2WPQAEWEPQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.917540715 (5h14m17.266847991s) [noise=true , address=89.149.201.147:4017 , piece_id=Q4AHXE26ASEWAANQIW55O433TDNA3RPYX7KCEZVPDET264I5DV3Q, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.926674337 (5h14m17.275981623s) [noise=true , address=89.149.201.147:4020 , piece_id=7O5NTDXJMZL7XX7EJJZMSCLQPS2KBXW2ASVMGFKBKDASUOJ5KYQA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.328819374 (5h14m17.67812666s) [noise=true , address=81.171.14.70:4030 , piece_id=ZTVTBK2E7IGYOYZMK6TTHKMMBST52RCZVKM776PV3USLXONMH66Q, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.349296225 (5h14m17.698603501s) [noise=true , address=89.149.201.147:4011 , piece_id=KQM7L432OU7BYKWL2QHAIKRNPKPA7NOPSZJDOAAFQEGV66PZMGTA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.352514193 (5h14m17.701821479s) [noise=true , address=89.149.201.147:4012 , piece_id=VGEAVYUXQB6F4OF7BCCCZGGI4S2OT5BXXDFSEMHGLMOUAPFCPXDQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.380253194 (5h14m17.72956049s) [noise=true , address=185.167.204.205:4030 , piece_id=35Y5DRDZZHA7LEUZDJQ36RU4MB6DQN2AAIG7E45EIC6YM3MQ7HHQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.385432055 (5h14m17.734739341s) [noise=true , address=185.167.204.205:4023 , piece_id=ACMLGJMZ5H25VH7VULKAIBWIHIAEE2AV366UEZFOJDZRNQ4NGYLA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.388082382 (5h14m17.737389678s) [noise=true , address=185.167.204.206:4040 , piece_id=PDSOHIACMQCDA6NQQZWS4YUI57BMU4DJY5GKRPR7JVLLFVZXDJXQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.391016018 (5h14m17.740323304s) [noise=true , address=185.167.204.206:4056 , piece_id=G5D6SI6CVQHAVSAPS6GJRVZIQ4YQ23PFH7KL26TVK4I4BBTW2C5A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.396014777 (5h14m17.745322053s) [noise=true , address=185.167.204.206:4052 , piece_id=RTBLKXBTFLJOSBGSMSZ6HJNPDSM5GPO67VVRHP3OAK5DF5QFAVCQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.401559615 (5h14m17.750866901s) [noise=true , address=185.167.204.205:4002 , piece_id=U57ZVYRVT2L35FNA2N6ODTLEP3PN3TPP5ZYSONBXJYXWE5K43S6A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.414355180 (5h14m17.763662466s) [noise=true , address=185.167.204.206:4041 , piece_id=NUWDUCCNI44ANZLNYISQQKFSBK7WYTPAPGQ6JJ43IP44LNCLT4SA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.421539241 (5h14m17.770846537s) [noise=true , address=185.167.204.206:4048 , piece_id=HD65TI6UG22CW34RKIVC5RMYIOUIYHL72BJZYL55XHCX3HQMZYHA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.423334288 (5h14m17.772641574s) [noise=true , address=185.167.204.205:4010 , piece_id=Q35AS6W5CQL2OMHIEPI7GVR6NS7IEJ6LCFXZEWGFEWL6XENNNVIA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.447102799 (5h14m17.796410075s) [noise=true , address=185.167.204.205:4012 , piece_id=JKUFH3UD6ACMEQWRFYJ2F5P5ZJQKYCA6E7FXTHBF7MNQA6EKLXGA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.473754258 (5h14m17.823061544s) [noise=true , address=185.167.204.206:4066 , piece_id=KKDV46RFAENAUYDYRPDCV64LWX5RB7JVRKB3HY7BXB4LU7DITSLA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.481151965 (5h14m17.830459251s) [noise=true , address=185.167.204.205:4019 , piece_id=7LYDTS6D3HQSDMVBCMRLB5NZIRLP44VRSWCUT5EKSGSRPWP4RHIA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.486154732 (5h14m17.835462018s) [noise=true , address=185.167.204.205:4001 , piece_id=Z22S36XDBYL5COSP36N575LMSLJVC6AP4ZXFNXNMRTVN23HTP5XA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:57.813202781 (5h15m15.162510068s) [noise=true , address=185.167.204.206:4053 , piece_id=UFA7HABPN4LRP7RSCHBHNXT5AMEDFUF3DSYEGWBFSXOTOXRQXT7A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 19:57:57.813463338 (5h15m15.162770614s) [noise=true , address=185.167.204.206:4047 , piece_id=Z2QX5FHJKEZVW4FXDV2NNUMXEBVPGEW4Z7C3GBVZRUTNFR4MA5IA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: ecclient: upload failed (node:12M7W4Yno5rMgemSC7nJd42asmZXqUY9cCyY7mtFFHEh8iqAhCF, address:185.167.204.206:4047): protocol: write tcp 188.166.225.170:59506->185.167.204.206:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 19:57:57.813491391 (5h15m15.162798677s) [noise=true , address=185.167.204.205:4013 , piece_id=KICB6KLFDM3KFOGJ52UVXO3G4BUPSSJF657ZIWUIVP56M2SLGMWA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: context deadline exceeded; context deadline exceeded Oct 27 19:57:57.813536527 (5h15m15.162843813s) [seg_pos={0 0}, upload=4621]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Oct 27 19:57:58.016780515 (5h15m15.366087802s) [upload=4621]: Done uploading segments... Oct 27 19:57:58.016879354 (5h15m15.36618663s) [upload=4621]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 4.972621214s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=3) [........................X........................X..........] duration: 3.453956742s FAIL (2025-10-27 20:37:45 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.454003962s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 4.996218352s FAIL (2025-10-27 20:37:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== eg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577374904 (5h14m15.926682211s) [noise=true , address=89.149.201.147:4020 , piece_id=7O5NTDXJMZL7XX7EJJZMSCLQPS2KBXW2ASVMGFKBKDASUOJ5KYQA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577388009 (5h14m15.926695285s) [noise=true , address=185.167.204.206:4052 , piece_id=RTBLKXBTFLJOSBGSMSZ6HJNPDSM5GPO67VVRHP3OAK5DF5QFAVCQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577699713 (5h14m15.927006989s) [noise=true , address=89.149.201.147:4012 , piece_id=VGEAVYUXQB6F4OF7BCCCZGGI4S2OT5BXXDFSEMHGLMOUAPFCPXDQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577834229 (5h14m15.927141505s) [noise=true , address=89.149.201.147:4017 , piece_id=Q4AHXE26ASEWAANQIW55O433TDNA3RPYX7KCEZVPDET264I5DV3Q, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578014502 (5h14m15.927321778s) [noise=true , address=89.149.201.147:4007 , piece_id=6YAZLKZQ3IRZ3KU4M2MVAAOBEPJZGLFJAS6A4BPSNUPCNNVQHDDQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578280880 (5h14m15.927588156s) [noise=true , address=185.167.204.205:4001 , piece_id=Z22S36XDBYL5COSP36N575LMSLJVC6AP4ZXFNXNMRTVN23HTP5XA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578608904 (5h14m15.92791618s) [noise=true , address=185.167.204.205:4012 , piece_id=JKUFH3UD6ACMEQWRFYJ2F5P5ZJQKYCA6E7FXTHBF7MNQA6EKLXGA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578935426 (5h14m15.928242712s) [noise=true , address=185.167.204.206:4048 , piece_id=HD65TI6UG22CW34RKIVC5RMYIOUIYHL72BJZYL55XHCX3HQMZYHA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579041648 (5h14m15.928348924s) [noise=true , address=185.167.204.205:4002 , piece_id=U57ZVYRVT2L35FNA2N6ODTLEP3PN3TPP5ZYSONBXJYXWE5K43S6A, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579222723 (5h14m15.928529999s) [noise=true , address=185.167.204.206:4040 , piece_id=PDSOHIACMQCDA6NQQZWS4YUI57BMU4DJY5GKRPR7JVLLFVZXDJXQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579486625 (5h14m15.928793901s) [noise=true , address=185.167.204.205:4010 , piece_id=Q35AS6W5CQL2OMHIEPI7GVR6NS7IEJ6LCFXZEWGFEWL6XENNNVIA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579780545 (5h14m15.929087821s) [noise=true , address=81.171.14.70:4039 , piece_id=S5634HCFPYT7SJGH5BPZ3OJZDIAJ5YYSXCUWGIYVIJ2WPQAEWEPQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.580102097 (5h14m15.929409403s) [noise=true , address=89.149.201.147:4005 , piece_id=27IBEU4BYZCGDNOUDCRTQZFZ35W3BLQGERULMCKVWFGWZ7676RPQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:59.402940250 (5h14m16.752247547s) [upload=4621]: Next returned nil segment Oct 27 19:56:59.402970929 (5h14m16.752278235s) [upload=4621]: Waiting for error group managing segments... Oct 27 19:56:59.801926071 (5h14m17.151233347s) [noise=true , address=81.171.14.70:4034 , piece_id=QQXBWVXWX24ETMCIFZ7LTONF3LVGL3RLDXXSIQGX62PLWPJSFM5A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.811249835 (5h14m17.160557121s) [noise=true , address=81.171.14.70:4048 , piece_id=PR2HDQTP5VKTMF7HG6VNKKUJD66LC2HKQVAZUGEZKKZNKH2QCZFQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.858197924 (5h14m17.20750521s) [noise=true , address=89.149.201.147:4007 , piece_id=6YAZLKZQ3IRZ3KU4M2MVAAOBEPJZGLFJAS6A4BPSNUPCNNVQHDDQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.897902089 (5h14m17.247209375s) [noise=true , address=89.149.201.147:4023 , piece_id=LEEWZDLYWPSSUDRIPEQK4NKC4PFF6JVLEBPZMQJLWCG4YZHRFQ3A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.901773520 (5h14m17.251080806s) [noise=true , address=89.149.201.147:4010 , piece_id=TRY6HG262YJRDUVNLLHRYG554BVP4J5TWPGHJUVN5N55WHU3C4ZA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.902238556 (5h14m17.251545842s) [noise=true , address=89.149.201.147:4005 , piece_id=27IBEU4BYZCGDNOUDCRTQZFZ35W3BLQGERULMCKVWFGWZ7676RPQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.902438327 (5h14m17.251745603s) [noise=true , address=81.171.14.70:4039 , piece_id=S5634HCFPYT7SJGH5BPZ3OJZDIAJ5YYSXCUWGIYVIJ2WPQAEWEPQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.917540715 (5h14m17.266847991s) [noise=true , address=89.149.201.147:4017 , piece_id=Q4AHXE26ASEWAANQIW55O433TDNA3RPYX7KCEZVPDET264I5DV3Q, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.926674337 (5h14m17.275981623s) [noise=true , address=89.149.201.147:4020 , piece_id=7O5NTDXJMZL7XX7EJJZMSCLQPS2KBXW2ASVMGFKBKDASUOJ5KYQA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.328819374 (5h14m17.67812666s) [noise=true , address=81.171.14.70:4030 , piece_id=ZTVTBK2E7IGYOYZMK6TTHKMMBST52RCZVKM776PV3USLXONMH66Q, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.349296225 (5h14m17.698603501s) [noise=true , address=89.149.201.147:4011 , piece_id=KQM7L432OU7BYKWL2QHAIKRNPKPA7NOPSZJDOAAFQEGV66PZMGTA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.352514193 (5h14m17.701821479s) [noise=true , address=89.149.201.147:4012 , piece_id=VGEAVYUXQB6F4OF7BCCCZGGI4S2OT5BXXDFSEMHGLMOUAPFCPXDQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.380253194 (5h14m17.72956049s) [noise=true , address=185.167.204.205:4030 , piece_id=35Y5DRDZZHA7LEUZDJQ36RU4MB6DQN2AAIG7E45EIC6YM3MQ7HHQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.385432055 (5h14m17.734739341s) [noise=true , address=185.167.204.205:4023 , piece_id=ACMLGJMZ5H25VH7VULKAIBWIHIAEE2AV366UEZFOJDZRNQ4NGYLA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.388082382 (5h14m17.737389678s) [noise=true , address=185.167.204.206:4040 , piece_id=PDSOHIACMQCDA6NQQZWS4YUI57BMU4DJY5GKRPR7JVLLFVZXDJXQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.391016018 (5h14m17.740323304s) [noise=true , address=185.167.204.206:4056 , piece_id=G5D6SI6CVQHAVSAPS6GJRVZIQ4YQ23PFH7KL26TVK4I4BBTW2C5A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.396014777 (5h14m17.745322053s) [noise=true , address=185.167.204.206:4052 , piece_id=RTBLKXBTFLJOSBGSMSZ6HJNPDSM5GPO67VVRHP3OAK5DF5QFAVCQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.401559615 (5h14m17.750866901s) [noise=true , address=185.167.204.205:4002 , piece_id=U57ZVYRVT2L35FNA2N6ODTLEP3PN3TPP5ZYSONBXJYXWE5K43S6A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.414355180 (5h14m17.763662466s) [noise=true , address=185.167.204.206:4041 , piece_id=NUWDUCCNI44ANZLNYISQQKFSBK7WYTPAPGQ6JJ43IP44LNCLT4SA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.421539241 (5h14m17.770846537s) [noise=true , address=185.167.204.206:4048 , piece_id=HD65TI6UG22CW34RKIVC5RMYIOUIYHL72BJZYL55XHCX3HQMZYHA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.423334288 (5h14m17.772641574s) [noise=true , address=185.167.204.205:4010 , piece_id=Q35AS6W5CQL2OMHIEPI7GVR6NS7IEJ6LCFXZEWGFEWL6XENNNVIA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.447102799 (5h14m17.796410075s) [noise=true , address=185.167.204.205:4012 , piece_id=JKUFH3UD6ACMEQWRFYJ2F5P5ZJQKYCA6E7FXTHBF7MNQA6EKLXGA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.473754258 (5h14m17.823061544s) [noise=true , address=185.167.204.206:4066 , piece_id=KKDV46RFAENAUYDYRPDCV64LWX5RB7JVRKB3HY7BXB4LU7DITSLA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.481151965 (5h14m17.830459251s) [noise=true , address=185.167.204.205:4019 , piece_id=7LYDTS6D3HQSDMVBCMRLB5NZIRLP44VRSWCUT5EKSGSRPWP4RHIA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.486154732 (5h14m17.835462018s) [noise=true , address=185.167.204.205:4001 , piece_id=Z22S36XDBYL5COSP36N575LMSLJVC6AP4ZXFNXNMRTVN23HTP5XA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:57.813202781 (5h15m15.162510068s) [noise=true , address=185.167.204.206:4053 , piece_id=UFA7HABPN4LRP7RSCHBHNXT5AMEDFUF3DSYEGWBFSXOTOXRQXT7A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 19:57:57.813463338 (5h15m15.162770614s) [noise=true , address=185.167.204.206:4047 , piece_id=Z2QX5FHJKEZVW4FXDV2NNUMXEBVPGEW4Z7C3GBVZRUTNFR4MA5IA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: ecclient: upload failed (node:12M7W4Yno5rMgemSC7nJd42asmZXqUY9cCyY7mtFFHEh8iqAhCF, address:185.167.204.206:4047): protocol: write tcp 188.166.225.170:59506->185.167.204.206:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 19:57:57.813491391 (5h15m15.162798677s) [noise=true , address=185.167.204.205:4013 , piece_id=KICB6KLFDM3KFOGJ52UVXO3G4BUPSSJF657ZIWUIVP56M2SLGMWA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: context deadline exceeded; context deadline exceeded Oct 27 19:57:57.813536527 (5h15m15.162843813s) [seg_pos={0 0}, upload=4621]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Oct 27 19:57:58.016780515 (5h15m15.366087802s) [upload=4621]: Done uploading segments... Oct 27 19:57:58.016879354 (5h15m15.36618663s) [upload=4621]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 4.996244221s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 4.967546474s FAIL (2025-10-27 20:37:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== eg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577374904 (5h14m15.926682211s) [noise=true , address=89.149.201.147:4020 , piece_id=7O5NTDXJMZL7XX7EJJZMSCLQPS2KBXW2ASVMGFKBKDASUOJ5KYQA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577388009 (5h14m15.926695285s) [noise=true , address=185.167.204.206:4052 , piece_id=RTBLKXBTFLJOSBGSMSZ6HJNPDSM5GPO67VVRHP3OAK5DF5QFAVCQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577699713 (5h14m15.927006989s) [noise=true , address=89.149.201.147:4012 , piece_id=VGEAVYUXQB6F4OF7BCCCZGGI4S2OT5BXXDFSEMHGLMOUAPFCPXDQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577834229 (5h14m15.927141505s) [noise=true , address=89.149.201.147:4017 , piece_id=Q4AHXE26ASEWAANQIW55O433TDNA3RPYX7KCEZVPDET264I5DV3Q, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578014502 (5h14m15.927321778s) [noise=true , address=89.149.201.147:4007 , piece_id=6YAZLKZQ3IRZ3KU4M2MVAAOBEPJZGLFJAS6A4BPSNUPCNNVQHDDQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578280880 (5h14m15.927588156s) [noise=true , address=185.167.204.205:4001 , piece_id=Z22S36XDBYL5COSP36N575LMSLJVC6AP4ZXFNXNMRTVN23HTP5XA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578608904 (5h14m15.92791618s) [noise=true , address=185.167.204.205:4012 , piece_id=JKUFH3UD6ACMEQWRFYJ2F5P5ZJQKYCA6E7FXTHBF7MNQA6EKLXGA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578935426 (5h14m15.928242712s) [noise=true , address=185.167.204.206:4048 , piece_id=HD65TI6UG22CW34RKIVC5RMYIOUIYHL72BJZYL55XHCX3HQMZYHA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579041648 (5h14m15.928348924s) [noise=true , address=185.167.204.205:4002 , piece_id=U57ZVYRVT2L35FNA2N6ODTLEP3PN3TPP5ZYSONBXJYXWE5K43S6A, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579222723 (5h14m15.928529999s) [noise=true , address=185.167.204.206:4040 , piece_id=PDSOHIACMQCDA6NQQZWS4YUI57BMU4DJY5GKRPR7JVLLFVZXDJXQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579486625 (5h14m15.928793901s) [noise=true , address=185.167.204.205:4010 , piece_id=Q35AS6W5CQL2OMHIEPI7GVR6NS7IEJ6LCFXZEWGFEWL6XENNNVIA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579780545 (5h14m15.929087821s) [noise=true , address=81.171.14.70:4039 , piece_id=S5634HCFPYT7SJGH5BPZ3OJZDIAJ5YYSXCUWGIYVIJ2WPQAEWEPQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.580102097 (5h14m15.929409403s) [noise=true , address=89.149.201.147:4005 , piece_id=27IBEU4BYZCGDNOUDCRTQZFZ35W3BLQGERULMCKVWFGWZ7676RPQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:59.402940250 (5h14m16.752247547s) [upload=4621]: Next returned nil segment Oct 27 19:56:59.402970929 (5h14m16.752278235s) [upload=4621]: Waiting for error group managing segments... Oct 27 19:56:59.801926071 (5h14m17.151233347s) [noise=true , address=81.171.14.70:4034 , piece_id=QQXBWVXWX24ETMCIFZ7LTONF3LVGL3RLDXXSIQGX62PLWPJSFM5A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.811249835 (5h14m17.160557121s) [noise=true , address=81.171.14.70:4048 , piece_id=PR2HDQTP5VKTMF7HG6VNKKUJD66LC2HKQVAZUGEZKKZNKH2QCZFQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.858197924 (5h14m17.20750521s) [noise=true , address=89.149.201.147:4007 , piece_id=6YAZLKZQ3IRZ3KU4M2MVAAOBEPJZGLFJAS6A4BPSNUPCNNVQHDDQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.897902089 (5h14m17.247209375s) [noise=true , address=89.149.201.147:4023 , piece_id=LEEWZDLYWPSSUDRIPEQK4NKC4PFF6JVLEBPZMQJLWCG4YZHRFQ3A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.901773520 (5h14m17.251080806s) [noise=true , address=89.149.201.147:4010 , piece_id=TRY6HG262YJRDUVNLLHRYG554BVP4J5TWPGHJUVN5N55WHU3C4ZA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.902238556 (5h14m17.251545842s) [noise=true , address=89.149.201.147:4005 , piece_id=27IBEU4BYZCGDNOUDCRTQZFZ35W3BLQGERULMCKVWFGWZ7676RPQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.902438327 (5h14m17.251745603s) [noise=true , address=81.171.14.70:4039 , piece_id=S5634HCFPYT7SJGH5BPZ3OJZDIAJ5YYSXCUWGIYVIJ2WPQAEWEPQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.917540715 (5h14m17.266847991s) [noise=true , address=89.149.201.147:4017 , piece_id=Q4AHXE26ASEWAANQIW55O433TDNA3RPYX7KCEZVPDET264I5DV3Q, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.926674337 (5h14m17.275981623s) [noise=true , address=89.149.201.147:4020 , piece_id=7O5NTDXJMZL7XX7EJJZMSCLQPS2KBXW2ASVMGFKBKDASUOJ5KYQA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.328819374 (5h14m17.67812666s) [noise=true , address=81.171.14.70:4030 , piece_id=ZTVTBK2E7IGYOYZMK6TTHKMMBST52RCZVKM776PV3USLXONMH66Q, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.349296225 (5h14m17.698603501s) [noise=true , address=89.149.201.147:4011 , piece_id=KQM7L432OU7BYKWL2QHAIKRNPKPA7NOPSZJDOAAFQEGV66PZMGTA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.352514193 (5h14m17.701821479s) [noise=true , address=89.149.201.147:4012 , piece_id=VGEAVYUXQB6F4OF7BCCCZGGI4S2OT5BXXDFSEMHGLMOUAPFCPXDQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.380253194 (5h14m17.72956049s) [noise=true , address=185.167.204.205:4030 , piece_id=35Y5DRDZZHA7LEUZDJQ36RU4MB6DQN2AAIG7E45EIC6YM3MQ7HHQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.385432055 (5h14m17.734739341s) [noise=true , address=185.167.204.205:4023 , piece_id=ACMLGJMZ5H25VH7VULKAIBWIHIAEE2AV366UEZFOJDZRNQ4NGYLA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.388082382 (5h14m17.737389678s) [noise=true , address=185.167.204.206:4040 , piece_id=PDSOHIACMQCDA6NQQZWS4YUI57BMU4DJY5GKRPR7JVLLFVZXDJXQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.391016018 (5h14m17.740323304s) [noise=true , address=185.167.204.206:4056 , piece_id=G5D6SI6CVQHAVSAPS6GJRVZIQ4YQ23PFH7KL26TVK4I4BBTW2C5A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.396014777 (5h14m17.745322053s) [noise=true , address=185.167.204.206:4052 , piece_id=RTBLKXBTFLJOSBGSMSZ6HJNPDSM5GPO67VVRHP3OAK5DF5QFAVCQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.401559615 (5h14m17.750866901s) [noise=true , address=185.167.204.205:4002 , piece_id=U57ZVYRVT2L35FNA2N6ODTLEP3PN3TPP5ZYSONBXJYXWE5K43S6A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.414355180 (5h14m17.763662466s) [noise=true , address=185.167.204.206:4041 , piece_id=NUWDUCCNI44ANZLNYISQQKFSBK7WYTPAPGQ6JJ43IP44LNCLT4SA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.421539241 (5h14m17.770846537s) [noise=true , address=185.167.204.206:4048 , piece_id=HD65TI6UG22CW34RKIVC5RMYIOUIYHL72BJZYL55XHCX3HQMZYHA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.423334288 (5h14m17.772641574s) [noise=true , address=185.167.204.205:4010 , piece_id=Q35AS6W5CQL2OMHIEPI7GVR6NS7IEJ6LCFXZEWGFEWL6XENNNVIA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.447102799 (5h14m17.796410075s) [noise=true , address=185.167.204.205:4012 , piece_id=JKUFH3UD6ACMEQWRFYJ2F5P5ZJQKYCA6E7FXTHBF7MNQA6EKLXGA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.473754258 (5h14m17.823061544s) [noise=true , address=185.167.204.206:4066 , piece_id=KKDV46RFAENAUYDYRPDCV64LWX5RB7JVRKB3HY7BXB4LU7DITSLA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.481151965 (5h14m17.830459251s) [noise=true , address=185.167.204.205:4019 , piece_id=7LYDTS6D3HQSDMVBCMRLB5NZIRLP44VRSWCUT5EKSGSRPWP4RHIA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.486154732 (5h14m17.835462018s) [noise=true , address=185.167.204.205:4001 , piece_id=Z22S36XDBYL5COSP36N575LMSLJVC6AP4ZXFNXNMRTVN23HTP5XA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:57.813202781 (5h15m15.162510068s) [noise=true , address=185.167.204.206:4053 , piece_id=UFA7HABPN4LRP7RSCHBHNXT5AMEDFUF3DSYEGWBFSXOTOXRQXT7A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 19:57:57.813463338 (5h15m15.162770614s) [noise=true , address=185.167.204.206:4047 , piece_id=Z2QX5FHJKEZVW4FXDV2NNUMXEBVPGEW4Z7C3GBVZRUTNFR4MA5IA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: ecclient: upload failed (node:12M7W4Yno5rMgemSC7nJd42asmZXqUY9cCyY7mtFFHEh8iqAhCF, address:185.167.204.206:4047): protocol: write tcp 188.166.225.170:59506->185.167.204.206:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 19:57:57.813491391 (5h15m15.162798677s) [noise=true , address=185.167.204.205:4013 , piece_id=KICB6KLFDM3KFOGJ52UVXO3G4BUPSSJF657ZIWUIVP56M2SLGMWA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: context deadline exceeded; context deadline exceeded Oct 27 19:57:57.813536527 (5h15m15.162843813s) [seg_pos={0 0}, upload=4621]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Oct 27 19:57:58.016780515 (5h15m15.366087802s) [upload=4621]: Done uploading segments... Oct 27 19:57:58.016879354 (5h15m15.36618663s) [upload=4621]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 4.967577583s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=3) [.........................X........................X.........] duration: 3.473438745s FAIL (2025-10-27 20:37:03 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.473466438s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 5.012406137s FAIL (2025-10-27 20:36:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== eg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577374904 (5h14m15.926682211s) [noise=true , address=89.149.201.147:4020 , piece_id=7O5NTDXJMZL7XX7EJJZMSCLQPS2KBXW2ASVMGFKBKDASUOJ5KYQA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577388009 (5h14m15.926695285s) [noise=true , address=185.167.204.206:4052 , piece_id=RTBLKXBTFLJOSBGSMSZ6HJNPDSM5GPO67VVRHP3OAK5DF5QFAVCQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577699713 (5h14m15.927006989s) [noise=true , address=89.149.201.147:4012 , piece_id=VGEAVYUXQB6F4OF7BCCCZGGI4S2OT5BXXDFSEMHGLMOUAPFCPXDQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577834229 (5h14m15.927141505s) [noise=true , address=89.149.201.147:4017 , piece_id=Q4AHXE26ASEWAANQIW55O433TDNA3RPYX7KCEZVPDET264I5DV3Q, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578014502 (5h14m15.927321778s) [noise=true , address=89.149.201.147:4007 , piece_id=6YAZLKZQ3IRZ3KU4M2MVAAOBEPJZGLFJAS6A4BPSNUPCNNVQHDDQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578280880 (5h14m15.927588156s) [noise=true , address=185.167.204.205:4001 , piece_id=Z22S36XDBYL5COSP36N575LMSLJVC6AP4ZXFNXNMRTVN23HTP5XA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578608904 (5h14m15.92791618s) [noise=true , address=185.167.204.205:4012 , piece_id=JKUFH3UD6ACMEQWRFYJ2F5P5ZJQKYCA6E7FXTHBF7MNQA6EKLXGA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578935426 (5h14m15.928242712s) [noise=true , address=185.167.204.206:4048 , piece_id=HD65TI6UG22CW34RKIVC5RMYIOUIYHL72BJZYL55XHCX3HQMZYHA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579041648 (5h14m15.928348924s) [noise=true , address=185.167.204.205:4002 , piece_id=U57ZVYRVT2L35FNA2N6ODTLEP3PN3TPP5ZYSONBXJYXWE5K43S6A, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579222723 (5h14m15.928529999s) [noise=true , address=185.167.204.206:4040 , piece_id=PDSOHIACMQCDA6NQQZWS4YUI57BMU4DJY5GKRPR7JVLLFVZXDJXQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579486625 (5h14m15.928793901s) [noise=true , address=185.167.204.205:4010 , piece_id=Q35AS6W5CQL2OMHIEPI7GVR6NS7IEJ6LCFXZEWGFEWL6XENNNVIA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579780545 (5h14m15.929087821s) [noise=true , address=81.171.14.70:4039 , piece_id=S5634HCFPYT7SJGH5BPZ3OJZDIAJ5YYSXCUWGIYVIJ2WPQAEWEPQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.580102097 (5h14m15.929409403s) [noise=true , address=89.149.201.147:4005 , piece_id=27IBEU4BYZCGDNOUDCRTQZFZ35W3BLQGERULMCKVWFGWZ7676RPQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:59.402940250 (5h14m16.752247547s) [upload=4621]: Next returned nil segment Oct 27 19:56:59.402970929 (5h14m16.752278235s) [upload=4621]: Waiting for error group managing segments... Oct 27 19:56:59.801926071 (5h14m17.151233347s) [noise=true , address=81.171.14.70:4034 , piece_id=QQXBWVXWX24ETMCIFZ7LTONF3LVGL3RLDXXSIQGX62PLWPJSFM5A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.811249835 (5h14m17.160557121s) [noise=true , address=81.171.14.70:4048 , piece_id=PR2HDQTP5VKTMF7HG6VNKKUJD66LC2HKQVAZUGEZKKZNKH2QCZFQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.858197924 (5h14m17.20750521s) [noise=true , address=89.149.201.147:4007 , piece_id=6YAZLKZQ3IRZ3KU4M2MVAAOBEPJZGLFJAS6A4BPSNUPCNNVQHDDQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.897902089 (5h14m17.247209375s) [noise=true , address=89.149.201.147:4023 , piece_id=LEEWZDLYWPSSUDRIPEQK4NKC4PFF6JVLEBPZMQJLWCG4YZHRFQ3A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.901773520 (5h14m17.251080806s) [noise=true , address=89.149.201.147:4010 , piece_id=TRY6HG262YJRDUVNLLHRYG554BVP4J5TWPGHJUVN5N55WHU3C4ZA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.902238556 (5h14m17.251545842s) [noise=true , address=89.149.201.147:4005 , piece_id=27IBEU4BYZCGDNOUDCRTQZFZ35W3BLQGERULMCKVWFGWZ7676RPQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.902438327 (5h14m17.251745603s) [noise=true , address=81.171.14.70:4039 , piece_id=S5634HCFPYT7SJGH5BPZ3OJZDIAJ5YYSXCUWGIYVIJ2WPQAEWEPQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.917540715 (5h14m17.266847991s) [noise=true , address=89.149.201.147:4017 , piece_id=Q4AHXE26ASEWAANQIW55O433TDNA3RPYX7KCEZVPDET264I5DV3Q, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.926674337 (5h14m17.275981623s) [noise=true , address=89.149.201.147:4020 , piece_id=7O5NTDXJMZL7XX7EJJZMSCLQPS2KBXW2ASVMGFKBKDASUOJ5KYQA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.328819374 (5h14m17.67812666s) [noise=true , address=81.171.14.70:4030 , piece_id=ZTVTBK2E7IGYOYZMK6TTHKMMBST52RCZVKM776PV3USLXONMH66Q, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.349296225 (5h14m17.698603501s) [noise=true , address=89.149.201.147:4011 , piece_id=KQM7L432OU7BYKWL2QHAIKRNPKPA7NOPSZJDOAAFQEGV66PZMGTA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.352514193 (5h14m17.701821479s) [noise=true , address=89.149.201.147:4012 , piece_id=VGEAVYUXQB6F4OF7BCCCZGGI4S2OT5BXXDFSEMHGLMOUAPFCPXDQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.380253194 (5h14m17.72956049s) [noise=true , address=185.167.204.205:4030 , piece_id=35Y5DRDZZHA7LEUZDJQ36RU4MB6DQN2AAIG7E45EIC6YM3MQ7HHQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.385432055 (5h14m17.734739341s) [noise=true , address=185.167.204.205:4023 , piece_id=ACMLGJMZ5H25VH7VULKAIBWIHIAEE2AV366UEZFOJDZRNQ4NGYLA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.388082382 (5h14m17.737389678s) [noise=true , address=185.167.204.206:4040 , piece_id=PDSOHIACMQCDA6NQQZWS4YUI57BMU4DJY5GKRPR7JVLLFVZXDJXQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.391016018 (5h14m17.740323304s) [noise=true , address=185.167.204.206:4056 , piece_id=G5D6SI6CVQHAVSAPS6GJRVZIQ4YQ23PFH7KL26TVK4I4BBTW2C5A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.396014777 (5h14m17.745322053s) [noise=true , address=185.167.204.206:4052 , piece_id=RTBLKXBTFLJOSBGSMSZ6HJNPDSM5GPO67VVRHP3OAK5DF5QFAVCQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.401559615 (5h14m17.750866901s) [noise=true , address=185.167.204.205:4002 , piece_id=U57ZVYRVT2L35FNA2N6ODTLEP3PN3TPP5ZYSONBXJYXWE5K43S6A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.414355180 (5h14m17.763662466s) [noise=true , address=185.167.204.206:4041 , piece_id=NUWDUCCNI44ANZLNYISQQKFSBK7WYTPAPGQ6JJ43IP44LNCLT4SA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.421539241 (5h14m17.770846537s) [noise=true , address=185.167.204.206:4048 , piece_id=HD65TI6UG22CW34RKIVC5RMYIOUIYHL72BJZYL55XHCX3HQMZYHA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.423334288 (5h14m17.772641574s) [noise=true , address=185.167.204.205:4010 , piece_id=Q35AS6W5CQL2OMHIEPI7GVR6NS7IEJ6LCFXZEWGFEWL6XENNNVIA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.447102799 (5h14m17.796410075s) [noise=true , address=185.167.204.205:4012 , piece_id=JKUFH3UD6ACMEQWRFYJ2F5P5ZJQKYCA6E7FXTHBF7MNQA6EKLXGA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.473754258 (5h14m17.823061544s) [noise=true , address=185.167.204.206:4066 , piece_id=KKDV46RFAENAUYDYRPDCV64LWX5RB7JVRKB3HY7BXB4LU7DITSLA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.481151965 (5h14m17.830459251s) [noise=true , address=185.167.204.205:4019 , piece_id=7LYDTS6D3HQSDMVBCMRLB5NZIRLP44VRSWCUT5EKSGSRPWP4RHIA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.486154732 (5h14m17.835462018s) [noise=true , address=185.167.204.205:4001 , piece_id=Z22S36XDBYL5COSP36N575LMSLJVC6AP4ZXFNXNMRTVN23HTP5XA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:57.813202781 (5h15m15.162510068s) [noise=true , address=185.167.204.206:4053 , piece_id=UFA7HABPN4LRP7RSCHBHNXT5AMEDFUF3DSYEGWBFSXOTOXRQXT7A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 19:57:57.813463338 (5h15m15.162770614s) [noise=true , address=185.167.204.206:4047 , piece_id=Z2QX5FHJKEZVW4FXDV2NNUMXEBVPGEW4Z7C3GBVZRUTNFR4MA5IA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: ecclient: upload failed (node:12M7W4Yno5rMgemSC7nJd42asmZXqUY9cCyY7mtFFHEh8iqAhCF, address:185.167.204.206:4047): protocol: write tcp 188.166.225.170:59506->185.167.204.206:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 19:57:57.813491391 (5h15m15.162798677s) [noise=true , address=185.167.204.205:4013 , piece_id=KICB6KLFDM3KFOGJ52UVXO3G4BUPSSJF657ZIWUIVP56M2SLGMWA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: context deadline exceeded; context deadline exceeded Oct 27 19:57:57.813536527 (5h15m15.162843813s) [seg_pos={0 0}, upload=4621]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Oct 27 19:57:58.016780515 (5h15m15.366087802s) [upload=4621]: Done uploading segments... Oct 27 19:57:58.016879354 (5h15m15.36618663s) [upload=4621]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 5.012449999s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 4.99343423s FAIL (2025-10-27 20:36:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== eg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577374904 (5h14m15.926682211s) [noise=true , address=89.149.201.147:4020 , piece_id=7O5NTDXJMZL7XX7EJJZMSCLQPS2KBXW2ASVMGFKBKDASUOJ5KYQA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577388009 (5h14m15.926695285s) [noise=true , address=185.167.204.206:4052 , piece_id=RTBLKXBTFLJOSBGSMSZ6HJNPDSM5GPO67VVRHP3OAK5DF5QFAVCQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577699713 (5h14m15.927006989s) [noise=true , address=89.149.201.147:4012 , piece_id=VGEAVYUXQB6F4OF7BCCCZGGI4S2OT5BXXDFSEMHGLMOUAPFCPXDQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577834229 (5h14m15.927141505s) [noise=true , address=89.149.201.147:4017 , piece_id=Q4AHXE26ASEWAANQIW55O433TDNA3RPYX7KCEZVPDET264I5DV3Q, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578014502 (5h14m15.927321778s) [noise=true , address=89.149.201.147:4007 , piece_id=6YAZLKZQ3IRZ3KU4M2MVAAOBEPJZGLFJAS6A4BPSNUPCNNVQHDDQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578280880 (5h14m15.927588156s) [noise=true , address=185.167.204.205:4001 , piece_id=Z22S36XDBYL5COSP36N575LMSLJVC6AP4ZXFNXNMRTVN23HTP5XA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578608904 (5h14m15.92791618s) [noise=true , address=185.167.204.205:4012 , piece_id=JKUFH3UD6ACMEQWRFYJ2F5P5ZJQKYCA6E7FXTHBF7MNQA6EKLXGA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578935426 (5h14m15.928242712s) [noise=true , address=185.167.204.206:4048 , piece_id=HD65TI6UG22CW34RKIVC5RMYIOUIYHL72BJZYL55XHCX3HQMZYHA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579041648 (5h14m15.928348924s) [noise=true , address=185.167.204.205:4002 , piece_id=U57ZVYRVT2L35FNA2N6ODTLEP3PN3TPP5ZYSONBXJYXWE5K43S6A, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579222723 (5h14m15.928529999s) [noise=true , address=185.167.204.206:4040 , piece_id=PDSOHIACMQCDA6NQQZWS4YUI57BMU4DJY5GKRPR7JVLLFVZXDJXQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579486625 (5h14m15.928793901s) [noise=true , address=185.167.204.205:4010 , piece_id=Q35AS6W5CQL2OMHIEPI7GVR6NS7IEJ6LCFXZEWGFEWL6XENNNVIA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579780545 (5h14m15.929087821s) [noise=true , address=81.171.14.70:4039 , piece_id=S5634HCFPYT7SJGH5BPZ3OJZDIAJ5YYSXCUWGIYVIJ2WPQAEWEPQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.580102097 (5h14m15.929409403s) [noise=true , address=89.149.201.147:4005 , piece_id=27IBEU4BYZCGDNOUDCRTQZFZ35W3BLQGERULMCKVWFGWZ7676RPQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:59.402940250 (5h14m16.752247547s) [upload=4621]: Next returned nil segment Oct 27 19:56:59.402970929 (5h14m16.752278235s) [upload=4621]: Waiting for error group managing segments... Oct 27 19:56:59.801926071 (5h14m17.151233347s) [noise=true , address=81.171.14.70:4034 , piece_id=QQXBWVXWX24ETMCIFZ7LTONF3LVGL3RLDXXSIQGX62PLWPJSFM5A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.811249835 (5h14m17.160557121s) [noise=true , address=81.171.14.70:4048 , piece_id=PR2HDQTP5VKTMF7HG6VNKKUJD66LC2HKQVAZUGEZKKZNKH2QCZFQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.858197924 (5h14m17.20750521s) [noise=true , address=89.149.201.147:4007 , piece_id=6YAZLKZQ3IRZ3KU4M2MVAAOBEPJZGLFJAS6A4BPSNUPCNNVQHDDQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.897902089 (5h14m17.247209375s) [noise=true , address=89.149.201.147:4023 , piece_id=LEEWZDLYWPSSUDRIPEQK4NKC4PFF6JVLEBPZMQJLWCG4YZHRFQ3A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.901773520 (5h14m17.251080806s) [noise=true , address=89.149.201.147:4010 , piece_id=TRY6HG262YJRDUVNLLHRYG554BVP4J5TWPGHJUVN5N55WHU3C4ZA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.902238556 (5h14m17.251545842s) [noise=true , address=89.149.201.147:4005 , piece_id=27IBEU4BYZCGDNOUDCRTQZFZ35W3BLQGERULMCKVWFGWZ7676RPQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.902438327 (5h14m17.251745603s) [noise=true , address=81.171.14.70:4039 , piece_id=S5634HCFPYT7SJGH5BPZ3OJZDIAJ5YYSXCUWGIYVIJ2WPQAEWEPQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.917540715 (5h14m17.266847991s) [noise=true , address=89.149.201.147:4017 , piece_id=Q4AHXE26ASEWAANQIW55O433TDNA3RPYX7KCEZVPDET264I5DV3Q, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.926674337 (5h14m17.275981623s) [noise=true , address=89.149.201.147:4020 , piece_id=7O5NTDXJMZL7XX7EJJZMSCLQPS2KBXW2ASVMGFKBKDASUOJ5KYQA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.328819374 (5h14m17.67812666s) [noise=true , address=81.171.14.70:4030 , piece_id=ZTVTBK2E7IGYOYZMK6TTHKMMBST52RCZVKM776PV3USLXONMH66Q, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.349296225 (5h14m17.698603501s) [noise=true , address=89.149.201.147:4011 , piece_id=KQM7L432OU7BYKWL2QHAIKRNPKPA7NOPSZJDOAAFQEGV66PZMGTA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.352514193 (5h14m17.701821479s) [noise=true , address=89.149.201.147:4012 , piece_id=VGEAVYUXQB6F4OF7BCCCZGGI4S2OT5BXXDFSEMHGLMOUAPFCPXDQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.380253194 (5h14m17.72956049s) [noise=true , address=185.167.204.205:4030 , piece_id=35Y5DRDZZHA7LEUZDJQ36RU4MB6DQN2AAIG7E45EIC6YM3MQ7HHQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.385432055 (5h14m17.734739341s) [noise=true , address=185.167.204.205:4023 , piece_id=ACMLGJMZ5H25VH7VULKAIBWIHIAEE2AV366UEZFOJDZRNQ4NGYLA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.388082382 (5h14m17.737389678s) [noise=true , address=185.167.204.206:4040 , piece_id=PDSOHIACMQCDA6NQQZWS4YUI57BMU4DJY5GKRPR7JVLLFVZXDJXQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.391016018 (5h14m17.740323304s) [noise=true , address=185.167.204.206:4056 , piece_id=G5D6SI6CVQHAVSAPS6GJRVZIQ4YQ23PFH7KL26TVK4I4BBTW2C5A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.396014777 (5h14m17.745322053s) [noise=true , address=185.167.204.206:4052 , piece_id=RTBLKXBTFLJOSBGSMSZ6HJNPDSM5GPO67VVRHP3OAK5DF5QFAVCQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.401559615 (5h14m17.750866901s) [noise=true , address=185.167.204.205:4002 , piece_id=U57ZVYRVT2L35FNA2N6ODTLEP3PN3TPP5ZYSONBXJYXWE5K43S6A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.414355180 (5h14m17.763662466s) [noise=true , address=185.167.204.206:4041 , piece_id=NUWDUCCNI44ANZLNYISQQKFSBK7WYTPAPGQ6JJ43IP44LNCLT4SA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.421539241 (5h14m17.770846537s) [noise=true , address=185.167.204.206:4048 , piece_id=HD65TI6UG22CW34RKIVC5RMYIOUIYHL72BJZYL55XHCX3HQMZYHA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.423334288 (5h14m17.772641574s) [noise=true , address=185.167.204.205:4010 , piece_id=Q35AS6W5CQL2OMHIEPI7GVR6NS7IEJ6LCFXZEWGFEWL6XENNNVIA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.447102799 (5h14m17.796410075s) [noise=true , address=185.167.204.205:4012 , piece_id=JKUFH3UD6ACMEQWRFYJ2F5P5ZJQKYCA6E7FXTHBF7MNQA6EKLXGA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.473754258 (5h14m17.823061544s) [noise=true , address=185.167.204.206:4066 , piece_id=KKDV46RFAENAUYDYRPDCV64LWX5RB7JVRKB3HY7BXB4LU7DITSLA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.481151965 (5h14m17.830459251s) [noise=true , address=185.167.204.205:4019 , piece_id=7LYDTS6D3HQSDMVBCMRLB5NZIRLP44VRSWCUT5EKSGSRPWP4RHIA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.486154732 (5h14m17.835462018s) [noise=true , address=185.167.204.205:4001 , piece_id=Z22S36XDBYL5COSP36N575LMSLJVC6AP4ZXFNXNMRTVN23HTP5XA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:57.813202781 (5h15m15.162510068s) [noise=true , address=185.167.204.206:4053 , piece_id=UFA7HABPN4LRP7RSCHBHNXT5AMEDFUF3DSYEGWBFSXOTOXRQXT7A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 19:57:57.813463338 (5h15m15.162770614s) [noise=true , address=185.167.204.206:4047 , piece_id=Z2QX5FHJKEZVW4FXDV2NNUMXEBVPGEW4Z7C3GBVZRUTNFR4MA5IA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: ecclient: upload failed (node:12M7W4Yno5rMgemSC7nJd42asmZXqUY9cCyY7mtFFHEh8iqAhCF, address:185.167.204.206:4047): protocol: write tcp 188.166.225.170:59506->185.167.204.206:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 19:57:57.813491391 (5h15m15.162798677s) [noise=true , address=185.167.204.205:4013 , piece_id=KICB6KLFDM3KFOGJ52UVXO3G4BUPSSJF657ZIWUIVP56M2SLGMWA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: context deadline exceeded; context deadline exceeded Oct 27 19:57:57.813536527 (5h15m15.162843813s) [seg_pos={0 0}, upload=4621]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Oct 27 19:57:58.016780515 (5h15m15.366087802s) [upload=4621]: Done uploading segments... Oct 27 19:57:58.016879354 (5h15m15.36618663s) [upload=4621]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 4.993462404s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=3) [..........................X........................X........] duration: 3.386557997s FAIL (2025-10-27 20:36:11 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.386608342s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 5.027374689s FAIL (2025-10-27 20:35:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== eg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577374904 (5h14m15.926682211s) [noise=true , address=89.149.201.147:4020 , piece_id=7O5NTDXJMZL7XX7EJJZMSCLQPS2KBXW2ASVMGFKBKDASUOJ5KYQA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577388009 (5h14m15.926695285s) [noise=true , address=185.167.204.206:4052 , piece_id=RTBLKXBTFLJOSBGSMSZ6HJNPDSM5GPO67VVRHP3OAK5DF5QFAVCQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577699713 (5h14m15.927006989s) [noise=true , address=89.149.201.147:4012 , piece_id=VGEAVYUXQB6F4OF7BCCCZGGI4S2OT5BXXDFSEMHGLMOUAPFCPXDQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577834229 (5h14m15.927141505s) [noise=true , address=89.149.201.147:4017 , piece_id=Q4AHXE26ASEWAANQIW55O433TDNA3RPYX7KCEZVPDET264I5DV3Q, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578014502 (5h14m15.927321778s) [noise=true , address=89.149.201.147:4007 , piece_id=6YAZLKZQ3IRZ3KU4M2MVAAOBEPJZGLFJAS6A4BPSNUPCNNVQHDDQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578280880 (5h14m15.927588156s) [noise=true , address=185.167.204.205:4001 , piece_id=Z22S36XDBYL5COSP36N575LMSLJVC6AP4ZXFNXNMRTVN23HTP5XA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578608904 (5h14m15.92791618s) [noise=true , address=185.167.204.205:4012 , piece_id=JKUFH3UD6ACMEQWRFYJ2F5P5ZJQKYCA6E7FXTHBF7MNQA6EKLXGA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578935426 (5h14m15.928242712s) [noise=true , address=185.167.204.206:4048 , piece_id=HD65TI6UG22CW34RKIVC5RMYIOUIYHL72BJZYL55XHCX3HQMZYHA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579041648 (5h14m15.928348924s) [noise=true , address=185.167.204.205:4002 , piece_id=U57ZVYRVT2L35FNA2N6ODTLEP3PN3TPP5ZYSONBXJYXWE5K43S6A, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579222723 (5h14m15.928529999s) [noise=true , address=185.167.204.206:4040 , piece_id=PDSOHIACMQCDA6NQQZWS4YUI57BMU4DJY5GKRPR7JVLLFVZXDJXQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579486625 (5h14m15.928793901s) [noise=true , address=185.167.204.205:4010 , piece_id=Q35AS6W5CQL2OMHIEPI7GVR6NS7IEJ6LCFXZEWGFEWL6XENNNVIA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579780545 (5h14m15.929087821s) [noise=true , address=81.171.14.70:4039 , piece_id=S5634HCFPYT7SJGH5BPZ3OJZDIAJ5YYSXCUWGIYVIJ2WPQAEWEPQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.580102097 (5h14m15.929409403s) [noise=true , address=89.149.201.147:4005 , piece_id=27IBEU4BYZCGDNOUDCRTQZFZ35W3BLQGERULMCKVWFGWZ7676RPQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:59.402940250 (5h14m16.752247547s) [upload=4621]: Next returned nil segment Oct 27 19:56:59.402970929 (5h14m16.752278235s) [upload=4621]: Waiting for error group managing segments... Oct 27 19:56:59.801926071 (5h14m17.151233347s) [noise=true , address=81.171.14.70:4034 , piece_id=QQXBWVXWX24ETMCIFZ7LTONF3LVGL3RLDXXSIQGX62PLWPJSFM5A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.811249835 (5h14m17.160557121s) [noise=true , address=81.171.14.70:4048 , piece_id=PR2HDQTP5VKTMF7HG6VNKKUJD66LC2HKQVAZUGEZKKZNKH2QCZFQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.858197924 (5h14m17.20750521s) [noise=true , address=89.149.201.147:4007 , piece_id=6YAZLKZQ3IRZ3KU4M2MVAAOBEPJZGLFJAS6A4BPSNUPCNNVQHDDQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.897902089 (5h14m17.247209375s) [noise=true , address=89.149.201.147:4023 , piece_id=LEEWZDLYWPSSUDRIPEQK4NKC4PFF6JVLEBPZMQJLWCG4YZHRFQ3A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.901773520 (5h14m17.251080806s) [noise=true , address=89.149.201.147:4010 , piece_id=TRY6HG262YJRDUVNLLHRYG554BVP4J5TWPGHJUVN5N55WHU3C4ZA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.902238556 (5h14m17.251545842s) [noise=true , address=89.149.201.147:4005 , piece_id=27IBEU4BYZCGDNOUDCRTQZFZ35W3BLQGERULMCKVWFGWZ7676RPQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.902438327 (5h14m17.251745603s) [noise=true , address=81.171.14.70:4039 , piece_id=S5634HCFPYT7SJGH5BPZ3OJZDIAJ5YYSXCUWGIYVIJ2WPQAEWEPQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.917540715 (5h14m17.266847991s) [noise=true , address=89.149.201.147:4017 , piece_id=Q4AHXE26ASEWAANQIW55O433TDNA3RPYX7KCEZVPDET264I5DV3Q, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.926674337 (5h14m17.275981623s) [noise=true , address=89.149.201.147:4020 , piece_id=7O5NTDXJMZL7XX7EJJZMSCLQPS2KBXW2ASVMGFKBKDASUOJ5KYQA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.328819374 (5h14m17.67812666s) [noise=true , address=81.171.14.70:4030 , piece_id=ZTVTBK2E7IGYOYZMK6TTHKMMBST52RCZVKM776PV3USLXONMH66Q, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.349296225 (5h14m17.698603501s) [noise=true , address=89.149.201.147:4011 , piece_id=KQM7L432OU7BYKWL2QHAIKRNPKPA7NOPSZJDOAAFQEGV66PZMGTA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.352514193 (5h14m17.701821479s) [noise=true , address=89.149.201.147:4012 , piece_id=VGEAVYUXQB6F4OF7BCCCZGGI4S2OT5BXXDFSEMHGLMOUAPFCPXDQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.380253194 (5h14m17.72956049s) [noise=true , address=185.167.204.205:4030 , piece_id=35Y5DRDZZHA7LEUZDJQ36RU4MB6DQN2AAIG7E45EIC6YM3MQ7HHQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.385432055 (5h14m17.734739341s) [noise=true , address=185.167.204.205:4023 , piece_id=ACMLGJMZ5H25VH7VULKAIBWIHIAEE2AV366UEZFOJDZRNQ4NGYLA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.388082382 (5h14m17.737389678s) [noise=true , address=185.167.204.206:4040 , piece_id=PDSOHIACMQCDA6NQQZWS4YUI57BMU4DJY5GKRPR7JVLLFVZXDJXQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.391016018 (5h14m17.740323304s) [noise=true , address=185.167.204.206:4056 , piece_id=G5D6SI6CVQHAVSAPS6GJRVZIQ4YQ23PFH7KL26TVK4I4BBTW2C5A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.396014777 (5h14m17.745322053s) [noise=true , address=185.167.204.206:4052 , piece_id=RTBLKXBTFLJOSBGSMSZ6HJNPDSM5GPO67VVRHP3OAK5DF5QFAVCQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.401559615 (5h14m17.750866901s) [noise=true , address=185.167.204.205:4002 , piece_id=U57ZVYRVT2L35FNA2N6ODTLEP3PN3TPP5ZYSONBXJYXWE5K43S6A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.414355180 (5h14m17.763662466s) [noise=true , address=185.167.204.206:4041 , piece_id=NUWDUCCNI44ANZLNYISQQKFSBK7WYTPAPGQ6JJ43IP44LNCLT4SA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.421539241 (5h14m17.770846537s) [noise=true , address=185.167.204.206:4048 , piece_id=HD65TI6UG22CW34RKIVC5RMYIOUIYHL72BJZYL55XHCX3HQMZYHA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.423334288 (5h14m17.772641574s) [noise=true , address=185.167.204.205:4010 , piece_id=Q35AS6W5CQL2OMHIEPI7GVR6NS7IEJ6LCFXZEWGFEWL6XENNNVIA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.447102799 (5h14m17.796410075s) [noise=true , address=185.167.204.205:4012 , piece_id=JKUFH3UD6ACMEQWRFYJ2F5P5ZJQKYCA6E7FXTHBF7MNQA6EKLXGA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.473754258 (5h14m17.823061544s) [noise=true , address=185.167.204.206:4066 , piece_id=KKDV46RFAENAUYDYRPDCV64LWX5RB7JVRKB3HY7BXB4LU7DITSLA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.481151965 (5h14m17.830459251s) [noise=true , address=185.167.204.205:4019 , piece_id=7LYDTS6D3HQSDMVBCMRLB5NZIRLP44VRSWCUT5EKSGSRPWP4RHIA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.486154732 (5h14m17.835462018s) [noise=true , address=185.167.204.205:4001 , piece_id=Z22S36XDBYL5COSP36N575LMSLJVC6AP4ZXFNXNMRTVN23HTP5XA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:57.813202781 (5h15m15.162510068s) [noise=true , address=185.167.204.206:4053 , piece_id=UFA7HABPN4LRP7RSCHBHNXT5AMEDFUF3DSYEGWBFSXOTOXRQXT7A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 19:57:57.813463338 (5h15m15.162770614s) [noise=true , address=185.167.204.206:4047 , piece_id=Z2QX5FHJKEZVW4FXDV2NNUMXEBVPGEW4Z7C3GBVZRUTNFR4MA5IA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: ecclient: upload failed (node:12M7W4Yno5rMgemSC7nJd42asmZXqUY9cCyY7mtFFHEh8iqAhCF, address:185.167.204.206:4047): protocol: write tcp 188.166.225.170:59506->185.167.204.206:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 19:57:57.813491391 (5h15m15.162798677s) [noise=true , address=185.167.204.205:4013 , piece_id=KICB6KLFDM3KFOGJ52UVXO3G4BUPSSJF657ZIWUIVP56M2SLGMWA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: context deadline exceeded; context deadline exceeded Oct 27 19:57:57.813536527 (5h15m15.162843813s) [seg_pos={0 0}, upload=4621]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Oct 27 19:57:58.016780515 (5h15m15.366087802s) [upload=4621]: Done uploading segments... Oct 27 19:57:58.016879354 (5h15m15.36618663s) [upload=4621]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 5.027398974s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=3) [...........................X........................X.......] duration: 3.501440337s FAIL (2025-10-27 20:34:59 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.501461898s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 4.968934076s FAIL (2025-10-27 20:34:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== eg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577374904 (5h14m15.926682211s) [noise=true , address=89.149.201.147:4020 , piece_id=7O5NTDXJMZL7XX7EJJZMSCLQPS2KBXW2ASVMGFKBKDASUOJ5KYQA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577388009 (5h14m15.926695285s) [noise=true , address=185.167.204.206:4052 , piece_id=RTBLKXBTFLJOSBGSMSZ6HJNPDSM5GPO67VVRHP3OAK5DF5QFAVCQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577699713 (5h14m15.927006989s) [noise=true , address=89.149.201.147:4012 , piece_id=VGEAVYUXQB6F4OF7BCCCZGGI4S2OT5BXXDFSEMHGLMOUAPFCPXDQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577834229 (5h14m15.927141505s) [noise=true , address=89.149.201.147:4017 , piece_id=Q4AHXE26ASEWAANQIW55O433TDNA3RPYX7KCEZVPDET264I5DV3Q, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578014502 (5h14m15.927321778s) [noise=true , address=89.149.201.147:4007 , piece_id=6YAZLKZQ3IRZ3KU4M2MVAAOBEPJZGLFJAS6A4BPSNUPCNNVQHDDQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578280880 (5h14m15.927588156s) [noise=true , address=185.167.204.205:4001 , piece_id=Z22S36XDBYL5COSP36N575LMSLJVC6AP4ZXFNXNMRTVN23HTP5XA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578608904 (5h14m15.92791618s) [noise=true , address=185.167.204.205:4012 , piece_id=JKUFH3UD6ACMEQWRFYJ2F5P5ZJQKYCA6E7FXTHBF7MNQA6EKLXGA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578935426 (5h14m15.928242712s) [noise=true , address=185.167.204.206:4048 , piece_id=HD65TI6UG22CW34RKIVC5RMYIOUIYHL72BJZYL55XHCX3HQMZYHA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579041648 (5h14m15.928348924s) [noise=true , address=185.167.204.205:4002 , piece_id=U57ZVYRVT2L35FNA2N6ODTLEP3PN3TPP5ZYSONBXJYXWE5K43S6A, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579222723 (5h14m15.928529999s) [noise=true , address=185.167.204.206:4040 , piece_id=PDSOHIACMQCDA6NQQZWS4YUI57BMU4DJY5GKRPR7JVLLFVZXDJXQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579486625 (5h14m15.928793901s) [noise=true , address=185.167.204.205:4010 , piece_id=Q35AS6W5CQL2OMHIEPI7GVR6NS7IEJ6LCFXZEWGFEWL6XENNNVIA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579780545 (5h14m15.929087821s) [noise=true , address=81.171.14.70:4039 , piece_id=S5634HCFPYT7SJGH5BPZ3OJZDIAJ5YYSXCUWGIYVIJ2WPQAEWEPQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.580102097 (5h14m15.929409403s) [noise=true , address=89.149.201.147:4005 , piece_id=27IBEU4BYZCGDNOUDCRTQZFZ35W3BLQGERULMCKVWFGWZ7676RPQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:59.402940250 (5h14m16.752247547s) [upload=4621]: Next returned nil segment Oct 27 19:56:59.402970929 (5h14m16.752278235s) [upload=4621]: Waiting for error group managing segments... Oct 27 19:56:59.801926071 (5h14m17.151233347s) [noise=true , address=81.171.14.70:4034 , piece_id=QQXBWVXWX24ETMCIFZ7LTONF3LVGL3RLDXXSIQGX62PLWPJSFM5A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.811249835 (5h14m17.160557121s) [noise=true , address=81.171.14.70:4048 , piece_id=PR2HDQTP5VKTMF7HG6VNKKUJD66LC2HKQVAZUGEZKKZNKH2QCZFQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.858197924 (5h14m17.20750521s) [noise=true , address=89.149.201.147:4007 , piece_id=6YAZLKZQ3IRZ3KU4M2MVAAOBEPJZGLFJAS6A4BPSNUPCNNVQHDDQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.897902089 (5h14m17.247209375s) [noise=true , address=89.149.201.147:4023 , piece_id=LEEWZDLYWPSSUDRIPEQK4NKC4PFF6JVLEBPZMQJLWCG4YZHRFQ3A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.901773520 (5h14m17.251080806s) [noise=true , address=89.149.201.147:4010 , piece_id=TRY6HG262YJRDUVNLLHRYG554BVP4J5TWPGHJUVN5N55WHU3C4ZA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.902238556 (5h14m17.251545842s) [noise=true , address=89.149.201.147:4005 , piece_id=27IBEU4BYZCGDNOUDCRTQZFZ35W3BLQGERULMCKVWFGWZ7676RPQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.902438327 (5h14m17.251745603s) [noise=true , address=81.171.14.70:4039 , piece_id=S5634HCFPYT7SJGH5BPZ3OJZDIAJ5YYSXCUWGIYVIJ2WPQAEWEPQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.917540715 (5h14m17.266847991s) [noise=true , address=89.149.201.147:4017 , piece_id=Q4AHXE26ASEWAANQIW55O433TDNA3RPYX7KCEZVPDET264I5DV3Q, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.926674337 (5h14m17.275981623s) [noise=true , address=89.149.201.147:4020 , piece_id=7O5NTDXJMZL7XX7EJJZMSCLQPS2KBXW2ASVMGFKBKDASUOJ5KYQA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.328819374 (5h14m17.67812666s) [noise=true , address=81.171.14.70:4030 , piece_id=ZTVTBK2E7IGYOYZMK6TTHKMMBST52RCZVKM776PV3USLXONMH66Q, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.349296225 (5h14m17.698603501s) [noise=true , address=89.149.201.147:4011 , piece_id=KQM7L432OU7BYKWL2QHAIKRNPKPA7NOPSZJDOAAFQEGV66PZMGTA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.352514193 (5h14m17.701821479s) [noise=true , address=89.149.201.147:4012 , piece_id=VGEAVYUXQB6F4OF7BCCCZGGI4S2OT5BXXDFSEMHGLMOUAPFCPXDQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.380253194 (5h14m17.72956049s) [noise=true , address=185.167.204.205:4030 , piece_id=35Y5DRDZZHA7LEUZDJQ36RU4MB6DQN2AAIG7E45EIC6YM3MQ7HHQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.385432055 (5h14m17.734739341s) [noise=true , address=185.167.204.205:4023 , piece_id=ACMLGJMZ5H25VH7VULKAIBWIHIAEE2AV366UEZFOJDZRNQ4NGYLA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.388082382 (5h14m17.737389678s) [noise=true , address=185.167.204.206:4040 , piece_id=PDSOHIACMQCDA6NQQZWS4YUI57BMU4DJY5GKRPR7JVLLFVZXDJXQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.391016018 (5h14m17.740323304s) [noise=true , address=185.167.204.206:4056 , piece_id=G5D6SI6CVQHAVSAPS6GJRVZIQ4YQ23PFH7KL26TVK4I4BBTW2C5A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.396014777 (5h14m17.745322053s) [noise=true , address=185.167.204.206:4052 , piece_id=RTBLKXBTFLJOSBGSMSZ6HJNPDSM5GPO67VVRHP3OAK5DF5QFAVCQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.401559615 (5h14m17.750866901s) [noise=true , address=185.167.204.205:4002 , piece_id=U57ZVYRVT2L35FNA2N6ODTLEP3PN3TPP5ZYSONBXJYXWE5K43S6A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.414355180 (5h14m17.763662466s) [noise=true , address=185.167.204.206:4041 , piece_id=NUWDUCCNI44ANZLNYISQQKFSBK7WYTPAPGQ6JJ43IP44LNCLT4SA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.421539241 (5h14m17.770846537s) [noise=true , address=185.167.204.206:4048 , piece_id=HD65TI6UG22CW34RKIVC5RMYIOUIYHL72BJZYL55XHCX3HQMZYHA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.423334288 (5h14m17.772641574s) [noise=true , address=185.167.204.205:4010 , piece_id=Q35AS6W5CQL2OMHIEPI7GVR6NS7IEJ6LCFXZEWGFEWL6XENNNVIA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.447102799 (5h14m17.796410075s) [noise=true , address=185.167.204.205:4012 , piece_id=JKUFH3UD6ACMEQWRFYJ2F5P5ZJQKYCA6E7FXTHBF7MNQA6EKLXGA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.473754258 (5h14m17.823061544s) [noise=true , address=185.167.204.206:4066 , piece_id=KKDV46RFAENAUYDYRPDCV64LWX5RB7JVRKB3HY7BXB4LU7DITSLA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.481151965 (5h14m17.830459251s) [noise=true , address=185.167.204.205:4019 , piece_id=7LYDTS6D3HQSDMVBCMRLB5NZIRLP44VRSWCUT5EKSGSRPWP4RHIA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.486154732 (5h14m17.835462018s) [noise=true , address=185.167.204.205:4001 , piece_id=Z22S36XDBYL5COSP36N575LMSLJVC6AP4ZXFNXNMRTVN23HTP5XA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:57.813202781 (5h15m15.162510068s) [noise=true , address=185.167.204.206:4053 , piece_id=UFA7HABPN4LRP7RSCHBHNXT5AMEDFUF3DSYEGWBFSXOTOXRQXT7A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 19:57:57.813463338 (5h15m15.162770614s) [noise=true , address=185.167.204.206:4047 , piece_id=Z2QX5FHJKEZVW4FXDV2NNUMXEBVPGEW4Z7C3GBVZRUTNFR4MA5IA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: ecclient: upload failed (node:12M7W4Yno5rMgemSC7nJd42asmZXqUY9cCyY7mtFFHEh8iqAhCF, address:185.167.204.206:4047): protocol: write tcp 188.166.225.170:59506->185.167.204.206:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 19:57:57.813491391 (5h15m15.162798677s) [noise=true , address=185.167.204.205:4013 , piece_id=KICB6KLFDM3KFOGJ52UVXO3G4BUPSSJF657ZIWUIVP56M2SLGMWA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: context deadline exceeded; context deadline exceeded Oct 27 19:57:57.813536527 (5h15m15.162843813s) [seg_pos={0 0}, upload=4621]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Oct 27 19:57:58.016780515 (5h15m15.366087802s) [upload=4621]: Done uploading segments... Oct 27 19:57:58.016879354 (5h15m15.36618663s) [upload=4621]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 4.968960937s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=3) [............................X........................X......] duration: 3.425832067s FAIL (2025-10-27 20:34:41 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.425860229s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 4.98301069s FAIL (2025-10-27 20:34:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== eg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577374904 (5h14m15.926682211s) [noise=true , address=89.149.201.147:4020 , piece_id=7O5NTDXJMZL7XX7EJJZMSCLQPS2KBXW2ASVMGFKBKDASUOJ5KYQA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577388009 (5h14m15.926695285s) [noise=true , address=185.167.204.206:4052 , piece_id=RTBLKXBTFLJOSBGSMSZ6HJNPDSM5GPO67VVRHP3OAK5DF5QFAVCQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577699713 (5h14m15.927006989s) [noise=true , address=89.149.201.147:4012 , piece_id=VGEAVYUXQB6F4OF7BCCCZGGI4S2OT5BXXDFSEMHGLMOUAPFCPXDQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577834229 (5h14m15.927141505s) [noise=true , address=89.149.201.147:4017 , piece_id=Q4AHXE26ASEWAANQIW55O433TDNA3RPYX7KCEZVPDET264I5DV3Q, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578014502 (5h14m15.927321778s) [noise=true , address=89.149.201.147:4007 , piece_id=6YAZLKZQ3IRZ3KU4M2MVAAOBEPJZGLFJAS6A4BPSNUPCNNVQHDDQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578280880 (5h14m15.927588156s) [noise=true , address=185.167.204.205:4001 , piece_id=Z22S36XDBYL5COSP36N575LMSLJVC6AP4ZXFNXNMRTVN23HTP5XA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578608904 (5h14m15.92791618s) [noise=true , address=185.167.204.205:4012 , piece_id=JKUFH3UD6ACMEQWRFYJ2F5P5ZJQKYCA6E7FXTHBF7MNQA6EKLXGA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578935426 (5h14m15.928242712s) [noise=true , address=185.167.204.206:4048 , piece_id=HD65TI6UG22CW34RKIVC5RMYIOUIYHL72BJZYL55XHCX3HQMZYHA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579041648 (5h14m15.928348924s) [noise=true , address=185.167.204.205:4002 , piece_id=U57ZVYRVT2L35FNA2N6ODTLEP3PN3TPP5ZYSONBXJYXWE5K43S6A, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579222723 (5h14m15.928529999s) [noise=true , address=185.167.204.206:4040 , piece_id=PDSOHIACMQCDA6NQQZWS4YUI57BMU4DJY5GKRPR7JVLLFVZXDJXQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579486625 (5h14m15.928793901s) [noise=true , address=185.167.204.205:4010 , piece_id=Q35AS6W5CQL2OMHIEPI7GVR6NS7IEJ6LCFXZEWGFEWL6XENNNVIA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579780545 (5h14m15.929087821s) [noise=true , address=81.171.14.70:4039 , piece_id=S5634HCFPYT7SJGH5BPZ3OJZDIAJ5YYSXCUWGIYVIJ2WPQAEWEPQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.580102097 (5h14m15.929409403s) [noise=true , address=89.149.201.147:4005 , piece_id=27IBEU4BYZCGDNOUDCRTQZFZ35W3BLQGERULMCKVWFGWZ7676RPQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:59.402940250 (5h14m16.752247547s) [upload=4621]: Next returned nil segment Oct 27 19:56:59.402970929 (5h14m16.752278235s) [upload=4621]: Waiting for error group managing segments... Oct 27 19:56:59.801926071 (5h14m17.151233347s) [noise=true , address=81.171.14.70:4034 , piece_id=QQXBWVXWX24ETMCIFZ7LTONF3LVGL3RLDXXSIQGX62PLWPJSFM5A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.811249835 (5h14m17.160557121s) [noise=true , address=81.171.14.70:4048 , piece_id=PR2HDQTP5VKTMF7HG6VNKKUJD66LC2HKQVAZUGEZKKZNKH2QCZFQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.858197924 (5h14m17.20750521s) [noise=true , address=89.149.201.147:4007 , piece_id=6YAZLKZQ3IRZ3KU4M2MVAAOBEPJZGLFJAS6A4BPSNUPCNNVQHDDQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.897902089 (5h14m17.247209375s) [noise=true , address=89.149.201.147:4023 , piece_id=LEEWZDLYWPSSUDRIPEQK4NKC4PFF6JVLEBPZMQJLWCG4YZHRFQ3A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.901773520 (5h14m17.251080806s) [noise=true , address=89.149.201.147:4010 , piece_id=TRY6HG262YJRDUVNLLHRYG554BVP4J5TWPGHJUVN5N55WHU3C4ZA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.902238556 (5h14m17.251545842s) [noise=true , address=89.149.201.147:4005 , piece_id=27IBEU4BYZCGDNOUDCRTQZFZ35W3BLQGERULMCKVWFGWZ7676RPQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.902438327 (5h14m17.251745603s) [noise=true , address=81.171.14.70:4039 , piece_id=S5634HCFPYT7SJGH5BPZ3OJZDIAJ5YYSXCUWGIYVIJ2WPQAEWEPQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.917540715 (5h14m17.266847991s) [noise=true , address=89.149.201.147:4017 , piece_id=Q4AHXE26ASEWAANQIW55O433TDNA3RPYX7KCEZVPDET264I5DV3Q, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.926674337 (5h14m17.275981623s) [noise=true , address=89.149.201.147:4020 , piece_id=7O5NTDXJMZL7XX7EJJZMSCLQPS2KBXW2ASVMGFKBKDASUOJ5KYQA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.328819374 (5h14m17.67812666s) [noise=true , address=81.171.14.70:4030 , piece_id=ZTVTBK2E7IGYOYZMK6TTHKMMBST52RCZVKM776PV3USLXONMH66Q, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.349296225 (5h14m17.698603501s) [noise=true , address=89.149.201.147:4011 , piece_id=KQM7L432OU7BYKWL2QHAIKRNPKPA7NOPSZJDOAAFQEGV66PZMGTA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.352514193 (5h14m17.701821479s) [noise=true , address=89.149.201.147:4012 , piece_id=VGEAVYUXQB6F4OF7BCCCZGGI4S2OT5BXXDFSEMHGLMOUAPFCPXDQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.380253194 (5h14m17.72956049s) [noise=true , address=185.167.204.205:4030 , piece_id=35Y5DRDZZHA7LEUZDJQ36RU4MB6DQN2AAIG7E45EIC6YM3MQ7HHQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.385432055 (5h14m17.734739341s) [noise=true , address=185.167.204.205:4023 , piece_id=ACMLGJMZ5H25VH7VULKAIBWIHIAEE2AV366UEZFOJDZRNQ4NGYLA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.388082382 (5h14m17.737389678s) [noise=true , address=185.167.204.206:4040 , piece_id=PDSOHIACMQCDA6NQQZWS4YUI57BMU4DJY5GKRPR7JVLLFVZXDJXQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.391016018 (5h14m17.740323304s) [noise=true , address=185.167.204.206:4056 , piece_id=G5D6SI6CVQHAVSAPS6GJRVZIQ4YQ23PFH7KL26TVK4I4BBTW2C5A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.396014777 (5h14m17.745322053s) [noise=true , address=185.167.204.206:4052 , piece_id=RTBLKXBTFLJOSBGSMSZ6HJNPDSM5GPO67VVRHP3OAK5DF5QFAVCQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.401559615 (5h14m17.750866901s) [noise=true , address=185.167.204.205:4002 , piece_id=U57ZVYRVT2L35FNA2N6ODTLEP3PN3TPP5ZYSONBXJYXWE5K43S6A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.414355180 (5h14m17.763662466s) [noise=true , address=185.167.204.206:4041 , piece_id=NUWDUCCNI44ANZLNYISQQKFSBK7WYTPAPGQ6JJ43IP44LNCLT4SA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.421539241 (5h14m17.770846537s) [noise=true , address=185.167.204.206:4048 , piece_id=HD65TI6UG22CW34RKIVC5RMYIOUIYHL72BJZYL55XHCX3HQMZYHA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.423334288 (5h14m17.772641574s) [noise=true , address=185.167.204.205:4010 , piece_id=Q35AS6W5CQL2OMHIEPI7GVR6NS7IEJ6LCFXZEWGFEWL6XENNNVIA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.447102799 (5h14m17.796410075s) [noise=true , address=185.167.204.205:4012 , piece_id=JKUFH3UD6ACMEQWRFYJ2F5P5ZJQKYCA6E7FXTHBF7MNQA6EKLXGA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.473754258 (5h14m17.823061544s) [noise=true , address=185.167.204.206:4066 , piece_id=KKDV46RFAENAUYDYRPDCV64LWX5RB7JVRKB3HY7BXB4LU7DITSLA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.481151965 (5h14m17.830459251s) [noise=true , address=185.167.204.205:4019 , piece_id=7LYDTS6D3HQSDMVBCMRLB5NZIRLP44VRSWCUT5EKSGSRPWP4RHIA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.486154732 (5h14m17.835462018s) [noise=true , address=185.167.204.205:4001 , piece_id=Z22S36XDBYL5COSP36N575LMSLJVC6AP4ZXFNXNMRTVN23HTP5XA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:57.813202781 (5h15m15.162510068s) [noise=true , address=185.167.204.206:4053 , piece_id=UFA7HABPN4LRP7RSCHBHNXT5AMEDFUF3DSYEGWBFSXOTOXRQXT7A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 19:57:57.813463338 (5h15m15.162770614s) [noise=true , address=185.167.204.206:4047 , piece_id=Z2QX5FHJKEZVW4FXDV2NNUMXEBVPGEW4Z7C3GBVZRUTNFR4MA5IA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: ecclient: upload failed (node:12M7W4Yno5rMgemSC7nJd42asmZXqUY9cCyY7mtFFHEh8iqAhCF, address:185.167.204.206:4047): protocol: write tcp 188.166.225.170:59506->185.167.204.206:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 19:57:57.813491391 (5h15m15.162798677s) [noise=true , address=185.167.204.205:4013 , piece_id=KICB6KLFDM3KFOGJ52UVXO3G4BUPSSJF657ZIWUIVP56M2SLGMWA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: context deadline exceeded; context deadline exceeded Oct 27 19:57:57.813536527 (5h15m15.162843813s) [seg_pos={0 0}, upload=4621]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Oct 27 19:57:58.016780515 (5h15m15.366087802s) [upload=4621]: Done uploading segments... Oct 27 19:57:58.016879354 (5h15m15.36618663s) [upload=4621]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 4.983038753s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=3) [.............................X........................X.....] duration: 3.430070185s FAIL (2025-10-27 20:33:26 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.43009471s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 4.984490932s FAIL (2025-10-27 20:33:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== eg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577374904 (5h14m15.926682211s) [noise=true , address=89.149.201.147:4020 , piece_id=7O5NTDXJMZL7XX7EJJZMSCLQPS2KBXW2ASVMGFKBKDASUOJ5KYQA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577388009 (5h14m15.926695285s) [noise=true , address=185.167.204.206:4052 , piece_id=RTBLKXBTFLJOSBGSMSZ6HJNPDSM5GPO67VVRHP3OAK5DF5QFAVCQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577699713 (5h14m15.927006989s) [noise=true , address=89.149.201.147:4012 , piece_id=VGEAVYUXQB6F4OF7BCCCZGGI4S2OT5BXXDFSEMHGLMOUAPFCPXDQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577834229 (5h14m15.927141505s) [noise=true , address=89.149.201.147:4017 , piece_id=Q4AHXE26ASEWAANQIW55O433TDNA3RPYX7KCEZVPDET264I5DV3Q, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578014502 (5h14m15.927321778s) [noise=true , address=89.149.201.147:4007 , piece_id=6YAZLKZQ3IRZ3KU4M2MVAAOBEPJZGLFJAS6A4BPSNUPCNNVQHDDQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578280880 (5h14m15.927588156s) [noise=true , address=185.167.204.205:4001 , piece_id=Z22S36XDBYL5COSP36N575LMSLJVC6AP4ZXFNXNMRTVN23HTP5XA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578608904 (5h14m15.92791618s) [noise=true , address=185.167.204.205:4012 , piece_id=JKUFH3UD6ACMEQWRFYJ2F5P5ZJQKYCA6E7FXTHBF7MNQA6EKLXGA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578935426 (5h14m15.928242712s) [noise=true , address=185.167.204.206:4048 , piece_id=HD65TI6UG22CW34RKIVC5RMYIOUIYHL72BJZYL55XHCX3HQMZYHA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579041648 (5h14m15.928348924s) [noise=true , address=185.167.204.205:4002 , piece_id=U57ZVYRVT2L35FNA2N6ODTLEP3PN3TPP5ZYSONBXJYXWE5K43S6A, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579222723 (5h14m15.928529999s) [noise=true , address=185.167.204.206:4040 , piece_id=PDSOHIACMQCDA6NQQZWS4YUI57BMU4DJY5GKRPR7JVLLFVZXDJXQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579486625 (5h14m15.928793901s) [noise=true , address=185.167.204.205:4010 , piece_id=Q35AS6W5CQL2OMHIEPI7GVR6NS7IEJ6LCFXZEWGFEWL6XENNNVIA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579780545 (5h14m15.929087821s) [noise=true , address=81.171.14.70:4039 , piece_id=S5634HCFPYT7SJGH5BPZ3OJZDIAJ5YYSXCUWGIYVIJ2WPQAEWEPQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.580102097 (5h14m15.929409403s) [noise=true , address=89.149.201.147:4005 , piece_id=27IBEU4BYZCGDNOUDCRTQZFZ35W3BLQGERULMCKVWFGWZ7676RPQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:59.402940250 (5h14m16.752247547s) [upload=4621]: Next returned nil segment Oct 27 19:56:59.402970929 (5h14m16.752278235s) [upload=4621]: Waiting for error group managing segments... Oct 27 19:56:59.801926071 (5h14m17.151233347s) [noise=true , address=81.171.14.70:4034 , piece_id=QQXBWVXWX24ETMCIFZ7LTONF3LVGL3RLDXXSIQGX62PLWPJSFM5A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.811249835 (5h14m17.160557121s) [noise=true , address=81.171.14.70:4048 , piece_id=PR2HDQTP5VKTMF7HG6VNKKUJD66LC2HKQVAZUGEZKKZNKH2QCZFQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.858197924 (5h14m17.20750521s) [noise=true , address=89.149.201.147:4007 , piece_id=6YAZLKZQ3IRZ3KU4M2MVAAOBEPJZGLFJAS6A4BPSNUPCNNVQHDDQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.897902089 (5h14m17.247209375s) [noise=true , address=89.149.201.147:4023 , piece_id=LEEWZDLYWPSSUDRIPEQK4NKC4PFF6JVLEBPZMQJLWCG4YZHRFQ3A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.901773520 (5h14m17.251080806s) [noise=true , address=89.149.201.147:4010 , piece_id=TRY6HG262YJRDUVNLLHRYG554BVP4J5TWPGHJUVN5N55WHU3C4ZA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.902238556 (5h14m17.251545842s) [noise=true , address=89.149.201.147:4005 , piece_id=27IBEU4BYZCGDNOUDCRTQZFZ35W3BLQGERULMCKVWFGWZ7676RPQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.902438327 (5h14m17.251745603s) [noise=true , address=81.171.14.70:4039 , piece_id=S5634HCFPYT7SJGH5BPZ3OJZDIAJ5YYSXCUWGIYVIJ2WPQAEWEPQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.917540715 (5h14m17.266847991s) [noise=true , address=89.149.201.147:4017 , piece_id=Q4AHXE26ASEWAANQIW55O433TDNA3RPYX7KCEZVPDET264I5DV3Q, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.926674337 (5h14m17.275981623s) [noise=true , address=89.149.201.147:4020 , piece_id=7O5NTDXJMZL7XX7EJJZMSCLQPS2KBXW2ASVMGFKBKDASUOJ5KYQA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.328819374 (5h14m17.67812666s) [noise=true , address=81.171.14.70:4030 , piece_id=ZTVTBK2E7IGYOYZMK6TTHKMMBST52RCZVKM776PV3USLXONMH66Q, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.349296225 (5h14m17.698603501s) [noise=true , address=89.149.201.147:4011 , piece_id=KQM7L432OU7BYKWL2QHAIKRNPKPA7NOPSZJDOAAFQEGV66PZMGTA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.352514193 (5h14m17.701821479s) [noise=true , address=89.149.201.147:4012 , piece_id=VGEAVYUXQB6F4OF7BCCCZGGI4S2OT5BXXDFSEMHGLMOUAPFCPXDQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.380253194 (5h14m17.72956049s) [noise=true , address=185.167.204.205:4030 , piece_id=35Y5DRDZZHA7LEUZDJQ36RU4MB6DQN2AAIG7E45EIC6YM3MQ7HHQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.385432055 (5h14m17.734739341s) [noise=true , address=185.167.204.205:4023 , piece_id=ACMLGJMZ5H25VH7VULKAIBWIHIAEE2AV366UEZFOJDZRNQ4NGYLA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.388082382 (5h14m17.737389678s) [noise=true , address=185.167.204.206:4040 , piece_id=PDSOHIACMQCDA6NQQZWS4YUI57BMU4DJY5GKRPR7JVLLFVZXDJXQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.391016018 (5h14m17.740323304s) [noise=true , address=185.167.204.206:4056 , piece_id=G5D6SI6CVQHAVSAPS6GJRVZIQ4YQ23PFH7KL26TVK4I4BBTW2C5A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.396014777 (5h14m17.745322053s) [noise=true , address=185.167.204.206:4052 , piece_id=RTBLKXBTFLJOSBGSMSZ6HJNPDSM5GPO67VVRHP3OAK5DF5QFAVCQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.401559615 (5h14m17.750866901s) [noise=true , address=185.167.204.205:4002 , piece_id=U57ZVYRVT2L35FNA2N6ODTLEP3PN3TPP5ZYSONBXJYXWE5K43S6A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.414355180 (5h14m17.763662466s) [noise=true , address=185.167.204.206:4041 , piece_id=NUWDUCCNI44ANZLNYISQQKFSBK7WYTPAPGQ6JJ43IP44LNCLT4SA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.421539241 (5h14m17.770846537s) [noise=true , address=185.167.204.206:4048 , piece_id=HD65TI6UG22CW34RKIVC5RMYIOUIYHL72BJZYL55XHCX3HQMZYHA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.423334288 (5h14m17.772641574s) [noise=true , address=185.167.204.205:4010 , piece_id=Q35AS6W5CQL2OMHIEPI7GVR6NS7IEJ6LCFXZEWGFEWL6XENNNVIA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.447102799 (5h14m17.796410075s) [noise=true , address=185.167.204.205:4012 , piece_id=JKUFH3UD6ACMEQWRFYJ2F5P5ZJQKYCA6E7FXTHBF7MNQA6EKLXGA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.473754258 (5h14m17.823061544s) [noise=true , address=185.167.204.206:4066 , piece_id=KKDV46RFAENAUYDYRPDCV64LWX5RB7JVRKB3HY7BXB4LU7DITSLA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.481151965 (5h14m17.830459251s) [noise=true , address=185.167.204.205:4019 , piece_id=7LYDTS6D3HQSDMVBCMRLB5NZIRLP44VRSWCUT5EKSGSRPWP4RHIA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.486154732 (5h14m17.835462018s) [noise=true , address=185.167.204.205:4001 , piece_id=Z22S36XDBYL5COSP36N575LMSLJVC6AP4ZXFNXNMRTVN23HTP5XA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:57.813202781 (5h15m15.162510068s) [noise=true , address=185.167.204.206:4053 , piece_id=UFA7HABPN4LRP7RSCHBHNXT5AMEDFUF3DSYEGWBFSXOTOXRQXT7A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 19:57:57.813463338 (5h15m15.162770614s) [noise=true , address=185.167.204.206:4047 , piece_id=Z2QX5FHJKEZVW4FXDV2NNUMXEBVPGEW4Z7C3GBVZRUTNFR4MA5IA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: ecclient: upload failed (node:12M7W4Yno5rMgemSC7nJd42asmZXqUY9cCyY7mtFFHEh8iqAhCF, address:185.167.204.206:4047): protocol: write tcp 188.166.225.170:59506->185.167.204.206:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 19:57:57.813491391 (5h15m15.162798677s) [noise=true , address=185.167.204.205:4013 , piece_id=KICB6KLFDM3KFOGJ52UVXO3G4BUPSSJF657ZIWUIVP56M2SLGMWA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: context deadline exceeded; context deadline exceeded Oct 27 19:57:57.813536527 (5h15m15.162843813s) [seg_pos={0 0}, upload=4621]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Oct 27 19:57:58.016780515 (5h15m15.366087802s) [upload=4621]: Done uploading segments... Oct 27 19:57:58.016879354 (5h15m15.36618663s) [upload=4621]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 4.984524045s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=3) [..............................X........................X....] duration: 3.415148097s FAIL (2025-10-27 20:32:58 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.415177894s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=3) [...............................X........................X...] duration: 3.363720221s FAIL (2025-10-27 20:32:36 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.36374074s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 5.017855674s FAIL (2025-10-27 20:32:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== eg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577374904 (5h14m15.926682211s) [noise=true , address=89.149.201.147:4020 , piece_id=7O5NTDXJMZL7XX7EJJZMSCLQPS2KBXW2ASVMGFKBKDASUOJ5KYQA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577388009 (5h14m15.926695285s) [noise=true , address=185.167.204.206:4052 , piece_id=RTBLKXBTFLJOSBGSMSZ6HJNPDSM5GPO67VVRHP3OAK5DF5QFAVCQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577699713 (5h14m15.927006989s) [noise=true , address=89.149.201.147:4012 , piece_id=VGEAVYUXQB6F4OF7BCCCZGGI4S2OT5BXXDFSEMHGLMOUAPFCPXDQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577834229 (5h14m15.927141505s) [noise=true , address=89.149.201.147:4017 , piece_id=Q4AHXE26ASEWAANQIW55O433TDNA3RPYX7KCEZVPDET264I5DV3Q, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578014502 (5h14m15.927321778s) [noise=true , address=89.149.201.147:4007 , piece_id=6YAZLKZQ3IRZ3KU4M2MVAAOBEPJZGLFJAS6A4BPSNUPCNNVQHDDQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578280880 (5h14m15.927588156s) [noise=true , address=185.167.204.205:4001 , piece_id=Z22S36XDBYL5COSP36N575LMSLJVC6AP4ZXFNXNMRTVN23HTP5XA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578608904 (5h14m15.92791618s) [noise=true , address=185.167.204.205:4012 , piece_id=JKUFH3UD6ACMEQWRFYJ2F5P5ZJQKYCA6E7FXTHBF7MNQA6EKLXGA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578935426 (5h14m15.928242712s) [noise=true , address=185.167.204.206:4048 , piece_id=HD65TI6UG22CW34RKIVC5RMYIOUIYHL72BJZYL55XHCX3HQMZYHA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579041648 (5h14m15.928348924s) [noise=true , address=185.167.204.205:4002 , piece_id=U57ZVYRVT2L35FNA2N6ODTLEP3PN3TPP5ZYSONBXJYXWE5K43S6A, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579222723 (5h14m15.928529999s) [noise=true , address=185.167.204.206:4040 , piece_id=PDSOHIACMQCDA6NQQZWS4YUI57BMU4DJY5GKRPR7JVLLFVZXDJXQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579486625 (5h14m15.928793901s) [noise=true , address=185.167.204.205:4010 , piece_id=Q35AS6W5CQL2OMHIEPI7GVR6NS7IEJ6LCFXZEWGFEWL6XENNNVIA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579780545 (5h14m15.929087821s) [noise=true , address=81.171.14.70:4039 , piece_id=S5634HCFPYT7SJGH5BPZ3OJZDIAJ5YYSXCUWGIYVIJ2WPQAEWEPQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.580102097 (5h14m15.929409403s) [noise=true , address=89.149.201.147:4005 , piece_id=27IBEU4BYZCGDNOUDCRTQZFZ35W3BLQGERULMCKVWFGWZ7676RPQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:59.402940250 (5h14m16.752247547s) [upload=4621]: Next returned nil segment Oct 27 19:56:59.402970929 (5h14m16.752278235s) [upload=4621]: Waiting for error group managing segments... Oct 27 19:56:59.801926071 (5h14m17.151233347s) [noise=true , address=81.171.14.70:4034 , piece_id=QQXBWVXWX24ETMCIFZ7LTONF3LVGL3RLDXXSIQGX62PLWPJSFM5A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.811249835 (5h14m17.160557121s) [noise=true , address=81.171.14.70:4048 , piece_id=PR2HDQTP5VKTMF7HG6VNKKUJD66LC2HKQVAZUGEZKKZNKH2QCZFQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.858197924 (5h14m17.20750521s) [noise=true , address=89.149.201.147:4007 , piece_id=6YAZLKZQ3IRZ3KU4M2MVAAOBEPJZGLFJAS6A4BPSNUPCNNVQHDDQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.897902089 (5h14m17.247209375s) [noise=true , address=89.149.201.147:4023 , piece_id=LEEWZDLYWPSSUDRIPEQK4NKC4PFF6JVLEBPZMQJLWCG4YZHRFQ3A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.901773520 (5h14m17.251080806s) [noise=true , address=89.149.201.147:4010 , piece_id=TRY6HG262YJRDUVNLLHRYG554BVP4J5TWPGHJUVN5N55WHU3C4ZA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.902238556 (5h14m17.251545842s) [noise=true , address=89.149.201.147:4005 , piece_id=27IBEU4BYZCGDNOUDCRTQZFZ35W3BLQGERULMCKVWFGWZ7676RPQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.902438327 (5h14m17.251745603s) [noise=true , address=81.171.14.70:4039 , piece_id=S5634HCFPYT7SJGH5BPZ3OJZDIAJ5YYSXCUWGIYVIJ2WPQAEWEPQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.917540715 (5h14m17.266847991s) [noise=true , address=89.149.201.147:4017 , piece_id=Q4AHXE26ASEWAANQIW55O433TDNA3RPYX7KCEZVPDET264I5DV3Q, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.926674337 (5h14m17.275981623s) [noise=true , address=89.149.201.147:4020 , piece_id=7O5NTDXJMZL7XX7EJJZMSCLQPS2KBXW2ASVMGFKBKDASUOJ5KYQA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.328819374 (5h14m17.67812666s) [noise=true , address=81.171.14.70:4030 , piece_id=ZTVTBK2E7IGYOYZMK6TTHKMMBST52RCZVKM776PV3USLXONMH66Q, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.349296225 (5h14m17.698603501s) [noise=true , address=89.149.201.147:4011 , piece_id=KQM7L432OU7BYKWL2QHAIKRNPKPA7NOPSZJDOAAFQEGV66PZMGTA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.352514193 (5h14m17.701821479s) [noise=true , address=89.149.201.147:4012 , piece_id=VGEAVYUXQB6F4OF7BCCCZGGI4S2OT5BXXDFSEMHGLMOUAPFCPXDQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.380253194 (5h14m17.72956049s) [noise=true , address=185.167.204.205:4030 , piece_id=35Y5DRDZZHA7LEUZDJQ36RU4MB6DQN2AAIG7E45EIC6YM3MQ7HHQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.385432055 (5h14m17.734739341s) [noise=true , address=185.167.204.205:4023 , piece_id=ACMLGJMZ5H25VH7VULKAIBWIHIAEE2AV366UEZFOJDZRNQ4NGYLA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.388082382 (5h14m17.737389678s) [noise=true , address=185.167.204.206:4040 , piece_id=PDSOHIACMQCDA6NQQZWS4YUI57BMU4DJY5GKRPR7JVLLFVZXDJXQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.391016018 (5h14m17.740323304s) [noise=true , address=185.167.204.206:4056 , piece_id=G5D6SI6CVQHAVSAPS6GJRVZIQ4YQ23PFH7KL26TVK4I4BBTW2C5A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.396014777 (5h14m17.745322053s) [noise=true , address=185.167.204.206:4052 , piece_id=RTBLKXBTFLJOSBGSMSZ6HJNPDSM5GPO67VVRHP3OAK5DF5QFAVCQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.401559615 (5h14m17.750866901s) [noise=true , address=185.167.204.205:4002 , piece_id=U57ZVYRVT2L35FNA2N6ODTLEP3PN3TPP5ZYSONBXJYXWE5K43S6A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.414355180 (5h14m17.763662466s) [noise=true , address=185.167.204.206:4041 , piece_id=NUWDUCCNI44ANZLNYISQQKFSBK7WYTPAPGQ6JJ43IP44LNCLT4SA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.421539241 (5h14m17.770846537s) [noise=true , address=185.167.204.206:4048 , piece_id=HD65TI6UG22CW34RKIVC5RMYIOUIYHL72BJZYL55XHCX3HQMZYHA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.423334288 (5h14m17.772641574s) [noise=true , address=185.167.204.205:4010 , piece_id=Q35AS6W5CQL2OMHIEPI7GVR6NS7IEJ6LCFXZEWGFEWL6XENNNVIA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.447102799 (5h14m17.796410075s) [noise=true , address=185.167.204.205:4012 , piece_id=JKUFH3UD6ACMEQWRFYJ2F5P5ZJQKYCA6E7FXTHBF7MNQA6EKLXGA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.473754258 (5h14m17.823061544s) [noise=true , address=185.167.204.206:4066 , piece_id=KKDV46RFAENAUYDYRPDCV64LWX5RB7JVRKB3HY7BXB4LU7DITSLA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.481151965 (5h14m17.830459251s) [noise=true , address=185.167.204.205:4019 , piece_id=7LYDTS6D3HQSDMVBCMRLB5NZIRLP44VRSWCUT5EKSGSRPWP4RHIA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.486154732 (5h14m17.835462018s) [noise=true , address=185.167.204.205:4001 , piece_id=Z22S36XDBYL5COSP36N575LMSLJVC6AP4ZXFNXNMRTVN23HTP5XA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:57.813202781 (5h15m15.162510068s) [noise=true , address=185.167.204.206:4053 , piece_id=UFA7HABPN4LRP7RSCHBHNXT5AMEDFUF3DSYEGWBFSXOTOXRQXT7A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 19:57:57.813463338 (5h15m15.162770614s) [noise=true , address=185.167.204.206:4047 , piece_id=Z2QX5FHJKEZVW4FXDV2NNUMXEBVPGEW4Z7C3GBVZRUTNFR4MA5IA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: ecclient: upload failed (node:12M7W4Yno5rMgemSC7nJd42asmZXqUY9cCyY7mtFFHEh8iqAhCF, address:185.167.204.206:4047): protocol: write tcp 188.166.225.170:59506->185.167.204.206:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 19:57:57.813491391 (5h15m15.162798677s) [noise=true , address=185.167.204.205:4013 , piece_id=KICB6KLFDM3KFOGJ52UVXO3G4BUPSSJF657ZIWUIVP56M2SLGMWA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: context deadline exceeded; context deadline exceeded Oct 27 19:57:57.813536527 (5h15m15.162843813s) [seg_pos={0 0}, upload=4621]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Oct 27 19:57:58.016780515 (5h15m15.366087802s) [upload=4621]: Done uploading segments... Oct 27 19:57:58.016879354 (5h15m15.36618663s) [upload=4621]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 5.017887353s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=3) [................................X........................X..] duration: 3.394568442s FAIL (2025-10-27 20:31:59 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.394593578s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=3) [.................................X........................X.] duration: 3.454522174s FAIL (2025-10-27 20:31:33 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.454551791s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 4.979070336s FAIL (2025-10-27 20:31:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== eg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577374904 (5h14m15.926682211s) [noise=true , address=89.149.201.147:4020 , piece_id=7O5NTDXJMZL7XX7EJJZMSCLQPS2KBXW2ASVMGFKBKDASUOJ5KYQA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577388009 (5h14m15.926695285s) [noise=true , address=185.167.204.206:4052 , piece_id=RTBLKXBTFLJOSBGSMSZ6HJNPDSM5GPO67VVRHP3OAK5DF5QFAVCQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577699713 (5h14m15.927006989s) [noise=true , address=89.149.201.147:4012 , piece_id=VGEAVYUXQB6F4OF7BCCCZGGI4S2OT5BXXDFSEMHGLMOUAPFCPXDQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577834229 (5h14m15.927141505s) [noise=true , address=89.149.201.147:4017 , piece_id=Q4AHXE26ASEWAANQIW55O433TDNA3RPYX7KCEZVPDET264I5DV3Q, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578014502 (5h14m15.927321778s) [noise=true , address=89.149.201.147:4007 , piece_id=6YAZLKZQ3IRZ3KU4M2MVAAOBEPJZGLFJAS6A4BPSNUPCNNVQHDDQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578280880 (5h14m15.927588156s) [noise=true , address=185.167.204.205:4001 , piece_id=Z22S36XDBYL5COSP36N575LMSLJVC6AP4ZXFNXNMRTVN23HTP5XA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578608904 (5h14m15.92791618s) [noise=true , address=185.167.204.205:4012 , piece_id=JKUFH3UD6ACMEQWRFYJ2F5P5ZJQKYCA6E7FXTHBF7MNQA6EKLXGA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578935426 (5h14m15.928242712s) [noise=true , address=185.167.204.206:4048 , piece_id=HD65TI6UG22CW34RKIVC5RMYIOUIYHL72BJZYL55XHCX3HQMZYHA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579041648 (5h14m15.928348924s) [noise=true , address=185.167.204.205:4002 , piece_id=U57ZVYRVT2L35FNA2N6ODTLEP3PN3TPP5ZYSONBXJYXWE5K43S6A, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579222723 (5h14m15.928529999s) [noise=true , address=185.167.204.206:4040 , piece_id=PDSOHIACMQCDA6NQQZWS4YUI57BMU4DJY5GKRPR7JVLLFVZXDJXQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579486625 (5h14m15.928793901s) [noise=true , address=185.167.204.205:4010 , piece_id=Q35AS6W5CQL2OMHIEPI7GVR6NS7IEJ6LCFXZEWGFEWL6XENNNVIA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579780545 (5h14m15.929087821s) [noise=true , address=81.171.14.70:4039 , piece_id=S5634HCFPYT7SJGH5BPZ3OJZDIAJ5YYSXCUWGIYVIJ2WPQAEWEPQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.580102097 (5h14m15.929409403s) [noise=true , address=89.149.201.147:4005 , piece_id=27IBEU4BYZCGDNOUDCRTQZFZ35W3BLQGERULMCKVWFGWZ7676RPQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:59.402940250 (5h14m16.752247547s) [upload=4621]: Next returned nil segment Oct 27 19:56:59.402970929 (5h14m16.752278235s) [upload=4621]: Waiting for error group managing segments... Oct 27 19:56:59.801926071 (5h14m17.151233347s) [noise=true , address=81.171.14.70:4034 , piece_id=QQXBWVXWX24ETMCIFZ7LTONF3LVGL3RLDXXSIQGX62PLWPJSFM5A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.811249835 (5h14m17.160557121s) [noise=true , address=81.171.14.70:4048 , piece_id=PR2HDQTP5VKTMF7HG6VNKKUJD66LC2HKQVAZUGEZKKZNKH2QCZFQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.858197924 (5h14m17.20750521s) [noise=true , address=89.149.201.147:4007 , piece_id=6YAZLKZQ3IRZ3KU4M2MVAAOBEPJZGLFJAS6A4BPSNUPCNNVQHDDQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.897902089 (5h14m17.247209375s) [noise=true , address=89.149.201.147:4023 , piece_id=LEEWZDLYWPSSUDRIPEQK4NKC4PFF6JVLEBPZMQJLWCG4YZHRFQ3A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.901773520 (5h14m17.251080806s) [noise=true , address=89.149.201.147:4010 , piece_id=TRY6HG262YJRDUVNLLHRYG554BVP4J5TWPGHJUVN5N55WHU3C4ZA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.902238556 (5h14m17.251545842s) [noise=true , address=89.149.201.147:4005 , piece_id=27IBEU4BYZCGDNOUDCRTQZFZ35W3BLQGERULMCKVWFGWZ7676RPQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.902438327 (5h14m17.251745603s) [noise=true , address=81.171.14.70:4039 , piece_id=S5634HCFPYT7SJGH5BPZ3OJZDIAJ5YYSXCUWGIYVIJ2WPQAEWEPQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.917540715 (5h14m17.266847991s) [noise=true , address=89.149.201.147:4017 , piece_id=Q4AHXE26ASEWAANQIW55O433TDNA3RPYX7KCEZVPDET264I5DV3Q, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.926674337 (5h14m17.275981623s) [noise=true , address=89.149.201.147:4020 , piece_id=7O5NTDXJMZL7XX7EJJZMSCLQPS2KBXW2ASVMGFKBKDASUOJ5KYQA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.328819374 (5h14m17.67812666s) [noise=true , address=81.171.14.70:4030 , piece_id=ZTVTBK2E7IGYOYZMK6TTHKMMBST52RCZVKM776PV3USLXONMH66Q, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.349296225 (5h14m17.698603501s) [noise=true , address=89.149.201.147:4011 , piece_id=KQM7L432OU7BYKWL2QHAIKRNPKPA7NOPSZJDOAAFQEGV66PZMGTA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.352514193 (5h14m17.701821479s) [noise=true , address=89.149.201.147:4012 , piece_id=VGEAVYUXQB6F4OF7BCCCZGGI4S2OT5BXXDFSEMHGLMOUAPFCPXDQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.380253194 (5h14m17.72956049s) [noise=true , address=185.167.204.205:4030 , piece_id=35Y5DRDZZHA7LEUZDJQ36RU4MB6DQN2AAIG7E45EIC6YM3MQ7HHQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.385432055 (5h14m17.734739341s) [noise=true , address=185.167.204.205:4023 , piece_id=ACMLGJMZ5H25VH7VULKAIBWIHIAEE2AV366UEZFOJDZRNQ4NGYLA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.388082382 (5h14m17.737389678s) [noise=true , address=185.167.204.206:4040 , piece_id=PDSOHIACMQCDA6NQQZWS4YUI57BMU4DJY5GKRPR7JVLLFVZXDJXQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.391016018 (5h14m17.740323304s) [noise=true , address=185.167.204.206:4056 , piece_id=G5D6SI6CVQHAVSAPS6GJRVZIQ4YQ23PFH7KL26TVK4I4BBTW2C5A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.396014777 (5h14m17.745322053s) [noise=true , address=185.167.204.206:4052 , piece_id=RTBLKXBTFLJOSBGSMSZ6HJNPDSM5GPO67VVRHP3OAK5DF5QFAVCQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.401559615 (5h14m17.750866901s) [noise=true , address=185.167.204.205:4002 , piece_id=U57ZVYRVT2L35FNA2N6ODTLEP3PN3TPP5ZYSONBXJYXWE5K43S6A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.414355180 (5h14m17.763662466s) [noise=true , address=185.167.204.206:4041 , piece_id=NUWDUCCNI44ANZLNYISQQKFSBK7WYTPAPGQ6JJ43IP44LNCLT4SA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.421539241 (5h14m17.770846537s) [noise=true , address=185.167.204.206:4048 , piece_id=HD65TI6UG22CW34RKIVC5RMYIOUIYHL72BJZYL55XHCX3HQMZYHA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.423334288 (5h14m17.772641574s) [noise=true , address=185.167.204.205:4010 , piece_id=Q35AS6W5CQL2OMHIEPI7GVR6NS7IEJ6LCFXZEWGFEWL6XENNNVIA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.447102799 (5h14m17.796410075s) [noise=true , address=185.167.204.205:4012 , piece_id=JKUFH3UD6ACMEQWRFYJ2F5P5ZJQKYCA6E7FXTHBF7MNQA6EKLXGA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.473754258 (5h14m17.823061544s) [noise=true , address=185.167.204.206:4066 , piece_id=KKDV46RFAENAUYDYRPDCV64LWX5RB7JVRKB3HY7BXB4LU7DITSLA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.481151965 (5h14m17.830459251s) [noise=true , address=185.167.204.205:4019 , piece_id=7LYDTS6D3HQSDMVBCMRLB5NZIRLP44VRSWCUT5EKSGSRPWP4RHIA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.486154732 (5h14m17.835462018s) [noise=true , address=185.167.204.205:4001 , piece_id=Z22S36XDBYL5COSP36N575LMSLJVC6AP4ZXFNXNMRTVN23HTP5XA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:57.813202781 (5h15m15.162510068s) [noise=true , address=185.167.204.206:4053 , piece_id=UFA7HABPN4LRP7RSCHBHNXT5AMEDFUF3DSYEGWBFSXOTOXRQXT7A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 19:57:57.813463338 (5h15m15.162770614s) [noise=true , address=185.167.204.206:4047 , piece_id=Z2QX5FHJKEZVW4FXDV2NNUMXEBVPGEW4Z7C3GBVZRUTNFR4MA5IA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: ecclient: upload failed (node:12M7W4Yno5rMgemSC7nJd42asmZXqUY9cCyY7mtFFHEh8iqAhCF, address:185.167.204.206:4047): protocol: write tcp 188.166.225.170:59506->185.167.204.206:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 19:57:57.813491391 (5h15m15.162798677s) [noise=true , address=185.167.204.205:4013 , piece_id=KICB6KLFDM3KFOGJ52UVXO3G4BUPSSJF657ZIWUIVP56M2SLGMWA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: context deadline exceeded; context deadline exceeded Oct 27 19:57:57.813536527 (5h15m15.162843813s) [seg_pos={0 0}, upload=4621]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Oct 27 19:57:58.016780515 (5h15m15.366087802s) [upload=4621]: Done uploading segments... Oct 27 19:57:58.016879354 (5h15m15.36618663s) [upload=4621]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 4.979127494s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=3) [..................................X........................X] duration: 5.00128746s FAIL (2025-10-27 20:30:52 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.00131384s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 5.024425032s FAIL (2025-10-27 20:30:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== eg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577374904 (5h14m15.926682211s) [noise=true , address=89.149.201.147:4020 , piece_id=7O5NTDXJMZL7XX7EJJZMSCLQPS2KBXW2ASVMGFKBKDASUOJ5KYQA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577388009 (5h14m15.926695285s) [noise=true , address=185.167.204.206:4052 , piece_id=RTBLKXBTFLJOSBGSMSZ6HJNPDSM5GPO67VVRHP3OAK5DF5QFAVCQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577699713 (5h14m15.927006989s) [noise=true , address=89.149.201.147:4012 , piece_id=VGEAVYUXQB6F4OF7BCCCZGGI4S2OT5BXXDFSEMHGLMOUAPFCPXDQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577834229 (5h14m15.927141505s) [noise=true , address=89.149.201.147:4017 , piece_id=Q4AHXE26ASEWAANQIW55O433TDNA3RPYX7KCEZVPDET264I5DV3Q, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578014502 (5h14m15.927321778s) [noise=true , address=89.149.201.147:4007 , piece_id=6YAZLKZQ3IRZ3KU4M2MVAAOBEPJZGLFJAS6A4BPSNUPCNNVQHDDQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578280880 (5h14m15.927588156s) [noise=true , address=185.167.204.205:4001 , piece_id=Z22S36XDBYL5COSP36N575LMSLJVC6AP4ZXFNXNMRTVN23HTP5XA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578608904 (5h14m15.92791618s) [noise=true , address=185.167.204.205:4012 , piece_id=JKUFH3UD6ACMEQWRFYJ2F5P5ZJQKYCA6E7FXTHBF7MNQA6EKLXGA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578935426 (5h14m15.928242712s) [noise=true , address=185.167.204.206:4048 , piece_id=HD65TI6UG22CW34RKIVC5RMYIOUIYHL72BJZYL55XHCX3HQMZYHA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579041648 (5h14m15.928348924s) [noise=true , address=185.167.204.205:4002 , piece_id=U57ZVYRVT2L35FNA2N6ODTLEP3PN3TPP5ZYSONBXJYXWE5K43S6A, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579222723 (5h14m15.928529999s) [noise=true , address=185.167.204.206:4040 , piece_id=PDSOHIACMQCDA6NQQZWS4YUI57BMU4DJY5GKRPR7JVLLFVZXDJXQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579486625 (5h14m15.928793901s) [noise=true , address=185.167.204.205:4010 , piece_id=Q35AS6W5CQL2OMHIEPI7GVR6NS7IEJ6LCFXZEWGFEWL6XENNNVIA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579780545 (5h14m15.929087821s) [noise=true , address=81.171.14.70:4039 , piece_id=S5634HCFPYT7SJGH5BPZ3OJZDIAJ5YYSXCUWGIYVIJ2WPQAEWEPQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.580102097 (5h14m15.929409403s) [noise=true , address=89.149.201.147:4005 , piece_id=27IBEU4BYZCGDNOUDCRTQZFZ35W3BLQGERULMCKVWFGWZ7676RPQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:59.402940250 (5h14m16.752247547s) [upload=4621]: Next returned nil segment Oct 27 19:56:59.402970929 (5h14m16.752278235s) [upload=4621]: Waiting for error group managing segments... Oct 27 19:56:59.801926071 (5h14m17.151233347s) [noise=true , address=81.171.14.70:4034 , piece_id=QQXBWVXWX24ETMCIFZ7LTONF3LVGL3RLDXXSIQGX62PLWPJSFM5A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.811249835 (5h14m17.160557121s) [noise=true , address=81.171.14.70:4048 , piece_id=PR2HDQTP5VKTMF7HG6VNKKUJD66LC2HKQVAZUGEZKKZNKH2QCZFQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.858197924 (5h14m17.20750521s) [noise=true , address=89.149.201.147:4007 , piece_id=6YAZLKZQ3IRZ3KU4M2MVAAOBEPJZGLFJAS6A4BPSNUPCNNVQHDDQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.897902089 (5h14m17.247209375s) [noise=true , address=89.149.201.147:4023 , piece_id=LEEWZDLYWPSSUDRIPEQK4NKC4PFF6JVLEBPZMQJLWCG4YZHRFQ3A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.901773520 (5h14m17.251080806s) [noise=true , address=89.149.201.147:4010 , piece_id=TRY6HG262YJRDUVNLLHRYG554BVP4J5TWPGHJUVN5N55WHU3C4ZA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.902238556 (5h14m17.251545842s) [noise=true , address=89.149.201.147:4005 , piece_id=27IBEU4BYZCGDNOUDCRTQZFZ35W3BLQGERULMCKVWFGWZ7676RPQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.902438327 (5h14m17.251745603s) [noise=true , address=81.171.14.70:4039 , piece_id=S5634HCFPYT7SJGH5BPZ3OJZDIAJ5YYSXCUWGIYVIJ2WPQAEWEPQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.917540715 (5h14m17.266847991s) [noise=true , address=89.149.201.147:4017 , piece_id=Q4AHXE26ASEWAANQIW55O433TDNA3RPYX7KCEZVPDET264I5DV3Q, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.926674337 (5h14m17.275981623s) [noise=true , address=89.149.201.147:4020 , piece_id=7O5NTDXJMZL7XX7EJJZMSCLQPS2KBXW2ASVMGFKBKDASUOJ5KYQA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.328819374 (5h14m17.67812666s) [noise=true , address=81.171.14.70:4030 , piece_id=ZTVTBK2E7IGYOYZMK6TTHKMMBST52RCZVKM776PV3USLXONMH66Q, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.349296225 (5h14m17.698603501s) [noise=true , address=89.149.201.147:4011 , piece_id=KQM7L432OU7BYKWL2QHAIKRNPKPA7NOPSZJDOAAFQEGV66PZMGTA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.352514193 (5h14m17.701821479s) [noise=true , address=89.149.201.147:4012 , piece_id=VGEAVYUXQB6F4OF7BCCCZGGI4S2OT5BXXDFSEMHGLMOUAPFCPXDQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.380253194 (5h14m17.72956049s) [noise=true , address=185.167.204.205:4030 , piece_id=35Y5DRDZZHA7LEUZDJQ36RU4MB6DQN2AAIG7E45EIC6YM3MQ7HHQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.385432055 (5h14m17.734739341s) [noise=true , address=185.167.204.205:4023 , piece_id=ACMLGJMZ5H25VH7VULKAIBWIHIAEE2AV366UEZFOJDZRNQ4NGYLA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.388082382 (5h14m17.737389678s) [noise=true , address=185.167.204.206:4040 , piece_id=PDSOHIACMQCDA6NQQZWS4YUI57BMU4DJY5GKRPR7JVLLFVZXDJXQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.391016018 (5h14m17.740323304s) [noise=true , address=185.167.204.206:4056 , piece_id=G5D6SI6CVQHAVSAPS6GJRVZIQ4YQ23PFH7KL26TVK4I4BBTW2C5A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.396014777 (5h14m17.745322053s) [noise=true , address=185.167.204.206:4052 , piece_id=RTBLKXBTFLJOSBGSMSZ6HJNPDSM5GPO67VVRHP3OAK5DF5QFAVCQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.401559615 (5h14m17.750866901s) [noise=true , address=185.167.204.205:4002 , piece_id=U57ZVYRVT2L35FNA2N6ODTLEP3PN3TPP5ZYSONBXJYXWE5K43S6A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.414355180 (5h14m17.763662466s) [noise=true , address=185.167.204.206:4041 , piece_id=NUWDUCCNI44ANZLNYISQQKFSBK7WYTPAPGQ6JJ43IP44LNCLT4SA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.421539241 (5h14m17.770846537s) [noise=true , address=185.167.204.206:4048 , piece_id=HD65TI6UG22CW34RKIVC5RMYIOUIYHL72BJZYL55XHCX3HQMZYHA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.423334288 (5h14m17.772641574s) [noise=true , address=185.167.204.205:4010 , piece_id=Q35AS6W5CQL2OMHIEPI7GVR6NS7IEJ6LCFXZEWGFEWL6XENNNVIA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.447102799 (5h14m17.796410075s) [noise=true , address=185.167.204.205:4012 , piece_id=JKUFH3UD6ACMEQWRFYJ2F5P5ZJQKYCA6E7FXTHBF7MNQA6EKLXGA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.473754258 (5h14m17.823061544s) [noise=true , address=185.167.204.206:4066 , piece_id=KKDV46RFAENAUYDYRPDCV64LWX5RB7JVRKB3HY7BXB4LU7DITSLA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.481151965 (5h14m17.830459251s) [noise=true , address=185.167.204.205:4019 , piece_id=7LYDTS6D3HQSDMVBCMRLB5NZIRLP44VRSWCUT5EKSGSRPWP4RHIA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.486154732 (5h14m17.835462018s) [noise=true , address=185.167.204.205:4001 , piece_id=Z22S36XDBYL5COSP36N575LMSLJVC6AP4ZXFNXNMRTVN23HTP5XA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:57.813202781 (5h15m15.162510068s) [noise=true , address=185.167.204.206:4053 , piece_id=UFA7HABPN4LRP7RSCHBHNXT5AMEDFUF3DSYEGWBFSXOTOXRQXT7A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 19:57:57.813463338 (5h15m15.162770614s) [noise=true , address=185.167.204.206:4047 , piece_id=Z2QX5FHJKEZVW4FXDV2NNUMXEBVPGEW4Z7C3GBVZRUTNFR4MA5IA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: ecclient: upload failed (node:12M7W4Yno5rMgemSC7nJd42asmZXqUY9cCyY7mtFFHEh8iqAhCF, address:185.167.204.206:4047): protocol: write tcp 188.166.225.170:59506->185.167.204.206:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 19:57:57.813491391 (5h15m15.162798677s) [noise=true , address=185.167.204.205:4013 , piece_id=KICB6KLFDM3KFOGJ52UVXO3G4BUPSSJF657ZIWUIVP56M2SLGMWA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: context deadline exceeded; context deadline exceeded Oct 27 19:57:57.813536527 (5h15m15.162843813s) [seg_pos={0 0}, upload=4621]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Oct 27 19:57:58.016780515 (5h15m15.366087802s) [upload=4621]: Done uploading segments... Oct 27 19:57:58.016879354 (5h15m15.36618663s) [upload=4621]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 5.024473533s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 3.73138525s FAIL (2025-10-27 20:30:05 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.731431277s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 3.460179802s FAIL (2025-10-27 20:29:49 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.460203386s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 3.434235705s FAIL (2025-10-27 20:29:20 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.434257247s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 5.021162642s FAIL (2025-10-27 20:29:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== eg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577374904 (5h14m15.926682211s) [noise=true , address=89.149.201.147:4020 , piece_id=7O5NTDXJMZL7XX7EJJZMSCLQPS2KBXW2ASVMGFKBKDASUOJ5KYQA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577388009 (5h14m15.926695285s) [noise=true , address=185.167.204.206:4052 , piece_id=RTBLKXBTFLJOSBGSMSZ6HJNPDSM5GPO67VVRHP3OAK5DF5QFAVCQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577699713 (5h14m15.927006989s) [noise=true , address=89.149.201.147:4012 , piece_id=VGEAVYUXQB6F4OF7BCCCZGGI4S2OT5BXXDFSEMHGLMOUAPFCPXDQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577834229 (5h14m15.927141505s) [noise=true , address=89.149.201.147:4017 , piece_id=Q4AHXE26ASEWAANQIW55O433TDNA3RPYX7KCEZVPDET264I5DV3Q, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578014502 (5h14m15.927321778s) [noise=true , address=89.149.201.147:4007 , piece_id=6YAZLKZQ3IRZ3KU4M2MVAAOBEPJZGLFJAS6A4BPSNUPCNNVQHDDQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578280880 (5h14m15.927588156s) [noise=true , address=185.167.204.205:4001 , piece_id=Z22S36XDBYL5COSP36N575LMSLJVC6AP4ZXFNXNMRTVN23HTP5XA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578608904 (5h14m15.92791618s) [noise=true , address=185.167.204.205:4012 , piece_id=JKUFH3UD6ACMEQWRFYJ2F5P5ZJQKYCA6E7FXTHBF7MNQA6EKLXGA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578935426 (5h14m15.928242712s) [noise=true , address=185.167.204.206:4048 , piece_id=HD65TI6UG22CW34RKIVC5RMYIOUIYHL72BJZYL55XHCX3HQMZYHA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579041648 (5h14m15.928348924s) [noise=true , address=185.167.204.205:4002 , piece_id=U57ZVYRVT2L35FNA2N6ODTLEP3PN3TPP5ZYSONBXJYXWE5K43S6A, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579222723 (5h14m15.928529999s) [noise=true , address=185.167.204.206:4040 , piece_id=PDSOHIACMQCDA6NQQZWS4YUI57BMU4DJY5GKRPR7JVLLFVZXDJXQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579486625 (5h14m15.928793901s) [noise=true , address=185.167.204.205:4010 , piece_id=Q35AS6W5CQL2OMHIEPI7GVR6NS7IEJ6LCFXZEWGFEWL6XENNNVIA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579780545 (5h14m15.929087821s) [noise=true , address=81.171.14.70:4039 , piece_id=S5634HCFPYT7SJGH5BPZ3OJZDIAJ5YYSXCUWGIYVIJ2WPQAEWEPQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.580102097 (5h14m15.929409403s) [noise=true , address=89.149.201.147:4005 , piece_id=27IBEU4BYZCGDNOUDCRTQZFZ35W3BLQGERULMCKVWFGWZ7676RPQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:59.402940250 (5h14m16.752247547s) [upload=4621]: Next returned nil segment Oct 27 19:56:59.402970929 (5h14m16.752278235s) [upload=4621]: Waiting for error group managing segments... Oct 27 19:56:59.801926071 (5h14m17.151233347s) [noise=true , address=81.171.14.70:4034 , piece_id=QQXBWVXWX24ETMCIFZ7LTONF3LVGL3RLDXXSIQGX62PLWPJSFM5A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.811249835 (5h14m17.160557121s) [noise=true , address=81.171.14.70:4048 , piece_id=PR2HDQTP5VKTMF7HG6VNKKUJD66LC2HKQVAZUGEZKKZNKH2QCZFQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.858197924 (5h14m17.20750521s) [noise=true , address=89.149.201.147:4007 , piece_id=6YAZLKZQ3IRZ3KU4M2MVAAOBEPJZGLFJAS6A4BPSNUPCNNVQHDDQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.897902089 (5h14m17.247209375s) [noise=true , address=89.149.201.147:4023 , piece_id=LEEWZDLYWPSSUDRIPEQK4NKC4PFF6JVLEBPZMQJLWCG4YZHRFQ3A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.901773520 (5h14m17.251080806s) [noise=true , address=89.149.201.147:4010 , piece_id=TRY6HG262YJRDUVNLLHRYG554BVP4J5TWPGHJUVN5N55WHU3C4ZA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.902238556 (5h14m17.251545842s) [noise=true , address=89.149.201.147:4005 , piece_id=27IBEU4BYZCGDNOUDCRTQZFZ35W3BLQGERULMCKVWFGWZ7676RPQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.902438327 (5h14m17.251745603s) [noise=true , address=81.171.14.70:4039 , piece_id=S5634HCFPYT7SJGH5BPZ3OJZDIAJ5YYSXCUWGIYVIJ2WPQAEWEPQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.917540715 (5h14m17.266847991s) [noise=true , address=89.149.201.147:4017 , piece_id=Q4AHXE26ASEWAANQIW55O433TDNA3RPYX7KCEZVPDET264I5DV3Q, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.926674337 (5h14m17.275981623s) [noise=true , address=89.149.201.147:4020 , piece_id=7O5NTDXJMZL7XX7EJJZMSCLQPS2KBXW2ASVMGFKBKDASUOJ5KYQA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.328819374 (5h14m17.67812666s) [noise=true , address=81.171.14.70:4030 , piece_id=ZTVTBK2E7IGYOYZMK6TTHKMMBST52RCZVKM776PV3USLXONMH66Q, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.349296225 (5h14m17.698603501s) [noise=true , address=89.149.201.147:4011 , piece_id=KQM7L432OU7BYKWL2QHAIKRNPKPA7NOPSZJDOAAFQEGV66PZMGTA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.352514193 (5h14m17.701821479s) [noise=true , address=89.149.201.147:4012 , piece_id=VGEAVYUXQB6F4OF7BCCCZGGI4S2OT5BXXDFSEMHGLMOUAPFCPXDQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.380253194 (5h14m17.72956049s) [noise=true , address=185.167.204.205:4030 , piece_id=35Y5DRDZZHA7LEUZDJQ36RU4MB6DQN2AAIG7E45EIC6YM3MQ7HHQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.385432055 (5h14m17.734739341s) [noise=true , address=185.167.204.205:4023 , piece_id=ACMLGJMZ5H25VH7VULKAIBWIHIAEE2AV366UEZFOJDZRNQ4NGYLA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.388082382 (5h14m17.737389678s) [noise=true , address=185.167.204.206:4040 , piece_id=PDSOHIACMQCDA6NQQZWS4YUI57BMU4DJY5GKRPR7JVLLFVZXDJXQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.391016018 (5h14m17.740323304s) [noise=true , address=185.167.204.206:4056 , piece_id=G5D6SI6CVQHAVSAPS6GJRVZIQ4YQ23PFH7KL26TVK4I4BBTW2C5A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.396014777 (5h14m17.745322053s) [noise=true , address=185.167.204.206:4052 , piece_id=RTBLKXBTFLJOSBGSMSZ6HJNPDSM5GPO67VVRHP3OAK5DF5QFAVCQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.401559615 (5h14m17.750866901s) [noise=true , address=185.167.204.205:4002 , piece_id=U57ZVYRVT2L35FNA2N6ODTLEP3PN3TPP5ZYSONBXJYXWE5K43S6A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.414355180 (5h14m17.763662466s) [noise=true , address=185.167.204.206:4041 , piece_id=NUWDUCCNI44ANZLNYISQQKFSBK7WYTPAPGQ6JJ43IP44LNCLT4SA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.421539241 (5h14m17.770846537s) [noise=true , address=185.167.204.206:4048 , piece_id=HD65TI6UG22CW34RKIVC5RMYIOUIYHL72BJZYL55XHCX3HQMZYHA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.423334288 (5h14m17.772641574s) [noise=true , address=185.167.204.205:4010 , piece_id=Q35AS6W5CQL2OMHIEPI7GVR6NS7IEJ6LCFXZEWGFEWL6XENNNVIA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.447102799 (5h14m17.796410075s) [noise=true , address=185.167.204.205:4012 , piece_id=JKUFH3UD6ACMEQWRFYJ2F5P5ZJQKYCA6E7FXTHBF7MNQA6EKLXGA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.473754258 (5h14m17.823061544s) [noise=true , address=185.167.204.206:4066 , piece_id=KKDV46RFAENAUYDYRPDCV64LWX5RB7JVRKB3HY7BXB4LU7DITSLA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.481151965 (5h14m17.830459251s) [noise=true , address=185.167.204.205:4019 , piece_id=7LYDTS6D3HQSDMVBCMRLB5NZIRLP44VRSWCUT5EKSGSRPWP4RHIA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.486154732 (5h14m17.835462018s) [noise=true , address=185.167.204.205:4001 , piece_id=Z22S36XDBYL5COSP36N575LMSLJVC6AP4ZXFNXNMRTVN23HTP5XA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:57.813202781 (5h15m15.162510068s) [noise=true , address=185.167.204.206:4053 , piece_id=UFA7HABPN4LRP7RSCHBHNXT5AMEDFUF3DSYEGWBFSXOTOXRQXT7A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 19:57:57.813463338 (5h15m15.162770614s) [noise=true , address=185.167.204.206:4047 , piece_id=Z2QX5FHJKEZVW4FXDV2NNUMXEBVPGEW4Z7C3GBVZRUTNFR4MA5IA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: ecclient: upload failed (node:12M7W4Yno5rMgemSC7nJd42asmZXqUY9cCyY7mtFFHEh8iqAhCF, address:185.167.204.206:4047): protocol: write tcp 188.166.225.170:59506->185.167.204.206:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 19:57:57.813491391 (5h15m15.162798677s) [noise=true , address=185.167.204.205:4013 , piece_id=KICB6KLFDM3KFOGJ52UVXO3G4BUPSSJF657ZIWUIVP56M2SLGMWA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: context deadline exceeded; context deadline exceeded Oct 27 19:57:57.813536527 (5h15m15.162843813s) [seg_pos={0 0}, upload=4621]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Oct 27 19:57:58.016780515 (5h15m15.366087802s) [upload=4621]: Done uploading segments... Oct 27 19:57:58.016879354 (5h15m15.36618663s) [upload=4621]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 5.021198389s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 3.366989928s FAIL (2025-10-27 20:29:04 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.367023601s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 3.383626237s FAIL (2025-10-27 20:28:35 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.383652377s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 4.973940788s FAIL (2025-10-27 20:28:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== eg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577374904 (5h14m15.926682211s) [noise=true , address=89.149.201.147:4020 , piece_id=7O5NTDXJMZL7XX7EJJZMSCLQPS2KBXW2ASVMGFKBKDASUOJ5KYQA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577388009 (5h14m15.926695285s) [noise=true , address=185.167.204.206:4052 , piece_id=RTBLKXBTFLJOSBGSMSZ6HJNPDSM5GPO67VVRHP3OAK5DF5QFAVCQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577699713 (5h14m15.927006989s) [noise=true , address=89.149.201.147:4012 , piece_id=VGEAVYUXQB6F4OF7BCCCZGGI4S2OT5BXXDFSEMHGLMOUAPFCPXDQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577834229 (5h14m15.927141505s) [noise=true , address=89.149.201.147:4017 , piece_id=Q4AHXE26ASEWAANQIW55O433TDNA3RPYX7KCEZVPDET264I5DV3Q, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578014502 (5h14m15.927321778s) [noise=true , address=89.149.201.147:4007 , piece_id=6YAZLKZQ3IRZ3KU4M2MVAAOBEPJZGLFJAS6A4BPSNUPCNNVQHDDQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578280880 (5h14m15.927588156s) [noise=true , address=185.167.204.205:4001 , piece_id=Z22S36XDBYL5COSP36N575LMSLJVC6AP4ZXFNXNMRTVN23HTP5XA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578608904 (5h14m15.92791618s) [noise=true , address=185.167.204.205:4012 , piece_id=JKUFH3UD6ACMEQWRFYJ2F5P5ZJQKYCA6E7FXTHBF7MNQA6EKLXGA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578935426 (5h14m15.928242712s) [noise=true , address=185.167.204.206:4048 , piece_id=HD65TI6UG22CW34RKIVC5RMYIOUIYHL72BJZYL55XHCX3HQMZYHA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579041648 (5h14m15.928348924s) [noise=true , address=185.167.204.205:4002 , piece_id=U57ZVYRVT2L35FNA2N6ODTLEP3PN3TPP5ZYSONBXJYXWE5K43S6A, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579222723 (5h14m15.928529999s) [noise=true , address=185.167.204.206:4040 , piece_id=PDSOHIACMQCDA6NQQZWS4YUI57BMU4DJY5GKRPR7JVLLFVZXDJXQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579486625 (5h14m15.928793901s) [noise=true , address=185.167.204.205:4010 , piece_id=Q35AS6W5CQL2OMHIEPI7GVR6NS7IEJ6LCFXZEWGFEWL6XENNNVIA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579780545 (5h14m15.929087821s) [noise=true , address=81.171.14.70:4039 , piece_id=S5634HCFPYT7SJGH5BPZ3OJZDIAJ5YYSXCUWGIYVIJ2WPQAEWEPQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.580102097 (5h14m15.929409403s) [noise=true , address=89.149.201.147:4005 , piece_id=27IBEU4BYZCGDNOUDCRTQZFZ35W3BLQGERULMCKVWFGWZ7676RPQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:59.402940250 (5h14m16.752247547s) [upload=4621]: Next returned nil segment Oct 27 19:56:59.402970929 (5h14m16.752278235s) [upload=4621]: Waiting for error group managing segments... Oct 27 19:56:59.801926071 (5h14m17.151233347s) [noise=true , address=81.171.14.70:4034 , piece_id=QQXBWVXWX24ETMCIFZ7LTONF3LVGL3RLDXXSIQGX62PLWPJSFM5A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.811249835 (5h14m17.160557121s) [noise=true , address=81.171.14.70:4048 , piece_id=PR2HDQTP5VKTMF7HG6VNKKUJD66LC2HKQVAZUGEZKKZNKH2QCZFQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.858197924 (5h14m17.20750521s) [noise=true , address=89.149.201.147:4007 , piece_id=6YAZLKZQ3IRZ3KU4M2MVAAOBEPJZGLFJAS6A4BPSNUPCNNVQHDDQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.897902089 (5h14m17.247209375s) [noise=true , address=89.149.201.147:4023 , piece_id=LEEWZDLYWPSSUDRIPEQK4NKC4PFF6JVLEBPZMQJLWCG4YZHRFQ3A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.901773520 (5h14m17.251080806s) [noise=true , address=89.149.201.147:4010 , piece_id=TRY6HG262YJRDUVNLLHRYG554BVP4J5TWPGHJUVN5N55WHU3C4ZA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.902238556 (5h14m17.251545842s) [noise=true , address=89.149.201.147:4005 , piece_id=27IBEU4BYZCGDNOUDCRTQZFZ35W3BLQGERULMCKVWFGWZ7676RPQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.902438327 (5h14m17.251745603s) [noise=true , address=81.171.14.70:4039 , piece_id=S5634HCFPYT7SJGH5BPZ3OJZDIAJ5YYSXCUWGIYVIJ2WPQAEWEPQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.917540715 (5h14m17.266847991s) [noise=true , address=89.149.201.147:4017 , piece_id=Q4AHXE26ASEWAANQIW55O433TDNA3RPYX7KCEZVPDET264I5DV3Q, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.926674337 (5h14m17.275981623s) [noise=true , address=89.149.201.147:4020 , piece_id=7O5NTDXJMZL7XX7EJJZMSCLQPS2KBXW2ASVMGFKBKDASUOJ5KYQA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.328819374 (5h14m17.67812666s) [noise=true , address=81.171.14.70:4030 , piece_id=ZTVTBK2E7IGYOYZMK6TTHKMMBST52RCZVKM776PV3USLXONMH66Q, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.349296225 (5h14m17.698603501s) [noise=true , address=89.149.201.147:4011 , piece_id=KQM7L432OU7BYKWL2QHAIKRNPKPA7NOPSZJDOAAFQEGV66PZMGTA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.352514193 (5h14m17.701821479s) [noise=true , address=89.149.201.147:4012 , piece_id=VGEAVYUXQB6F4OF7BCCCZGGI4S2OT5BXXDFSEMHGLMOUAPFCPXDQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.380253194 (5h14m17.72956049s) [noise=true , address=185.167.204.205:4030 , piece_id=35Y5DRDZZHA7LEUZDJQ36RU4MB6DQN2AAIG7E45EIC6YM3MQ7HHQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.385432055 (5h14m17.734739341s) [noise=true , address=185.167.204.205:4023 , piece_id=ACMLGJMZ5H25VH7VULKAIBWIHIAEE2AV366UEZFOJDZRNQ4NGYLA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.388082382 (5h14m17.737389678s) [noise=true , address=185.167.204.206:4040 , piece_id=PDSOHIACMQCDA6NQQZWS4YUI57BMU4DJY5GKRPR7JVLLFVZXDJXQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.391016018 (5h14m17.740323304s) [noise=true , address=185.167.204.206:4056 , piece_id=G5D6SI6CVQHAVSAPS6GJRVZIQ4YQ23PFH7KL26TVK4I4BBTW2C5A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.396014777 (5h14m17.745322053s) [noise=true , address=185.167.204.206:4052 , piece_id=RTBLKXBTFLJOSBGSMSZ6HJNPDSM5GPO67VVRHP3OAK5DF5QFAVCQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.401559615 (5h14m17.750866901s) [noise=true , address=185.167.204.205:4002 , piece_id=U57ZVYRVT2L35FNA2N6ODTLEP3PN3TPP5ZYSONBXJYXWE5K43S6A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.414355180 (5h14m17.763662466s) [noise=true , address=185.167.204.206:4041 , piece_id=NUWDUCCNI44ANZLNYISQQKFSBK7WYTPAPGQ6JJ43IP44LNCLT4SA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.421539241 (5h14m17.770846537s) [noise=true , address=185.167.204.206:4048 , piece_id=HD65TI6UG22CW34RKIVC5RMYIOUIYHL72BJZYL55XHCX3HQMZYHA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.423334288 (5h14m17.772641574s) [noise=true , address=185.167.204.205:4010 , piece_id=Q35AS6W5CQL2OMHIEPI7GVR6NS7IEJ6LCFXZEWGFEWL6XENNNVIA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.447102799 (5h14m17.796410075s) [noise=true , address=185.167.204.205:4012 , piece_id=JKUFH3UD6ACMEQWRFYJ2F5P5ZJQKYCA6E7FXTHBF7MNQA6EKLXGA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.473754258 (5h14m17.823061544s) [noise=true , address=185.167.204.206:4066 , piece_id=KKDV46RFAENAUYDYRPDCV64LWX5RB7JVRKB3HY7BXB4LU7DITSLA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.481151965 (5h14m17.830459251s) [noise=true , address=185.167.204.205:4019 , piece_id=7LYDTS6D3HQSDMVBCMRLB5NZIRLP44VRSWCUT5EKSGSRPWP4RHIA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.486154732 (5h14m17.835462018s) [noise=true , address=185.167.204.205:4001 , piece_id=Z22S36XDBYL5COSP36N575LMSLJVC6AP4ZXFNXNMRTVN23HTP5XA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:57.813202781 (5h15m15.162510068s) [noise=true , address=185.167.204.206:4053 , piece_id=UFA7HABPN4LRP7RSCHBHNXT5AMEDFUF3DSYEGWBFSXOTOXRQXT7A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 19:57:57.813463338 (5h15m15.162770614s) [noise=true , address=185.167.204.206:4047 , piece_id=Z2QX5FHJKEZVW4FXDV2NNUMXEBVPGEW4Z7C3GBVZRUTNFR4MA5IA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: ecclient: upload failed (node:12M7W4Yno5rMgemSC7nJd42asmZXqUY9cCyY7mtFFHEh8iqAhCF, address:185.167.204.206:4047): protocol: write tcp 188.166.225.170:59506->185.167.204.206:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 19:57:57.813491391 (5h15m15.162798677s) [noise=true , address=185.167.204.205:4013 , piece_id=KICB6KLFDM3KFOGJ52UVXO3G4BUPSSJF657ZIWUIVP56M2SLGMWA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: context deadline exceeded; context deadline exceeded Oct 27 19:57:57.813536527 (5h15m15.162843813s) [seg_pos={0 0}, upload=4621]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Oct 27 19:57:58.016780515 (5h15m15.366087802s) [upload=4621]: Done uploading segments... Oct 27 19:57:58.016879354 (5h15m15.36618663s) [upload=4621]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 4.973999941s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 4.9584242s FAIL (2025-10-27 20:27:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== eg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577374904 (5h14m15.926682211s) [noise=true , address=89.149.201.147:4020 , piece_id=7O5NTDXJMZL7XX7EJJZMSCLQPS2KBXW2ASVMGFKBKDASUOJ5KYQA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577388009 (5h14m15.926695285s) [noise=true , address=185.167.204.206:4052 , piece_id=RTBLKXBTFLJOSBGSMSZ6HJNPDSM5GPO67VVRHP3OAK5DF5QFAVCQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577699713 (5h14m15.927006989s) [noise=true , address=89.149.201.147:4012 , piece_id=VGEAVYUXQB6F4OF7BCCCZGGI4S2OT5BXXDFSEMHGLMOUAPFCPXDQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577834229 (5h14m15.927141505s) [noise=true , address=89.149.201.147:4017 , piece_id=Q4AHXE26ASEWAANQIW55O433TDNA3RPYX7KCEZVPDET264I5DV3Q, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578014502 (5h14m15.927321778s) [noise=true , address=89.149.201.147:4007 , piece_id=6YAZLKZQ3IRZ3KU4M2MVAAOBEPJZGLFJAS6A4BPSNUPCNNVQHDDQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578280880 (5h14m15.927588156s) [noise=true , address=185.167.204.205:4001 , piece_id=Z22S36XDBYL5COSP36N575LMSLJVC6AP4ZXFNXNMRTVN23HTP5XA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578608904 (5h14m15.92791618s) [noise=true , address=185.167.204.205:4012 , piece_id=JKUFH3UD6ACMEQWRFYJ2F5P5ZJQKYCA6E7FXTHBF7MNQA6EKLXGA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578935426 (5h14m15.928242712s) [noise=true , address=185.167.204.206:4048 , piece_id=HD65TI6UG22CW34RKIVC5RMYIOUIYHL72BJZYL55XHCX3HQMZYHA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579041648 (5h14m15.928348924s) [noise=true , address=185.167.204.205:4002 , piece_id=U57ZVYRVT2L35FNA2N6ODTLEP3PN3TPP5ZYSONBXJYXWE5K43S6A, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579222723 (5h14m15.928529999s) [noise=true , address=185.167.204.206:4040 , piece_id=PDSOHIACMQCDA6NQQZWS4YUI57BMU4DJY5GKRPR7JVLLFVZXDJXQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579486625 (5h14m15.928793901s) [noise=true , address=185.167.204.205:4010 , piece_id=Q35AS6W5CQL2OMHIEPI7GVR6NS7IEJ6LCFXZEWGFEWL6XENNNVIA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579780545 (5h14m15.929087821s) [noise=true , address=81.171.14.70:4039 , piece_id=S5634HCFPYT7SJGH5BPZ3OJZDIAJ5YYSXCUWGIYVIJ2WPQAEWEPQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.580102097 (5h14m15.929409403s) [noise=true , address=89.149.201.147:4005 , piece_id=27IBEU4BYZCGDNOUDCRTQZFZ35W3BLQGERULMCKVWFGWZ7676RPQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:59.402940250 (5h14m16.752247547s) [upload=4621]: Next returned nil segment Oct 27 19:56:59.402970929 (5h14m16.752278235s) [upload=4621]: Waiting for error group managing segments... Oct 27 19:56:59.801926071 (5h14m17.151233347s) [noise=true , address=81.171.14.70:4034 , piece_id=QQXBWVXWX24ETMCIFZ7LTONF3LVGL3RLDXXSIQGX62PLWPJSFM5A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.811249835 (5h14m17.160557121s) [noise=true , address=81.171.14.70:4048 , piece_id=PR2HDQTP5VKTMF7HG6VNKKUJD66LC2HKQVAZUGEZKKZNKH2QCZFQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.858197924 (5h14m17.20750521s) [noise=true , address=89.149.201.147:4007 , piece_id=6YAZLKZQ3IRZ3KU4M2MVAAOBEPJZGLFJAS6A4BPSNUPCNNVQHDDQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.897902089 (5h14m17.247209375s) [noise=true , address=89.149.201.147:4023 , piece_id=LEEWZDLYWPSSUDRIPEQK4NKC4PFF6JVLEBPZMQJLWCG4YZHRFQ3A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.901773520 (5h14m17.251080806s) [noise=true , address=89.149.201.147:4010 , piece_id=TRY6HG262YJRDUVNLLHRYG554BVP4J5TWPGHJUVN5N55WHU3C4ZA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.902238556 (5h14m17.251545842s) [noise=true , address=89.149.201.147:4005 , piece_id=27IBEU4BYZCGDNOUDCRTQZFZ35W3BLQGERULMCKVWFGWZ7676RPQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.902438327 (5h14m17.251745603s) [noise=true , address=81.171.14.70:4039 , piece_id=S5634HCFPYT7SJGH5BPZ3OJZDIAJ5YYSXCUWGIYVIJ2WPQAEWEPQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.917540715 (5h14m17.266847991s) [noise=true , address=89.149.201.147:4017 , piece_id=Q4AHXE26ASEWAANQIW55O433TDNA3RPYX7KCEZVPDET264I5DV3Q, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.926674337 (5h14m17.275981623s) [noise=true , address=89.149.201.147:4020 , piece_id=7O5NTDXJMZL7XX7EJJZMSCLQPS2KBXW2ASVMGFKBKDASUOJ5KYQA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.328819374 (5h14m17.67812666s) [noise=true , address=81.171.14.70:4030 , piece_id=ZTVTBK2E7IGYOYZMK6TTHKMMBST52RCZVKM776PV3USLXONMH66Q, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.349296225 (5h14m17.698603501s) [noise=true , address=89.149.201.147:4011 , piece_id=KQM7L432OU7BYKWL2QHAIKRNPKPA7NOPSZJDOAAFQEGV66PZMGTA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.352514193 (5h14m17.701821479s) [noise=true , address=89.149.201.147:4012 , piece_id=VGEAVYUXQB6F4OF7BCCCZGGI4S2OT5BXXDFSEMHGLMOUAPFCPXDQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.380253194 (5h14m17.72956049s) [noise=true , address=185.167.204.205:4030 , piece_id=35Y5DRDZZHA7LEUZDJQ36RU4MB6DQN2AAIG7E45EIC6YM3MQ7HHQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.385432055 (5h14m17.734739341s) [noise=true , address=185.167.204.205:4023 , piece_id=ACMLGJMZ5H25VH7VULKAIBWIHIAEE2AV366UEZFOJDZRNQ4NGYLA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.388082382 (5h14m17.737389678s) [noise=true , address=185.167.204.206:4040 , piece_id=PDSOHIACMQCDA6NQQZWS4YUI57BMU4DJY5GKRPR7JVLLFVZXDJXQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.391016018 (5h14m17.740323304s) [noise=true , address=185.167.204.206:4056 , piece_id=G5D6SI6CVQHAVSAPS6GJRVZIQ4YQ23PFH7KL26TVK4I4BBTW2C5A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.396014777 (5h14m17.745322053s) [noise=true , address=185.167.204.206:4052 , piece_id=RTBLKXBTFLJOSBGSMSZ6HJNPDSM5GPO67VVRHP3OAK5DF5QFAVCQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.401559615 (5h14m17.750866901s) [noise=true , address=185.167.204.205:4002 , piece_id=U57ZVYRVT2L35FNA2N6ODTLEP3PN3TPP5ZYSONBXJYXWE5K43S6A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.414355180 (5h14m17.763662466s) [noise=true , address=185.167.204.206:4041 , piece_id=NUWDUCCNI44ANZLNYISQQKFSBK7WYTPAPGQ6JJ43IP44LNCLT4SA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.421539241 (5h14m17.770846537s) [noise=true , address=185.167.204.206:4048 , piece_id=HD65TI6UG22CW34RKIVC5RMYIOUIYHL72BJZYL55XHCX3HQMZYHA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.423334288 (5h14m17.772641574s) [noise=true , address=185.167.204.205:4010 , piece_id=Q35AS6W5CQL2OMHIEPI7GVR6NS7IEJ6LCFXZEWGFEWL6XENNNVIA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.447102799 (5h14m17.796410075s) [noise=true , address=185.167.204.205:4012 , piece_id=JKUFH3UD6ACMEQWRFYJ2F5P5ZJQKYCA6E7FXTHBF7MNQA6EKLXGA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.473754258 (5h14m17.823061544s) [noise=true , address=185.167.204.206:4066 , piece_id=KKDV46RFAENAUYDYRPDCV64LWX5RB7JVRKB3HY7BXB4LU7DITSLA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.481151965 (5h14m17.830459251s) [noise=true , address=185.167.204.205:4019 , piece_id=7LYDTS6D3HQSDMVBCMRLB5NZIRLP44VRSWCUT5EKSGSRPWP4RHIA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.486154732 (5h14m17.835462018s) [noise=true , address=185.167.204.205:4001 , piece_id=Z22S36XDBYL5COSP36N575LMSLJVC6AP4ZXFNXNMRTVN23HTP5XA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:57.813202781 (5h15m15.162510068s) [noise=true , address=185.167.204.206:4053 , piece_id=UFA7HABPN4LRP7RSCHBHNXT5AMEDFUF3DSYEGWBFSXOTOXRQXT7A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 19:57:57.813463338 (5h15m15.162770614s) [noise=true , address=185.167.204.206:4047 , piece_id=Z2QX5FHJKEZVW4FXDV2NNUMXEBVPGEW4Z7C3GBVZRUTNFR4MA5IA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: ecclient: upload failed (node:12M7W4Yno5rMgemSC7nJd42asmZXqUY9cCyY7mtFFHEh8iqAhCF, address:185.167.204.206:4047): protocol: write tcp 188.166.225.170:59506->185.167.204.206:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 19:57:57.813491391 (5h15m15.162798677s) [noise=true , address=185.167.204.205:4013 , piece_id=KICB6KLFDM3KFOGJ52UVXO3G4BUPSSJF657ZIWUIVP56M2SLGMWA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: context deadline exceeded; context deadline exceeded Oct 27 19:57:57.813536527 (5h15m15.162843813s) [seg_pos={0 0}, upload=4621]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Oct 27 19:57:58.016780515 (5h15m15.366087802s) [upload=4621]: Done uploading segments... Oct 27 19:57:58.016879354 (5h15m15.36618663s) [upload=4621]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 4.958450039s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 3.462860991s FAIL (2025-10-27 20:27:25 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.462884005s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 5.110152885s FAIL (2025-10-27 20:27:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== eg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577374904 (5h14m15.926682211s) [noise=true , address=89.149.201.147:4020 , piece_id=7O5NTDXJMZL7XX7EJJZMSCLQPS2KBXW2ASVMGFKBKDASUOJ5KYQA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577388009 (5h14m15.926695285s) [noise=true , address=185.167.204.206:4052 , piece_id=RTBLKXBTFLJOSBGSMSZ6HJNPDSM5GPO67VVRHP3OAK5DF5QFAVCQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577699713 (5h14m15.927006989s) [noise=true , address=89.149.201.147:4012 , piece_id=VGEAVYUXQB6F4OF7BCCCZGGI4S2OT5BXXDFSEMHGLMOUAPFCPXDQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.577834229 (5h14m15.927141505s) [noise=true , address=89.149.201.147:4017 , piece_id=Q4AHXE26ASEWAANQIW55O433TDNA3RPYX7KCEZVPDET264I5DV3Q, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578014502 (5h14m15.927321778s) [noise=true , address=89.149.201.147:4007 , piece_id=6YAZLKZQ3IRZ3KU4M2MVAAOBEPJZGLFJAS6A4BPSNUPCNNVQHDDQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578280880 (5h14m15.927588156s) [noise=true , address=185.167.204.205:4001 , piece_id=Z22S36XDBYL5COSP36N575LMSLJVC6AP4ZXFNXNMRTVN23HTP5XA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578608904 (5h14m15.92791618s) [noise=true , address=185.167.204.205:4012 , piece_id=JKUFH3UD6ACMEQWRFYJ2F5P5ZJQKYCA6E7FXTHBF7MNQA6EKLXGA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.578935426 (5h14m15.928242712s) [noise=true , address=185.167.204.206:4048 , piece_id=HD65TI6UG22CW34RKIVC5RMYIOUIYHL72BJZYL55XHCX3HQMZYHA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579041648 (5h14m15.928348924s) [noise=true , address=185.167.204.205:4002 , piece_id=U57ZVYRVT2L35FNA2N6ODTLEP3PN3TPP5ZYSONBXJYXWE5K43S6A, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579222723 (5h14m15.928529999s) [noise=true , address=185.167.204.206:4040 , piece_id=PDSOHIACMQCDA6NQQZWS4YUI57BMU4DJY5GKRPR7JVLLFVZXDJXQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579486625 (5h14m15.928793901s) [noise=true , address=185.167.204.205:4010 , piece_id=Q35AS6W5CQL2OMHIEPI7GVR6NS7IEJ6LCFXZEWGFEWL6XENNNVIA, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.579780545 (5h14m15.929087821s) [noise=true , address=81.171.14.70:4039 , piece_id=S5634HCFPYT7SJGH5BPZ3OJZDIAJ5YYSXCUWGIYVIJ2WPQAEWEPQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:58.580102097 (5h14m15.929409403s) [noise=true , address=89.149.201.147:4005 , piece_id=27IBEU4BYZCGDNOUDCRTQZFZ35W3BLQGERULMCKVWFGWZ7676RPQ, seg_pos={0 0}, upload=4621]: Uploading piece... Oct 27 19:56:59.402940250 (5h14m16.752247547s) [upload=4621]: Next returned nil segment Oct 27 19:56:59.402970929 (5h14m16.752278235s) [upload=4621]: Waiting for error group managing segments... Oct 27 19:56:59.801926071 (5h14m17.151233347s) [noise=true , address=81.171.14.70:4034 , piece_id=QQXBWVXWX24ETMCIFZ7LTONF3LVGL3RLDXXSIQGX62PLWPJSFM5A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.811249835 (5h14m17.160557121s) [noise=true , address=81.171.14.70:4048 , piece_id=PR2HDQTP5VKTMF7HG6VNKKUJD66LC2HKQVAZUGEZKKZNKH2QCZFQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.858197924 (5h14m17.20750521s) [noise=true , address=89.149.201.147:4007 , piece_id=6YAZLKZQ3IRZ3KU4M2MVAAOBEPJZGLFJAS6A4BPSNUPCNNVQHDDQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.897902089 (5h14m17.247209375s) [noise=true , address=89.149.201.147:4023 , piece_id=LEEWZDLYWPSSUDRIPEQK4NKC4PFF6JVLEBPZMQJLWCG4YZHRFQ3A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.901773520 (5h14m17.251080806s) [noise=true , address=89.149.201.147:4010 , piece_id=TRY6HG262YJRDUVNLLHRYG554BVP4J5TWPGHJUVN5N55WHU3C4ZA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.902238556 (5h14m17.251545842s) [noise=true , address=89.149.201.147:4005 , piece_id=27IBEU4BYZCGDNOUDCRTQZFZ35W3BLQGERULMCKVWFGWZ7676RPQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.902438327 (5h14m17.251745603s) [noise=true , address=81.171.14.70:4039 , piece_id=S5634HCFPYT7SJGH5BPZ3OJZDIAJ5YYSXCUWGIYVIJ2WPQAEWEPQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.917540715 (5h14m17.266847991s) [noise=true , address=89.149.201.147:4017 , piece_id=Q4AHXE26ASEWAANQIW55O433TDNA3RPYX7KCEZVPDET264I5DV3Q, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:56:59.926674337 (5h14m17.275981623s) [noise=true , address=89.149.201.147:4020 , piece_id=7O5NTDXJMZL7XX7EJJZMSCLQPS2KBXW2ASVMGFKBKDASUOJ5KYQA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.328819374 (5h14m17.67812666s) [noise=true , address=81.171.14.70:4030 , piece_id=ZTVTBK2E7IGYOYZMK6TTHKMMBST52RCZVKM776PV3USLXONMH66Q, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.349296225 (5h14m17.698603501s) [noise=true , address=89.149.201.147:4011 , piece_id=KQM7L432OU7BYKWL2QHAIKRNPKPA7NOPSZJDOAAFQEGV66PZMGTA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.352514193 (5h14m17.701821479s) [noise=true , address=89.149.201.147:4012 , piece_id=VGEAVYUXQB6F4OF7BCCCZGGI4S2OT5BXXDFSEMHGLMOUAPFCPXDQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.380253194 (5h14m17.72956049s) [noise=true , address=185.167.204.205:4030 , piece_id=35Y5DRDZZHA7LEUZDJQ36RU4MB6DQN2AAIG7E45EIC6YM3MQ7HHQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.385432055 (5h14m17.734739341s) [noise=true , address=185.167.204.205:4023 , piece_id=ACMLGJMZ5H25VH7VULKAIBWIHIAEE2AV366UEZFOJDZRNQ4NGYLA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.388082382 (5h14m17.737389678s) [noise=true , address=185.167.204.206:4040 , piece_id=PDSOHIACMQCDA6NQQZWS4YUI57BMU4DJY5GKRPR7JVLLFVZXDJXQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.391016018 (5h14m17.740323304s) [noise=true , address=185.167.204.206:4056 , piece_id=G5D6SI6CVQHAVSAPS6GJRVZIQ4YQ23PFH7KL26TVK4I4BBTW2C5A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.396014777 (5h14m17.745322053s) [noise=true , address=185.167.204.206:4052 , piece_id=RTBLKXBTFLJOSBGSMSZ6HJNPDSM5GPO67VVRHP3OAK5DF5QFAVCQ, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.401559615 (5h14m17.750866901s) [noise=true , address=185.167.204.205:4002 , piece_id=U57ZVYRVT2L35FNA2N6ODTLEP3PN3TPP5ZYSONBXJYXWE5K43S6A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.414355180 (5h14m17.763662466s) [noise=true , address=185.167.204.206:4041 , piece_id=NUWDUCCNI44ANZLNYISQQKFSBK7WYTPAPGQ6JJ43IP44LNCLT4SA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.421539241 (5h14m17.770846537s) [noise=true , address=185.167.204.206:4048 , piece_id=HD65TI6UG22CW34RKIVC5RMYIOUIYHL72BJZYL55XHCX3HQMZYHA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.423334288 (5h14m17.772641574s) [noise=true , address=185.167.204.205:4010 , piece_id=Q35AS6W5CQL2OMHIEPI7GVR6NS7IEJ6LCFXZEWGFEWL6XENNNVIA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.447102799 (5h14m17.796410075s) [noise=true , address=185.167.204.205:4012 , piece_id=JKUFH3UD6ACMEQWRFYJ2F5P5ZJQKYCA6E7FXTHBF7MNQA6EKLXGA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.473754258 (5h14m17.823061544s) [noise=true , address=185.167.204.206:4066 , piece_id=KKDV46RFAENAUYDYRPDCV64LWX5RB7JVRKB3HY7BXB4LU7DITSLA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.481151965 (5h14m17.830459251s) [noise=true , address=185.167.204.205:4019 , piece_id=7LYDTS6D3HQSDMVBCMRLB5NZIRLP44VRSWCUT5EKSGSRPWP4RHIA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:00.486154732 (5h14m17.835462018s) [noise=true , address=185.167.204.205:4001 , piece_id=Z22S36XDBYL5COSP36N575LMSLJVC6AP4ZXFNXNMRTVN23HTP5XA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: <nil> Oct 27 19:57:57.813202781 (5h15m15.162510068s) [noise=true , address=185.167.204.206:4053 , piece_id=UFA7HABPN4LRP7RSCHBHNXT5AMEDFUF3DSYEGWBFSXOTOXRQXT7A, seg_pos={0 0}, upload=4621]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 19:57:57.813463338 (5h15m15.162770614s) [noise=true , address=185.167.204.206:4047 , piece_id=Z2QX5FHJKEZVW4FXDV2NNUMXEBVPGEW4Z7C3GBVZRUTNFR4MA5IA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: ecclient: upload failed (node:12M7W4Yno5rMgemSC7nJd42asmZXqUY9cCyY7mtFFHEh8iqAhCF, address:185.167.204.206:4047): protocol: write tcp 188.166.225.170:59506->185.167.204.206:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 19:57:57.813491391 (5h15m15.162798677s) [noise=true , address=185.167.204.205:4013 , piece_id=KICB6KLFDM3KFOGJ52UVXO3G4BUPSSJF657ZIWUIVP56M2SLGMWA, seg_pos={0 0}, upload=4621]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: context deadline exceeded; context deadline exceeded Oct 27 19:57:57.813536527 (5h15m15.162843813s) [seg_pos={0 0}, upload=4621]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Oct 27 19:57:58.016780515 (5h15m15.366087802s) [upload=4621]: Done uploading segments... Oct 27 19:57:58.016879354 (5h15m15.36618663s) [upload=4621]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 5.110250141s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 3.497956511s FAIL (2025-10-27 20:27:01 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.498079556s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)