Orbiter History

checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 6.425640961s FAIL (2025-07-01 22:08:50 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.425663795s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........................................X.X...............] duration: 1.917809701s FAIL (2025-07-01 22:08:40 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.91784063s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [...........................................X.X..............] duration: 1.883989007s FAIL (2025-07-01 22:08:04 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.884026728s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 6.150197394s FAIL (2025-07-01 22:07:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.150239164s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [............................................X.X.............] duration: 1.890145439s FAIL (2025-07-01 22:07:00 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.890170899s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 5.988038841s FAIL (2025-07-01 22:06:57 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.98806446s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.............................................X.X............] duration: 1.93111701s FAIL (2025-07-01 22:06:27 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.931139833s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [..............................................X.X...........] duration: 1.957527326s FAIL (2025-07-01 22:06:10 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.957547795s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.001505655s FAIL (2025-07-01 22:06:09 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.001526765s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [...............................................X.X..........] duration: 1.899455736s FAIL (2025-07-01 22:05:33 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.899474132s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [................................................X.X.........] duration: 1.833044376s FAIL (2025-07-01 22:04:34 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.833070927s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.................................................X.X........] duration: 1.936533721s FAIL (2025-07-01 22:03:40 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.936560172s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [..................................................X.X.......] duration: 1.839044235s FAIL (2025-07-01 22:02:33 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.839073059s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [...................................................X.X......] duration: 1.925969399s FAIL (2025-07-01 22:02:09 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.925997904s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [....................................................X.X.....] duration: 1.872174404s FAIL (2025-07-01 22:01:14 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.872199342s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.....................................................X.X....] duration: 1.884076725s FAIL (2025-07-01 22:00:49 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.884109269s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [......................................................X.X...] duration: 1.973134823s FAIL (2025-07-01 21:59:36 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.973160964s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......................................................X.X..] duration: 1.890087916s FAIL (2025-07-01 21:59:19 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.890116332s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [........................................................X.X.] duration: 1.870687631s FAIL (2025-07-01 21:58:09 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.870707919s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........................................................X.X] duration: 30.000480556s FAIL (2025-07-01 21:57:52 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 30.000500595s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 1.894108568s FAIL (2025-07-01 21:56:18 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.89414136s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.001127422s FAIL (2025-07-01 21:56:04 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 30.001147409s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 5.721465301s FAIL (2025-07-01 21:15:58 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== p 188.166.225.170:38826->45.91.116.14:4190: use of closed network connection Jul 1 20:30:07.397683164 (203h19m42.168324499s) [seg_pos={0 0}, upload=162621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 20:30:07.397793445 (203h19m42.16843478s) [upload=162621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 20:30:07.397832890 (203h19m42.168474225s) [upload=162621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 20:30:07.690755035 (203h19m42.46139637s) [upload=162621]: Done uploading segments... Jul 1 20:30:07.690777598 (203h19m42.461418933s) [upload=162621]: Upload finished. err: <nil> Jul 1 20:30:51.075923771 (203h20m25.846565096s) [upload=162628]: Starting upload Jul 1 20:30:51.075979769 (203h20m25.846621104s) [upload=162628]: Done starting upload Jul 1 20:30:51.076046185 (203h20m25.84668752s) [upload=162628]: Uploading segments... Jul 1 20:30:51.076156256 (203h20m25.846797591s) [upload=162628]: Got next segment. Inline: false Jul 1 20:30:51.076184720 (203h20m25.846826055s) [upload=162628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 1 20:30:51.076189279 (203h20m25.846830614s) [upload=162628]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 1 20:30:51.307264904 (203h20m26.077906239s) [seg_pos={0 0}, upload=162628]: Begin upload segment... Jul 1 20:30:51.307309248 (203h20m26.077950583s) [seg_pos={0 0}, upload=162628]: Done begin upload segment. Jul 1 20:30:51.307323446 (203h20m26.077964771s) [noise=true , address=45.91.116.8:4048 , piece_id=2G2OOQLJPTUDY5PZSHQ2MNAV7774DPK55SELX5STL5W35MXSFKNQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307341239 (203h20m26.077982574s) [noise=true , address=77.90.31.12:4589 , piece_id=OAQAOA63GE45RWO52GQFOO6FGD4M2AW6ALCPMKCB7T25UDBFOBIA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307377640 (203h20m26.078018965s) [noise=true , address=45.91.116.13:4154 , piece_id=CWIE4GHPWQCF7YHM2QG62RJMBQBNKNXRK2JI4G6OBTPKN4VV73BA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307671732 (203h20m26.078313057s) [noise=true , address=104.36.82.14:4221 , piece_id=JK73AQZVYWALWCBO7DORATYWJOIKWT2WBBHSZ26Q3TJLBYDTYO2Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307680439 (203h20m26.078321774s) [noise=true , address=104.36.82.7:4909 , piece_id=JNUIUO5MFV5I3L4CTK6IY2CMQDKTVCGPAR6VQHIKE2BKPIQQNGHA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307944213 (203h20m26.078585548s) [noise=true , address=45.91.116.5:5299 , piece_id=V6X7BVMX3IP23A65VFY7PIHGCJPGKLTZAYH4QVPPUFB34M3JUQYQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308197999 (203h20m26.078839334s) [noise=true , address=104.36.82.2:4731 , piece_id=JXQL75TODICFVUAIEE4TRGI2DUYVNC3ZR3RNEARTKQS56IIKZATQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308448899 (203h20m26.079090234s) [noise=true , address=45.91.116.4:4937 , piece_id=CMO4GLDKCZ7KQWHM5S4XX5QB2L3KAHUKRUYXWNE5OPEJ464X2NBA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308746398 (203h20m26.079387733s) [noise=true , address=77.90.31.17:4770 , piece_id=OFDOKUGNGNDMRFTF4HF3BHPZO3HSDDJZL7NC6G7PQSPKZRZVWGJA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308975577 (203h20m26.079616912s) [noise=true , address=45.91.116.13:4155 , piece_id=WN7BEIS5XO4K3BGAHLFDGBXUK52OHWYBPFFH6GCNADP6HWYBM73Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309167925 (203h20m26.07980926s) [noise=true , address=45.91.116.9:5262 , piece_id=N2SGOATWGVAKHJUCGXIUCMO5GTHQS4FHSFXZJBSGGT4HIQK4MFSQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309359802 (203h20m26.080001137s) [noise=true , address=45.91.116.6:4975 , piece_id=YUJIO2VMD53TDD66ANUI55LFMDTPHRMKV4Y7L7X66KA2BMKTIUQA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309548883 (203h20m26.080190218s) [noise=true , address=45.91.116.10:4082 , piece_id=U3OGQJQN3KWNAO2ALYP2OVAZFOE3PZHWZWY2HH64MFCO47TINKWA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309824350 (203h20m26.080465675s) [noise=true , address=104.36.82.8:4972 , piece_id=DA5ZEQHEMMJRTFRB4HMJL2OGGSA45P6UPNDJDKAU47S3A6OYQNMA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.310037578 (203h20m26.080678913s) [noise=true , address=104.36.82.4:4804 , piece_id=HV3FD4MSGB3ARPAOJYNYLLXHUS7JAF6KAQWLMIYCXC4UGW5BETTQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.311261871 (203h20m26.081903206s) [noise=true , address=77.90.31.12:4590 , piece_id=5XDULYYTTMHQXP4QSDT4M2W6NS7CM4ZYWH3OU32FMBAGXNQIVU6Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:53.080800025 (203h20m27.85144135s) [upload=162628]: Next returned nil segment Jul 1 20:30:53.080836496 (203h20m27.851477821s) [upload=162628]: Waiting for error group managing segments... Jul 1 20:30:53.362137719 (203h20m28.132806747s) [noise=true , address=45.91.116.4:4937 , piece_id=CMO4GLDKCZ7KQWHM5S4XX5QB2L3KAHUKRUYXWNE5OPEJ464X2NBA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.365537323 (203h20m28.136178648s) [noise=true , address=45.91.116.10:4082 , piece_id=U3OGQJQN3KWNAO2ALYP2OVAZFOE3PZHWZWY2HH64MFCO47TINKWA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.366047188 (203h20m28.136688523s) [noise=true , address=45.91.116.9:5262 , piece_id=N2SGOATWGVAKHJUCGXIUCMO5GTHQS4FHSFXZJBSGGT4HIQK4MFSQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.366428668 (203h20m28.137070003s) [noise=true , address=45.91.116.5:5299 , piece_id=V6X7BVMX3IP23A65VFY7PIHGCJPGKLTZAYH4QVPPUFB34M3JUQYQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.373588435 (203h20m28.14422977s) [noise=true , address=45.91.116.13:4155 , piece_id=WN7BEIS5XO4K3BGAHLFDGBXUK52OHWYBPFFH6GCNADP6HWYBM73Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.395606298 (203h20m28.166247633s) [noise=true , address=77.90.31.12:4589 , piece_id=OAQAOA63GE45RWO52GQFOO6FGD4M2AW6ALCPMKCB7T25UDBFOBIA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.399444591 (203h20m28.170085926s) [noise=true , address=77.90.31.17:4770 , piece_id=OFDOKUGNGNDMRFTF4HF3BHPZO3HSDDJZL7NC6G7PQSPKZRZVWGJA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.409917327 (203h20m28.180558662s) [noise=true , address=77.90.31.12:4590 , piece_id=5XDULYYTTMHQXP4QSDT4M2W6NS7CM4ZYWH3OU32FMBAGXNQIVU6Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.459664931 (203h20m28.230306266s) [noise=true , address=104.36.82.14:4221 , piece_id=JK73AQZVYWALWCBO7DORATYWJOIKWT2WBBHSZ26Q3TJLBYDTYO2Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.461422203 (203h20m28.232063538s) [noise=true , address=45.91.116.13:4154 , piece_id=CWIE4GHPWQCF7YHM2QG62RJMBQBNKNXRK2JI4G6OBTPKN4VV73BA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.506236628 (203h20m28.276877963s) [noise=true , address=45.91.116.6:4975 , piece_id=YUJIO2VMD53TDD66ANUI55LFMDTPHRMKV4Y7L7X66KA2BMKTIUQA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.855073943 (203h20m29.625715268s) [noise=true , address=104.36.82.2:4731 , piece_id=JXQL75TODICFVUAIEE4TRGI2DUYVNC3ZR3RNEARTKQS56IIKZATQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.986719438 (203h20m29.757360773s) [noise=true , address=104.36.82.8:4972 , piece_id=DA5ZEQHEMMJRTFRB4HMJL2OGGSA45P6UPNDJDKAU47S3A6OYQNMA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.986744686 (203h20m29.757386021s) [seg_pos={0 0}, upload=162628]: Segment reached optimal threshold of 13 pieces. Jul 1 20:30:54.986928978 (203h20m29.757570303s) [noise=true , address=45.91.116.8:4048 , piece_id=2G2OOQLJPTUDY5PZSHQ2MNAV7774DPK55SELX5STL5W35MXSFKNQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection; write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection Jul 1 20:30:54.986947524 (203h20m29.757588859s) [noise=true , address=104.36.82.7:4909 , piece_id=JNUIUO5MFV5I3L4CTK6IY2CMQDKTVCGPAR6VQHIKE2BKPIQQNGHA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF Jul 1 20:30:54.987028379 (203h20m29.757669714s) [noise=true , address=104.36.82.4:4804 , piece_id=HV3FD4MSGB3ARPAOJYNYLLXHUS7JAF6KAQWLMIYCXC4UGW5BETTQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g): protocol: read tcp 188.166.225.170:50928->104.36.82.4:4804: use of closed network connection; context canceled Jul 1 20:30:54.987039529 (203h20m29.757680864s) [seg_pos={0 0}, upload=162628]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 20:30:54.987097500 (203h20m29.757738835s) [upload=162628]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 20:30:54.987100907 (203h20m29.757742232s) [upload=162628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 20:30:55.290907064 (203h20m30.061548409s) [upload=162628]: Done uploading segments... Jul 1 20:30:55.290920750 (203h20m30.061562085s) [upload=162628]: Upload finished. err: <nil> Duration: 5.721495019s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 5.852662983s FAIL (2025-07-01 21:15:39 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== p 188.166.225.170:38826->45.91.116.14:4190: use of closed network connection Jul 1 20:30:07.397683164 (203h19m42.168324499s) [seg_pos={0 0}, upload=162621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 20:30:07.397793445 (203h19m42.16843478s) [upload=162621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 20:30:07.397832890 (203h19m42.168474225s) [upload=162621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 20:30:07.690755035 (203h19m42.46139637s) [upload=162621]: Done uploading segments... Jul 1 20:30:07.690777598 (203h19m42.461418933s) [upload=162621]: Upload finished. err: <nil> Jul 1 20:30:51.075923771 (203h20m25.846565096s) [upload=162628]: Starting upload Jul 1 20:30:51.075979769 (203h20m25.846621104s) [upload=162628]: Done starting upload Jul 1 20:30:51.076046185 (203h20m25.84668752s) [upload=162628]: Uploading segments... Jul 1 20:30:51.076156256 (203h20m25.846797591s) [upload=162628]: Got next segment. Inline: false Jul 1 20:30:51.076184720 (203h20m25.846826055s) [upload=162628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 1 20:30:51.076189279 (203h20m25.846830614s) [upload=162628]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 1 20:30:51.307264904 (203h20m26.077906239s) [seg_pos={0 0}, upload=162628]: Begin upload segment... Jul 1 20:30:51.307309248 (203h20m26.077950583s) [seg_pos={0 0}, upload=162628]: Done begin upload segment. Jul 1 20:30:51.307323446 (203h20m26.077964771s) [noise=true , address=45.91.116.8:4048 , piece_id=2G2OOQLJPTUDY5PZSHQ2MNAV7774DPK55SELX5STL5W35MXSFKNQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307341239 (203h20m26.077982574s) [noise=true , address=77.90.31.12:4589 , piece_id=OAQAOA63GE45RWO52GQFOO6FGD4M2AW6ALCPMKCB7T25UDBFOBIA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307377640 (203h20m26.078018965s) [noise=true , address=45.91.116.13:4154 , piece_id=CWIE4GHPWQCF7YHM2QG62RJMBQBNKNXRK2JI4G6OBTPKN4VV73BA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307671732 (203h20m26.078313057s) [noise=true , address=104.36.82.14:4221 , piece_id=JK73AQZVYWALWCBO7DORATYWJOIKWT2WBBHSZ26Q3TJLBYDTYO2Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307680439 (203h20m26.078321774s) [noise=true , address=104.36.82.7:4909 , piece_id=JNUIUO5MFV5I3L4CTK6IY2CMQDKTVCGPAR6VQHIKE2BKPIQQNGHA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307944213 (203h20m26.078585548s) [noise=true , address=45.91.116.5:5299 , piece_id=V6X7BVMX3IP23A65VFY7PIHGCJPGKLTZAYH4QVPPUFB34M3JUQYQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308197999 (203h20m26.078839334s) [noise=true , address=104.36.82.2:4731 , piece_id=JXQL75TODICFVUAIEE4TRGI2DUYVNC3ZR3RNEARTKQS56IIKZATQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308448899 (203h20m26.079090234s) [noise=true , address=45.91.116.4:4937 , piece_id=CMO4GLDKCZ7KQWHM5S4XX5QB2L3KAHUKRUYXWNE5OPEJ464X2NBA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308746398 (203h20m26.079387733s) [noise=true , address=77.90.31.17:4770 , piece_id=OFDOKUGNGNDMRFTF4HF3BHPZO3HSDDJZL7NC6G7PQSPKZRZVWGJA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308975577 (203h20m26.079616912s) [noise=true , address=45.91.116.13:4155 , piece_id=WN7BEIS5XO4K3BGAHLFDGBXUK52OHWYBPFFH6GCNADP6HWYBM73Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309167925 (203h20m26.07980926s) [noise=true , address=45.91.116.9:5262 , piece_id=N2SGOATWGVAKHJUCGXIUCMO5GTHQS4FHSFXZJBSGGT4HIQK4MFSQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309359802 (203h20m26.080001137s) [noise=true , address=45.91.116.6:4975 , piece_id=YUJIO2VMD53TDD66ANUI55LFMDTPHRMKV4Y7L7X66KA2BMKTIUQA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309548883 (203h20m26.080190218s) [noise=true , address=45.91.116.10:4082 , piece_id=U3OGQJQN3KWNAO2ALYP2OVAZFOE3PZHWZWY2HH64MFCO47TINKWA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309824350 (203h20m26.080465675s) [noise=true , address=104.36.82.8:4972 , piece_id=DA5ZEQHEMMJRTFRB4HMJL2OGGSA45P6UPNDJDKAU47S3A6OYQNMA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.310037578 (203h20m26.080678913s) [noise=true , address=104.36.82.4:4804 , piece_id=HV3FD4MSGB3ARPAOJYNYLLXHUS7JAF6KAQWLMIYCXC4UGW5BETTQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.311261871 (203h20m26.081903206s) [noise=true , address=77.90.31.12:4590 , piece_id=5XDULYYTTMHQXP4QSDT4M2W6NS7CM4ZYWH3OU32FMBAGXNQIVU6Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:53.080800025 (203h20m27.85144135s) [upload=162628]: Next returned nil segment Jul 1 20:30:53.080836496 (203h20m27.851477821s) [upload=162628]: Waiting for error group managing segments... Jul 1 20:30:53.362137719 (203h20m28.132806747s) [noise=true , address=45.91.116.4:4937 , piece_id=CMO4GLDKCZ7KQWHM5S4XX5QB2L3KAHUKRUYXWNE5OPEJ464X2NBA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.365537323 (203h20m28.136178648s) [noise=true , address=45.91.116.10:4082 , piece_id=U3OGQJQN3KWNAO2ALYP2OVAZFOE3PZHWZWY2HH64MFCO47TINKWA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.366047188 (203h20m28.136688523s) [noise=true , address=45.91.116.9:5262 , piece_id=N2SGOATWGVAKHJUCGXIUCMO5GTHQS4FHSFXZJBSGGT4HIQK4MFSQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.366428668 (203h20m28.137070003s) [noise=true , address=45.91.116.5:5299 , piece_id=V6X7BVMX3IP23A65VFY7PIHGCJPGKLTZAYH4QVPPUFB34M3JUQYQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.373588435 (203h20m28.14422977s) [noise=true , address=45.91.116.13:4155 , piece_id=WN7BEIS5XO4K3BGAHLFDGBXUK52OHWYBPFFH6GCNADP6HWYBM73Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.395606298 (203h20m28.166247633s) [noise=true , address=77.90.31.12:4589 , piece_id=OAQAOA63GE45RWO52GQFOO6FGD4M2AW6ALCPMKCB7T25UDBFOBIA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.399444591 (203h20m28.170085926s) [noise=true , address=77.90.31.17:4770 , piece_id=OFDOKUGNGNDMRFTF4HF3BHPZO3HSDDJZL7NC6G7PQSPKZRZVWGJA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.409917327 (203h20m28.180558662s) [noise=true , address=77.90.31.12:4590 , piece_id=5XDULYYTTMHQXP4QSDT4M2W6NS7CM4ZYWH3OU32FMBAGXNQIVU6Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.459664931 (203h20m28.230306266s) [noise=true , address=104.36.82.14:4221 , piece_id=JK73AQZVYWALWCBO7DORATYWJOIKWT2WBBHSZ26Q3TJLBYDTYO2Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.461422203 (203h20m28.232063538s) [noise=true , address=45.91.116.13:4154 , piece_id=CWIE4GHPWQCF7YHM2QG62RJMBQBNKNXRK2JI4G6OBTPKN4VV73BA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.506236628 (203h20m28.276877963s) [noise=true , address=45.91.116.6:4975 , piece_id=YUJIO2VMD53TDD66ANUI55LFMDTPHRMKV4Y7L7X66KA2BMKTIUQA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.855073943 (203h20m29.625715268s) [noise=true , address=104.36.82.2:4731 , piece_id=JXQL75TODICFVUAIEE4TRGI2DUYVNC3ZR3RNEARTKQS56IIKZATQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.986719438 (203h20m29.757360773s) [noise=true , address=104.36.82.8:4972 , piece_id=DA5ZEQHEMMJRTFRB4HMJL2OGGSA45P6UPNDJDKAU47S3A6OYQNMA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.986744686 (203h20m29.757386021s) [seg_pos={0 0}, upload=162628]: Segment reached optimal threshold of 13 pieces. Jul 1 20:30:54.986928978 (203h20m29.757570303s) [noise=true , address=45.91.116.8:4048 , piece_id=2G2OOQLJPTUDY5PZSHQ2MNAV7774DPK55SELX5STL5W35MXSFKNQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection; write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection Jul 1 20:30:54.986947524 (203h20m29.757588859s) [noise=true , address=104.36.82.7:4909 , piece_id=JNUIUO5MFV5I3L4CTK6IY2CMQDKTVCGPAR6VQHIKE2BKPIQQNGHA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF Jul 1 20:30:54.987028379 (203h20m29.757669714s) [noise=true , address=104.36.82.4:4804 , piece_id=HV3FD4MSGB3ARPAOJYNYLLXHUS7JAF6KAQWLMIYCXC4UGW5BETTQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g): protocol: read tcp 188.166.225.170:50928->104.36.82.4:4804: use of closed network connection; context canceled Jul 1 20:30:54.987039529 (203h20m29.757680864s) [seg_pos={0 0}, upload=162628]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 20:30:54.987097500 (203h20m29.757738835s) [upload=162628]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 20:30:54.987100907 (203h20m29.757742232s) [upload=162628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 20:30:55.290907064 (203h20m30.061548409s) [upload=162628]: Done uploading segments... Jul 1 20:30:55.290920750 (203h20m30.061562085s) [upload=162628]: Upload finished. err: <nil> Duration: 5.85268714s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 28.298720783s FAIL (2025-07-01 21:14:48 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== p 188.166.225.170:38826->45.91.116.14:4190: use of closed network connection Jul 1 20:30:07.397683164 (203h19m42.168324499s) [seg_pos={0 0}, upload=162621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 20:30:07.397793445 (203h19m42.16843478s) [upload=162621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 20:30:07.397832890 (203h19m42.168474225s) [upload=162621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 20:30:07.690755035 (203h19m42.46139637s) [upload=162621]: Done uploading segments... Jul 1 20:30:07.690777598 (203h19m42.461418933s) [upload=162621]: Upload finished. err: <nil> Jul 1 20:30:51.075923771 (203h20m25.846565096s) [upload=162628]: Starting upload Jul 1 20:30:51.075979769 (203h20m25.846621104s) [upload=162628]: Done starting upload Jul 1 20:30:51.076046185 (203h20m25.84668752s) [upload=162628]: Uploading segments... Jul 1 20:30:51.076156256 (203h20m25.846797591s) [upload=162628]: Got next segment. Inline: false Jul 1 20:30:51.076184720 (203h20m25.846826055s) [upload=162628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 1 20:30:51.076189279 (203h20m25.846830614s) [upload=162628]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 1 20:30:51.307264904 (203h20m26.077906239s) [seg_pos={0 0}, upload=162628]: Begin upload segment... Jul 1 20:30:51.307309248 (203h20m26.077950583s) [seg_pos={0 0}, upload=162628]: Done begin upload segment. Jul 1 20:30:51.307323446 (203h20m26.077964771s) [noise=true , address=45.91.116.8:4048 , piece_id=2G2OOQLJPTUDY5PZSHQ2MNAV7774DPK55SELX5STL5W35MXSFKNQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307341239 (203h20m26.077982574s) [noise=true , address=77.90.31.12:4589 , piece_id=OAQAOA63GE45RWO52GQFOO6FGD4M2AW6ALCPMKCB7T25UDBFOBIA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307377640 (203h20m26.078018965s) [noise=true , address=45.91.116.13:4154 , piece_id=CWIE4GHPWQCF7YHM2QG62RJMBQBNKNXRK2JI4G6OBTPKN4VV73BA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307671732 (203h20m26.078313057s) [noise=true , address=104.36.82.14:4221 , piece_id=JK73AQZVYWALWCBO7DORATYWJOIKWT2WBBHSZ26Q3TJLBYDTYO2Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307680439 (203h20m26.078321774s) [noise=true , address=104.36.82.7:4909 , piece_id=JNUIUO5MFV5I3L4CTK6IY2CMQDKTVCGPAR6VQHIKE2BKPIQQNGHA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307944213 (203h20m26.078585548s) [noise=true , address=45.91.116.5:5299 , piece_id=V6X7BVMX3IP23A65VFY7PIHGCJPGKLTZAYH4QVPPUFB34M3JUQYQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308197999 (203h20m26.078839334s) [noise=true , address=104.36.82.2:4731 , piece_id=JXQL75TODICFVUAIEE4TRGI2DUYVNC3ZR3RNEARTKQS56IIKZATQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308448899 (203h20m26.079090234s) [noise=true , address=45.91.116.4:4937 , piece_id=CMO4GLDKCZ7KQWHM5S4XX5QB2L3KAHUKRUYXWNE5OPEJ464X2NBA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308746398 (203h20m26.079387733s) [noise=true , address=77.90.31.17:4770 , piece_id=OFDOKUGNGNDMRFTF4HF3BHPZO3HSDDJZL7NC6G7PQSPKZRZVWGJA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308975577 (203h20m26.079616912s) [noise=true , address=45.91.116.13:4155 , piece_id=WN7BEIS5XO4K3BGAHLFDGBXUK52OHWYBPFFH6GCNADP6HWYBM73Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309167925 (203h20m26.07980926s) [noise=true , address=45.91.116.9:5262 , piece_id=N2SGOATWGVAKHJUCGXIUCMO5GTHQS4FHSFXZJBSGGT4HIQK4MFSQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309359802 (203h20m26.080001137s) [noise=true , address=45.91.116.6:4975 , piece_id=YUJIO2VMD53TDD66ANUI55LFMDTPHRMKV4Y7L7X66KA2BMKTIUQA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309548883 (203h20m26.080190218s) [noise=true , address=45.91.116.10:4082 , piece_id=U3OGQJQN3KWNAO2ALYP2OVAZFOE3PZHWZWY2HH64MFCO47TINKWA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309824350 (203h20m26.080465675s) [noise=true , address=104.36.82.8:4972 , piece_id=DA5ZEQHEMMJRTFRB4HMJL2OGGSA45P6UPNDJDKAU47S3A6OYQNMA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.310037578 (203h20m26.080678913s) [noise=true , address=104.36.82.4:4804 , piece_id=HV3FD4MSGB3ARPAOJYNYLLXHUS7JAF6KAQWLMIYCXC4UGW5BETTQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.311261871 (203h20m26.081903206s) [noise=true , address=77.90.31.12:4590 , piece_id=5XDULYYTTMHQXP4QSDT4M2W6NS7CM4ZYWH3OU32FMBAGXNQIVU6Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:53.080800025 (203h20m27.85144135s) [upload=162628]: Next returned nil segment Jul 1 20:30:53.080836496 (203h20m27.851477821s) [upload=162628]: Waiting for error group managing segments... Jul 1 20:30:53.362137719 (203h20m28.132806747s) [noise=true , address=45.91.116.4:4937 , piece_id=CMO4GLDKCZ7KQWHM5S4XX5QB2L3KAHUKRUYXWNE5OPEJ464X2NBA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.365537323 (203h20m28.136178648s) [noise=true , address=45.91.116.10:4082 , piece_id=U3OGQJQN3KWNAO2ALYP2OVAZFOE3PZHWZWY2HH64MFCO47TINKWA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.366047188 (203h20m28.136688523s) [noise=true , address=45.91.116.9:5262 , piece_id=N2SGOATWGVAKHJUCGXIUCMO5GTHQS4FHSFXZJBSGGT4HIQK4MFSQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.366428668 (203h20m28.137070003s) [noise=true , address=45.91.116.5:5299 , piece_id=V6X7BVMX3IP23A65VFY7PIHGCJPGKLTZAYH4QVPPUFB34M3JUQYQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.373588435 (203h20m28.14422977s) [noise=true , address=45.91.116.13:4155 , piece_id=WN7BEIS5XO4K3BGAHLFDGBXUK52OHWYBPFFH6GCNADP6HWYBM73Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.395606298 (203h20m28.166247633s) [noise=true , address=77.90.31.12:4589 , piece_id=OAQAOA63GE45RWO52GQFOO6FGD4M2AW6ALCPMKCB7T25UDBFOBIA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.399444591 (203h20m28.170085926s) [noise=true , address=77.90.31.17:4770 , piece_id=OFDOKUGNGNDMRFTF4HF3BHPZO3HSDDJZL7NC6G7PQSPKZRZVWGJA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.409917327 (203h20m28.180558662s) [noise=true , address=77.90.31.12:4590 , piece_id=5XDULYYTTMHQXP4QSDT4M2W6NS7CM4ZYWH3OU32FMBAGXNQIVU6Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.459664931 (203h20m28.230306266s) [noise=true , address=104.36.82.14:4221 , piece_id=JK73AQZVYWALWCBO7DORATYWJOIKWT2WBBHSZ26Q3TJLBYDTYO2Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.461422203 (203h20m28.232063538s) [noise=true , address=45.91.116.13:4154 , piece_id=CWIE4GHPWQCF7YHM2QG62RJMBQBNKNXRK2JI4G6OBTPKN4VV73BA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.506236628 (203h20m28.276877963s) [noise=true , address=45.91.116.6:4975 , piece_id=YUJIO2VMD53TDD66ANUI55LFMDTPHRMKV4Y7L7X66KA2BMKTIUQA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.855073943 (203h20m29.625715268s) [noise=true , address=104.36.82.2:4731 , piece_id=JXQL75TODICFVUAIEE4TRGI2DUYVNC3ZR3RNEARTKQS56IIKZATQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.986719438 (203h20m29.757360773s) [noise=true , address=104.36.82.8:4972 , piece_id=DA5ZEQHEMMJRTFRB4HMJL2OGGSA45P6UPNDJDKAU47S3A6OYQNMA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.986744686 (203h20m29.757386021s) [seg_pos={0 0}, upload=162628]: Segment reached optimal threshold of 13 pieces. Jul 1 20:30:54.986928978 (203h20m29.757570303s) [noise=true , address=45.91.116.8:4048 , piece_id=2G2OOQLJPTUDY5PZSHQ2MNAV7774DPK55SELX5STL5W35MXSFKNQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection; write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection Jul 1 20:30:54.986947524 (203h20m29.757588859s) [noise=true , address=104.36.82.7:4909 , piece_id=JNUIUO5MFV5I3L4CTK6IY2CMQDKTVCGPAR6VQHIKE2BKPIQQNGHA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF Jul 1 20:30:54.987028379 (203h20m29.757669714s) [noise=true , address=104.36.82.4:4804 , piece_id=HV3FD4MSGB3ARPAOJYNYLLXHUS7JAF6KAQWLMIYCXC4UGW5BETTQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g): protocol: read tcp 188.166.225.170:50928->104.36.82.4:4804: use of closed network connection; context canceled Jul 1 20:30:54.987039529 (203h20m29.757680864s) [seg_pos={0 0}, upload=162628]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 20:30:54.987097500 (203h20m29.757738835s) [upload=162628]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 20:30:54.987100907 (203h20m29.757742232s) [upload=162628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 20:30:55.290907064 (203h20m30.061548409s) [upload=162628]: Done uploading segments... Jul 1 20:30:55.290920750 (203h20m30.061562085s) [upload=162628]: Upload finished. err: <nil> Duration: 28.298748215s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 6.428861872s FAIL (2025-07-01 21:13:33 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== p 188.166.225.170:38826->45.91.116.14:4190: use of closed network connection Jul 1 20:30:07.397683164 (203h19m42.168324499s) [seg_pos={0 0}, upload=162621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 20:30:07.397793445 (203h19m42.16843478s) [upload=162621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 20:30:07.397832890 (203h19m42.168474225s) [upload=162621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 20:30:07.690755035 (203h19m42.46139637s) [upload=162621]: Done uploading segments... Jul 1 20:30:07.690777598 (203h19m42.461418933s) [upload=162621]: Upload finished. err: <nil> Jul 1 20:30:51.075923771 (203h20m25.846565096s) [upload=162628]: Starting upload Jul 1 20:30:51.075979769 (203h20m25.846621104s) [upload=162628]: Done starting upload Jul 1 20:30:51.076046185 (203h20m25.84668752s) [upload=162628]: Uploading segments... Jul 1 20:30:51.076156256 (203h20m25.846797591s) [upload=162628]: Got next segment. Inline: false Jul 1 20:30:51.076184720 (203h20m25.846826055s) [upload=162628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 1 20:30:51.076189279 (203h20m25.846830614s) [upload=162628]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 1 20:30:51.307264904 (203h20m26.077906239s) [seg_pos={0 0}, upload=162628]: Begin upload segment... Jul 1 20:30:51.307309248 (203h20m26.077950583s) [seg_pos={0 0}, upload=162628]: Done begin upload segment. Jul 1 20:30:51.307323446 (203h20m26.077964771s) [noise=true , address=45.91.116.8:4048 , piece_id=2G2OOQLJPTUDY5PZSHQ2MNAV7774DPK55SELX5STL5W35MXSFKNQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307341239 (203h20m26.077982574s) [noise=true , address=77.90.31.12:4589 , piece_id=OAQAOA63GE45RWO52GQFOO6FGD4M2AW6ALCPMKCB7T25UDBFOBIA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307377640 (203h20m26.078018965s) [noise=true , address=45.91.116.13:4154 , piece_id=CWIE4GHPWQCF7YHM2QG62RJMBQBNKNXRK2JI4G6OBTPKN4VV73BA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307671732 (203h20m26.078313057s) [noise=true , address=104.36.82.14:4221 , piece_id=JK73AQZVYWALWCBO7DORATYWJOIKWT2WBBHSZ26Q3TJLBYDTYO2Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307680439 (203h20m26.078321774s) [noise=true , address=104.36.82.7:4909 , piece_id=JNUIUO5MFV5I3L4CTK6IY2CMQDKTVCGPAR6VQHIKE2BKPIQQNGHA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307944213 (203h20m26.078585548s) [noise=true , address=45.91.116.5:5299 , piece_id=V6X7BVMX3IP23A65VFY7PIHGCJPGKLTZAYH4QVPPUFB34M3JUQYQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308197999 (203h20m26.078839334s) [noise=true , address=104.36.82.2:4731 , piece_id=JXQL75TODICFVUAIEE4TRGI2DUYVNC3ZR3RNEARTKQS56IIKZATQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308448899 (203h20m26.079090234s) [noise=true , address=45.91.116.4:4937 , piece_id=CMO4GLDKCZ7KQWHM5S4XX5QB2L3KAHUKRUYXWNE5OPEJ464X2NBA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308746398 (203h20m26.079387733s) [noise=true , address=77.90.31.17:4770 , piece_id=OFDOKUGNGNDMRFTF4HF3BHPZO3HSDDJZL7NC6G7PQSPKZRZVWGJA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308975577 (203h20m26.079616912s) [noise=true , address=45.91.116.13:4155 , piece_id=WN7BEIS5XO4K3BGAHLFDGBXUK52OHWYBPFFH6GCNADP6HWYBM73Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309167925 (203h20m26.07980926s) [noise=true , address=45.91.116.9:5262 , piece_id=N2SGOATWGVAKHJUCGXIUCMO5GTHQS4FHSFXZJBSGGT4HIQK4MFSQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309359802 (203h20m26.080001137s) [noise=true , address=45.91.116.6:4975 , piece_id=YUJIO2VMD53TDD66ANUI55LFMDTPHRMKV4Y7L7X66KA2BMKTIUQA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309548883 (203h20m26.080190218s) [noise=true , address=45.91.116.10:4082 , piece_id=U3OGQJQN3KWNAO2ALYP2OVAZFOE3PZHWZWY2HH64MFCO47TINKWA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309824350 (203h20m26.080465675s) [noise=true , address=104.36.82.8:4972 , piece_id=DA5ZEQHEMMJRTFRB4HMJL2OGGSA45P6UPNDJDKAU47S3A6OYQNMA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.310037578 (203h20m26.080678913s) [noise=true , address=104.36.82.4:4804 , piece_id=HV3FD4MSGB3ARPAOJYNYLLXHUS7JAF6KAQWLMIYCXC4UGW5BETTQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.311261871 (203h20m26.081903206s) [noise=true , address=77.90.31.12:4590 , piece_id=5XDULYYTTMHQXP4QSDT4M2W6NS7CM4ZYWH3OU32FMBAGXNQIVU6Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:53.080800025 (203h20m27.85144135s) [upload=162628]: Next returned nil segment Jul 1 20:30:53.080836496 (203h20m27.851477821s) [upload=162628]: Waiting for error group managing segments... Jul 1 20:30:53.362137719 (203h20m28.132806747s) [noise=true , address=45.91.116.4:4937 , piece_id=CMO4GLDKCZ7KQWHM5S4XX5QB2L3KAHUKRUYXWNE5OPEJ464X2NBA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.365537323 (203h20m28.136178648s) [noise=true , address=45.91.116.10:4082 , piece_id=U3OGQJQN3KWNAO2ALYP2OVAZFOE3PZHWZWY2HH64MFCO47TINKWA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.366047188 (203h20m28.136688523s) [noise=true , address=45.91.116.9:5262 , piece_id=N2SGOATWGVAKHJUCGXIUCMO5GTHQS4FHSFXZJBSGGT4HIQK4MFSQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.366428668 (203h20m28.137070003s) [noise=true , address=45.91.116.5:5299 , piece_id=V6X7BVMX3IP23A65VFY7PIHGCJPGKLTZAYH4QVPPUFB34M3JUQYQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.373588435 (203h20m28.14422977s) [noise=true , address=45.91.116.13:4155 , piece_id=WN7BEIS5XO4K3BGAHLFDGBXUK52OHWYBPFFH6GCNADP6HWYBM73Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.395606298 (203h20m28.166247633s) [noise=true , address=77.90.31.12:4589 , piece_id=OAQAOA63GE45RWO52GQFOO6FGD4M2AW6ALCPMKCB7T25UDBFOBIA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.399444591 (203h20m28.170085926s) [noise=true , address=77.90.31.17:4770 , piece_id=OFDOKUGNGNDMRFTF4HF3BHPZO3HSDDJZL7NC6G7PQSPKZRZVWGJA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.409917327 (203h20m28.180558662s) [noise=true , address=77.90.31.12:4590 , piece_id=5XDULYYTTMHQXP4QSDT4M2W6NS7CM4ZYWH3OU32FMBAGXNQIVU6Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.459664931 (203h20m28.230306266s) [noise=true , address=104.36.82.14:4221 , piece_id=JK73AQZVYWALWCBO7DORATYWJOIKWT2WBBHSZ26Q3TJLBYDTYO2Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.461422203 (203h20m28.232063538s) [noise=true , address=45.91.116.13:4154 , piece_id=CWIE4GHPWQCF7YHM2QG62RJMBQBNKNXRK2JI4G6OBTPKN4VV73BA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.506236628 (203h20m28.276877963s) [noise=true , address=45.91.116.6:4975 , piece_id=YUJIO2VMD53TDD66ANUI55LFMDTPHRMKV4Y7L7X66KA2BMKTIUQA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.855073943 (203h20m29.625715268s) [noise=true , address=104.36.82.2:4731 , piece_id=JXQL75TODICFVUAIEE4TRGI2DUYVNC3ZR3RNEARTKQS56IIKZATQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.986719438 (203h20m29.757360773s) [noise=true , address=104.36.82.8:4972 , piece_id=DA5ZEQHEMMJRTFRB4HMJL2OGGSA45P6UPNDJDKAU47S3A6OYQNMA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.986744686 (203h20m29.757386021s) [seg_pos={0 0}, upload=162628]: Segment reached optimal threshold of 13 pieces. Jul 1 20:30:54.986928978 (203h20m29.757570303s) [noise=true , address=45.91.116.8:4048 , piece_id=2G2OOQLJPTUDY5PZSHQ2MNAV7774DPK55SELX5STL5W35MXSFKNQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection; write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection Jul 1 20:30:54.986947524 (203h20m29.757588859s) [noise=true , address=104.36.82.7:4909 , piece_id=JNUIUO5MFV5I3L4CTK6IY2CMQDKTVCGPAR6VQHIKE2BKPIQQNGHA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF Jul 1 20:30:54.987028379 (203h20m29.757669714s) [noise=true , address=104.36.82.4:4804 , piece_id=HV3FD4MSGB3ARPAOJYNYLLXHUS7JAF6KAQWLMIYCXC4UGW5BETTQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g): protocol: read tcp 188.166.225.170:50928->104.36.82.4:4804: use of closed network connection; context canceled Jul 1 20:30:54.987039529 (203h20m29.757680864s) [seg_pos={0 0}, upload=162628]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 20:30:54.987097500 (203h20m29.757738835s) [upload=162628]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 20:30:54.987100907 (203h20m29.757742232s) [upload=162628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 20:30:55.290907064 (203h20m30.061548409s) [upload=162628]: Done uploading segments... Jul 1 20:30:55.290920750 (203h20m30.061562085s) [upload=162628]: Upload finished. err: <nil> Duration: 6.428908991s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 5.736205826s FAIL (2025-07-01 21:12:38 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== p 188.166.225.170:38826->45.91.116.14:4190: use of closed network connection Jul 1 20:30:07.397683164 (203h19m42.168324499s) [seg_pos={0 0}, upload=162621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 20:30:07.397793445 (203h19m42.16843478s) [upload=162621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 20:30:07.397832890 (203h19m42.168474225s) [upload=162621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 20:30:07.690755035 (203h19m42.46139637s) [upload=162621]: Done uploading segments... Jul 1 20:30:07.690777598 (203h19m42.461418933s) [upload=162621]: Upload finished. err: <nil> Jul 1 20:30:51.075923771 (203h20m25.846565096s) [upload=162628]: Starting upload Jul 1 20:30:51.075979769 (203h20m25.846621104s) [upload=162628]: Done starting upload Jul 1 20:30:51.076046185 (203h20m25.84668752s) [upload=162628]: Uploading segments... Jul 1 20:30:51.076156256 (203h20m25.846797591s) [upload=162628]: Got next segment. Inline: false Jul 1 20:30:51.076184720 (203h20m25.846826055s) [upload=162628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 1 20:30:51.076189279 (203h20m25.846830614s) [upload=162628]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 1 20:30:51.307264904 (203h20m26.077906239s) [seg_pos={0 0}, upload=162628]: Begin upload segment... Jul 1 20:30:51.307309248 (203h20m26.077950583s) [seg_pos={0 0}, upload=162628]: Done begin upload segment. Jul 1 20:30:51.307323446 (203h20m26.077964771s) [noise=true , address=45.91.116.8:4048 , piece_id=2G2OOQLJPTUDY5PZSHQ2MNAV7774DPK55SELX5STL5W35MXSFKNQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307341239 (203h20m26.077982574s) [noise=true , address=77.90.31.12:4589 , piece_id=OAQAOA63GE45RWO52GQFOO6FGD4M2AW6ALCPMKCB7T25UDBFOBIA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307377640 (203h20m26.078018965s) [noise=true , address=45.91.116.13:4154 , piece_id=CWIE4GHPWQCF7YHM2QG62RJMBQBNKNXRK2JI4G6OBTPKN4VV73BA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307671732 (203h20m26.078313057s) [noise=true , address=104.36.82.14:4221 , piece_id=JK73AQZVYWALWCBO7DORATYWJOIKWT2WBBHSZ26Q3TJLBYDTYO2Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307680439 (203h20m26.078321774s) [noise=true , address=104.36.82.7:4909 , piece_id=JNUIUO5MFV5I3L4CTK6IY2CMQDKTVCGPAR6VQHIKE2BKPIQQNGHA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307944213 (203h20m26.078585548s) [noise=true , address=45.91.116.5:5299 , piece_id=V6X7BVMX3IP23A65VFY7PIHGCJPGKLTZAYH4QVPPUFB34M3JUQYQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308197999 (203h20m26.078839334s) [noise=true , address=104.36.82.2:4731 , piece_id=JXQL75TODICFVUAIEE4TRGI2DUYVNC3ZR3RNEARTKQS56IIKZATQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308448899 (203h20m26.079090234s) [noise=true , address=45.91.116.4:4937 , piece_id=CMO4GLDKCZ7KQWHM5S4XX5QB2L3KAHUKRUYXWNE5OPEJ464X2NBA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308746398 (203h20m26.079387733s) [noise=true , address=77.90.31.17:4770 , piece_id=OFDOKUGNGNDMRFTF4HF3BHPZO3HSDDJZL7NC6G7PQSPKZRZVWGJA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308975577 (203h20m26.079616912s) [noise=true , address=45.91.116.13:4155 , piece_id=WN7BEIS5XO4K3BGAHLFDGBXUK52OHWYBPFFH6GCNADP6HWYBM73Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309167925 (203h20m26.07980926s) [noise=true , address=45.91.116.9:5262 , piece_id=N2SGOATWGVAKHJUCGXIUCMO5GTHQS4FHSFXZJBSGGT4HIQK4MFSQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309359802 (203h20m26.080001137s) [noise=true , address=45.91.116.6:4975 , piece_id=YUJIO2VMD53TDD66ANUI55LFMDTPHRMKV4Y7L7X66KA2BMKTIUQA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309548883 (203h20m26.080190218s) [noise=true , address=45.91.116.10:4082 , piece_id=U3OGQJQN3KWNAO2ALYP2OVAZFOE3PZHWZWY2HH64MFCO47TINKWA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309824350 (203h20m26.080465675s) [noise=true , address=104.36.82.8:4972 , piece_id=DA5ZEQHEMMJRTFRB4HMJL2OGGSA45P6UPNDJDKAU47S3A6OYQNMA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.310037578 (203h20m26.080678913s) [noise=true , address=104.36.82.4:4804 , piece_id=HV3FD4MSGB3ARPAOJYNYLLXHUS7JAF6KAQWLMIYCXC4UGW5BETTQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.311261871 (203h20m26.081903206s) [noise=true , address=77.90.31.12:4590 , piece_id=5XDULYYTTMHQXP4QSDT4M2W6NS7CM4ZYWH3OU32FMBAGXNQIVU6Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:53.080800025 (203h20m27.85144135s) [upload=162628]: Next returned nil segment Jul 1 20:30:53.080836496 (203h20m27.851477821s) [upload=162628]: Waiting for error group managing segments... Jul 1 20:30:53.362137719 (203h20m28.132806747s) [noise=true , address=45.91.116.4:4937 , piece_id=CMO4GLDKCZ7KQWHM5S4XX5QB2L3KAHUKRUYXWNE5OPEJ464X2NBA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.365537323 (203h20m28.136178648s) [noise=true , address=45.91.116.10:4082 , piece_id=U3OGQJQN3KWNAO2ALYP2OVAZFOE3PZHWZWY2HH64MFCO47TINKWA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.366047188 (203h20m28.136688523s) [noise=true , address=45.91.116.9:5262 , piece_id=N2SGOATWGVAKHJUCGXIUCMO5GTHQS4FHSFXZJBSGGT4HIQK4MFSQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.366428668 (203h20m28.137070003s) [noise=true , address=45.91.116.5:5299 , piece_id=V6X7BVMX3IP23A65VFY7PIHGCJPGKLTZAYH4QVPPUFB34M3JUQYQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.373588435 (203h20m28.14422977s) [noise=true , address=45.91.116.13:4155 , piece_id=WN7BEIS5XO4K3BGAHLFDGBXUK52OHWYBPFFH6GCNADP6HWYBM73Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.395606298 (203h20m28.166247633s) [noise=true , address=77.90.31.12:4589 , piece_id=OAQAOA63GE45RWO52GQFOO6FGD4M2AW6ALCPMKCB7T25UDBFOBIA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.399444591 (203h20m28.170085926s) [noise=true , address=77.90.31.17:4770 , piece_id=OFDOKUGNGNDMRFTF4HF3BHPZO3HSDDJZL7NC6G7PQSPKZRZVWGJA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.409917327 (203h20m28.180558662s) [noise=true , address=77.90.31.12:4590 , piece_id=5XDULYYTTMHQXP4QSDT4M2W6NS7CM4ZYWH3OU32FMBAGXNQIVU6Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.459664931 (203h20m28.230306266s) [noise=true , address=104.36.82.14:4221 , piece_id=JK73AQZVYWALWCBO7DORATYWJOIKWT2WBBHSZ26Q3TJLBYDTYO2Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.461422203 (203h20m28.232063538s) [noise=true , address=45.91.116.13:4154 , piece_id=CWIE4GHPWQCF7YHM2QG62RJMBQBNKNXRK2JI4G6OBTPKN4VV73BA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.506236628 (203h20m28.276877963s) [noise=true , address=45.91.116.6:4975 , piece_id=YUJIO2VMD53TDD66ANUI55LFMDTPHRMKV4Y7L7X66KA2BMKTIUQA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.855073943 (203h20m29.625715268s) [noise=true , address=104.36.82.2:4731 , piece_id=JXQL75TODICFVUAIEE4TRGI2DUYVNC3ZR3RNEARTKQS56IIKZATQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.986719438 (203h20m29.757360773s) [noise=true , address=104.36.82.8:4972 , piece_id=DA5ZEQHEMMJRTFRB4HMJL2OGGSA45P6UPNDJDKAU47S3A6OYQNMA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.986744686 (203h20m29.757386021s) [seg_pos={0 0}, upload=162628]: Segment reached optimal threshold of 13 pieces. Jul 1 20:30:54.986928978 (203h20m29.757570303s) [noise=true , address=45.91.116.8:4048 , piece_id=2G2OOQLJPTUDY5PZSHQ2MNAV7774DPK55SELX5STL5W35MXSFKNQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection; write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection Jul 1 20:30:54.986947524 (203h20m29.757588859s) [noise=true , address=104.36.82.7:4909 , piece_id=JNUIUO5MFV5I3L4CTK6IY2CMQDKTVCGPAR6VQHIKE2BKPIQQNGHA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF Jul 1 20:30:54.987028379 (203h20m29.757669714s) [noise=true , address=104.36.82.4:4804 , piece_id=HV3FD4MSGB3ARPAOJYNYLLXHUS7JAF6KAQWLMIYCXC4UGW5BETTQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g): protocol: read tcp 188.166.225.170:50928->104.36.82.4:4804: use of closed network connection; context canceled Jul 1 20:30:54.987039529 (203h20m29.757680864s) [seg_pos={0 0}, upload=162628]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 20:30:54.987097500 (203h20m29.757738835s) [upload=162628]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 20:30:54.987100907 (203h20m29.757742232s) [upload=162628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 20:30:55.290907064 (203h20m30.061548409s) [upload=162628]: Done uploading segments... Jul 1 20:30:55.290920750 (203h20m30.061562085s) [upload=162628]: Upload finished. err: <nil> Duration: 5.736233458s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 7.55229736s FAIL (2025-07-01 21:11:42 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== p 188.166.225.170:38826->45.91.116.14:4190: use of closed network connection Jul 1 20:30:07.397683164 (203h19m42.168324499s) [seg_pos={0 0}, upload=162621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 20:30:07.397793445 (203h19m42.16843478s) [upload=162621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 20:30:07.397832890 (203h19m42.168474225s) [upload=162621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 20:30:07.690755035 (203h19m42.46139637s) [upload=162621]: Done uploading segments... Jul 1 20:30:07.690777598 (203h19m42.461418933s) [upload=162621]: Upload finished. err: <nil> Jul 1 20:30:51.075923771 (203h20m25.846565096s) [upload=162628]: Starting upload Jul 1 20:30:51.075979769 (203h20m25.846621104s) [upload=162628]: Done starting upload Jul 1 20:30:51.076046185 (203h20m25.84668752s) [upload=162628]: Uploading segments... Jul 1 20:30:51.076156256 (203h20m25.846797591s) [upload=162628]: Got next segment. Inline: false Jul 1 20:30:51.076184720 (203h20m25.846826055s) [upload=162628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 1 20:30:51.076189279 (203h20m25.846830614s) [upload=162628]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 1 20:30:51.307264904 (203h20m26.077906239s) [seg_pos={0 0}, upload=162628]: Begin upload segment... Jul 1 20:30:51.307309248 (203h20m26.077950583s) [seg_pos={0 0}, upload=162628]: Done begin upload segment. Jul 1 20:30:51.307323446 (203h20m26.077964771s) [noise=true , address=45.91.116.8:4048 , piece_id=2G2OOQLJPTUDY5PZSHQ2MNAV7774DPK55SELX5STL5W35MXSFKNQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307341239 (203h20m26.077982574s) [noise=true , address=77.90.31.12:4589 , piece_id=OAQAOA63GE45RWO52GQFOO6FGD4M2AW6ALCPMKCB7T25UDBFOBIA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307377640 (203h20m26.078018965s) [noise=true , address=45.91.116.13:4154 , piece_id=CWIE4GHPWQCF7YHM2QG62RJMBQBNKNXRK2JI4G6OBTPKN4VV73BA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307671732 (203h20m26.078313057s) [noise=true , address=104.36.82.14:4221 , piece_id=JK73AQZVYWALWCBO7DORATYWJOIKWT2WBBHSZ26Q3TJLBYDTYO2Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307680439 (203h20m26.078321774s) [noise=true , address=104.36.82.7:4909 , piece_id=JNUIUO5MFV5I3L4CTK6IY2CMQDKTVCGPAR6VQHIKE2BKPIQQNGHA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307944213 (203h20m26.078585548s) [noise=true , address=45.91.116.5:5299 , piece_id=V6X7BVMX3IP23A65VFY7PIHGCJPGKLTZAYH4QVPPUFB34M3JUQYQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308197999 (203h20m26.078839334s) [noise=true , address=104.36.82.2:4731 , piece_id=JXQL75TODICFVUAIEE4TRGI2DUYVNC3ZR3RNEARTKQS56IIKZATQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308448899 (203h20m26.079090234s) [noise=true , address=45.91.116.4:4937 , piece_id=CMO4GLDKCZ7KQWHM5S4XX5QB2L3KAHUKRUYXWNE5OPEJ464X2NBA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308746398 (203h20m26.079387733s) [noise=true , address=77.90.31.17:4770 , piece_id=OFDOKUGNGNDMRFTF4HF3BHPZO3HSDDJZL7NC6G7PQSPKZRZVWGJA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308975577 (203h20m26.079616912s) [noise=true , address=45.91.116.13:4155 , piece_id=WN7BEIS5XO4K3BGAHLFDGBXUK52OHWYBPFFH6GCNADP6HWYBM73Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309167925 (203h20m26.07980926s) [noise=true , address=45.91.116.9:5262 , piece_id=N2SGOATWGVAKHJUCGXIUCMO5GTHQS4FHSFXZJBSGGT4HIQK4MFSQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309359802 (203h20m26.080001137s) [noise=true , address=45.91.116.6:4975 , piece_id=YUJIO2VMD53TDD66ANUI55LFMDTPHRMKV4Y7L7X66KA2BMKTIUQA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309548883 (203h20m26.080190218s) [noise=true , address=45.91.116.10:4082 , piece_id=U3OGQJQN3KWNAO2ALYP2OVAZFOE3PZHWZWY2HH64MFCO47TINKWA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309824350 (203h20m26.080465675s) [noise=true , address=104.36.82.8:4972 , piece_id=DA5ZEQHEMMJRTFRB4HMJL2OGGSA45P6UPNDJDKAU47S3A6OYQNMA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.310037578 (203h20m26.080678913s) [noise=true , address=104.36.82.4:4804 , piece_id=HV3FD4MSGB3ARPAOJYNYLLXHUS7JAF6KAQWLMIYCXC4UGW5BETTQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.311261871 (203h20m26.081903206s) [noise=true , address=77.90.31.12:4590 , piece_id=5XDULYYTTMHQXP4QSDT4M2W6NS7CM4ZYWH3OU32FMBAGXNQIVU6Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:53.080800025 (203h20m27.85144135s) [upload=162628]: Next returned nil segment Jul 1 20:30:53.080836496 (203h20m27.851477821s) [upload=162628]: Waiting for error group managing segments... Jul 1 20:30:53.362137719 (203h20m28.132806747s) [noise=true , address=45.91.116.4:4937 , piece_id=CMO4GLDKCZ7KQWHM5S4XX5QB2L3KAHUKRUYXWNE5OPEJ464X2NBA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.365537323 (203h20m28.136178648s) [noise=true , address=45.91.116.10:4082 , piece_id=U3OGQJQN3KWNAO2ALYP2OVAZFOE3PZHWZWY2HH64MFCO47TINKWA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.366047188 (203h20m28.136688523s) [noise=true , address=45.91.116.9:5262 , piece_id=N2SGOATWGVAKHJUCGXIUCMO5GTHQS4FHSFXZJBSGGT4HIQK4MFSQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.366428668 (203h20m28.137070003s) [noise=true , address=45.91.116.5:5299 , piece_id=V6X7BVMX3IP23A65VFY7PIHGCJPGKLTZAYH4QVPPUFB34M3JUQYQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.373588435 (203h20m28.14422977s) [noise=true , address=45.91.116.13:4155 , piece_id=WN7BEIS5XO4K3BGAHLFDGBXUK52OHWYBPFFH6GCNADP6HWYBM73Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.395606298 (203h20m28.166247633s) [noise=true , address=77.90.31.12:4589 , piece_id=OAQAOA63GE45RWO52GQFOO6FGD4M2AW6ALCPMKCB7T25UDBFOBIA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.399444591 (203h20m28.170085926s) [noise=true , address=77.90.31.17:4770 , piece_id=OFDOKUGNGNDMRFTF4HF3BHPZO3HSDDJZL7NC6G7PQSPKZRZVWGJA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.409917327 (203h20m28.180558662s) [noise=true , address=77.90.31.12:4590 , piece_id=5XDULYYTTMHQXP4QSDT4M2W6NS7CM4ZYWH3OU32FMBAGXNQIVU6Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.459664931 (203h20m28.230306266s) [noise=true , address=104.36.82.14:4221 , piece_id=JK73AQZVYWALWCBO7DORATYWJOIKWT2WBBHSZ26Q3TJLBYDTYO2Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.461422203 (203h20m28.232063538s) [noise=true , address=45.91.116.13:4154 , piece_id=CWIE4GHPWQCF7YHM2QG62RJMBQBNKNXRK2JI4G6OBTPKN4VV73BA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.506236628 (203h20m28.276877963s) [noise=true , address=45.91.116.6:4975 , piece_id=YUJIO2VMD53TDD66ANUI55LFMDTPHRMKV4Y7L7X66KA2BMKTIUQA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.855073943 (203h20m29.625715268s) [noise=true , address=104.36.82.2:4731 , piece_id=JXQL75TODICFVUAIEE4TRGI2DUYVNC3ZR3RNEARTKQS56IIKZATQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.986719438 (203h20m29.757360773s) [noise=true , address=104.36.82.8:4972 , piece_id=DA5ZEQHEMMJRTFRB4HMJL2OGGSA45P6UPNDJDKAU47S3A6OYQNMA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.986744686 (203h20m29.757386021s) [seg_pos={0 0}, upload=162628]: Segment reached optimal threshold of 13 pieces. Jul 1 20:30:54.986928978 (203h20m29.757570303s) [noise=true , address=45.91.116.8:4048 , piece_id=2G2OOQLJPTUDY5PZSHQ2MNAV7774DPK55SELX5STL5W35MXSFKNQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection; write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection Jul 1 20:30:54.986947524 (203h20m29.757588859s) [noise=true , address=104.36.82.7:4909 , piece_id=JNUIUO5MFV5I3L4CTK6IY2CMQDKTVCGPAR6VQHIKE2BKPIQQNGHA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF Jul 1 20:30:54.987028379 (203h20m29.757669714s) [noise=true , address=104.36.82.4:4804 , piece_id=HV3FD4MSGB3ARPAOJYNYLLXHUS7JAF6KAQWLMIYCXC4UGW5BETTQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g): protocol: read tcp 188.166.225.170:50928->104.36.82.4:4804: use of closed network connection; context canceled Jul 1 20:30:54.987039529 (203h20m29.757680864s) [seg_pos={0 0}, upload=162628]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 20:30:54.987097500 (203h20m29.757738835s) [upload=162628]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 20:30:54.987100907 (203h20m29.757742232s) [upload=162628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 20:30:55.290907064 (203h20m30.061548409s) [upload=162628]: Done uploading segments... Jul 1 20:30:55.290920750 (203h20m30.061562085s) [upload=162628]: Upload finished. err: <nil> Duration: 7.552322859s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 5.870891172s FAIL (2025-07-01 21:10:35 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== p 188.166.225.170:38826->45.91.116.14:4190: use of closed network connection Jul 1 20:30:07.397683164 (203h19m42.168324499s) [seg_pos={0 0}, upload=162621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 20:30:07.397793445 (203h19m42.16843478s) [upload=162621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 20:30:07.397832890 (203h19m42.168474225s) [upload=162621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 20:30:07.690755035 (203h19m42.46139637s) [upload=162621]: Done uploading segments... Jul 1 20:30:07.690777598 (203h19m42.461418933s) [upload=162621]: Upload finished. err: <nil> Jul 1 20:30:51.075923771 (203h20m25.846565096s) [upload=162628]: Starting upload Jul 1 20:30:51.075979769 (203h20m25.846621104s) [upload=162628]: Done starting upload Jul 1 20:30:51.076046185 (203h20m25.84668752s) [upload=162628]: Uploading segments... Jul 1 20:30:51.076156256 (203h20m25.846797591s) [upload=162628]: Got next segment. Inline: false Jul 1 20:30:51.076184720 (203h20m25.846826055s) [upload=162628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 1 20:30:51.076189279 (203h20m25.846830614s) [upload=162628]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 1 20:30:51.307264904 (203h20m26.077906239s) [seg_pos={0 0}, upload=162628]: Begin upload segment... Jul 1 20:30:51.307309248 (203h20m26.077950583s) [seg_pos={0 0}, upload=162628]: Done begin upload segment. Jul 1 20:30:51.307323446 (203h20m26.077964771s) [noise=true , address=45.91.116.8:4048 , piece_id=2G2OOQLJPTUDY5PZSHQ2MNAV7774DPK55SELX5STL5W35MXSFKNQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307341239 (203h20m26.077982574s) [noise=true , address=77.90.31.12:4589 , piece_id=OAQAOA63GE45RWO52GQFOO6FGD4M2AW6ALCPMKCB7T25UDBFOBIA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307377640 (203h20m26.078018965s) [noise=true , address=45.91.116.13:4154 , piece_id=CWIE4GHPWQCF7YHM2QG62RJMBQBNKNXRK2JI4G6OBTPKN4VV73BA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307671732 (203h20m26.078313057s) [noise=true , address=104.36.82.14:4221 , piece_id=JK73AQZVYWALWCBO7DORATYWJOIKWT2WBBHSZ26Q3TJLBYDTYO2Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307680439 (203h20m26.078321774s) [noise=true , address=104.36.82.7:4909 , piece_id=JNUIUO5MFV5I3L4CTK6IY2CMQDKTVCGPAR6VQHIKE2BKPIQQNGHA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307944213 (203h20m26.078585548s) [noise=true , address=45.91.116.5:5299 , piece_id=V6X7BVMX3IP23A65VFY7PIHGCJPGKLTZAYH4QVPPUFB34M3JUQYQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308197999 (203h20m26.078839334s) [noise=true , address=104.36.82.2:4731 , piece_id=JXQL75TODICFVUAIEE4TRGI2DUYVNC3ZR3RNEARTKQS56IIKZATQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308448899 (203h20m26.079090234s) [noise=true , address=45.91.116.4:4937 , piece_id=CMO4GLDKCZ7KQWHM5S4XX5QB2L3KAHUKRUYXWNE5OPEJ464X2NBA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308746398 (203h20m26.079387733s) [noise=true , address=77.90.31.17:4770 , piece_id=OFDOKUGNGNDMRFTF4HF3BHPZO3HSDDJZL7NC6G7PQSPKZRZVWGJA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308975577 (203h20m26.079616912s) [noise=true , address=45.91.116.13:4155 , piece_id=WN7BEIS5XO4K3BGAHLFDGBXUK52OHWYBPFFH6GCNADP6HWYBM73Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309167925 (203h20m26.07980926s) [noise=true , address=45.91.116.9:5262 , piece_id=N2SGOATWGVAKHJUCGXIUCMO5GTHQS4FHSFXZJBSGGT4HIQK4MFSQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309359802 (203h20m26.080001137s) [noise=true , address=45.91.116.6:4975 , piece_id=YUJIO2VMD53TDD66ANUI55LFMDTPHRMKV4Y7L7X66KA2BMKTIUQA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309548883 (203h20m26.080190218s) [noise=true , address=45.91.116.10:4082 , piece_id=U3OGQJQN3KWNAO2ALYP2OVAZFOE3PZHWZWY2HH64MFCO47TINKWA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309824350 (203h20m26.080465675s) [noise=true , address=104.36.82.8:4972 , piece_id=DA5ZEQHEMMJRTFRB4HMJL2OGGSA45P6UPNDJDKAU47S3A6OYQNMA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.310037578 (203h20m26.080678913s) [noise=true , address=104.36.82.4:4804 , piece_id=HV3FD4MSGB3ARPAOJYNYLLXHUS7JAF6KAQWLMIYCXC4UGW5BETTQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.311261871 (203h20m26.081903206s) [noise=true , address=77.90.31.12:4590 , piece_id=5XDULYYTTMHQXP4QSDT4M2W6NS7CM4ZYWH3OU32FMBAGXNQIVU6Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:53.080800025 (203h20m27.85144135s) [upload=162628]: Next returned nil segment Jul 1 20:30:53.080836496 (203h20m27.851477821s) [upload=162628]: Waiting for error group managing segments... Jul 1 20:30:53.362137719 (203h20m28.132806747s) [noise=true , address=45.91.116.4:4937 , piece_id=CMO4GLDKCZ7KQWHM5S4XX5QB2L3KAHUKRUYXWNE5OPEJ464X2NBA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.365537323 (203h20m28.136178648s) [noise=true , address=45.91.116.10:4082 , piece_id=U3OGQJQN3KWNAO2ALYP2OVAZFOE3PZHWZWY2HH64MFCO47TINKWA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.366047188 (203h20m28.136688523s) [noise=true , address=45.91.116.9:5262 , piece_id=N2SGOATWGVAKHJUCGXIUCMO5GTHQS4FHSFXZJBSGGT4HIQK4MFSQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.366428668 (203h20m28.137070003s) [noise=true , address=45.91.116.5:5299 , piece_id=V6X7BVMX3IP23A65VFY7PIHGCJPGKLTZAYH4QVPPUFB34M3JUQYQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.373588435 (203h20m28.14422977s) [noise=true , address=45.91.116.13:4155 , piece_id=WN7BEIS5XO4K3BGAHLFDGBXUK52OHWYBPFFH6GCNADP6HWYBM73Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.395606298 (203h20m28.166247633s) [noise=true , address=77.90.31.12:4589 , piece_id=OAQAOA63GE45RWO52GQFOO6FGD4M2AW6ALCPMKCB7T25UDBFOBIA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.399444591 (203h20m28.170085926s) [noise=true , address=77.90.31.17:4770 , piece_id=OFDOKUGNGNDMRFTF4HF3BHPZO3HSDDJZL7NC6G7PQSPKZRZVWGJA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.409917327 (203h20m28.180558662s) [noise=true , address=77.90.31.12:4590 , piece_id=5XDULYYTTMHQXP4QSDT4M2W6NS7CM4ZYWH3OU32FMBAGXNQIVU6Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.459664931 (203h20m28.230306266s) [noise=true , address=104.36.82.14:4221 , piece_id=JK73AQZVYWALWCBO7DORATYWJOIKWT2WBBHSZ26Q3TJLBYDTYO2Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.461422203 (203h20m28.232063538s) [noise=true , address=45.91.116.13:4154 , piece_id=CWIE4GHPWQCF7YHM2QG62RJMBQBNKNXRK2JI4G6OBTPKN4VV73BA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.506236628 (203h20m28.276877963s) [noise=true , address=45.91.116.6:4975 , piece_id=YUJIO2VMD53TDD66ANUI55LFMDTPHRMKV4Y7L7X66KA2BMKTIUQA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.855073943 (203h20m29.625715268s) [noise=true , address=104.36.82.2:4731 , piece_id=JXQL75TODICFVUAIEE4TRGI2DUYVNC3ZR3RNEARTKQS56IIKZATQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.986719438 (203h20m29.757360773s) [noise=true , address=104.36.82.8:4972 , piece_id=DA5ZEQHEMMJRTFRB4HMJL2OGGSA45P6UPNDJDKAU47S3A6OYQNMA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.986744686 (203h20m29.757386021s) [seg_pos={0 0}, upload=162628]: Segment reached optimal threshold of 13 pieces. Jul 1 20:30:54.986928978 (203h20m29.757570303s) [noise=true , address=45.91.116.8:4048 , piece_id=2G2OOQLJPTUDY5PZSHQ2MNAV7774DPK55SELX5STL5W35MXSFKNQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection; write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection Jul 1 20:30:54.986947524 (203h20m29.757588859s) [noise=true , address=104.36.82.7:4909 , piece_id=JNUIUO5MFV5I3L4CTK6IY2CMQDKTVCGPAR6VQHIKE2BKPIQQNGHA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF Jul 1 20:30:54.987028379 (203h20m29.757669714s) [noise=true , address=104.36.82.4:4804 , piece_id=HV3FD4MSGB3ARPAOJYNYLLXHUS7JAF6KAQWLMIYCXC4UGW5BETTQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g): protocol: read tcp 188.166.225.170:50928->104.36.82.4:4804: use of closed network connection; context canceled Jul 1 20:30:54.987039529 (203h20m29.757680864s) [seg_pos={0 0}, upload=162628]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 20:30:54.987097500 (203h20m29.757738835s) [upload=162628]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 20:30:54.987100907 (203h20m29.757742232s) [upload=162628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 20:30:55.290907064 (203h20m30.061548409s) [upload=162628]: Done uploading segments... Jul 1 20:30:55.290920750 (203h20m30.061562085s) [upload=162628]: Upload finished. err: <nil> Duration: 5.870913685s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 7.546408813s FAIL (2025-07-01 21:09:51 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== p 188.166.225.170:38826->45.91.116.14:4190: use of closed network connection Jul 1 20:30:07.397683164 (203h19m42.168324499s) [seg_pos={0 0}, upload=162621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 20:30:07.397793445 (203h19m42.16843478s) [upload=162621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 20:30:07.397832890 (203h19m42.168474225s) [upload=162621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 20:30:07.690755035 (203h19m42.46139637s) [upload=162621]: Done uploading segments... Jul 1 20:30:07.690777598 (203h19m42.461418933s) [upload=162621]: Upload finished. err: <nil> Jul 1 20:30:51.075923771 (203h20m25.846565096s) [upload=162628]: Starting upload Jul 1 20:30:51.075979769 (203h20m25.846621104s) [upload=162628]: Done starting upload Jul 1 20:30:51.076046185 (203h20m25.84668752s) [upload=162628]: Uploading segments... Jul 1 20:30:51.076156256 (203h20m25.846797591s) [upload=162628]: Got next segment. Inline: false Jul 1 20:30:51.076184720 (203h20m25.846826055s) [upload=162628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 1 20:30:51.076189279 (203h20m25.846830614s) [upload=162628]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 1 20:30:51.307264904 (203h20m26.077906239s) [seg_pos={0 0}, upload=162628]: Begin upload segment... Jul 1 20:30:51.307309248 (203h20m26.077950583s) [seg_pos={0 0}, upload=162628]: Done begin upload segment. Jul 1 20:30:51.307323446 (203h20m26.077964771s) [noise=true , address=45.91.116.8:4048 , piece_id=2G2OOQLJPTUDY5PZSHQ2MNAV7774DPK55SELX5STL5W35MXSFKNQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307341239 (203h20m26.077982574s) [noise=true , address=77.90.31.12:4589 , piece_id=OAQAOA63GE45RWO52GQFOO6FGD4M2AW6ALCPMKCB7T25UDBFOBIA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307377640 (203h20m26.078018965s) [noise=true , address=45.91.116.13:4154 , piece_id=CWIE4GHPWQCF7YHM2QG62RJMBQBNKNXRK2JI4G6OBTPKN4VV73BA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307671732 (203h20m26.078313057s) [noise=true , address=104.36.82.14:4221 , piece_id=JK73AQZVYWALWCBO7DORATYWJOIKWT2WBBHSZ26Q3TJLBYDTYO2Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307680439 (203h20m26.078321774s) [noise=true , address=104.36.82.7:4909 , piece_id=JNUIUO5MFV5I3L4CTK6IY2CMQDKTVCGPAR6VQHIKE2BKPIQQNGHA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307944213 (203h20m26.078585548s) [noise=true , address=45.91.116.5:5299 , piece_id=V6X7BVMX3IP23A65VFY7PIHGCJPGKLTZAYH4QVPPUFB34M3JUQYQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308197999 (203h20m26.078839334s) [noise=true , address=104.36.82.2:4731 , piece_id=JXQL75TODICFVUAIEE4TRGI2DUYVNC3ZR3RNEARTKQS56IIKZATQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308448899 (203h20m26.079090234s) [noise=true , address=45.91.116.4:4937 , piece_id=CMO4GLDKCZ7KQWHM5S4XX5QB2L3KAHUKRUYXWNE5OPEJ464X2NBA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308746398 (203h20m26.079387733s) [noise=true , address=77.90.31.17:4770 , piece_id=OFDOKUGNGNDMRFTF4HF3BHPZO3HSDDJZL7NC6G7PQSPKZRZVWGJA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308975577 (203h20m26.079616912s) [noise=true , address=45.91.116.13:4155 , piece_id=WN7BEIS5XO4K3BGAHLFDGBXUK52OHWYBPFFH6GCNADP6HWYBM73Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309167925 (203h20m26.07980926s) [noise=true , address=45.91.116.9:5262 , piece_id=N2SGOATWGVAKHJUCGXIUCMO5GTHQS4FHSFXZJBSGGT4HIQK4MFSQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309359802 (203h20m26.080001137s) [noise=true , address=45.91.116.6:4975 , piece_id=YUJIO2VMD53TDD66ANUI55LFMDTPHRMKV4Y7L7X66KA2BMKTIUQA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309548883 (203h20m26.080190218s) [noise=true , address=45.91.116.10:4082 , piece_id=U3OGQJQN3KWNAO2ALYP2OVAZFOE3PZHWZWY2HH64MFCO47TINKWA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309824350 (203h20m26.080465675s) [noise=true , address=104.36.82.8:4972 , piece_id=DA5ZEQHEMMJRTFRB4HMJL2OGGSA45P6UPNDJDKAU47S3A6OYQNMA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.310037578 (203h20m26.080678913s) [noise=true , address=104.36.82.4:4804 , piece_id=HV3FD4MSGB3ARPAOJYNYLLXHUS7JAF6KAQWLMIYCXC4UGW5BETTQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.311261871 (203h20m26.081903206s) [noise=true , address=77.90.31.12:4590 , piece_id=5XDULYYTTMHQXP4QSDT4M2W6NS7CM4ZYWH3OU32FMBAGXNQIVU6Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:53.080800025 (203h20m27.85144135s) [upload=162628]: Next returned nil segment Jul 1 20:30:53.080836496 (203h20m27.851477821s) [upload=162628]: Waiting for error group managing segments... Jul 1 20:30:53.362137719 (203h20m28.132806747s) [noise=true , address=45.91.116.4:4937 , piece_id=CMO4GLDKCZ7KQWHM5S4XX5QB2L3KAHUKRUYXWNE5OPEJ464X2NBA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.365537323 (203h20m28.136178648s) [noise=true , address=45.91.116.10:4082 , piece_id=U3OGQJQN3KWNAO2ALYP2OVAZFOE3PZHWZWY2HH64MFCO47TINKWA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.366047188 (203h20m28.136688523s) [noise=true , address=45.91.116.9:5262 , piece_id=N2SGOATWGVAKHJUCGXIUCMO5GTHQS4FHSFXZJBSGGT4HIQK4MFSQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.366428668 (203h20m28.137070003s) [noise=true , address=45.91.116.5:5299 , piece_id=V6X7BVMX3IP23A65VFY7PIHGCJPGKLTZAYH4QVPPUFB34M3JUQYQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.373588435 (203h20m28.14422977s) [noise=true , address=45.91.116.13:4155 , piece_id=WN7BEIS5XO4K3BGAHLFDGBXUK52OHWYBPFFH6GCNADP6HWYBM73Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.395606298 (203h20m28.166247633s) [noise=true , address=77.90.31.12:4589 , piece_id=OAQAOA63GE45RWO52GQFOO6FGD4M2AW6ALCPMKCB7T25UDBFOBIA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.399444591 (203h20m28.170085926s) [noise=true , address=77.90.31.17:4770 , piece_id=OFDOKUGNGNDMRFTF4HF3BHPZO3HSDDJZL7NC6G7PQSPKZRZVWGJA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.409917327 (203h20m28.180558662s) [noise=true , address=77.90.31.12:4590 , piece_id=5XDULYYTTMHQXP4QSDT4M2W6NS7CM4ZYWH3OU32FMBAGXNQIVU6Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.459664931 (203h20m28.230306266s) [noise=true , address=104.36.82.14:4221 , piece_id=JK73AQZVYWALWCBO7DORATYWJOIKWT2WBBHSZ26Q3TJLBYDTYO2Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.461422203 (203h20m28.232063538s) [noise=true , address=45.91.116.13:4154 , piece_id=CWIE4GHPWQCF7YHM2QG62RJMBQBNKNXRK2JI4G6OBTPKN4VV73BA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.506236628 (203h20m28.276877963s) [noise=true , address=45.91.116.6:4975 , piece_id=YUJIO2VMD53TDD66ANUI55LFMDTPHRMKV4Y7L7X66KA2BMKTIUQA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.855073943 (203h20m29.625715268s) [noise=true , address=104.36.82.2:4731 , piece_id=JXQL75TODICFVUAIEE4TRGI2DUYVNC3ZR3RNEARTKQS56IIKZATQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.986719438 (203h20m29.757360773s) [noise=true , address=104.36.82.8:4972 , piece_id=DA5ZEQHEMMJRTFRB4HMJL2OGGSA45P6UPNDJDKAU47S3A6OYQNMA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.986744686 (203h20m29.757386021s) [seg_pos={0 0}, upload=162628]: Segment reached optimal threshold of 13 pieces. Jul 1 20:30:54.986928978 (203h20m29.757570303s) [noise=true , address=45.91.116.8:4048 , piece_id=2G2OOQLJPTUDY5PZSHQ2MNAV7774DPK55SELX5STL5W35MXSFKNQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection; write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection Jul 1 20:30:54.986947524 (203h20m29.757588859s) [noise=true , address=104.36.82.7:4909 , piece_id=JNUIUO5MFV5I3L4CTK6IY2CMQDKTVCGPAR6VQHIKE2BKPIQQNGHA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF Jul 1 20:30:54.987028379 (203h20m29.757669714s) [noise=true , address=104.36.82.4:4804 , piece_id=HV3FD4MSGB3ARPAOJYNYLLXHUS7JAF6KAQWLMIYCXC4UGW5BETTQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g): protocol: read tcp 188.166.225.170:50928->104.36.82.4:4804: use of closed network connection; context canceled Jul 1 20:30:54.987039529 (203h20m29.757680864s) [seg_pos={0 0}, upload=162628]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 20:30:54.987097500 (203h20m29.757738835s) [upload=162628]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 20:30:54.987100907 (203h20m29.757742232s) [upload=162628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 20:30:55.290907064 (203h20m30.061548409s) [upload=162628]: Done uploading segments... Jul 1 20:30:55.290920750 (203h20m30.061562085s) [upload=162628]: Upload finished. err: <nil> Duration: 7.546431157s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 5.74754072s FAIL (2025-07-01 21:08:45 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== p 188.166.225.170:38826->45.91.116.14:4190: use of closed network connection Jul 1 20:30:07.397683164 (203h19m42.168324499s) [seg_pos={0 0}, upload=162621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 20:30:07.397793445 (203h19m42.16843478s) [upload=162621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 20:30:07.397832890 (203h19m42.168474225s) [upload=162621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 20:30:07.690755035 (203h19m42.46139637s) [upload=162621]: Done uploading segments... Jul 1 20:30:07.690777598 (203h19m42.461418933s) [upload=162621]: Upload finished. err: <nil> Jul 1 20:30:51.075923771 (203h20m25.846565096s) [upload=162628]: Starting upload Jul 1 20:30:51.075979769 (203h20m25.846621104s) [upload=162628]: Done starting upload Jul 1 20:30:51.076046185 (203h20m25.84668752s) [upload=162628]: Uploading segments... Jul 1 20:30:51.076156256 (203h20m25.846797591s) [upload=162628]: Got next segment. Inline: false Jul 1 20:30:51.076184720 (203h20m25.846826055s) [upload=162628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 1 20:30:51.076189279 (203h20m25.846830614s) [upload=162628]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 1 20:30:51.307264904 (203h20m26.077906239s) [seg_pos={0 0}, upload=162628]: Begin upload segment... Jul 1 20:30:51.307309248 (203h20m26.077950583s) [seg_pos={0 0}, upload=162628]: Done begin upload segment. Jul 1 20:30:51.307323446 (203h20m26.077964771s) [noise=true , address=45.91.116.8:4048 , piece_id=2G2OOQLJPTUDY5PZSHQ2MNAV7774DPK55SELX5STL5W35MXSFKNQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307341239 (203h20m26.077982574s) [noise=true , address=77.90.31.12:4589 , piece_id=OAQAOA63GE45RWO52GQFOO6FGD4M2AW6ALCPMKCB7T25UDBFOBIA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307377640 (203h20m26.078018965s) [noise=true , address=45.91.116.13:4154 , piece_id=CWIE4GHPWQCF7YHM2QG62RJMBQBNKNXRK2JI4G6OBTPKN4VV73BA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307671732 (203h20m26.078313057s) [noise=true , address=104.36.82.14:4221 , piece_id=JK73AQZVYWALWCBO7DORATYWJOIKWT2WBBHSZ26Q3TJLBYDTYO2Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307680439 (203h20m26.078321774s) [noise=true , address=104.36.82.7:4909 , piece_id=JNUIUO5MFV5I3L4CTK6IY2CMQDKTVCGPAR6VQHIKE2BKPIQQNGHA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307944213 (203h20m26.078585548s) [noise=true , address=45.91.116.5:5299 , piece_id=V6X7BVMX3IP23A65VFY7PIHGCJPGKLTZAYH4QVPPUFB34M3JUQYQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308197999 (203h20m26.078839334s) [noise=true , address=104.36.82.2:4731 , piece_id=JXQL75TODICFVUAIEE4TRGI2DUYVNC3ZR3RNEARTKQS56IIKZATQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308448899 (203h20m26.079090234s) [noise=true , address=45.91.116.4:4937 , piece_id=CMO4GLDKCZ7KQWHM5S4XX5QB2L3KAHUKRUYXWNE5OPEJ464X2NBA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308746398 (203h20m26.079387733s) [noise=true , address=77.90.31.17:4770 , piece_id=OFDOKUGNGNDMRFTF4HF3BHPZO3HSDDJZL7NC6G7PQSPKZRZVWGJA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308975577 (203h20m26.079616912s) [noise=true , address=45.91.116.13:4155 , piece_id=WN7BEIS5XO4K3BGAHLFDGBXUK52OHWYBPFFH6GCNADP6HWYBM73Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309167925 (203h20m26.07980926s) [noise=true , address=45.91.116.9:5262 , piece_id=N2SGOATWGVAKHJUCGXIUCMO5GTHQS4FHSFXZJBSGGT4HIQK4MFSQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309359802 (203h20m26.080001137s) [noise=true , address=45.91.116.6:4975 , piece_id=YUJIO2VMD53TDD66ANUI55LFMDTPHRMKV4Y7L7X66KA2BMKTIUQA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309548883 (203h20m26.080190218s) [noise=true , address=45.91.116.10:4082 , piece_id=U3OGQJQN3KWNAO2ALYP2OVAZFOE3PZHWZWY2HH64MFCO47TINKWA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309824350 (203h20m26.080465675s) [noise=true , address=104.36.82.8:4972 , piece_id=DA5ZEQHEMMJRTFRB4HMJL2OGGSA45P6UPNDJDKAU47S3A6OYQNMA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.310037578 (203h20m26.080678913s) [noise=true , address=104.36.82.4:4804 , piece_id=HV3FD4MSGB3ARPAOJYNYLLXHUS7JAF6KAQWLMIYCXC4UGW5BETTQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.311261871 (203h20m26.081903206s) [noise=true , address=77.90.31.12:4590 , piece_id=5XDULYYTTMHQXP4QSDT4M2W6NS7CM4ZYWH3OU32FMBAGXNQIVU6Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:53.080800025 (203h20m27.85144135s) [upload=162628]: Next returned nil segment Jul 1 20:30:53.080836496 (203h20m27.851477821s) [upload=162628]: Waiting for error group managing segments... Jul 1 20:30:53.362137719 (203h20m28.132806747s) [noise=true , address=45.91.116.4:4937 , piece_id=CMO4GLDKCZ7KQWHM5S4XX5QB2L3KAHUKRUYXWNE5OPEJ464X2NBA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.365537323 (203h20m28.136178648s) [noise=true , address=45.91.116.10:4082 , piece_id=U3OGQJQN3KWNAO2ALYP2OVAZFOE3PZHWZWY2HH64MFCO47TINKWA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.366047188 (203h20m28.136688523s) [noise=true , address=45.91.116.9:5262 , piece_id=N2SGOATWGVAKHJUCGXIUCMO5GTHQS4FHSFXZJBSGGT4HIQK4MFSQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.366428668 (203h20m28.137070003s) [noise=true , address=45.91.116.5:5299 , piece_id=V6X7BVMX3IP23A65VFY7PIHGCJPGKLTZAYH4QVPPUFB34M3JUQYQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.373588435 (203h20m28.14422977s) [noise=true , address=45.91.116.13:4155 , piece_id=WN7BEIS5XO4K3BGAHLFDGBXUK52OHWYBPFFH6GCNADP6HWYBM73Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.395606298 (203h20m28.166247633s) [noise=true , address=77.90.31.12:4589 , piece_id=OAQAOA63GE45RWO52GQFOO6FGD4M2AW6ALCPMKCB7T25UDBFOBIA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.399444591 (203h20m28.170085926s) [noise=true , address=77.90.31.17:4770 , piece_id=OFDOKUGNGNDMRFTF4HF3BHPZO3HSDDJZL7NC6G7PQSPKZRZVWGJA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.409917327 (203h20m28.180558662s) [noise=true , address=77.90.31.12:4590 , piece_id=5XDULYYTTMHQXP4QSDT4M2W6NS7CM4ZYWH3OU32FMBAGXNQIVU6Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.459664931 (203h20m28.230306266s) [noise=true , address=104.36.82.14:4221 , piece_id=JK73AQZVYWALWCBO7DORATYWJOIKWT2WBBHSZ26Q3TJLBYDTYO2Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.461422203 (203h20m28.232063538s) [noise=true , address=45.91.116.13:4154 , piece_id=CWIE4GHPWQCF7YHM2QG62RJMBQBNKNXRK2JI4G6OBTPKN4VV73BA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.506236628 (203h20m28.276877963s) [noise=true , address=45.91.116.6:4975 , piece_id=YUJIO2VMD53TDD66ANUI55LFMDTPHRMKV4Y7L7X66KA2BMKTIUQA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.855073943 (203h20m29.625715268s) [noise=true , address=104.36.82.2:4731 , piece_id=JXQL75TODICFVUAIEE4TRGI2DUYVNC3ZR3RNEARTKQS56IIKZATQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.986719438 (203h20m29.757360773s) [noise=true , address=104.36.82.8:4972 , piece_id=DA5ZEQHEMMJRTFRB4HMJL2OGGSA45P6UPNDJDKAU47S3A6OYQNMA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.986744686 (203h20m29.757386021s) [seg_pos={0 0}, upload=162628]: Segment reached optimal threshold of 13 pieces. Jul 1 20:30:54.986928978 (203h20m29.757570303s) [noise=true , address=45.91.116.8:4048 , piece_id=2G2OOQLJPTUDY5PZSHQ2MNAV7774DPK55SELX5STL5W35MXSFKNQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection; write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection Jul 1 20:30:54.986947524 (203h20m29.757588859s) [noise=true , address=104.36.82.7:4909 , piece_id=JNUIUO5MFV5I3L4CTK6IY2CMQDKTVCGPAR6VQHIKE2BKPIQQNGHA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF Jul 1 20:30:54.987028379 (203h20m29.757669714s) [noise=true , address=104.36.82.4:4804 , piece_id=HV3FD4MSGB3ARPAOJYNYLLXHUS7JAF6KAQWLMIYCXC4UGW5BETTQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g): protocol: read tcp 188.166.225.170:50928->104.36.82.4:4804: use of closed network connection; context canceled Jul 1 20:30:54.987039529 (203h20m29.757680864s) [seg_pos={0 0}, upload=162628]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 20:30:54.987097500 (203h20m29.757738835s) [upload=162628]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 20:30:54.987100907 (203h20m29.757742232s) [upload=162628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 20:30:55.290907064 (203h20m30.061548409s) [upload=162628]: Done uploading segments... Jul 1 20:30:55.290920750 (203h20m30.061562085s) [upload=162628]: Upload finished. err: <nil> Duration: 5.747573674s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 7.186741804s FAIL (2025-07-01 21:07:56 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== p 188.166.225.170:38826->45.91.116.14:4190: use of closed network connection Jul 1 20:30:07.397683164 (203h19m42.168324499s) [seg_pos={0 0}, upload=162621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 20:30:07.397793445 (203h19m42.16843478s) [upload=162621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 20:30:07.397832890 (203h19m42.168474225s) [upload=162621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 20:30:07.690755035 (203h19m42.46139637s) [upload=162621]: Done uploading segments... Jul 1 20:30:07.690777598 (203h19m42.461418933s) [upload=162621]: Upload finished. err: <nil> Jul 1 20:30:51.075923771 (203h20m25.846565096s) [upload=162628]: Starting upload Jul 1 20:30:51.075979769 (203h20m25.846621104s) [upload=162628]: Done starting upload Jul 1 20:30:51.076046185 (203h20m25.84668752s) [upload=162628]: Uploading segments... Jul 1 20:30:51.076156256 (203h20m25.846797591s) [upload=162628]: Got next segment. Inline: false Jul 1 20:30:51.076184720 (203h20m25.846826055s) [upload=162628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 1 20:30:51.076189279 (203h20m25.846830614s) [upload=162628]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 1 20:30:51.307264904 (203h20m26.077906239s) [seg_pos={0 0}, upload=162628]: Begin upload segment... Jul 1 20:30:51.307309248 (203h20m26.077950583s) [seg_pos={0 0}, upload=162628]: Done begin upload segment. Jul 1 20:30:51.307323446 (203h20m26.077964771s) [noise=true , address=45.91.116.8:4048 , piece_id=2G2OOQLJPTUDY5PZSHQ2MNAV7774DPK55SELX5STL5W35MXSFKNQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307341239 (203h20m26.077982574s) [noise=true , address=77.90.31.12:4589 , piece_id=OAQAOA63GE45RWO52GQFOO6FGD4M2AW6ALCPMKCB7T25UDBFOBIA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307377640 (203h20m26.078018965s) [noise=true , address=45.91.116.13:4154 , piece_id=CWIE4GHPWQCF7YHM2QG62RJMBQBNKNXRK2JI4G6OBTPKN4VV73BA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307671732 (203h20m26.078313057s) [noise=true , address=104.36.82.14:4221 , piece_id=JK73AQZVYWALWCBO7DORATYWJOIKWT2WBBHSZ26Q3TJLBYDTYO2Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307680439 (203h20m26.078321774s) [noise=true , address=104.36.82.7:4909 , piece_id=JNUIUO5MFV5I3L4CTK6IY2CMQDKTVCGPAR6VQHIKE2BKPIQQNGHA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307944213 (203h20m26.078585548s) [noise=true , address=45.91.116.5:5299 , piece_id=V6X7BVMX3IP23A65VFY7PIHGCJPGKLTZAYH4QVPPUFB34M3JUQYQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308197999 (203h20m26.078839334s) [noise=true , address=104.36.82.2:4731 , piece_id=JXQL75TODICFVUAIEE4TRGI2DUYVNC3ZR3RNEARTKQS56IIKZATQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308448899 (203h20m26.079090234s) [noise=true , address=45.91.116.4:4937 , piece_id=CMO4GLDKCZ7KQWHM5S4XX5QB2L3KAHUKRUYXWNE5OPEJ464X2NBA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308746398 (203h20m26.079387733s) [noise=true , address=77.90.31.17:4770 , piece_id=OFDOKUGNGNDMRFTF4HF3BHPZO3HSDDJZL7NC6G7PQSPKZRZVWGJA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308975577 (203h20m26.079616912s) [noise=true , address=45.91.116.13:4155 , piece_id=WN7BEIS5XO4K3BGAHLFDGBXUK52OHWYBPFFH6GCNADP6HWYBM73Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309167925 (203h20m26.07980926s) [noise=true , address=45.91.116.9:5262 , piece_id=N2SGOATWGVAKHJUCGXIUCMO5GTHQS4FHSFXZJBSGGT4HIQK4MFSQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309359802 (203h20m26.080001137s) [noise=true , address=45.91.116.6:4975 , piece_id=YUJIO2VMD53TDD66ANUI55LFMDTPHRMKV4Y7L7X66KA2BMKTIUQA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309548883 (203h20m26.080190218s) [noise=true , address=45.91.116.10:4082 , piece_id=U3OGQJQN3KWNAO2ALYP2OVAZFOE3PZHWZWY2HH64MFCO47TINKWA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309824350 (203h20m26.080465675s) [noise=true , address=104.36.82.8:4972 , piece_id=DA5ZEQHEMMJRTFRB4HMJL2OGGSA45P6UPNDJDKAU47S3A6OYQNMA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.310037578 (203h20m26.080678913s) [noise=true , address=104.36.82.4:4804 , piece_id=HV3FD4MSGB3ARPAOJYNYLLXHUS7JAF6KAQWLMIYCXC4UGW5BETTQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.311261871 (203h20m26.081903206s) [noise=true , address=77.90.31.12:4590 , piece_id=5XDULYYTTMHQXP4QSDT4M2W6NS7CM4ZYWH3OU32FMBAGXNQIVU6Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:53.080800025 (203h20m27.85144135s) [upload=162628]: Next returned nil segment Jul 1 20:30:53.080836496 (203h20m27.851477821s) [upload=162628]: Waiting for error group managing segments... Jul 1 20:30:53.362137719 (203h20m28.132806747s) [noise=true , address=45.91.116.4:4937 , piece_id=CMO4GLDKCZ7KQWHM5S4XX5QB2L3KAHUKRUYXWNE5OPEJ464X2NBA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.365537323 (203h20m28.136178648s) [noise=true , address=45.91.116.10:4082 , piece_id=U3OGQJQN3KWNAO2ALYP2OVAZFOE3PZHWZWY2HH64MFCO47TINKWA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.366047188 (203h20m28.136688523s) [noise=true , address=45.91.116.9:5262 , piece_id=N2SGOATWGVAKHJUCGXIUCMO5GTHQS4FHSFXZJBSGGT4HIQK4MFSQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.366428668 (203h20m28.137070003s) [noise=true , address=45.91.116.5:5299 , piece_id=V6X7BVMX3IP23A65VFY7PIHGCJPGKLTZAYH4QVPPUFB34M3JUQYQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.373588435 (203h20m28.14422977s) [noise=true , address=45.91.116.13:4155 , piece_id=WN7BEIS5XO4K3BGAHLFDGBXUK52OHWYBPFFH6GCNADP6HWYBM73Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.395606298 (203h20m28.166247633s) [noise=true , address=77.90.31.12:4589 , piece_id=OAQAOA63GE45RWO52GQFOO6FGD4M2AW6ALCPMKCB7T25UDBFOBIA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.399444591 (203h20m28.170085926s) [noise=true , address=77.90.31.17:4770 , piece_id=OFDOKUGNGNDMRFTF4HF3BHPZO3HSDDJZL7NC6G7PQSPKZRZVWGJA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.409917327 (203h20m28.180558662s) [noise=true , address=77.90.31.12:4590 , piece_id=5XDULYYTTMHQXP4QSDT4M2W6NS7CM4ZYWH3OU32FMBAGXNQIVU6Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.459664931 (203h20m28.230306266s) [noise=true , address=104.36.82.14:4221 , piece_id=JK73AQZVYWALWCBO7DORATYWJOIKWT2WBBHSZ26Q3TJLBYDTYO2Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.461422203 (203h20m28.232063538s) [noise=true , address=45.91.116.13:4154 , piece_id=CWIE4GHPWQCF7YHM2QG62RJMBQBNKNXRK2JI4G6OBTPKN4VV73BA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.506236628 (203h20m28.276877963s) [noise=true , address=45.91.116.6:4975 , piece_id=YUJIO2VMD53TDD66ANUI55LFMDTPHRMKV4Y7L7X66KA2BMKTIUQA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.855073943 (203h20m29.625715268s) [noise=true , address=104.36.82.2:4731 , piece_id=JXQL75TODICFVUAIEE4TRGI2DUYVNC3ZR3RNEARTKQS56IIKZATQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.986719438 (203h20m29.757360773s) [noise=true , address=104.36.82.8:4972 , piece_id=DA5ZEQHEMMJRTFRB4HMJL2OGGSA45P6UPNDJDKAU47S3A6OYQNMA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.986744686 (203h20m29.757386021s) [seg_pos={0 0}, upload=162628]: Segment reached optimal threshold of 13 pieces. Jul 1 20:30:54.986928978 (203h20m29.757570303s) [noise=true , address=45.91.116.8:4048 , piece_id=2G2OOQLJPTUDY5PZSHQ2MNAV7774DPK55SELX5STL5W35MXSFKNQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection; write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection Jul 1 20:30:54.986947524 (203h20m29.757588859s) [noise=true , address=104.36.82.7:4909 , piece_id=JNUIUO5MFV5I3L4CTK6IY2CMQDKTVCGPAR6VQHIKE2BKPIQQNGHA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF Jul 1 20:30:54.987028379 (203h20m29.757669714s) [noise=true , address=104.36.82.4:4804 , piece_id=HV3FD4MSGB3ARPAOJYNYLLXHUS7JAF6KAQWLMIYCXC4UGW5BETTQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g): protocol: read tcp 188.166.225.170:50928->104.36.82.4:4804: use of closed network connection; context canceled Jul 1 20:30:54.987039529 (203h20m29.757680864s) [seg_pos={0 0}, upload=162628]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 20:30:54.987097500 (203h20m29.757738835s) [upload=162628]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 20:30:54.987100907 (203h20m29.757742232s) [upload=162628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 20:30:55.290907064 (203h20m30.061548409s) [upload=162628]: Done uploading segments... Jul 1 20:30:55.290920750 (203h20m30.061562085s) [upload=162628]: Upload finished. err: <nil> Duration: 7.186766121s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 6.397920048s FAIL (2025-07-01 21:07:22 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== p 188.166.225.170:38826->45.91.116.14:4190: use of closed network connection Jul 1 20:30:07.397683164 (203h19m42.168324499s) [seg_pos={0 0}, upload=162621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 20:30:07.397793445 (203h19m42.16843478s) [upload=162621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 20:30:07.397832890 (203h19m42.168474225s) [upload=162621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 20:30:07.690755035 (203h19m42.46139637s) [upload=162621]: Done uploading segments... Jul 1 20:30:07.690777598 (203h19m42.461418933s) [upload=162621]: Upload finished. err: <nil> Jul 1 20:30:51.075923771 (203h20m25.846565096s) [upload=162628]: Starting upload Jul 1 20:30:51.075979769 (203h20m25.846621104s) [upload=162628]: Done starting upload Jul 1 20:30:51.076046185 (203h20m25.84668752s) [upload=162628]: Uploading segments... Jul 1 20:30:51.076156256 (203h20m25.846797591s) [upload=162628]: Got next segment. Inline: false Jul 1 20:30:51.076184720 (203h20m25.846826055s) [upload=162628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 1 20:30:51.076189279 (203h20m25.846830614s) [upload=162628]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 1 20:30:51.307264904 (203h20m26.077906239s) [seg_pos={0 0}, upload=162628]: Begin upload segment... Jul 1 20:30:51.307309248 (203h20m26.077950583s) [seg_pos={0 0}, upload=162628]: Done begin upload segment. Jul 1 20:30:51.307323446 (203h20m26.077964771s) [noise=true , address=45.91.116.8:4048 , piece_id=2G2OOQLJPTUDY5PZSHQ2MNAV7774DPK55SELX5STL5W35MXSFKNQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307341239 (203h20m26.077982574s) [noise=true , address=77.90.31.12:4589 , piece_id=OAQAOA63GE45RWO52GQFOO6FGD4M2AW6ALCPMKCB7T25UDBFOBIA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307377640 (203h20m26.078018965s) [noise=true , address=45.91.116.13:4154 , piece_id=CWIE4GHPWQCF7YHM2QG62RJMBQBNKNXRK2JI4G6OBTPKN4VV73BA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307671732 (203h20m26.078313057s) [noise=true , address=104.36.82.14:4221 , piece_id=JK73AQZVYWALWCBO7DORATYWJOIKWT2WBBHSZ26Q3TJLBYDTYO2Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307680439 (203h20m26.078321774s) [noise=true , address=104.36.82.7:4909 , piece_id=JNUIUO5MFV5I3L4CTK6IY2CMQDKTVCGPAR6VQHIKE2BKPIQQNGHA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307944213 (203h20m26.078585548s) [noise=true , address=45.91.116.5:5299 , piece_id=V6X7BVMX3IP23A65VFY7PIHGCJPGKLTZAYH4QVPPUFB34M3JUQYQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308197999 (203h20m26.078839334s) [noise=true , address=104.36.82.2:4731 , piece_id=JXQL75TODICFVUAIEE4TRGI2DUYVNC3ZR3RNEARTKQS56IIKZATQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308448899 (203h20m26.079090234s) [noise=true , address=45.91.116.4:4937 , piece_id=CMO4GLDKCZ7KQWHM5S4XX5QB2L3KAHUKRUYXWNE5OPEJ464X2NBA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308746398 (203h20m26.079387733s) [noise=true , address=77.90.31.17:4770 , piece_id=OFDOKUGNGNDMRFTF4HF3BHPZO3HSDDJZL7NC6G7PQSPKZRZVWGJA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308975577 (203h20m26.079616912s) [noise=true , address=45.91.116.13:4155 , piece_id=WN7BEIS5XO4K3BGAHLFDGBXUK52OHWYBPFFH6GCNADP6HWYBM73Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309167925 (203h20m26.07980926s) [noise=true , address=45.91.116.9:5262 , piece_id=N2SGOATWGVAKHJUCGXIUCMO5GTHQS4FHSFXZJBSGGT4HIQK4MFSQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309359802 (203h20m26.080001137s) [noise=true , address=45.91.116.6:4975 , piece_id=YUJIO2VMD53TDD66ANUI55LFMDTPHRMKV4Y7L7X66KA2BMKTIUQA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309548883 (203h20m26.080190218s) [noise=true , address=45.91.116.10:4082 , piece_id=U3OGQJQN3KWNAO2ALYP2OVAZFOE3PZHWZWY2HH64MFCO47TINKWA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309824350 (203h20m26.080465675s) [noise=true , address=104.36.82.8:4972 , piece_id=DA5ZEQHEMMJRTFRB4HMJL2OGGSA45P6UPNDJDKAU47S3A6OYQNMA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.310037578 (203h20m26.080678913s) [noise=true , address=104.36.82.4:4804 , piece_id=HV3FD4MSGB3ARPAOJYNYLLXHUS7JAF6KAQWLMIYCXC4UGW5BETTQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.311261871 (203h20m26.081903206s) [noise=true , address=77.90.31.12:4590 , piece_id=5XDULYYTTMHQXP4QSDT4M2W6NS7CM4ZYWH3OU32FMBAGXNQIVU6Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:53.080800025 (203h20m27.85144135s) [upload=162628]: Next returned nil segment Jul 1 20:30:53.080836496 (203h20m27.851477821s) [upload=162628]: Waiting for error group managing segments... Jul 1 20:30:53.362137719 (203h20m28.132806747s) [noise=true , address=45.91.116.4:4937 , piece_id=CMO4GLDKCZ7KQWHM5S4XX5QB2L3KAHUKRUYXWNE5OPEJ464X2NBA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.365537323 (203h20m28.136178648s) [noise=true , address=45.91.116.10:4082 , piece_id=U3OGQJQN3KWNAO2ALYP2OVAZFOE3PZHWZWY2HH64MFCO47TINKWA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.366047188 (203h20m28.136688523s) [noise=true , address=45.91.116.9:5262 , piece_id=N2SGOATWGVAKHJUCGXIUCMO5GTHQS4FHSFXZJBSGGT4HIQK4MFSQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.366428668 (203h20m28.137070003s) [noise=true , address=45.91.116.5:5299 , piece_id=V6X7BVMX3IP23A65VFY7PIHGCJPGKLTZAYH4QVPPUFB34M3JUQYQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.373588435 (203h20m28.14422977s) [noise=true , address=45.91.116.13:4155 , piece_id=WN7BEIS5XO4K3BGAHLFDGBXUK52OHWYBPFFH6GCNADP6HWYBM73Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.395606298 (203h20m28.166247633s) [noise=true , address=77.90.31.12:4589 , piece_id=OAQAOA63GE45RWO52GQFOO6FGD4M2AW6ALCPMKCB7T25UDBFOBIA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.399444591 (203h20m28.170085926s) [noise=true , address=77.90.31.17:4770 , piece_id=OFDOKUGNGNDMRFTF4HF3BHPZO3HSDDJZL7NC6G7PQSPKZRZVWGJA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.409917327 (203h20m28.180558662s) [noise=true , address=77.90.31.12:4590 , piece_id=5XDULYYTTMHQXP4QSDT4M2W6NS7CM4ZYWH3OU32FMBAGXNQIVU6Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.459664931 (203h20m28.230306266s) [noise=true , address=104.36.82.14:4221 , piece_id=JK73AQZVYWALWCBO7DORATYWJOIKWT2WBBHSZ26Q3TJLBYDTYO2Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.461422203 (203h20m28.232063538s) [noise=true , address=45.91.116.13:4154 , piece_id=CWIE4GHPWQCF7YHM2QG62RJMBQBNKNXRK2JI4G6OBTPKN4VV73BA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.506236628 (203h20m28.276877963s) [noise=true , address=45.91.116.6:4975 , piece_id=YUJIO2VMD53TDD66ANUI55LFMDTPHRMKV4Y7L7X66KA2BMKTIUQA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.855073943 (203h20m29.625715268s) [noise=true , address=104.36.82.2:4731 , piece_id=JXQL75TODICFVUAIEE4TRGI2DUYVNC3ZR3RNEARTKQS56IIKZATQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.986719438 (203h20m29.757360773s) [noise=true , address=104.36.82.8:4972 , piece_id=DA5ZEQHEMMJRTFRB4HMJL2OGGSA45P6UPNDJDKAU47S3A6OYQNMA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.986744686 (203h20m29.757386021s) [seg_pos={0 0}, upload=162628]: Segment reached optimal threshold of 13 pieces. Jul 1 20:30:54.986928978 (203h20m29.757570303s) [noise=true , address=45.91.116.8:4048 , piece_id=2G2OOQLJPTUDY5PZSHQ2MNAV7774DPK55SELX5STL5W35MXSFKNQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection; write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection Jul 1 20:30:54.986947524 (203h20m29.757588859s) [noise=true , address=104.36.82.7:4909 , piece_id=JNUIUO5MFV5I3L4CTK6IY2CMQDKTVCGPAR6VQHIKE2BKPIQQNGHA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF Jul 1 20:30:54.987028379 (203h20m29.757669714s) [noise=true , address=104.36.82.4:4804 , piece_id=HV3FD4MSGB3ARPAOJYNYLLXHUS7JAF6KAQWLMIYCXC4UGW5BETTQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g): protocol: read tcp 188.166.225.170:50928->104.36.82.4:4804: use of closed network connection; context canceled Jul 1 20:30:54.987039529 (203h20m29.757680864s) [seg_pos={0 0}, upload=162628]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 20:30:54.987097500 (203h20m29.757738835s) [upload=162628]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 20:30:54.987100907 (203h20m29.757742232s) [upload=162628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 20:30:55.290907064 (203h20m30.061548409s) [upload=162628]: Done uploading segments... Jul 1 20:30:55.290920750 (203h20m30.061562085s) [upload=162628]: Upload finished. err: <nil> Duration: 6.397944836s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 12.151764776s FAIL (2025-07-01 21:07:04 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== p 188.166.225.170:38826->45.91.116.14:4190: use of closed network connection Jul 1 20:30:07.397683164 (203h19m42.168324499s) [seg_pos={0 0}, upload=162621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 20:30:07.397793445 (203h19m42.16843478s) [upload=162621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 20:30:07.397832890 (203h19m42.168474225s) [upload=162621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 20:30:07.690755035 (203h19m42.46139637s) [upload=162621]: Done uploading segments... Jul 1 20:30:07.690777598 (203h19m42.461418933s) [upload=162621]: Upload finished. err: <nil> Jul 1 20:30:51.075923771 (203h20m25.846565096s) [upload=162628]: Starting upload Jul 1 20:30:51.075979769 (203h20m25.846621104s) [upload=162628]: Done starting upload Jul 1 20:30:51.076046185 (203h20m25.84668752s) [upload=162628]: Uploading segments... Jul 1 20:30:51.076156256 (203h20m25.846797591s) [upload=162628]: Got next segment. Inline: false Jul 1 20:30:51.076184720 (203h20m25.846826055s) [upload=162628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 1 20:30:51.076189279 (203h20m25.846830614s) [upload=162628]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 1 20:30:51.307264904 (203h20m26.077906239s) [seg_pos={0 0}, upload=162628]: Begin upload segment... Jul 1 20:30:51.307309248 (203h20m26.077950583s) [seg_pos={0 0}, upload=162628]: Done begin upload segment. Jul 1 20:30:51.307323446 (203h20m26.077964771s) [noise=true , address=45.91.116.8:4048 , piece_id=2G2OOQLJPTUDY5PZSHQ2MNAV7774DPK55SELX5STL5W35MXSFKNQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307341239 (203h20m26.077982574s) [noise=true , address=77.90.31.12:4589 , piece_id=OAQAOA63GE45RWO52GQFOO6FGD4M2AW6ALCPMKCB7T25UDBFOBIA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307377640 (203h20m26.078018965s) [noise=true , address=45.91.116.13:4154 , piece_id=CWIE4GHPWQCF7YHM2QG62RJMBQBNKNXRK2JI4G6OBTPKN4VV73BA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307671732 (203h20m26.078313057s) [noise=true , address=104.36.82.14:4221 , piece_id=JK73AQZVYWALWCBO7DORATYWJOIKWT2WBBHSZ26Q3TJLBYDTYO2Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307680439 (203h20m26.078321774s) [noise=true , address=104.36.82.7:4909 , piece_id=JNUIUO5MFV5I3L4CTK6IY2CMQDKTVCGPAR6VQHIKE2BKPIQQNGHA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307944213 (203h20m26.078585548s) [noise=true , address=45.91.116.5:5299 , piece_id=V6X7BVMX3IP23A65VFY7PIHGCJPGKLTZAYH4QVPPUFB34M3JUQYQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308197999 (203h20m26.078839334s) [noise=true , address=104.36.82.2:4731 , piece_id=JXQL75TODICFVUAIEE4TRGI2DUYVNC3ZR3RNEARTKQS56IIKZATQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308448899 (203h20m26.079090234s) [noise=true , address=45.91.116.4:4937 , piece_id=CMO4GLDKCZ7KQWHM5S4XX5QB2L3KAHUKRUYXWNE5OPEJ464X2NBA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308746398 (203h20m26.079387733s) [noise=true , address=77.90.31.17:4770 , piece_id=OFDOKUGNGNDMRFTF4HF3BHPZO3HSDDJZL7NC6G7PQSPKZRZVWGJA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308975577 (203h20m26.079616912s) [noise=true , address=45.91.116.13:4155 , piece_id=WN7BEIS5XO4K3BGAHLFDGBXUK52OHWYBPFFH6GCNADP6HWYBM73Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309167925 (203h20m26.07980926s) [noise=true , address=45.91.116.9:5262 , piece_id=N2SGOATWGVAKHJUCGXIUCMO5GTHQS4FHSFXZJBSGGT4HIQK4MFSQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309359802 (203h20m26.080001137s) [noise=true , address=45.91.116.6:4975 , piece_id=YUJIO2VMD53TDD66ANUI55LFMDTPHRMKV4Y7L7X66KA2BMKTIUQA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309548883 (203h20m26.080190218s) [noise=true , address=45.91.116.10:4082 , piece_id=U3OGQJQN3KWNAO2ALYP2OVAZFOE3PZHWZWY2HH64MFCO47TINKWA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309824350 (203h20m26.080465675s) [noise=true , address=104.36.82.8:4972 , piece_id=DA5ZEQHEMMJRTFRB4HMJL2OGGSA45P6UPNDJDKAU47S3A6OYQNMA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.310037578 (203h20m26.080678913s) [noise=true , address=104.36.82.4:4804 , piece_id=HV3FD4MSGB3ARPAOJYNYLLXHUS7JAF6KAQWLMIYCXC4UGW5BETTQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.311261871 (203h20m26.081903206s) [noise=true , address=77.90.31.12:4590 , piece_id=5XDULYYTTMHQXP4QSDT4M2W6NS7CM4ZYWH3OU32FMBAGXNQIVU6Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:53.080800025 (203h20m27.85144135s) [upload=162628]: Next returned nil segment Jul 1 20:30:53.080836496 (203h20m27.851477821s) [upload=162628]: Waiting for error group managing segments... Jul 1 20:30:53.362137719 (203h20m28.132806747s) [noise=true , address=45.91.116.4:4937 , piece_id=CMO4GLDKCZ7KQWHM5S4XX5QB2L3KAHUKRUYXWNE5OPEJ464X2NBA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.365537323 (203h20m28.136178648s) [noise=true , address=45.91.116.10:4082 , piece_id=U3OGQJQN3KWNAO2ALYP2OVAZFOE3PZHWZWY2HH64MFCO47TINKWA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.366047188 (203h20m28.136688523s) [noise=true , address=45.91.116.9:5262 , piece_id=N2SGOATWGVAKHJUCGXIUCMO5GTHQS4FHSFXZJBSGGT4HIQK4MFSQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.366428668 (203h20m28.137070003s) [noise=true , address=45.91.116.5:5299 , piece_id=V6X7BVMX3IP23A65VFY7PIHGCJPGKLTZAYH4QVPPUFB34M3JUQYQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.373588435 (203h20m28.14422977s) [noise=true , address=45.91.116.13:4155 , piece_id=WN7BEIS5XO4K3BGAHLFDGBXUK52OHWYBPFFH6GCNADP6HWYBM73Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.395606298 (203h20m28.166247633s) [noise=true , address=77.90.31.12:4589 , piece_id=OAQAOA63GE45RWO52GQFOO6FGD4M2AW6ALCPMKCB7T25UDBFOBIA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.399444591 (203h20m28.170085926s) [noise=true , address=77.90.31.17:4770 , piece_id=OFDOKUGNGNDMRFTF4HF3BHPZO3HSDDJZL7NC6G7PQSPKZRZVWGJA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.409917327 (203h20m28.180558662s) [noise=true , address=77.90.31.12:4590 , piece_id=5XDULYYTTMHQXP4QSDT4M2W6NS7CM4ZYWH3OU32FMBAGXNQIVU6Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.459664931 (203h20m28.230306266s) [noise=true , address=104.36.82.14:4221 , piece_id=JK73AQZVYWALWCBO7DORATYWJOIKWT2WBBHSZ26Q3TJLBYDTYO2Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.461422203 (203h20m28.232063538s) [noise=true , address=45.91.116.13:4154 , piece_id=CWIE4GHPWQCF7YHM2QG62RJMBQBNKNXRK2JI4G6OBTPKN4VV73BA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.506236628 (203h20m28.276877963s) [noise=true , address=45.91.116.6:4975 , piece_id=YUJIO2VMD53TDD66ANUI55LFMDTPHRMKV4Y7L7X66KA2BMKTIUQA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.855073943 (203h20m29.625715268s) [noise=true , address=104.36.82.2:4731 , piece_id=JXQL75TODICFVUAIEE4TRGI2DUYVNC3ZR3RNEARTKQS56IIKZATQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.986719438 (203h20m29.757360773s) [noise=true , address=104.36.82.8:4972 , piece_id=DA5ZEQHEMMJRTFRB4HMJL2OGGSA45P6UPNDJDKAU47S3A6OYQNMA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.986744686 (203h20m29.757386021s) [seg_pos={0 0}, upload=162628]: Segment reached optimal threshold of 13 pieces. Jul 1 20:30:54.986928978 (203h20m29.757570303s) [noise=true , address=45.91.116.8:4048 , piece_id=2G2OOQLJPTUDY5PZSHQ2MNAV7774DPK55SELX5STL5W35MXSFKNQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection; write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection Jul 1 20:30:54.986947524 (203h20m29.757588859s) [noise=true , address=104.36.82.7:4909 , piece_id=JNUIUO5MFV5I3L4CTK6IY2CMQDKTVCGPAR6VQHIKE2BKPIQQNGHA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF Jul 1 20:30:54.987028379 (203h20m29.757669714s) [noise=true , address=104.36.82.4:4804 , piece_id=HV3FD4MSGB3ARPAOJYNYLLXHUS7JAF6KAQWLMIYCXC4UGW5BETTQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g): protocol: read tcp 188.166.225.170:50928->104.36.82.4:4804: use of closed network connection; context canceled Jul 1 20:30:54.987039529 (203h20m29.757680864s) [seg_pos={0 0}, upload=162628]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 20:30:54.987097500 (203h20m29.757738835s) [upload=162628]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 20:30:54.987100907 (203h20m29.757742232s) [upload=162628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 20:30:55.290907064 (203h20m30.061548409s) [upload=162628]: Done uploading segments... Jul 1 20:30:55.290920750 (203h20m30.061562085s) [upload=162628]: Upload finished. err: <nil> Duration: 12.15179333s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 6.954929472s FAIL (2025-07-01 21:06:26 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== p 188.166.225.170:38826->45.91.116.14:4190: use of closed network connection Jul 1 20:30:07.397683164 (203h19m42.168324499s) [seg_pos={0 0}, upload=162621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 20:30:07.397793445 (203h19m42.16843478s) [upload=162621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 20:30:07.397832890 (203h19m42.168474225s) [upload=162621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 20:30:07.690755035 (203h19m42.46139637s) [upload=162621]: Done uploading segments... Jul 1 20:30:07.690777598 (203h19m42.461418933s) [upload=162621]: Upload finished. err: <nil> Jul 1 20:30:51.075923771 (203h20m25.846565096s) [upload=162628]: Starting upload Jul 1 20:30:51.075979769 (203h20m25.846621104s) [upload=162628]: Done starting upload Jul 1 20:30:51.076046185 (203h20m25.84668752s) [upload=162628]: Uploading segments... Jul 1 20:30:51.076156256 (203h20m25.846797591s) [upload=162628]: Got next segment. Inline: false Jul 1 20:30:51.076184720 (203h20m25.846826055s) [upload=162628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 1 20:30:51.076189279 (203h20m25.846830614s) [upload=162628]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 1 20:30:51.307264904 (203h20m26.077906239s) [seg_pos={0 0}, upload=162628]: Begin upload segment... Jul 1 20:30:51.307309248 (203h20m26.077950583s) [seg_pos={0 0}, upload=162628]: Done begin upload segment. Jul 1 20:30:51.307323446 (203h20m26.077964771s) [noise=true , address=45.91.116.8:4048 , piece_id=2G2OOQLJPTUDY5PZSHQ2MNAV7774DPK55SELX5STL5W35MXSFKNQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307341239 (203h20m26.077982574s) [noise=true , address=77.90.31.12:4589 , piece_id=OAQAOA63GE45RWO52GQFOO6FGD4M2AW6ALCPMKCB7T25UDBFOBIA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307377640 (203h20m26.078018965s) [noise=true , address=45.91.116.13:4154 , piece_id=CWIE4GHPWQCF7YHM2QG62RJMBQBNKNXRK2JI4G6OBTPKN4VV73BA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307671732 (203h20m26.078313057s) [noise=true , address=104.36.82.14:4221 , piece_id=JK73AQZVYWALWCBO7DORATYWJOIKWT2WBBHSZ26Q3TJLBYDTYO2Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307680439 (203h20m26.078321774s) [noise=true , address=104.36.82.7:4909 , piece_id=JNUIUO5MFV5I3L4CTK6IY2CMQDKTVCGPAR6VQHIKE2BKPIQQNGHA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307944213 (203h20m26.078585548s) [noise=true , address=45.91.116.5:5299 , piece_id=V6X7BVMX3IP23A65VFY7PIHGCJPGKLTZAYH4QVPPUFB34M3JUQYQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308197999 (203h20m26.078839334s) [noise=true , address=104.36.82.2:4731 , piece_id=JXQL75TODICFVUAIEE4TRGI2DUYVNC3ZR3RNEARTKQS56IIKZATQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308448899 (203h20m26.079090234s) [noise=true , address=45.91.116.4:4937 , piece_id=CMO4GLDKCZ7KQWHM5S4XX5QB2L3KAHUKRUYXWNE5OPEJ464X2NBA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308746398 (203h20m26.079387733s) [noise=true , address=77.90.31.17:4770 , piece_id=OFDOKUGNGNDMRFTF4HF3BHPZO3HSDDJZL7NC6G7PQSPKZRZVWGJA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308975577 (203h20m26.079616912s) [noise=true , address=45.91.116.13:4155 , piece_id=WN7BEIS5XO4K3BGAHLFDGBXUK52OHWYBPFFH6GCNADP6HWYBM73Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309167925 (203h20m26.07980926s) [noise=true , address=45.91.116.9:5262 , piece_id=N2SGOATWGVAKHJUCGXIUCMO5GTHQS4FHSFXZJBSGGT4HIQK4MFSQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309359802 (203h20m26.080001137s) [noise=true , address=45.91.116.6:4975 , piece_id=YUJIO2VMD53TDD66ANUI55LFMDTPHRMKV4Y7L7X66KA2BMKTIUQA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309548883 (203h20m26.080190218s) [noise=true , address=45.91.116.10:4082 , piece_id=U3OGQJQN3KWNAO2ALYP2OVAZFOE3PZHWZWY2HH64MFCO47TINKWA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309824350 (203h20m26.080465675s) [noise=true , address=104.36.82.8:4972 , piece_id=DA5ZEQHEMMJRTFRB4HMJL2OGGSA45P6UPNDJDKAU47S3A6OYQNMA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.310037578 (203h20m26.080678913s) [noise=true , address=104.36.82.4:4804 , piece_id=HV3FD4MSGB3ARPAOJYNYLLXHUS7JAF6KAQWLMIYCXC4UGW5BETTQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.311261871 (203h20m26.081903206s) [noise=true , address=77.90.31.12:4590 , piece_id=5XDULYYTTMHQXP4QSDT4M2W6NS7CM4ZYWH3OU32FMBAGXNQIVU6Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:53.080800025 (203h20m27.85144135s) [upload=162628]: Next returned nil segment Jul 1 20:30:53.080836496 (203h20m27.851477821s) [upload=162628]: Waiting for error group managing segments... Jul 1 20:30:53.362137719 (203h20m28.132806747s) [noise=true , address=45.91.116.4:4937 , piece_id=CMO4GLDKCZ7KQWHM5S4XX5QB2L3KAHUKRUYXWNE5OPEJ464X2NBA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.365537323 (203h20m28.136178648s) [noise=true , address=45.91.116.10:4082 , piece_id=U3OGQJQN3KWNAO2ALYP2OVAZFOE3PZHWZWY2HH64MFCO47TINKWA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.366047188 (203h20m28.136688523s) [noise=true , address=45.91.116.9:5262 , piece_id=N2SGOATWGVAKHJUCGXIUCMO5GTHQS4FHSFXZJBSGGT4HIQK4MFSQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.366428668 (203h20m28.137070003s) [noise=true , address=45.91.116.5:5299 , piece_id=V6X7BVMX3IP23A65VFY7PIHGCJPGKLTZAYH4QVPPUFB34M3JUQYQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.373588435 (203h20m28.14422977s) [noise=true , address=45.91.116.13:4155 , piece_id=WN7BEIS5XO4K3BGAHLFDGBXUK52OHWYBPFFH6GCNADP6HWYBM73Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.395606298 (203h20m28.166247633s) [noise=true , address=77.90.31.12:4589 , piece_id=OAQAOA63GE45RWO52GQFOO6FGD4M2AW6ALCPMKCB7T25UDBFOBIA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.399444591 (203h20m28.170085926s) [noise=true , address=77.90.31.17:4770 , piece_id=OFDOKUGNGNDMRFTF4HF3BHPZO3HSDDJZL7NC6G7PQSPKZRZVWGJA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.409917327 (203h20m28.180558662s) [noise=true , address=77.90.31.12:4590 , piece_id=5XDULYYTTMHQXP4QSDT4M2W6NS7CM4ZYWH3OU32FMBAGXNQIVU6Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.459664931 (203h20m28.230306266s) [noise=true , address=104.36.82.14:4221 , piece_id=JK73AQZVYWALWCBO7DORATYWJOIKWT2WBBHSZ26Q3TJLBYDTYO2Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.461422203 (203h20m28.232063538s) [noise=true , address=45.91.116.13:4154 , piece_id=CWIE4GHPWQCF7YHM2QG62RJMBQBNKNXRK2JI4G6OBTPKN4VV73BA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.506236628 (203h20m28.276877963s) [noise=true , address=45.91.116.6:4975 , piece_id=YUJIO2VMD53TDD66ANUI55LFMDTPHRMKV4Y7L7X66KA2BMKTIUQA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.855073943 (203h20m29.625715268s) [noise=true , address=104.36.82.2:4731 , piece_id=JXQL75TODICFVUAIEE4TRGI2DUYVNC3ZR3RNEARTKQS56IIKZATQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.986719438 (203h20m29.757360773s) [noise=true , address=104.36.82.8:4972 , piece_id=DA5ZEQHEMMJRTFRB4HMJL2OGGSA45P6UPNDJDKAU47S3A6OYQNMA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.986744686 (203h20m29.757386021s) [seg_pos={0 0}, upload=162628]: Segment reached optimal threshold of 13 pieces. Jul 1 20:30:54.986928978 (203h20m29.757570303s) [noise=true , address=45.91.116.8:4048 , piece_id=2G2OOQLJPTUDY5PZSHQ2MNAV7774DPK55SELX5STL5W35MXSFKNQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection; write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection Jul 1 20:30:54.986947524 (203h20m29.757588859s) [noise=true , address=104.36.82.7:4909 , piece_id=JNUIUO5MFV5I3L4CTK6IY2CMQDKTVCGPAR6VQHIKE2BKPIQQNGHA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF Jul 1 20:30:54.987028379 (203h20m29.757669714s) [noise=true , address=104.36.82.4:4804 , piece_id=HV3FD4MSGB3ARPAOJYNYLLXHUS7JAF6KAQWLMIYCXC4UGW5BETTQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g): protocol: read tcp 188.166.225.170:50928->104.36.82.4:4804: use of closed network connection; context canceled Jul 1 20:30:54.987039529 (203h20m29.757680864s) [seg_pos={0 0}, upload=162628]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 20:30:54.987097500 (203h20m29.757738835s) [upload=162628]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 20:30:54.987100907 (203h20m29.757742232s) [upload=162628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 20:30:55.290907064 (203h20m30.061548409s) [upload=162628]: Done uploading segments... Jul 1 20:30:55.290920750 (203h20m30.061562085s) [upload=162628]: Upload finished. err: <nil> Duration: 6.954957757s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 6.708025727s FAIL (2025-07-01 21:05:49 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== p 188.166.225.170:38826->45.91.116.14:4190: use of closed network connection Jul 1 20:30:07.397683164 (203h19m42.168324499s) [seg_pos={0 0}, upload=162621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 20:30:07.397793445 (203h19m42.16843478s) [upload=162621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 20:30:07.397832890 (203h19m42.168474225s) [upload=162621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 20:30:07.690755035 (203h19m42.46139637s) [upload=162621]: Done uploading segments... Jul 1 20:30:07.690777598 (203h19m42.461418933s) [upload=162621]: Upload finished. err: <nil> Jul 1 20:30:51.075923771 (203h20m25.846565096s) [upload=162628]: Starting upload Jul 1 20:30:51.075979769 (203h20m25.846621104s) [upload=162628]: Done starting upload Jul 1 20:30:51.076046185 (203h20m25.84668752s) [upload=162628]: Uploading segments... Jul 1 20:30:51.076156256 (203h20m25.846797591s) [upload=162628]: Got next segment. Inline: false Jul 1 20:30:51.076184720 (203h20m25.846826055s) [upload=162628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 1 20:30:51.076189279 (203h20m25.846830614s) [upload=162628]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 1 20:30:51.307264904 (203h20m26.077906239s) [seg_pos={0 0}, upload=162628]: Begin upload segment... Jul 1 20:30:51.307309248 (203h20m26.077950583s) [seg_pos={0 0}, upload=162628]: Done begin upload segment. Jul 1 20:30:51.307323446 (203h20m26.077964771s) [noise=true , address=45.91.116.8:4048 , piece_id=2G2OOQLJPTUDY5PZSHQ2MNAV7774DPK55SELX5STL5W35MXSFKNQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307341239 (203h20m26.077982574s) [noise=true , address=77.90.31.12:4589 , piece_id=OAQAOA63GE45RWO52GQFOO6FGD4M2AW6ALCPMKCB7T25UDBFOBIA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307377640 (203h20m26.078018965s) [noise=true , address=45.91.116.13:4154 , piece_id=CWIE4GHPWQCF7YHM2QG62RJMBQBNKNXRK2JI4G6OBTPKN4VV73BA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307671732 (203h20m26.078313057s) [noise=true , address=104.36.82.14:4221 , piece_id=JK73AQZVYWALWCBO7DORATYWJOIKWT2WBBHSZ26Q3TJLBYDTYO2Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307680439 (203h20m26.078321774s) [noise=true , address=104.36.82.7:4909 , piece_id=JNUIUO5MFV5I3L4CTK6IY2CMQDKTVCGPAR6VQHIKE2BKPIQQNGHA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307944213 (203h20m26.078585548s) [noise=true , address=45.91.116.5:5299 , piece_id=V6X7BVMX3IP23A65VFY7PIHGCJPGKLTZAYH4QVPPUFB34M3JUQYQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308197999 (203h20m26.078839334s) [noise=true , address=104.36.82.2:4731 , piece_id=JXQL75TODICFVUAIEE4TRGI2DUYVNC3ZR3RNEARTKQS56IIKZATQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308448899 (203h20m26.079090234s) [noise=true , address=45.91.116.4:4937 , piece_id=CMO4GLDKCZ7KQWHM5S4XX5QB2L3KAHUKRUYXWNE5OPEJ464X2NBA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308746398 (203h20m26.079387733s) [noise=true , address=77.90.31.17:4770 , piece_id=OFDOKUGNGNDMRFTF4HF3BHPZO3HSDDJZL7NC6G7PQSPKZRZVWGJA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308975577 (203h20m26.079616912s) [noise=true , address=45.91.116.13:4155 , piece_id=WN7BEIS5XO4K3BGAHLFDGBXUK52OHWYBPFFH6GCNADP6HWYBM73Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309167925 (203h20m26.07980926s) [noise=true , address=45.91.116.9:5262 , piece_id=N2SGOATWGVAKHJUCGXIUCMO5GTHQS4FHSFXZJBSGGT4HIQK4MFSQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309359802 (203h20m26.080001137s) [noise=true , address=45.91.116.6:4975 , piece_id=YUJIO2VMD53TDD66ANUI55LFMDTPHRMKV4Y7L7X66KA2BMKTIUQA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309548883 (203h20m26.080190218s) [noise=true , address=45.91.116.10:4082 , piece_id=U3OGQJQN3KWNAO2ALYP2OVAZFOE3PZHWZWY2HH64MFCO47TINKWA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309824350 (203h20m26.080465675s) [noise=true , address=104.36.82.8:4972 , piece_id=DA5ZEQHEMMJRTFRB4HMJL2OGGSA45P6UPNDJDKAU47S3A6OYQNMA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.310037578 (203h20m26.080678913s) [noise=true , address=104.36.82.4:4804 , piece_id=HV3FD4MSGB3ARPAOJYNYLLXHUS7JAF6KAQWLMIYCXC4UGW5BETTQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.311261871 (203h20m26.081903206s) [noise=true , address=77.90.31.12:4590 , piece_id=5XDULYYTTMHQXP4QSDT4M2W6NS7CM4ZYWH3OU32FMBAGXNQIVU6Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:53.080800025 (203h20m27.85144135s) [upload=162628]: Next returned nil segment Jul 1 20:30:53.080836496 (203h20m27.851477821s) [upload=162628]: Waiting for error group managing segments... Jul 1 20:30:53.362137719 (203h20m28.132806747s) [noise=true , address=45.91.116.4:4937 , piece_id=CMO4GLDKCZ7KQWHM5S4XX5QB2L3KAHUKRUYXWNE5OPEJ464X2NBA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.365537323 (203h20m28.136178648s) [noise=true , address=45.91.116.10:4082 , piece_id=U3OGQJQN3KWNAO2ALYP2OVAZFOE3PZHWZWY2HH64MFCO47TINKWA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.366047188 (203h20m28.136688523s) [noise=true , address=45.91.116.9:5262 , piece_id=N2SGOATWGVAKHJUCGXIUCMO5GTHQS4FHSFXZJBSGGT4HIQK4MFSQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.366428668 (203h20m28.137070003s) [noise=true , address=45.91.116.5:5299 , piece_id=V6X7BVMX3IP23A65VFY7PIHGCJPGKLTZAYH4QVPPUFB34M3JUQYQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.373588435 (203h20m28.14422977s) [noise=true , address=45.91.116.13:4155 , piece_id=WN7BEIS5XO4K3BGAHLFDGBXUK52OHWYBPFFH6GCNADP6HWYBM73Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.395606298 (203h20m28.166247633s) [noise=true , address=77.90.31.12:4589 , piece_id=OAQAOA63GE45RWO52GQFOO6FGD4M2AW6ALCPMKCB7T25UDBFOBIA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.399444591 (203h20m28.170085926s) [noise=true , address=77.90.31.17:4770 , piece_id=OFDOKUGNGNDMRFTF4HF3BHPZO3HSDDJZL7NC6G7PQSPKZRZVWGJA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.409917327 (203h20m28.180558662s) [noise=true , address=77.90.31.12:4590 , piece_id=5XDULYYTTMHQXP4QSDT4M2W6NS7CM4ZYWH3OU32FMBAGXNQIVU6Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.459664931 (203h20m28.230306266s) [noise=true , address=104.36.82.14:4221 , piece_id=JK73AQZVYWALWCBO7DORATYWJOIKWT2WBBHSZ26Q3TJLBYDTYO2Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.461422203 (203h20m28.232063538s) [noise=true , address=45.91.116.13:4154 , piece_id=CWIE4GHPWQCF7YHM2QG62RJMBQBNKNXRK2JI4G6OBTPKN4VV73BA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.506236628 (203h20m28.276877963s) [noise=true , address=45.91.116.6:4975 , piece_id=YUJIO2VMD53TDD66ANUI55LFMDTPHRMKV4Y7L7X66KA2BMKTIUQA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.855073943 (203h20m29.625715268s) [noise=true , address=104.36.82.2:4731 , piece_id=JXQL75TODICFVUAIEE4TRGI2DUYVNC3ZR3RNEARTKQS56IIKZATQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.986719438 (203h20m29.757360773s) [noise=true , address=104.36.82.8:4972 , piece_id=DA5ZEQHEMMJRTFRB4HMJL2OGGSA45P6UPNDJDKAU47S3A6OYQNMA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.986744686 (203h20m29.757386021s) [seg_pos={0 0}, upload=162628]: Segment reached optimal threshold of 13 pieces. Jul 1 20:30:54.986928978 (203h20m29.757570303s) [noise=true , address=45.91.116.8:4048 , piece_id=2G2OOQLJPTUDY5PZSHQ2MNAV7774DPK55SELX5STL5W35MXSFKNQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection; write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection Jul 1 20:30:54.986947524 (203h20m29.757588859s) [noise=true , address=104.36.82.7:4909 , piece_id=JNUIUO5MFV5I3L4CTK6IY2CMQDKTVCGPAR6VQHIKE2BKPIQQNGHA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF Jul 1 20:30:54.987028379 (203h20m29.757669714s) [noise=true , address=104.36.82.4:4804 , piece_id=HV3FD4MSGB3ARPAOJYNYLLXHUS7JAF6KAQWLMIYCXC4UGW5BETTQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g): protocol: read tcp 188.166.225.170:50928->104.36.82.4:4804: use of closed network connection; context canceled Jul 1 20:30:54.987039529 (203h20m29.757680864s) [seg_pos={0 0}, upload=162628]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 20:30:54.987097500 (203h20m29.757738835s) [upload=162628]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 20:30:54.987100907 (203h20m29.757742232s) [upload=162628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 20:30:55.290907064 (203h20m30.061548409s) [upload=162628]: Done uploading segments... Jul 1 20:30:55.290920750 (203h20m30.061562085s) [upload=162628]: Upload finished. err: <nil> Duration: 6.708050542s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 5.953934175s FAIL (2025-07-01 21:04:48 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== p 188.166.225.170:38826->45.91.116.14:4190: use of closed network connection Jul 1 20:30:07.397683164 (203h19m42.168324499s) [seg_pos={0 0}, upload=162621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 20:30:07.397793445 (203h19m42.16843478s) [upload=162621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 20:30:07.397832890 (203h19m42.168474225s) [upload=162621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 20:30:07.690755035 (203h19m42.46139637s) [upload=162621]: Done uploading segments... Jul 1 20:30:07.690777598 (203h19m42.461418933s) [upload=162621]: Upload finished. err: <nil> Jul 1 20:30:51.075923771 (203h20m25.846565096s) [upload=162628]: Starting upload Jul 1 20:30:51.075979769 (203h20m25.846621104s) [upload=162628]: Done starting upload Jul 1 20:30:51.076046185 (203h20m25.84668752s) [upload=162628]: Uploading segments... Jul 1 20:30:51.076156256 (203h20m25.846797591s) [upload=162628]: Got next segment. Inline: false Jul 1 20:30:51.076184720 (203h20m25.846826055s) [upload=162628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 1 20:30:51.076189279 (203h20m25.846830614s) [upload=162628]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 1 20:30:51.307264904 (203h20m26.077906239s) [seg_pos={0 0}, upload=162628]: Begin upload segment... Jul 1 20:30:51.307309248 (203h20m26.077950583s) [seg_pos={0 0}, upload=162628]: Done begin upload segment. Jul 1 20:30:51.307323446 (203h20m26.077964771s) [noise=true , address=45.91.116.8:4048 , piece_id=2G2OOQLJPTUDY5PZSHQ2MNAV7774DPK55SELX5STL5W35MXSFKNQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307341239 (203h20m26.077982574s) [noise=true , address=77.90.31.12:4589 , piece_id=OAQAOA63GE45RWO52GQFOO6FGD4M2AW6ALCPMKCB7T25UDBFOBIA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307377640 (203h20m26.078018965s) [noise=true , address=45.91.116.13:4154 , piece_id=CWIE4GHPWQCF7YHM2QG62RJMBQBNKNXRK2JI4G6OBTPKN4VV73BA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307671732 (203h20m26.078313057s) [noise=true , address=104.36.82.14:4221 , piece_id=JK73AQZVYWALWCBO7DORATYWJOIKWT2WBBHSZ26Q3TJLBYDTYO2Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307680439 (203h20m26.078321774s) [noise=true , address=104.36.82.7:4909 , piece_id=JNUIUO5MFV5I3L4CTK6IY2CMQDKTVCGPAR6VQHIKE2BKPIQQNGHA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307944213 (203h20m26.078585548s) [noise=true , address=45.91.116.5:5299 , piece_id=V6X7BVMX3IP23A65VFY7PIHGCJPGKLTZAYH4QVPPUFB34M3JUQYQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308197999 (203h20m26.078839334s) [noise=true , address=104.36.82.2:4731 , piece_id=JXQL75TODICFVUAIEE4TRGI2DUYVNC3ZR3RNEARTKQS56IIKZATQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308448899 (203h20m26.079090234s) [noise=true , address=45.91.116.4:4937 , piece_id=CMO4GLDKCZ7KQWHM5S4XX5QB2L3KAHUKRUYXWNE5OPEJ464X2NBA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308746398 (203h20m26.079387733s) [noise=true , address=77.90.31.17:4770 , piece_id=OFDOKUGNGNDMRFTF4HF3BHPZO3HSDDJZL7NC6G7PQSPKZRZVWGJA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308975577 (203h20m26.079616912s) [noise=true , address=45.91.116.13:4155 , piece_id=WN7BEIS5XO4K3BGAHLFDGBXUK52OHWYBPFFH6GCNADP6HWYBM73Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309167925 (203h20m26.07980926s) [noise=true , address=45.91.116.9:5262 , piece_id=N2SGOATWGVAKHJUCGXIUCMO5GTHQS4FHSFXZJBSGGT4HIQK4MFSQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309359802 (203h20m26.080001137s) [noise=true , address=45.91.116.6:4975 , piece_id=YUJIO2VMD53TDD66ANUI55LFMDTPHRMKV4Y7L7X66KA2BMKTIUQA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309548883 (203h20m26.080190218s) [noise=true , address=45.91.116.10:4082 , piece_id=U3OGQJQN3KWNAO2ALYP2OVAZFOE3PZHWZWY2HH64MFCO47TINKWA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309824350 (203h20m26.080465675s) [noise=true , address=104.36.82.8:4972 , piece_id=DA5ZEQHEMMJRTFRB4HMJL2OGGSA45P6UPNDJDKAU47S3A6OYQNMA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.310037578 (203h20m26.080678913s) [noise=true , address=104.36.82.4:4804 , piece_id=HV3FD4MSGB3ARPAOJYNYLLXHUS7JAF6KAQWLMIYCXC4UGW5BETTQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.311261871 (203h20m26.081903206s) [noise=true , address=77.90.31.12:4590 , piece_id=5XDULYYTTMHQXP4QSDT4M2W6NS7CM4ZYWH3OU32FMBAGXNQIVU6Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:53.080800025 (203h20m27.85144135s) [upload=162628]: Next returned nil segment Jul 1 20:30:53.080836496 (203h20m27.851477821s) [upload=162628]: Waiting for error group managing segments... Jul 1 20:30:53.362137719 (203h20m28.132806747s) [noise=true , address=45.91.116.4:4937 , piece_id=CMO4GLDKCZ7KQWHM5S4XX5QB2L3KAHUKRUYXWNE5OPEJ464X2NBA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.365537323 (203h20m28.136178648s) [noise=true , address=45.91.116.10:4082 , piece_id=U3OGQJQN3KWNAO2ALYP2OVAZFOE3PZHWZWY2HH64MFCO47TINKWA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.366047188 (203h20m28.136688523s) [noise=true , address=45.91.116.9:5262 , piece_id=N2SGOATWGVAKHJUCGXIUCMO5GTHQS4FHSFXZJBSGGT4HIQK4MFSQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.366428668 (203h20m28.137070003s) [noise=true , address=45.91.116.5:5299 , piece_id=V6X7BVMX3IP23A65VFY7PIHGCJPGKLTZAYH4QVPPUFB34M3JUQYQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.373588435 (203h20m28.14422977s) [noise=true , address=45.91.116.13:4155 , piece_id=WN7BEIS5XO4K3BGAHLFDGBXUK52OHWYBPFFH6GCNADP6HWYBM73Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.395606298 (203h20m28.166247633s) [noise=true , address=77.90.31.12:4589 , piece_id=OAQAOA63GE45RWO52GQFOO6FGD4M2AW6ALCPMKCB7T25UDBFOBIA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.399444591 (203h20m28.170085926s) [noise=true , address=77.90.31.17:4770 , piece_id=OFDOKUGNGNDMRFTF4HF3BHPZO3HSDDJZL7NC6G7PQSPKZRZVWGJA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.409917327 (203h20m28.180558662s) [noise=true , address=77.90.31.12:4590 , piece_id=5XDULYYTTMHQXP4QSDT4M2W6NS7CM4ZYWH3OU32FMBAGXNQIVU6Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.459664931 (203h20m28.230306266s) [noise=true , address=104.36.82.14:4221 , piece_id=JK73AQZVYWALWCBO7DORATYWJOIKWT2WBBHSZ26Q3TJLBYDTYO2Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.461422203 (203h20m28.232063538s) [noise=true , address=45.91.116.13:4154 , piece_id=CWIE4GHPWQCF7YHM2QG62RJMBQBNKNXRK2JI4G6OBTPKN4VV73BA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.506236628 (203h20m28.276877963s) [noise=true , address=45.91.116.6:4975 , piece_id=YUJIO2VMD53TDD66ANUI55LFMDTPHRMKV4Y7L7X66KA2BMKTIUQA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.855073943 (203h20m29.625715268s) [noise=true , address=104.36.82.2:4731 , piece_id=JXQL75TODICFVUAIEE4TRGI2DUYVNC3ZR3RNEARTKQS56IIKZATQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.986719438 (203h20m29.757360773s) [noise=true , address=104.36.82.8:4972 , piece_id=DA5ZEQHEMMJRTFRB4HMJL2OGGSA45P6UPNDJDKAU47S3A6OYQNMA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.986744686 (203h20m29.757386021s) [seg_pos={0 0}, upload=162628]: Segment reached optimal threshold of 13 pieces. Jul 1 20:30:54.986928978 (203h20m29.757570303s) [noise=true , address=45.91.116.8:4048 , piece_id=2G2OOQLJPTUDY5PZSHQ2MNAV7774DPK55SELX5STL5W35MXSFKNQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection; write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection Jul 1 20:30:54.986947524 (203h20m29.757588859s) [noise=true , address=104.36.82.7:4909 , piece_id=JNUIUO5MFV5I3L4CTK6IY2CMQDKTVCGPAR6VQHIKE2BKPIQQNGHA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF Jul 1 20:30:54.987028379 (203h20m29.757669714s) [noise=true , address=104.36.82.4:4804 , piece_id=HV3FD4MSGB3ARPAOJYNYLLXHUS7JAF6KAQWLMIYCXC4UGW5BETTQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g): protocol: read tcp 188.166.225.170:50928->104.36.82.4:4804: use of closed network connection; context canceled Jul 1 20:30:54.987039529 (203h20m29.757680864s) [seg_pos={0 0}, upload=162628]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 20:30:54.987097500 (203h20m29.757738835s) [upload=162628]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 20:30:54.987100907 (203h20m29.757742232s) [upload=162628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 20:30:55.290907064 (203h20m30.061548409s) [upload=162628]: Done uploading segments... Jul 1 20:30:55.290920750 (203h20m30.061562085s) [upload=162628]: Upload finished. err: <nil> Duration: 5.953959643s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 5.9201248s FAIL (2025-07-01 21:03:41 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== p 188.166.225.170:38826->45.91.116.14:4190: use of closed network connection Jul 1 20:30:07.397683164 (203h19m42.168324499s) [seg_pos={0 0}, upload=162621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 20:30:07.397793445 (203h19m42.16843478s) [upload=162621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 20:30:07.397832890 (203h19m42.168474225s) [upload=162621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 20:30:07.690755035 (203h19m42.46139637s) [upload=162621]: Done uploading segments... Jul 1 20:30:07.690777598 (203h19m42.461418933s) [upload=162621]: Upload finished. err: <nil> Jul 1 20:30:51.075923771 (203h20m25.846565096s) [upload=162628]: Starting upload Jul 1 20:30:51.075979769 (203h20m25.846621104s) [upload=162628]: Done starting upload Jul 1 20:30:51.076046185 (203h20m25.84668752s) [upload=162628]: Uploading segments... Jul 1 20:30:51.076156256 (203h20m25.846797591s) [upload=162628]: Got next segment. Inline: false Jul 1 20:30:51.076184720 (203h20m25.846826055s) [upload=162628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 1 20:30:51.076189279 (203h20m25.846830614s) [upload=162628]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 1 20:30:51.307264904 (203h20m26.077906239s) [seg_pos={0 0}, upload=162628]: Begin upload segment... Jul 1 20:30:51.307309248 (203h20m26.077950583s) [seg_pos={0 0}, upload=162628]: Done begin upload segment. Jul 1 20:30:51.307323446 (203h20m26.077964771s) [noise=true , address=45.91.116.8:4048 , piece_id=2G2OOQLJPTUDY5PZSHQ2MNAV7774DPK55SELX5STL5W35MXSFKNQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307341239 (203h20m26.077982574s) [noise=true , address=77.90.31.12:4589 , piece_id=OAQAOA63GE45RWO52GQFOO6FGD4M2AW6ALCPMKCB7T25UDBFOBIA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307377640 (203h20m26.078018965s) [noise=true , address=45.91.116.13:4154 , piece_id=CWIE4GHPWQCF7YHM2QG62RJMBQBNKNXRK2JI4G6OBTPKN4VV73BA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307671732 (203h20m26.078313057s) [noise=true , address=104.36.82.14:4221 , piece_id=JK73AQZVYWALWCBO7DORATYWJOIKWT2WBBHSZ26Q3TJLBYDTYO2Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307680439 (203h20m26.078321774s) [noise=true , address=104.36.82.7:4909 , piece_id=JNUIUO5MFV5I3L4CTK6IY2CMQDKTVCGPAR6VQHIKE2BKPIQQNGHA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307944213 (203h20m26.078585548s) [noise=true , address=45.91.116.5:5299 , piece_id=V6X7BVMX3IP23A65VFY7PIHGCJPGKLTZAYH4QVPPUFB34M3JUQYQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308197999 (203h20m26.078839334s) [noise=true , address=104.36.82.2:4731 , piece_id=JXQL75TODICFVUAIEE4TRGI2DUYVNC3ZR3RNEARTKQS56IIKZATQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308448899 (203h20m26.079090234s) [noise=true , address=45.91.116.4:4937 , piece_id=CMO4GLDKCZ7KQWHM5S4XX5QB2L3KAHUKRUYXWNE5OPEJ464X2NBA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308746398 (203h20m26.079387733s) [noise=true , address=77.90.31.17:4770 , piece_id=OFDOKUGNGNDMRFTF4HF3BHPZO3HSDDJZL7NC6G7PQSPKZRZVWGJA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308975577 (203h20m26.079616912s) [noise=true , address=45.91.116.13:4155 , piece_id=WN7BEIS5XO4K3BGAHLFDGBXUK52OHWYBPFFH6GCNADP6HWYBM73Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309167925 (203h20m26.07980926s) [noise=true , address=45.91.116.9:5262 , piece_id=N2SGOATWGVAKHJUCGXIUCMO5GTHQS4FHSFXZJBSGGT4HIQK4MFSQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309359802 (203h20m26.080001137s) [noise=true , address=45.91.116.6:4975 , piece_id=YUJIO2VMD53TDD66ANUI55LFMDTPHRMKV4Y7L7X66KA2BMKTIUQA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309548883 (203h20m26.080190218s) [noise=true , address=45.91.116.10:4082 , piece_id=U3OGQJQN3KWNAO2ALYP2OVAZFOE3PZHWZWY2HH64MFCO47TINKWA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309824350 (203h20m26.080465675s) [noise=true , address=104.36.82.8:4972 , piece_id=DA5ZEQHEMMJRTFRB4HMJL2OGGSA45P6UPNDJDKAU47S3A6OYQNMA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.310037578 (203h20m26.080678913s) [noise=true , address=104.36.82.4:4804 , piece_id=HV3FD4MSGB3ARPAOJYNYLLXHUS7JAF6KAQWLMIYCXC4UGW5BETTQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.311261871 (203h20m26.081903206s) [noise=true , address=77.90.31.12:4590 , piece_id=5XDULYYTTMHQXP4QSDT4M2W6NS7CM4ZYWH3OU32FMBAGXNQIVU6Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:53.080800025 (203h20m27.85144135s) [upload=162628]: Next returned nil segment Jul 1 20:30:53.080836496 (203h20m27.851477821s) [upload=162628]: Waiting for error group managing segments... Jul 1 20:30:53.362137719 (203h20m28.132806747s) [noise=true , address=45.91.116.4:4937 , piece_id=CMO4GLDKCZ7KQWHM5S4XX5QB2L3KAHUKRUYXWNE5OPEJ464X2NBA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.365537323 (203h20m28.136178648s) [noise=true , address=45.91.116.10:4082 , piece_id=U3OGQJQN3KWNAO2ALYP2OVAZFOE3PZHWZWY2HH64MFCO47TINKWA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.366047188 (203h20m28.136688523s) [noise=true , address=45.91.116.9:5262 , piece_id=N2SGOATWGVAKHJUCGXIUCMO5GTHQS4FHSFXZJBSGGT4HIQK4MFSQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.366428668 (203h20m28.137070003s) [noise=true , address=45.91.116.5:5299 , piece_id=V6X7BVMX3IP23A65VFY7PIHGCJPGKLTZAYH4QVPPUFB34M3JUQYQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.373588435 (203h20m28.14422977s) [noise=true , address=45.91.116.13:4155 , piece_id=WN7BEIS5XO4K3BGAHLFDGBXUK52OHWYBPFFH6GCNADP6HWYBM73Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.395606298 (203h20m28.166247633s) [noise=true , address=77.90.31.12:4589 , piece_id=OAQAOA63GE45RWO52GQFOO6FGD4M2AW6ALCPMKCB7T25UDBFOBIA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.399444591 (203h20m28.170085926s) [noise=true , address=77.90.31.17:4770 , piece_id=OFDOKUGNGNDMRFTF4HF3BHPZO3HSDDJZL7NC6G7PQSPKZRZVWGJA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.409917327 (203h20m28.180558662s) [noise=true , address=77.90.31.12:4590 , piece_id=5XDULYYTTMHQXP4QSDT4M2W6NS7CM4ZYWH3OU32FMBAGXNQIVU6Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.459664931 (203h20m28.230306266s) [noise=true , address=104.36.82.14:4221 , piece_id=JK73AQZVYWALWCBO7DORATYWJOIKWT2WBBHSZ26Q3TJLBYDTYO2Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.461422203 (203h20m28.232063538s) [noise=true , address=45.91.116.13:4154 , piece_id=CWIE4GHPWQCF7YHM2QG62RJMBQBNKNXRK2JI4G6OBTPKN4VV73BA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.506236628 (203h20m28.276877963s) [noise=true , address=45.91.116.6:4975 , piece_id=YUJIO2VMD53TDD66ANUI55LFMDTPHRMKV4Y7L7X66KA2BMKTIUQA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.855073943 (203h20m29.625715268s) [noise=true , address=104.36.82.2:4731 , piece_id=JXQL75TODICFVUAIEE4TRGI2DUYVNC3ZR3RNEARTKQS56IIKZATQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.986719438 (203h20m29.757360773s) [noise=true , address=104.36.82.8:4972 , piece_id=DA5ZEQHEMMJRTFRB4HMJL2OGGSA45P6UPNDJDKAU47S3A6OYQNMA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.986744686 (203h20m29.757386021s) [seg_pos={0 0}, upload=162628]: Segment reached optimal threshold of 13 pieces. Jul 1 20:30:54.986928978 (203h20m29.757570303s) [noise=true , address=45.91.116.8:4048 , piece_id=2G2OOQLJPTUDY5PZSHQ2MNAV7774DPK55SELX5STL5W35MXSFKNQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection; write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection Jul 1 20:30:54.986947524 (203h20m29.757588859s) [noise=true , address=104.36.82.7:4909 , piece_id=JNUIUO5MFV5I3L4CTK6IY2CMQDKTVCGPAR6VQHIKE2BKPIQQNGHA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF Jul 1 20:30:54.987028379 (203h20m29.757669714s) [noise=true , address=104.36.82.4:4804 , piece_id=HV3FD4MSGB3ARPAOJYNYLLXHUS7JAF6KAQWLMIYCXC4UGW5BETTQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g): protocol: read tcp 188.166.225.170:50928->104.36.82.4:4804: use of closed network connection; context canceled Jul 1 20:30:54.987039529 (203h20m29.757680864s) [seg_pos={0 0}, upload=162628]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 20:30:54.987097500 (203h20m29.757738835s) [upload=162628]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 20:30:54.987100907 (203h20m29.757742232s) [upload=162628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 20:30:55.290907064 (203h20m30.061548409s) [upload=162628]: Done uploading segments... Jul 1 20:30:55.290920750 (203h20m30.061562085s) [upload=162628]: Upload finished. err: <nil> Duration: 5.920149667s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 5.751951108s FAIL (2025-07-01 21:02:43 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== p 188.166.225.170:38826->45.91.116.14:4190: use of closed network connection Jul 1 20:30:07.397683164 (203h19m42.168324499s) [seg_pos={0 0}, upload=162621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 20:30:07.397793445 (203h19m42.16843478s) [upload=162621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 20:30:07.397832890 (203h19m42.168474225s) [upload=162621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 20:30:07.690755035 (203h19m42.46139637s) [upload=162621]: Done uploading segments... Jul 1 20:30:07.690777598 (203h19m42.461418933s) [upload=162621]: Upload finished. err: <nil> Jul 1 20:30:51.075923771 (203h20m25.846565096s) [upload=162628]: Starting upload Jul 1 20:30:51.075979769 (203h20m25.846621104s) [upload=162628]: Done starting upload Jul 1 20:30:51.076046185 (203h20m25.84668752s) [upload=162628]: Uploading segments... Jul 1 20:30:51.076156256 (203h20m25.846797591s) [upload=162628]: Got next segment. Inline: false Jul 1 20:30:51.076184720 (203h20m25.846826055s) [upload=162628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 1 20:30:51.076189279 (203h20m25.846830614s) [upload=162628]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 1 20:30:51.307264904 (203h20m26.077906239s) [seg_pos={0 0}, upload=162628]: Begin upload segment... Jul 1 20:30:51.307309248 (203h20m26.077950583s) [seg_pos={0 0}, upload=162628]: Done begin upload segment. Jul 1 20:30:51.307323446 (203h20m26.077964771s) [noise=true , address=45.91.116.8:4048 , piece_id=2G2OOQLJPTUDY5PZSHQ2MNAV7774DPK55SELX5STL5W35MXSFKNQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307341239 (203h20m26.077982574s) [noise=true , address=77.90.31.12:4589 , piece_id=OAQAOA63GE45RWO52GQFOO6FGD4M2AW6ALCPMKCB7T25UDBFOBIA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307377640 (203h20m26.078018965s) [noise=true , address=45.91.116.13:4154 , piece_id=CWIE4GHPWQCF7YHM2QG62RJMBQBNKNXRK2JI4G6OBTPKN4VV73BA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307671732 (203h20m26.078313057s) [noise=true , address=104.36.82.14:4221 , piece_id=JK73AQZVYWALWCBO7DORATYWJOIKWT2WBBHSZ26Q3TJLBYDTYO2Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307680439 (203h20m26.078321774s) [noise=true , address=104.36.82.7:4909 , piece_id=JNUIUO5MFV5I3L4CTK6IY2CMQDKTVCGPAR6VQHIKE2BKPIQQNGHA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307944213 (203h20m26.078585548s) [noise=true , address=45.91.116.5:5299 , piece_id=V6X7BVMX3IP23A65VFY7PIHGCJPGKLTZAYH4QVPPUFB34M3JUQYQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308197999 (203h20m26.078839334s) [noise=true , address=104.36.82.2:4731 , piece_id=JXQL75TODICFVUAIEE4TRGI2DUYVNC3ZR3RNEARTKQS56IIKZATQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308448899 (203h20m26.079090234s) [noise=true , address=45.91.116.4:4937 , piece_id=CMO4GLDKCZ7KQWHM5S4XX5QB2L3KAHUKRUYXWNE5OPEJ464X2NBA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308746398 (203h20m26.079387733s) [noise=true , address=77.90.31.17:4770 , piece_id=OFDOKUGNGNDMRFTF4HF3BHPZO3HSDDJZL7NC6G7PQSPKZRZVWGJA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308975577 (203h20m26.079616912s) [noise=true , address=45.91.116.13:4155 , piece_id=WN7BEIS5XO4K3BGAHLFDGBXUK52OHWYBPFFH6GCNADP6HWYBM73Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309167925 (203h20m26.07980926s) [noise=true , address=45.91.116.9:5262 , piece_id=N2SGOATWGVAKHJUCGXIUCMO5GTHQS4FHSFXZJBSGGT4HIQK4MFSQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309359802 (203h20m26.080001137s) [noise=true , address=45.91.116.6:4975 , piece_id=YUJIO2VMD53TDD66ANUI55LFMDTPHRMKV4Y7L7X66KA2BMKTIUQA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309548883 (203h20m26.080190218s) [noise=true , address=45.91.116.10:4082 , piece_id=U3OGQJQN3KWNAO2ALYP2OVAZFOE3PZHWZWY2HH64MFCO47TINKWA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309824350 (203h20m26.080465675s) [noise=true , address=104.36.82.8:4972 , piece_id=DA5ZEQHEMMJRTFRB4HMJL2OGGSA45P6UPNDJDKAU47S3A6OYQNMA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.310037578 (203h20m26.080678913s) [noise=true , address=104.36.82.4:4804 , piece_id=HV3FD4MSGB3ARPAOJYNYLLXHUS7JAF6KAQWLMIYCXC4UGW5BETTQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.311261871 (203h20m26.081903206s) [noise=true , address=77.90.31.12:4590 , piece_id=5XDULYYTTMHQXP4QSDT4M2W6NS7CM4ZYWH3OU32FMBAGXNQIVU6Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:53.080800025 (203h20m27.85144135s) [upload=162628]: Next returned nil segment Jul 1 20:30:53.080836496 (203h20m27.851477821s) [upload=162628]: Waiting for error group managing segments... Jul 1 20:30:53.362137719 (203h20m28.132806747s) [noise=true , address=45.91.116.4:4937 , piece_id=CMO4GLDKCZ7KQWHM5S4XX5QB2L3KAHUKRUYXWNE5OPEJ464X2NBA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.365537323 (203h20m28.136178648s) [noise=true , address=45.91.116.10:4082 , piece_id=U3OGQJQN3KWNAO2ALYP2OVAZFOE3PZHWZWY2HH64MFCO47TINKWA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.366047188 (203h20m28.136688523s) [noise=true , address=45.91.116.9:5262 , piece_id=N2SGOATWGVAKHJUCGXIUCMO5GTHQS4FHSFXZJBSGGT4HIQK4MFSQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.366428668 (203h20m28.137070003s) [noise=true , address=45.91.116.5:5299 , piece_id=V6X7BVMX3IP23A65VFY7PIHGCJPGKLTZAYH4QVPPUFB34M3JUQYQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.373588435 (203h20m28.14422977s) [noise=true , address=45.91.116.13:4155 , piece_id=WN7BEIS5XO4K3BGAHLFDGBXUK52OHWYBPFFH6GCNADP6HWYBM73Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.395606298 (203h20m28.166247633s) [noise=true , address=77.90.31.12:4589 , piece_id=OAQAOA63GE45RWO52GQFOO6FGD4M2AW6ALCPMKCB7T25UDBFOBIA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.399444591 (203h20m28.170085926s) [noise=true , address=77.90.31.17:4770 , piece_id=OFDOKUGNGNDMRFTF4HF3BHPZO3HSDDJZL7NC6G7PQSPKZRZVWGJA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.409917327 (203h20m28.180558662s) [noise=true , address=77.90.31.12:4590 , piece_id=5XDULYYTTMHQXP4QSDT4M2W6NS7CM4ZYWH3OU32FMBAGXNQIVU6Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.459664931 (203h20m28.230306266s) [noise=true , address=104.36.82.14:4221 , piece_id=JK73AQZVYWALWCBO7DORATYWJOIKWT2WBBHSZ26Q3TJLBYDTYO2Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.461422203 (203h20m28.232063538s) [noise=true , address=45.91.116.13:4154 , piece_id=CWIE4GHPWQCF7YHM2QG62RJMBQBNKNXRK2JI4G6OBTPKN4VV73BA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.506236628 (203h20m28.276877963s) [noise=true , address=45.91.116.6:4975 , piece_id=YUJIO2VMD53TDD66ANUI55LFMDTPHRMKV4Y7L7X66KA2BMKTIUQA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.855073943 (203h20m29.625715268s) [noise=true , address=104.36.82.2:4731 , piece_id=JXQL75TODICFVUAIEE4TRGI2DUYVNC3ZR3RNEARTKQS56IIKZATQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.986719438 (203h20m29.757360773s) [noise=true , address=104.36.82.8:4972 , piece_id=DA5ZEQHEMMJRTFRB4HMJL2OGGSA45P6UPNDJDKAU47S3A6OYQNMA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.986744686 (203h20m29.757386021s) [seg_pos={0 0}, upload=162628]: Segment reached optimal threshold of 13 pieces. Jul 1 20:30:54.986928978 (203h20m29.757570303s) [noise=true , address=45.91.116.8:4048 , piece_id=2G2OOQLJPTUDY5PZSHQ2MNAV7774DPK55SELX5STL5W35MXSFKNQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection; write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection Jul 1 20:30:54.986947524 (203h20m29.757588859s) [noise=true , address=104.36.82.7:4909 , piece_id=JNUIUO5MFV5I3L4CTK6IY2CMQDKTVCGPAR6VQHIKE2BKPIQQNGHA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF Jul 1 20:30:54.987028379 (203h20m29.757669714s) [noise=true , address=104.36.82.4:4804 , piece_id=HV3FD4MSGB3ARPAOJYNYLLXHUS7JAF6KAQWLMIYCXC4UGW5BETTQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g): protocol: read tcp 188.166.225.170:50928->104.36.82.4:4804: use of closed network connection; context canceled Jul 1 20:30:54.987039529 (203h20m29.757680864s) [seg_pos={0 0}, upload=162628]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 20:30:54.987097500 (203h20m29.757738835s) [upload=162628]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 20:30:54.987100907 (203h20m29.757742232s) [upload=162628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 20:30:55.290907064 (203h20m30.061548409s) [upload=162628]: Done uploading segments... Jul 1 20:30:55.290920750 (203h20m30.061562085s) [upload=162628]: Upload finished. err: <nil> Duration: 5.751977607s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 5.791822974s FAIL (2025-07-01 21:01:52 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== p 188.166.225.170:38826->45.91.116.14:4190: use of closed network connection Jul 1 20:30:07.397683164 (203h19m42.168324499s) [seg_pos={0 0}, upload=162621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 20:30:07.397793445 (203h19m42.16843478s) [upload=162621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 20:30:07.397832890 (203h19m42.168474225s) [upload=162621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 20:30:07.690755035 (203h19m42.46139637s) [upload=162621]: Done uploading segments... Jul 1 20:30:07.690777598 (203h19m42.461418933s) [upload=162621]: Upload finished. err: <nil> Jul 1 20:30:51.075923771 (203h20m25.846565096s) [upload=162628]: Starting upload Jul 1 20:30:51.075979769 (203h20m25.846621104s) [upload=162628]: Done starting upload Jul 1 20:30:51.076046185 (203h20m25.84668752s) [upload=162628]: Uploading segments... Jul 1 20:30:51.076156256 (203h20m25.846797591s) [upload=162628]: Got next segment. Inline: false Jul 1 20:30:51.076184720 (203h20m25.846826055s) [upload=162628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 1 20:30:51.076189279 (203h20m25.846830614s) [upload=162628]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 1 20:30:51.307264904 (203h20m26.077906239s) [seg_pos={0 0}, upload=162628]: Begin upload segment... Jul 1 20:30:51.307309248 (203h20m26.077950583s) [seg_pos={0 0}, upload=162628]: Done begin upload segment. Jul 1 20:30:51.307323446 (203h20m26.077964771s) [noise=true , address=45.91.116.8:4048 , piece_id=2G2OOQLJPTUDY5PZSHQ2MNAV7774DPK55SELX5STL5W35MXSFKNQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307341239 (203h20m26.077982574s) [noise=true , address=77.90.31.12:4589 , piece_id=OAQAOA63GE45RWO52GQFOO6FGD4M2AW6ALCPMKCB7T25UDBFOBIA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307377640 (203h20m26.078018965s) [noise=true , address=45.91.116.13:4154 , piece_id=CWIE4GHPWQCF7YHM2QG62RJMBQBNKNXRK2JI4G6OBTPKN4VV73BA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307671732 (203h20m26.078313057s) [noise=true , address=104.36.82.14:4221 , piece_id=JK73AQZVYWALWCBO7DORATYWJOIKWT2WBBHSZ26Q3TJLBYDTYO2Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307680439 (203h20m26.078321774s) [noise=true , address=104.36.82.7:4909 , piece_id=JNUIUO5MFV5I3L4CTK6IY2CMQDKTVCGPAR6VQHIKE2BKPIQQNGHA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307944213 (203h20m26.078585548s) [noise=true , address=45.91.116.5:5299 , piece_id=V6X7BVMX3IP23A65VFY7PIHGCJPGKLTZAYH4QVPPUFB34M3JUQYQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308197999 (203h20m26.078839334s) [noise=true , address=104.36.82.2:4731 , piece_id=JXQL75TODICFVUAIEE4TRGI2DUYVNC3ZR3RNEARTKQS56IIKZATQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308448899 (203h20m26.079090234s) [noise=true , address=45.91.116.4:4937 , piece_id=CMO4GLDKCZ7KQWHM5S4XX5QB2L3KAHUKRUYXWNE5OPEJ464X2NBA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308746398 (203h20m26.079387733s) [noise=true , address=77.90.31.17:4770 , piece_id=OFDOKUGNGNDMRFTF4HF3BHPZO3HSDDJZL7NC6G7PQSPKZRZVWGJA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308975577 (203h20m26.079616912s) [noise=true , address=45.91.116.13:4155 , piece_id=WN7BEIS5XO4K3BGAHLFDGBXUK52OHWYBPFFH6GCNADP6HWYBM73Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309167925 (203h20m26.07980926s) [noise=true , address=45.91.116.9:5262 , piece_id=N2SGOATWGVAKHJUCGXIUCMO5GTHQS4FHSFXZJBSGGT4HIQK4MFSQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309359802 (203h20m26.080001137s) [noise=true , address=45.91.116.6:4975 , piece_id=YUJIO2VMD53TDD66ANUI55LFMDTPHRMKV4Y7L7X66KA2BMKTIUQA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309548883 (203h20m26.080190218s) [noise=true , address=45.91.116.10:4082 , piece_id=U3OGQJQN3KWNAO2ALYP2OVAZFOE3PZHWZWY2HH64MFCO47TINKWA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309824350 (203h20m26.080465675s) [noise=true , address=104.36.82.8:4972 , piece_id=DA5ZEQHEMMJRTFRB4HMJL2OGGSA45P6UPNDJDKAU47S3A6OYQNMA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.310037578 (203h20m26.080678913s) [noise=true , address=104.36.82.4:4804 , piece_id=HV3FD4MSGB3ARPAOJYNYLLXHUS7JAF6KAQWLMIYCXC4UGW5BETTQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.311261871 (203h20m26.081903206s) [noise=true , address=77.90.31.12:4590 , piece_id=5XDULYYTTMHQXP4QSDT4M2W6NS7CM4ZYWH3OU32FMBAGXNQIVU6Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:53.080800025 (203h20m27.85144135s) [upload=162628]: Next returned nil segment Jul 1 20:30:53.080836496 (203h20m27.851477821s) [upload=162628]: Waiting for error group managing segments... Jul 1 20:30:53.362137719 (203h20m28.132806747s) [noise=true , address=45.91.116.4:4937 , piece_id=CMO4GLDKCZ7KQWHM5S4XX5QB2L3KAHUKRUYXWNE5OPEJ464X2NBA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.365537323 (203h20m28.136178648s) [noise=true , address=45.91.116.10:4082 , piece_id=U3OGQJQN3KWNAO2ALYP2OVAZFOE3PZHWZWY2HH64MFCO47TINKWA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.366047188 (203h20m28.136688523s) [noise=true , address=45.91.116.9:5262 , piece_id=N2SGOATWGVAKHJUCGXIUCMO5GTHQS4FHSFXZJBSGGT4HIQK4MFSQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.366428668 (203h20m28.137070003s) [noise=true , address=45.91.116.5:5299 , piece_id=V6X7BVMX3IP23A65VFY7PIHGCJPGKLTZAYH4QVPPUFB34M3JUQYQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.373588435 (203h20m28.14422977s) [noise=true , address=45.91.116.13:4155 , piece_id=WN7BEIS5XO4K3BGAHLFDGBXUK52OHWYBPFFH6GCNADP6HWYBM73Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.395606298 (203h20m28.166247633s) [noise=true , address=77.90.31.12:4589 , piece_id=OAQAOA63GE45RWO52GQFOO6FGD4M2AW6ALCPMKCB7T25UDBFOBIA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.399444591 (203h20m28.170085926s) [noise=true , address=77.90.31.17:4770 , piece_id=OFDOKUGNGNDMRFTF4HF3BHPZO3HSDDJZL7NC6G7PQSPKZRZVWGJA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.409917327 (203h20m28.180558662s) [noise=true , address=77.90.31.12:4590 , piece_id=5XDULYYTTMHQXP4QSDT4M2W6NS7CM4ZYWH3OU32FMBAGXNQIVU6Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.459664931 (203h20m28.230306266s) [noise=true , address=104.36.82.14:4221 , piece_id=JK73AQZVYWALWCBO7DORATYWJOIKWT2WBBHSZ26Q3TJLBYDTYO2Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.461422203 (203h20m28.232063538s) [noise=true , address=45.91.116.13:4154 , piece_id=CWIE4GHPWQCF7YHM2QG62RJMBQBNKNXRK2JI4G6OBTPKN4VV73BA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.506236628 (203h20m28.276877963s) [noise=true , address=45.91.116.6:4975 , piece_id=YUJIO2VMD53TDD66ANUI55LFMDTPHRMKV4Y7L7X66KA2BMKTIUQA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.855073943 (203h20m29.625715268s) [noise=true , address=104.36.82.2:4731 , piece_id=JXQL75TODICFVUAIEE4TRGI2DUYVNC3ZR3RNEARTKQS56IIKZATQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.986719438 (203h20m29.757360773s) [noise=true , address=104.36.82.8:4972 , piece_id=DA5ZEQHEMMJRTFRB4HMJL2OGGSA45P6UPNDJDKAU47S3A6OYQNMA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.986744686 (203h20m29.757386021s) [seg_pos={0 0}, upload=162628]: Segment reached optimal threshold of 13 pieces. Jul 1 20:30:54.986928978 (203h20m29.757570303s) [noise=true , address=45.91.116.8:4048 , piece_id=2G2OOQLJPTUDY5PZSHQ2MNAV7774DPK55SELX5STL5W35MXSFKNQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection; write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection Jul 1 20:30:54.986947524 (203h20m29.757588859s) [noise=true , address=104.36.82.7:4909 , piece_id=JNUIUO5MFV5I3L4CTK6IY2CMQDKTVCGPAR6VQHIKE2BKPIQQNGHA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF Jul 1 20:30:54.987028379 (203h20m29.757669714s) [noise=true , address=104.36.82.4:4804 , piece_id=HV3FD4MSGB3ARPAOJYNYLLXHUS7JAF6KAQWLMIYCXC4UGW5BETTQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g): protocol: read tcp 188.166.225.170:50928->104.36.82.4:4804: use of closed network connection; context canceled Jul 1 20:30:54.987039529 (203h20m29.757680864s) [seg_pos={0 0}, upload=162628]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 20:30:54.987097500 (203h20m29.757738835s) [upload=162628]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 20:30:54.987100907 (203h20m29.757742232s) [upload=162628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 20:30:55.290907064 (203h20m30.061548409s) [upload=162628]: Done uploading segments... Jul 1 20:30:55.290920750 (203h20m30.061562085s) [upload=162628]: Upload finished. err: <nil> Duration: 5.791845858s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 6.623208413s FAIL (2025-07-01 21:01:11 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== p 188.166.225.170:38826->45.91.116.14:4190: use of closed network connection Jul 1 20:30:07.397683164 (203h19m42.168324499s) [seg_pos={0 0}, upload=162621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 20:30:07.397793445 (203h19m42.16843478s) [upload=162621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 20:30:07.397832890 (203h19m42.168474225s) [upload=162621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 20:30:07.690755035 (203h19m42.46139637s) [upload=162621]: Done uploading segments... Jul 1 20:30:07.690777598 (203h19m42.461418933s) [upload=162621]: Upload finished. err: <nil> Jul 1 20:30:51.075923771 (203h20m25.846565096s) [upload=162628]: Starting upload Jul 1 20:30:51.075979769 (203h20m25.846621104s) [upload=162628]: Done starting upload Jul 1 20:30:51.076046185 (203h20m25.84668752s) [upload=162628]: Uploading segments... Jul 1 20:30:51.076156256 (203h20m25.846797591s) [upload=162628]: Got next segment. Inline: false Jul 1 20:30:51.076184720 (203h20m25.846826055s) [upload=162628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 1 20:30:51.076189279 (203h20m25.846830614s) [upload=162628]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 1 20:30:51.307264904 (203h20m26.077906239s) [seg_pos={0 0}, upload=162628]: Begin upload segment... Jul 1 20:30:51.307309248 (203h20m26.077950583s) [seg_pos={0 0}, upload=162628]: Done begin upload segment. Jul 1 20:30:51.307323446 (203h20m26.077964771s) [noise=true , address=45.91.116.8:4048 , piece_id=2G2OOQLJPTUDY5PZSHQ2MNAV7774DPK55SELX5STL5W35MXSFKNQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307341239 (203h20m26.077982574s) [noise=true , address=77.90.31.12:4589 , piece_id=OAQAOA63GE45RWO52GQFOO6FGD4M2AW6ALCPMKCB7T25UDBFOBIA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307377640 (203h20m26.078018965s) [noise=true , address=45.91.116.13:4154 , piece_id=CWIE4GHPWQCF7YHM2QG62RJMBQBNKNXRK2JI4G6OBTPKN4VV73BA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307671732 (203h20m26.078313057s) [noise=true , address=104.36.82.14:4221 , piece_id=JK73AQZVYWALWCBO7DORATYWJOIKWT2WBBHSZ26Q3TJLBYDTYO2Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307680439 (203h20m26.078321774s) [noise=true , address=104.36.82.7:4909 , piece_id=JNUIUO5MFV5I3L4CTK6IY2CMQDKTVCGPAR6VQHIKE2BKPIQQNGHA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307944213 (203h20m26.078585548s) [noise=true , address=45.91.116.5:5299 , piece_id=V6X7BVMX3IP23A65VFY7PIHGCJPGKLTZAYH4QVPPUFB34M3JUQYQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308197999 (203h20m26.078839334s) [noise=true , address=104.36.82.2:4731 , piece_id=JXQL75TODICFVUAIEE4TRGI2DUYVNC3ZR3RNEARTKQS56IIKZATQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308448899 (203h20m26.079090234s) [noise=true , address=45.91.116.4:4937 , piece_id=CMO4GLDKCZ7KQWHM5S4XX5QB2L3KAHUKRUYXWNE5OPEJ464X2NBA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308746398 (203h20m26.079387733s) [noise=true , address=77.90.31.17:4770 , piece_id=OFDOKUGNGNDMRFTF4HF3BHPZO3HSDDJZL7NC6G7PQSPKZRZVWGJA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308975577 (203h20m26.079616912s) [noise=true , address=45.91.116.13:4155 , piece_id=WN7BEIS5XO4K3BGAHLFDGBXUK52OHWYBPFFH6GCNADP6HWYBM73Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309167925 (203h20m26.07980926s) [noise=true , address=45.91.116.9:5262 , piece_id=N2SGOATWGVAKHJUCGXIUCMO5GTHQS4FHSFXZJBSGGT4HIQK4MFSQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309359802 (203h20m26.080001137s) [noise=true , address=45.91.116.6:4975 , piece_id=YUJIO2VMD53TDD66ANUI55LFMDTPHRMKV4Y7L7X66KA2BMKTIUQA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309548883 (203h20m26.080190218s) [noise=true , address=45.91.116.10:4082 , piece_id=U3OGQJQN3KWNAO2ALYP2OVAZFOE3PZHWZWY2HH64MFCO47TINKWA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309824350 (203h20m26.080465675s) [noise=true , address=104.36.82.8:4972 , piece_id=DA5ZEQHEMMJRTFRB4HMJL2OGGSA45P6UPNDJDKAU47S3A6OYQNMA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.310037578 (203h20m26.080678913s) [noise=true , address=104.36.82.4:4804 , piece_id=HV3FD4MSGB3ARPAOJYNYLLXHUS7JAF6KAQWLMIYCXC4UGW5BETTQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.311261871 (203h20m26.081903206s) [noise=true , address=77.90.31.12:4590 , piece_id=5XDULYYTTMHQXP4QSDT4M2W6NS7CM4ZYWH3OU32FMBAGXNQIVU6Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:53.080800025 (203h20m27.85144135s) [upload=162628]: Next returned nil segment Jul 1 20:30:53.080836496 (203h20m27.851477821s) [upload=162628]: Waiting for error group managing segments... Jul 1 20:30:53.362137719 (203h20m28.132806747s) [noise=true , address=45.91.116.4:4937 , piece_id=CMO4GLDKCZ7KQWHM5S4XX5QB2L3KAHUKRUYXWNE5OPEJ464X2NBA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.365537323 (203h20m28.136178648s) [noise=true , address=45.91.116.10:4082 , piece_id=U3OGQJQN3KWNAO2ALYP2OVAZFOE3PZHWZWY2HH64MFCO47TINKWA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.366047188 (203h20m28.136688523s) [noise=true , address=45.91.116.9:5262 , piece_id=N2SGOATWGVAKHJUCGXIUCMO5GTHQS4FHSFXZJBSGGT4HIQK4MFSQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.366428668 (203h20m28.137070003s) [noise=true , address=45.91.116.5:5299 , piece_id=V6X7BVMX3IP23A65VFY7PIHGCJPGKLTZAYH4QVPPUFB34M3JUQYQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.373588435 (203h20m28.14422977s) [noise=true , address=45.91.116.13:4155 , piece_id=WN7BEIS5XO4K3BGAHLFDGBXUK52OHWYBPFFH6GCNADP6HWYBM73Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.395606298 (203h20m28.166247633s) [noise=true , address=77.90.31.12:4589 , piece_id=OAQAOA63GE45RWO52GQFOO6FGD4M2AW6ALCPMKCB7T25UDBFOBIA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.399444591 (203h20m28.170085926s) [noise=true , address=77.90.31.17:4770 , piece_id=OFDOKUGNGNDMRFTF4HF3BHPZO3HSDDJZL7NC6G7PQSPKZRZVWGJA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.409917327 (203h20m28.180558662s) [noise=true , address=77.90.31.12:4590 , piece_id=5XDULYYTTMHQXP4QSDT4M2W6NS7CM4ZYWH3OU32FMBAGXNQIVU6Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.459664931 (203h20m28.230306266s) [noise=true , address=104.36.82.14:4221 , piece_id=JK73AQZVYWALWCBO7DORATYWJOIKWT2WBBHSZ26Q3TJLBYDTYO2Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.461422203 (203h20m28.232063538s) [noise=true , address=45.91.116.13:4154 , piece_id=CWIE4GHPWQCF7YHM2QG62RJMBQBNKNXRK2JI4G6OBTPKN4VV73BA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.506236628 (203h20m28.276877963s) [noise=true , address=45.91.116.6:4975 , piece_id=YUJIO2VMD53TDD66ANUI55LFMDTPHRMKV4Y7L7X66KA2BMKTIUQA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.855073943 (203h20m29.625715268s) [noise=true , address=104.36.82.2:4731 , piece_id=JXQL75TODICFVUAIEE4TRGI2DUYVNC3ZR3RNEARTKQS56IIKZATQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.986719438 (203h20m29.757360773s) [noise=true , address=104.36.82.8:4972 , piece_id=DA5ZEQHEMMJRTFRB4HMJL2OGGSA45P6UPNDJDKAU47S3A6OYQNMA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.986744686 (203h20m29.757386021s) [seg_pos={0 0}, upload=162628]: Segment reached optimal threshold of 13 pieces. Jul 1 20:30:54.986928978 (203h20m29.757570303s) [noise=true , address=45.91.116.8:4048 , piece_id=2G2OOQLJPTUDY5PZSHQ2MNAV7774DPK55SELX5STL5W35MXSFKNQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection; write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection Jul 1 20:30:54.986947524 (203h20m29.757588859s) [noise=true , address=104.36.82.7:4909 , piece_id=JNUIUO5MFV5I3L4CTK6IY2CMQDKTVCGPAR6VQHIKE2BKPIQQNGHA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF Jul 1 20:30:54.987028379 (203h20m29.757669714s) [noise=true , address=104.36.82.4:4804 , piece_id=HV3FD4MSGB3ARPAOJYNYLLXHUS7JAF6KAQWLMIYCXC4UGW5BETTQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g): protocol: read tcp 188.166.225.170:50928->104.36.82.4:4804: use of closed network connection; context canceled Jul 1 20:30:54.987039529 (203h20m29.757680864s) [seg_pos={0 0}, upload=162628]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 20:30:54.987097500 (203h20m29.757738835s) [upload=162628]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 20:30:54.987100907 (203h20m29.757742232s) [upload=162628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 20:30:55.290907064 (203h20m30.061548409s) [upload=162628]: Done uploading segments... Jul 1 20:30:55.290920750 (203h20m30.061562085s) [upload=162628]: Upload finished. err: <nil> Duration: 6.623240814s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 5.742829849s FAIL (2025-07-01 21:00:31 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== p 188.166.225.170:38826->45.91.116.14:4190: use of closed network connection Jul 1 20:30:07.397683164 (203h19m42.168324499s) [seg_pos={0 0}, upload=162621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 20:30:07.397793445 (203h19m42.16843478s) [upload=162621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 20:30:07.397832890 (203h19m42.168474225s) [upload=162621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 20:30:07.690755035 (203h19m42.46139637s) [upload=162621]: Done uploading segments... Jul 1 20:30:07.690777598 (203h19m42.461418933s) [upload=162621]: Upload finished. err: <nil> Jul 1 20:30:51.075923771 (203h20m25.846565096s) [upload=162628]: Starting upload Jul 1 20:30:51.075979769 (203h20m25.846621104s) [upload=162628]: Done starting upload Jul 1 20:30:51.076046185 (203h20m25.84668752s) [upload=162628]: Uploading segments... Jul 1 20:30:51.076156256 (203h20m25.846797591s) [upload=162628]: Got next segment. Inline: false Jul 1 20:30:51.076184720 (203h20m25.846826055s) [upload=162628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 1 20:30:51.076189279 (203h20m25.846830614s) [upload=162628]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 1 20:30:51.307264904 (203h20m26.077906239s) [seg_pos={0 0}, upload=162628]: Begin upload segment... Jul 1 20:30:51.307309248 (203h20m26.077950583s) [seg_pos={0 0}, upload=162628]: Done begin upload segment. Jul 1 20:30:51.307323446 (203h20m26.077964771s) [noise=true , address=45.91.116.8:4048 , piece_id=2G2OOQLJPTUDY5PZSHQ2MNAV7774DPK55SELX5STL5W35MXSFKNQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307341239 (203h20m26.077982574s) [noise=true , address=77.90.31.12:4589 , piece_id=OAQAOA63GE45RWO52GQFOO6FGD4M2AW6ALCPMKCB7T25UDBFOBIA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307377640 (203h20m26.078018965s) [noise=true , address=45.91.116.13:4154 , piece_id=CWIE4GHPWQCF7YHM2QG62RJMBQBNKNXRK2JI4G6OBTPKN4VV73BA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307671732 (203h20m26.078313057s) [noise=true , address=104.36.82.14:4221 , piece_id=JK73AQZVYWALWCBO7DORATYWJOIKWT2WBBHSZ26Q3TJLBYDTYO2Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307680439 (203h20m26.078321774s) [noise=true , address=104.36.82.7:4909 , piece_id=JNUIUO5MFV5I3L4CTK6IY2CMQDKTVCGPAR6VQHIKE2BKPIQQNGHA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307944213 (203h20m26.078585548s) [noise=true , address=45.91.116.5:5299 , piece_id=V6X7BVMX3IP23A65VFY7PIHGCJPGKLTZAYH4QVPPUFB34M3JUQYQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308197999 (203h20m26.078839334s) [noise=true , address=104.36.82.2:4731 , piece_id=JXQL75TODICFVUAIEE4TRGI2DUYVNC3ZR3RNEARTKQS56IIKZATQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308448899 (203h20m26.079090234s) [noise=true , address=45.91.116.4:4937 , piece_id=CMO4GLDKCZ7KQWHM5S4XX5QB2L3KAHUKRUYXWNE5OPEJ464X2NBA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308746398 (203h20m26.079387733s) [noise=true , address=77.90.31.17:4770 , piece_id=OFDOKUGNGNDMRFTF4HF3BHPZO3HSDDJZL7NC6G7PQSPKZRZVWGJA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308975577 (203h20m26.079616912s) [noise=true , address=45.91.116.13:4155 , piece_id=WN7BEIS5XO4K3BGAHLFDGBXUK52OHWYBPFFH6GCNADP6HWYBM73Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309167925 (203h20m26.07980926s) [noise=true , address=45.91.116.9:5262 , piece_id=N2SGOATWGVAKHJUCGXIUCMO5GTHQS4FHSFXZJBSGGT4HIQK4MFSQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309359802 (203h20m26.080001137s) [noise=true , address=45.91.116.6:4975 , piece_id=YUJIO2VMD53TDD66ANUI55LFMDTPHRMKV4Y7L7X66KA2BMKTIUQA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309548883 (203h20m26.080190218s) [noise=true , address=45.91.116.10:4082 , piece_id=U3OGQJQN3KWNAO2ALYP2OVAZFOE3PZHWZWY2HH64MFCO47TINKWA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309824350 (203h20m26.080465675s) [noise=true , address=104.36.82.8:4972 , piece_id=DA5ZEQHEMMJRTFRB4HMJL2OGGSA45P6UPNDJDKAU47S3A6OYQNMA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.310037578 (203h20m26.080678913s) [noise=true , address=104.36.82.4:4804 , piece_id=HV3FD4MSGB3ARPAOJYNYLLXHUS7JAF6KAQWLMIYCXC4UGW5BETTQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.311261871 (203h20m26.081903206s) [noise=true , address=77.90.31.12:4590 , piece_id=5XDULYYTTMHQXP4QSDT4M2W6NS7CM4ZYWH3OU32FMBAGXNQIVU6Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:53.080800025 (203h20m27.85144135s) [upload=162628]: Next returned nil segment Jul 1 20:30:53.080836496 (203h20m27.851477821s) [upload=162628]: Waiting for error group managing segments... Jul 1 20:30:53.362137719 (203h20m28.132806747s) [noise=true , address=45.91.116.4:4937 , piece_id=CMO4GLDKCZ7KQWHM5S4XX5QB2L3KAHUKRUYXWNE5OPEJ464X2NBA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.365537323 (203h20m28.136178648s) [noise=true , address=45.91.116.10:4082 , piece_id=U3OGQJQN3KWNAO2ALYP2OVAZFOE3PZHWZWY2HH64MFCO47TINKWA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.366047188 (203h20m28.136688523s) [noise=true , address=45.91.116.9:5262 , piece_id=N2SGOATWGVAKHJUCGXIUCMO5GTHQS4FHSFXZJBSGGT4HIQK4MFSQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.366428668 (203h20m28.137070003s) [noise=true , address=45.91.116.5:5299 , piece_id=V6X7BVMX3IP23A65VFY7PIHGCJPGKLTZAYH4QVPPUFB34M3JUQYQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.373588435 (203h20m28.14422977s) [noise=true , address=45.91.116.13:4155 , piece_id=WN7BEIS5XO4K3BGAHLFDGBXUK52OHWYBPFFH6GCNADP6HWYBM73Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.395606298 (203h20m28.166247633s) [noise=true , address=77.90.31.12:4589 , piece_id=OAQAOA63GE45RWO52GQFOO6FGD4M2AW6ALCPMKCB7T25UDBFOBIA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.399444591 (203h20m28.170085926s) [noise=true , address=77.90.31.17:4770 , piece_id=OFDOKUGNGNDMRFTF4HF3BHPZO3HSDDJZL7NC6G7PQSPKZRZVWGJA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.409917327 (203h20m28.180558662s) [noise=true , address=77.90.31.12:4590 , piece_id=5XDULYYTTMHQXP4QSDT4M2W6NS7CM4ZYWH3OU32FMBAGXNQIVU6Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.459664931 (203h20m28.230306266s) [noise=true , address=104.36.82.14:4221 , piece_id=JK73AQZVYWALWCBO7DORATYWJOIKWT2WBBHSZ26Q3TJLBYDTYO2Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.461422203 (203h20m28.232063538s) [noise=true , address=45.91.116.13:4154 , piece_id=CWIE4GHPWQCF7YHM2QG62RJMBQBNKNXRK2JI4G6OBTPKN4VV73BA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.506236628 (203h20m28.276877963s) [noise=true , address=45.91.116.6:4975 , piece_id=YUJIO2VMD53TDD66ANUI55LFMDTPHRMKV4Y7L7X66KA2BMKTIUQA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.855073943 (203h20m29.625715268s) [noise=true , address=104.36.82.2:4731 , piece_id=JXQL75TODICFVUAIEE4TRGI2DUYVNC3ZR3RNEARTKQS56IIKZATQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.986719438 (203h20m29.757360773s) [noise=true , address=104.36.82.8:4972 , piece_id=DA5ZEQHEMMJRTFRB4HMJL2OGGSA45P6UPNDJDKAU47S3A6OYQNMA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.986744686 (203h20m29.757386021s) [seg_pos={0 0}, upload=162628]: Segment reached optimal threshold of 13 pieces. Jul 1 20:30:54.986928978 (203h20m29.757570303s) [noise=true , address=45.91.116.8:4048 , piece_id=2G2OOQLJPTUDY5PZSHQ2MNAV7774DPK55SELX5STL5W35MXSFKNQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection; write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection Jul 1 20:30:54.986947524 (203h20m29.757588859s) [noise=true , address=104.36.82.7:4909 , piece_id=JNUIUO5MFV5I3L4CTK6IY2CMQDKTVCGPAR6VQHIKE2BKPIQQNGHA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF Jul 1 20:30:54.987028379 (203h20m29.757669714s) [noise=true , address=104.36.82.4:4804 , piece_id=HV3FD4MSGB3ARPAOJYNYLLXHUS7JAF6KAQWLMIYCXC4UGW5BETTQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g): protocol: read tcp 188.166.225.170:50928->104.36.82.4:4804: use of closed network connection; context canceled Jul 1 20:30:54.987039529 (203h20m29.757680864s) [seg_pos={0 0}, upload=162628]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 20:30:54.987097500 (203h20m29.757738835s) [upload=162628]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 20:30:54.987100907 (203h20m29.757742232s) [upload=162628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 20:30:55.290907064 (203h20m30.061548409s) [upload=162628]: Done uploading segments... Jul 1 20:30:55.290920750 (203h20m30.061562085s) [upload=162628]: Upload finished. err: <nil> Duration: 5.742857853s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 5.74918772s FAIL (2025-07-01 20:59:55 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== p 188.166.225.170:38826->45.91.116.14:4190: use of closed network connection Jul 1 20:30:07.397683164 (203h19m42.168324499s) [seg_pos={0 0}, upload=162621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 20:30:07.397793445 (203h19m42.16843478s) [upload=162621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 20:30:07.397832890 (203h19m42.168474225s) [upload=162621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 20:30:07.690755035 (203h19m42.46139637s) [upload=162621]: Done uploading segments... Jul 1 20:30:07.690777598 (203h19m42.461418933s) [upload=162621]: Upload finished. err: <nil> Jul 1 20:30:51.075923771 (203h20m25.846565096s) [upload=162628]: Starting upload Jul 1 20:30:51.075979769 (203h20m25.846621104s) [upload=162628]: Done starting upload Jul 1 20:30:51.076046185 (203h20m25.84668752s) [upload=162628]: Uploading segments... Jul 1 20:30:51.076156256 (203h20m25.846797591s) [upload=162628]: Got next segment. Inline: false Jul 1 20:30:51.076184720 (203h20m25.846826055s) [upload=162628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 1 20:30:51.076189279 (203h20m25.846830614s) [upload=162628]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 1 20:30:51.307264904 (203h20m26.077906239s) [seg_pos={0 0}, upload=162628]: Begin upload segment... Jul 1 20:30:51.307309248 (203h20m26.077950583s) [seg_pos={0 0}, upload=162628]: Done begin upload segment. Jul 1 20:30:51.307323446 (203h20m26.077964771s) [noise=true , address=45.91.116.8:4048 , piece_id=2G2OOQLJPTUDY5PZSHQ2MNAV7774DPK55SELX5STL5W35MXSFKNQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307341239 (203h20m26.077982574s) [noise=true , address=77.90.31.12:4589 , piece_id=OAQAOA63GE45RWO52GQFOO6FGD4M2AW6ALCPMKCB7T25UDBFOBIA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307377640 (203h20m26.078018965s) [noise=true , address=45.91.116.13:4154 , piece_id=CWIE4GHPWQCF7YHM2QG62RJMBQBNKNXRK2JI4G6OBTPKN4VV73BA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307671732 (203h20m26.078313057s) [noise=true , address=104.36.82.14:4221 , piece_id=JK73AQZVYWALWCBO7DORATYWJOIKWT2WBBHSZ26Q3TJLBYDTYO2Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307680439 (203h20m26.078321774s) [noise=true , address=104.36.82.7:4909 , piece_id=JNUIUO5MFV5I3L4CTK6IY2CMQDKTVCGPAR6VQHIKE2BKPIQQNGHA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307944213 (203h20m26.078585548s) [noise=true , address=45.91.116.5:5299 , piece_id=V6X7BVMX3IP23A65VFY7PIHGCJPGKLTZAYH4QVPPUFB34M3JUQYQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308197999 (203h20m26.078839334s) [noise=true , address=104.36.82.2:4731 , piece_id=JXQL75TODICFVUAIEE4TRGI2DUYVNC3ZR3RNEARTKQS56IIKZATQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308448899 (203h20m26.079090234s) [noise=true , address=45.91.116.4:4937 , piece_id=CMO4GLDKCZ7KQWHM5S4XX5QB2L3KAHUKRUYXWNE5OPEJ464X2NBA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308746398 (203h20m26.079387733s) [noise=true , address=77.90.31.17:4770 , piece_id=OFDOKUGNGNDMRFTF4HF3BHPZO3HSDDJZL7NC6G7PQSPKZRZVWGJA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308975577 (203h20m26.079616912s) [noise=true , address=45.91.116.13:4155 , piece_id=WN7BEIS5XO4K3BGAHLFDGBXUK52OHWYBPFFH6GCNADP6HWYBM73Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309167925 (203h20m26.07980926s) [noise=true , address=45.91.116.9:5262 , piece_id=N2SGOATWGVAKHJUCGXIUCMO5GTHQS4FHSFXZJBSGGT4HIQK4MFSQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309359802 (203h20m26.080001137s) [noise=true , address=45.91.116.6:4975 , piece_id=YUJIO2VMD53TDD66ANUI55LFMDTPHRMKV4Y7L7X66KA2BMKTIUQA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309548883 (203h20m26.080190218s) [noise=true , address=45.91.116.10:4082 , piece_id=U3OGQJQN3KWNAO2ALYP2OVAZFOE3PZHWZWY2HH64MFCO47TINKWA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309824350 (203h20m26.080465675s) [noise=true , address=104.36.82.8:4972 , piece_id=DA5ZEQHEMMJRTFRB4HMJL2OGGSA45P6UPNDJDKAU47S3A6OYQNMA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.310037578 (203h20m26.080678913s) [noise=true , address=104.36.82.4:4804 , piece_id=HV3FD4MSGB3ARPAOJYNYLLXHUS7JAF6KAQWLMIYCXC4UGW5BETTQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.311261871 (203h20m26.081903206s) [noise=true , address=77.90.31.12:4590 , piece_id=5XDULYYTTMHQXP4QSDT4M2W6NS7CM4ZYWH3OU32FMBAGXNQIVU6Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:53.080800025 (203h20m27.85144135s) [upload=162628]: Next returned nil segment Jul 1 20:30:53.080836496 (203h20m27.851477821s) [upload=162628]: Waiting for error group managing segments... Jul 1 20:30:53.362137719 (203h20m28.132806747s) [noise=true , address=45.91.116.4:4937 , piece_id=CMO4GLDKCZ7KQWHM5S4XX5QB2L3KAHUKRUYXWNE5OPEJ464X2NBA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.365537323 (203h20m28.136178648s) [noise=true , address=45.91.116.10:4082 , piece_id=U3OGQJQN3KWNAO2ALYP2OVAZFOE3PZHWZWY2HH64MFCO47TINKWA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.366047188 (203h20m28.136688523s) [noise=true , address=45.91.116.9:5262 , piece_id=N2SGOATWGVAKHJUCGXIUCMO5GTHQS4FHSFXZJBSGGT4HIQK4MFSQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.366428668 (203h20m28.137070003s) [noise=true , address=45.91.116.5:5299 , piece_id=V6X7BVMX3IP23A65VFY7PIHGCJPGKLTZAYH4QVPPUFB34M3JUQYQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.373588435 (203h20m28.14422977s) [noise=true , address=45.91.116.13:4155 , piece_id=WN7BEIS5XO4K3BGAHLFDGBXUK52OHWYBPFFH6GCNADP6HWYBM73Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.395606298 (203h20m28.166247633s) [noise=true , address=77.90.31.12:4589 , piece_id=OAQAOA63GE45RWO52GQFOO6FGD4M2AW6ALCPMKCB7T25UDBFOBIA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.399444591 (203h20m28.170085926s) [noise=true , address=77.90.31.17:4770 , piece_id=OFDOKUGNGNDMRFTF4HF3BHPZO3HSDDJZL7NC6G7PQSPKZRZVWGJA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.409917327 (203h20m28.180558662s) [noise=true , address=77.90.31.12:4590 , piece_id=5XDULYYTTMHQXP4QSDT4M2W6NS7CM4ZYWH3OU32FMBAGXNQIVU6Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.459664931 (203h20m28.230306266s) [noise=true , address=104.36.82.14:4221 , piece_id=JK73AQZVYWALWCBO7DORATYWJOIKWT2WBBHSZ26Q3TJLBYDTYO2Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.461422203 (203h20m28.232063538s) [noise=true , address=45.91.116.13:4154 , piece_id=CWIE4GHPWQCF7YHM2QG62RJMBQBNKNXRK2JI4G6OBTPKN4VV73BA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.506236628 (203h20m28.276877963s) [noise=true , address=45.91.116.6:4975 , piece_id=YUJIO2VMD53TDD66ANUI55LFMDTPHRMKV4Y7L7X66KA2BMKTIUQA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.855073943 (203h20m29.625715268s) [noise=true , address=104.36.82.2:4731 , piece_id=JXQL75TODICFVUAIEE4TRGI2DUYVNC3ZR3RNEARTKQS56IIKZATQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.986719438 (203h20m29.757360773s) [noise=true , address=104.36.82.8:4972 , piece_id=DA5ZEQHEMMJRTFRB4HMJL2OGGSA45P6UPNDJDKAU47S3A6OYQNMA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.986744686 (203h20m29.757386021s) [seg_pos={0 0}, upload=162628]: Segment reached optimal threshold of 13 pieces. Jul 1 20:30:54.986928978 (203h20m29.757570303s) [noise=true , address=45.91.116.8:4048 , piece_id=2G2OOQLJPTUDY5PZSHQ2MNAV7774DPK55SELX5STL5W35MXSFKNQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection; write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection Jul 1 20:30:54.986947524 (203h20m29.757588859s) [noise=true , address=104.36.82.7:4909 , piece_id=JNUIUO5MFV5I3L4CTK6IY2CMQDKTVCGPAR6VQHIKE2BKPIQQNGHA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF Jul 1 20:30:54.987028379 (203h20m29.757669714s) [noise=true , address=104.36.82.4:4804 , piece_id=HV3FD4MSGB3ARPAOJYNYLLXHUS7JAF6KAQWLMIYCXC4UGW5BETTQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g): protocol: read tcp 188.166.225.170:50928->104.36.82.4:4804: use of closed network connection; context canceled Jul 1 20:30:54.987039529 (203h20m29.757680864s) [seg_pos={0 0}, upload=162628]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 20:30:54.987097500 (203h20m29.757738835s) [upload=162628]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 20:30:54.987100907 (203h20m29.757742232s) [upload=162628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 20:30:55.290907064 (203h20m30.061548409s) [upload=162628]: Done uploading segments... Jul 1 20:30:55.290920750 (203h20m30.061562085s) [upload=162628]: Upload finished. err: <nil> Duration: 5.749210815s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 7.306110801s FAIL (2025-07-01 20:58:47 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== p 188.166.225.170:38826->45.91.116.14:4190: use of closed network connection Jul 1 20:30:07.397683164 (203h19m42.168324499s) [seg_pos={0 0}, upload=162621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 20:30:07.397793445 (203h19m42.16843478s) [upload=162621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 20:30:07.397832890 (203h19m42.168474225s) [upload=162621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 20:30:07.690755035 (203h19m42.46139637s) [upload=162621]: Done uploading segments... Jul 1 20:30:07.690777598 (203h19m42.461418933s) [upload=162621]: Upload finished. err: <nil> Jul 1 20:30:51.075923771 (203h20m25.846565096s) [upload=162628]: Starting upload Jul 1 20:30:51.075979769 (203h20m25.846621104s) [upload=162628]: Done starting upload Jul 1 20:30:51.076046185 (203h20m25.84668752s) [upload=162628]: Uploading segments... Jul 1 20:30:51.076156256 (203h20m25.846797591s) [upload=162628]: Got next segment. Inline: false Jul 1 20:30:51.076184720 (203h20m25.846826055s) [upload=162628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 1 20:30:51.076189279 (203h20m25.846830614s) [upload=162628]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 1 20:30:51.307264904 (203h20m26.077906239s) [seg_pos={0 0}, upload=162628]: Begin upload segment... Jul 1 20:30:51.307309248 (203h20m26.077950583s) [seg_pos={0 0}, upload=162628]: Done begin upload segment. Jul 1 20:30:51.307323446 (203h20m26.077964771s) [noise=true , address=45.91.116.8:4048 , piece_id=2G2OOQLJPTUDY5PZSHQ2MNAV7774DPK55SELX5STL5W35MXSFKNQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307341239 (203h20m26.077982574s) [noise=true , address=77.90.31.12:4589 , piece_id=OAQAOA63GE45RWO52GQFOO6FGD4M2AW6ALCPMKCB7T25UDBFOBIA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307377640 (203h20m26.078018965s) [noise=true , address=45.91.116.13:4154 , piece_id=CWIE4GHPWQCF7YHM2QG62RJMBQBNKNXRK2JI4G6OBTPKN4VV73BA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307671732 (203h20m26.078313057s) [noise=true , address=104.36.82.14:4221 , piece_id=JK73AQZVYWALWCBO7DORATYWJOIKWT2WBBHSZ26Q3TJLBYDTYO2Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307680439 (203h20m26.078321774s) [noise=true , address=104.36.82.7:4909 , piece_id=JNUIUO5MFV5I3L4CTK6IY2CMQDKTVCGPAR6VQHIKE2BKPIQQNGHA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307944213 (203h20m26.078585548s) [noise=true , address=45.91.116.5:5299 , piece_id=V6X7BVMX3IP23A65VFY7PIHGCJPGKLTZAYH4QVPPUFB34M3JUQYQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308197999 (203h20m26.078839334s) [noise=true , address=104.36.82.2:4731 , piece_id=JXQL75TODICFVUAIEE4TRGI2DUYVNC3ZR3RNEARTKQS56IIKZATQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308448899 (203h20m26.079090234s) [noise=true , address=45.91.116.4:4937 , piece_id=CMO4GLDKCZ7KQWHM5S4XX5QB2L3KAHUKRUYXWNE5OPEJ464X2NBA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308746398 (203h20m26.079387733s) [noise=true , address=77.90.31.17:4770 , piece_id=OFDOKUGNGNDMRFTF4HF3BHPZO3HSDDJZL7NC6G7PQSPKZRZVWGJA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308975577 (203h20m26.079616912s) [noise=true , address=45.91.116.13:4155 , piece_id=WN7BEIS5XO4K3BGAHLFDGBXUK52OHWYBPFFH6GCNADP6HWYBM73Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309167925 (203h20m26.07980926s) [noise=true , address=45.91.116.9:5262 , piece_id=N2SGOATWGVAKHJUCGXIUCMO5GTHQS4FHSFXZJBSGGT4HIQK4MFSQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309359802 (203h20m26.080001137s) [noise=true , address=45.91.116.6:4975 , piece_id=YUJIO2VMD53TDD66ANUI55LFMDTPHRMKV4Y7L7X66KA2BMKTIUQA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309548883 (203h20m26.080190218s) [noise=true , address=45.91.116.10:4082 , piece_id=U3OGQJQN3KWNAO2ALYP2OVAZFOE3PZHWZWY2HH64MFCO47TINKWA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309824350 (203h20m26.080465675s) [noise=true , address=104.36.82.8:4972 , piece_id=DA5ZEQHEMMJRTFRB4HMJL2OGGSA45P6UPNDJDKAU47S3A6OYQNMA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.310037578 (203h20m26.080678913s) [noise=true , address=104.36.82.4:4804 , piece_id=HV3FD4MSGB3ARPAOJYNYLLXHUS7JAF6KAQWLMIYCXC4UGW5BETTQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.311261871 (203h20m26.081903206s) [noise=true , address=77.90.31.12:4590 , piece_id=5XDULYYTTMHQXP4QSDT4M2W6NS7CM4ZYWH3OU32FMBAGXNQIVU6Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:53.080800025 (203h20m27.85144135s) [upload=162628]: Next returned nil segment Jul 1 20:30:53.080836496 (203h20m27.851477821s) [upload=162628]: Waiting for error group managing segments... Jul 1 20:30:53.362137719 (203h20m28.132806747s) [noise=true , address=45.91.116.4:4937 , piece_id=CMO4GLDKCZ7KQWHM5S4XX5QB2L3KAHUKRUYXWNE5OPEJ464X2NBA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.365537323 (203h20m28.136178648s) [noise=true , address=45.91.116.10:4082 , piece_id=U3OGQJQN3KWNAO2ALYP2OVAZFOE3PZHWZWY2HH64MFCO47TINKWA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.366047188 (203h20m28.136688523s) [noise=true , address=45.91.116.9:5262 , piece_id=N2SGOATWGVAKHJUCGXIUCMO5GTHQS4FHSFXZJBSGGT4HIQK4MFSQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.366428668 (203h20m28.137070003s) [noise=true , address=45.91.116.5:5299 , piece_id=V6X7BVMX3IP23A65VFY7PIHGCJPGKLTZAYH4QVPPUFB34M3JUQYQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.373588435 (203h20m28.14422977s) [noise=true , address=45.91.116.13:4155 , piece_id=WN7BEIS5XO4K3BGAHLFDGBXUK52OHWYBPFFH6GCNADP6HWYBM73Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.395606298 (203h20m28.166247633s) [noise=true , address=77.90.31.12:4589 , piece_id=OAQAOA63GE45RWO52GQFOO6FGD4M2AW6ALCPMKCB7T25UDBFOBIA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.399444591 (203h20m28.170085926s) [noise=true , address=77.90.31.17:4770 , piece_id=OFDOKUGNGNDMRFTF4HF3BHPZO3HSDDJZL7NC6G7PQSPKZRZVWGJA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.409917327 (203h20m28.180558662s) [noise=true , address=77.90.31.12:4590 , piece_id=5XDULYYTTMHQXP4QSDT4M2W6NS7CM4ZYWH3OU32FMBAGXNQIVU6Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.459664931 (203h20m28.230306266s) [noise=true , address=104.36.82.14:4221 , piece_id=JK73AQZVYWALWCBO7DORATYWJOIKWT2WBBHSZ26Q3TJLBYDTYO2Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.461422203 (203h20m28.232063538s) [noise=true , address=45.91.116.13:4154 , piece_id=CWIE4GHPWQCF7YHM2QG62RJMBQBNKNXRK2JI4G6OBTPKN4VV73BA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.506236628 (203h20m28.276877963s) [noise=true , address=45.91.116.6:4975 , piece_id=YUJIO2VMD53TDD66ANUI55LFMDTPHRMKV4Y7L7X66KA2BMKTIUQA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.855073943 (203h20m29.625715268s) [noise=true , address=104.36.82.2:4731 , piece_id=JXQL75TODICFVUAIEE4TRGI2DUYVNC3ZR3RNEARTKQS56IIKZATQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.986719438 (203h20m29.757360773s) [noise=true , address=104.36.82.8:4972 , piece_id=DA5ZEQHEMMJRTFRB4HMJL2OGGSA45P6UPNDJDKAU47S3A6OYQNMA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.986744686 (203h20m29.757386021s) [seg_pos={0 0}, upload=162628]: Segment reached optimal threshold of 13 pieces. Jul 1 20:30:54.986928978 (203h20m29.757570303s) [noise=true , address=45.91.116.8:4048 , piece_id=2G2OOQLJPTUDY5PZSHQ2MNAV7774DPK55SELX5STL5W35MXSFKNQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection; write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection Jul 1 20:30:54.986947524 (203h20m29.757588859s) [noise=true , address=104.36.82.7:4909 , piece_id=JNUIUO5MFV5I3L4CTK6IY2CMQDKTVCGPAR6VQHIKE2BKPIQQNGHA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF Jul 1 20:30:54.987028379 (203h20m29.757669714s) [noise=true , address=104.36.82.4:4804 , piece_id=HV3FD4MSGB3ARPAOJYNYLLXHUS7JAF6KAQWLMIYCXC4UGW5BETTQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g): protocol: read tcp 188.166.225.170:50928->104.36.82.4:4804: use of closed network connection; context canceled Jul 1 20:30:54.987039529 (203h20m29.757680864s) [seg_pos={0 0}, upload=162628]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 20:30:54.987097500 (203h20m29.757738835s) [upload=162628]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 20:30:54.987100907 (203h20m29.757742232s) [upload=162628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 20:30:55.290907064 (203h20m30.061548409s) [upload=162628]: Done uploading segments... Jul 1 20:30:55.290920750 (203h20m30.061562085s) [upload=162628]: Upload finished. err: <nil> Duration: 7.306139425s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 7.075291849s FAIL (2025-07-01 20:58:18 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== p 188.166.225.170:38826->45.91.116.14:4190: use of closed network connection Jul 1 20:30:07.397683164 (203h19m42.168324499s) [seg_pos={0 0}, upload=162621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 20:30:07.397793445 (203h19m42.16843478s) [upload=162621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 20:30:07.397832890 (203h19m42.168474225s) [upload=162621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 20:30:07.690755035 (203h19m42.46139637s) [upload=162621]: Done uploading segments... Jul 1 20:30:07.690777598 (203h19m42.461418933s) [upload=162621]: Upload finished. err: <nil> Jul 1 20:30:51.075923771 (203h20m25.846565096s) [upload=162628]: Starting upload Jul 1 20:30:51.075979769 (203h20m25.846621104s) [upload=162628]: Done starting upload Jul 1 20:30:51.076046185 (203h20m25.84668752s) [upload=162628]: Uploading segments... Jul 1 20:30:51.076156256 (203h20m25.846797591s) [upload=162628]: Got next segment. Inline: false Jul 1 20:30:51.076184720 (203h20m25.846826055s) [upload=162628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 1 20:30:51.076189279 (203h20m25.846830614s) [upload=162628]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 1 20:30:51.307264904 (203h20m26.077906239s) [seg_pos={0 0}, upload=162628]: Begin upload segment... Jul 1 20:30:51.307309248 (203h20m26.077950583s) [seg_pos={0 0}, upload=162628]: Done begin upload segment. Jul 1 20:30:51.307323446 (203h20m26.077964771s) [noise=true , address=45.91.116.8:4048 , piece_id=2G2OOQLJPTUDY5PZSHQ2MNAV7774DPK55SELX5STL5W35MXSFKNQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307341239 (203h20m26.077982574s) [noise=true , address=77.90.31.12:4589 , piece_id=OAQAOA63GE45RWO52GQFOO6FGD4M2AW6ALCPMKCB7T25UDBFOBIA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307377640 (203h20m26.078018965s) [noise=true , address=45.91.116.13:4154 , piece_id=CWIE4GHPWQCF7YHM2QG62RJMBQBNKNXRK2JI4G6OBTPKN4VV73BA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307671732 (203h20m26.078313057s) [noise=true , address=104.36.82.14:4221 , piece_id=JK73AQZVYWALWCBO7DORATYWJOIKWT2WBBHSZ26Q3TJLBYDTYO2Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307680439 (203h20m26.078321774s) [noise=true , address=104.36.82.7:4909 , piece_id=JNUIUO5MFV5I3L4CTK6IY2CMQDKTVCGPAR6VQHIKE2BKPIQQNGHA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307944213 (203h20m26.078585548s) [noise=true , address=45.91.116.5:5299 , piece_id=V6X7BVMX3IP23A65VFY7PIHGCJPGKLTZAYH4QVPPUFB34M3JUQYQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308197999 (203h20m26.078839334s) [noise=true , address=104.36.82.2:4731 , piece_id=JXQL75TODICFVUAIEE4TRGI2DUYVNC3ZR3RNEARTKQS56IIKZATQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308448899 (203h20m26.079090234s) [noise=true , address=45.91.116.4:4937 , piece_id=CMO4GLDKCZ7KQWHM5S4XX5QB2L3KAHUKRUYXWNE5OPEJ464X2NBA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308746398 (203h20m26.079387733s) [noise=true , address=77.90.31.17:4770 , piece_id=OFDOKUGNGNDMRFTF4HF3BHPZO3HSDDJZL7NC6G7PQSPKZRZVWGJA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308975577 (203h20m26.079616912s) [noise=true , address=45.91.116.13:4155 , piece_id=WN7BEIS5XO4K3BGAHLFDGBXUK52OHWYBPFFH6GCNADP6HWYBM73Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309167925 (203h20m26.07980926s) [noise=true , address=45.91.116.9:5262 , piece_id=N2SGOATWGVAKHJUCGXIUCMO5GTHQS4FHSFXZJBSGGT4HIQK4MFSQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309359802 (203h20m26.080001137s) [noise=true , address=45.91.116.6:4975 , piece_id=YUJIO2VMD53TDD66ANUI55LFMDTPHRMKV4Y7L7X66KA2BMKTIUQA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309548883 (203h20m26.080190218s) [noise=true , address=45.91.116.10:4082 , piece_id=U3OGQJQN3KWNAO2ALYP2OVAZFOE3PZHWZWY2HH64MFCO47TINKWA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309824350 (203h20m26.080465675s) [noise=true , address=104.36.82.8:4972 , piece_id=DA5ZEQHEMMJRTFRB4HMJL2OGGSA45P6UPNDJDKAU47S3A6OYQNMA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.310037578 (203h20m26.080678913s) [noise=true , address=104.36.82.4:4804 , piece_id=HV3FD4MSGB3ARPAOJYNYLLXHUS7JAF6KAQWLMIYCXC4UGW5BETTQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.311261871 (203h20m26.081903206s) [noise=true , address=77.90.31.12:4590 , piece_id=5XDULYYTTMHQXP4QSDT4M2W6NS7CM4ZYWH3OU32FMBAGXNQIVU6Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:53.080800025 (203h20m27.85144135s) [upload=162628]: Next returned nil segment Jul 1 20:30:53.080836496 (203h20m27.851477821s) [upload=162628]: Waiting for error group managing segments... Jul 1 20:30:53.362137719 (203h20m28.132806747s) [noise=true , address=45.91.116.4:4937 , piece_id=CMO4GLDKCZ7KQWHM5S4XX5QB2L3KAHUKRUYXWNE5OPEJ464X2NBA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.365537323 (203h20m28.136178648s) [noise=true , address=45.91.116.10:4082 , piece_id=U3OGQJQN3KWNAO2ALYP2OVAZFOE3PZHWZWY2HH64MFCO47TINKWA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.366047188 (203h20m28.136688523s) [noise=true , address=45.91.116.9:5262 , piece_id=N2SGOATWGVAKHJUCGXIUCMO5GTHQS4FHSFXZJBSGGT4HIQK4MFSQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.366428668 (203h20m28.137070003s) [noise=true , address=45.91.116.5:5299 , piece_id=V6X7BVMX3IP23A65VFY7PIHGCJPGKLTZAYH4QVPPUFB34M3JUQYQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.373588435 (203h20m28.14422977s) [noise=true , address=45.91.116.13:4155 , piece_id=WN7BEIS5XO4K3BGAHLFDGBXUK52OHWYBPFFH6GCNADP6HWYBM73Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.395606298 (203h20m28.166247633s) [noise=true , address=77.90.31.12:4589 , piece_id=OAQAOA63GE45RWO52GQFOO6FGD4M2AW6ALCPMKCB7T25UDBFOBIA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.399444591 (203h20m28.170085926s) [noise=true , address=77.90.31.17:4770 , piece_id=OFDOKUGNGNDMRFTF4HF3BHPZO3HSDDJZL7NC6G7PQSPKZRZVWGJA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.409917327 (203h20m28.180558662s) [noise=true , address=77.90.31.12:4590 , piece_id=5XDULYYTTMHQXP4QSDT4M2W6NS7CM4ZYWH3OU32FMBAGXNQIVU6Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.459664931 (203h20m28.230306266s) [noise=true , address=104.36.82.14:4221 , piece_id=JK73AQZVYWALWCBO7DORATYWJOIKWT2WBBHSZ26Q3TJLBYDTYO2Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.461422203 (203h20m28.232063538s) [noise=true , address=45.91.116.13:4154 , piece_id=CWIE4GHPWQCF7YHM2QG62RJMBQBNKNXRK2JI4G6OBTPKN4VV73BA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.506236628 (203h20m28.276877963s) [noise=true , address=45.91.116.6:4975 , piece_id=YUJIO2VMD53TDD66ANUI55LFMDTPHRMKV4Y7L7X66KA2BMKTIUQA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.855073943 (203h20m29.625715268s) [noise=true , address=104.36.82.2:4731 , piece_id=JXQL75TODICFVUAIEE4TRGI2DUYVNC3ZR3RNEARTKQS56IIKZATQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.986719438 (203h20m29.757360773s) [noise=true , address=104.36.82.8:4972 , piece_id=DA5ZEQHEMMJRTFRB4HMJL2OGGSA45P6UPNDJDKAU47S3A6OYQNMA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.986744686 (203h20m29.757386021s) [seg_pos={0 0}, upload=162628]: Segment reached optimal threshold of 13 pieces. Jul 1 20:30:54.986928978 (203h20m29.757570303s) [noise=true , address=45.91.116.8:4048 , piece_id=2G2OOQLJPTUDY5PZSHQ2MNAV7774DPK55SELX5STL5W35MXSFKNQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection; write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection Jul 1 20:30:54.986947524 (203h20m29.757588859s) [noise=true , address=104.36.82.7:4909 , piece_id=JNUIUO5MFV5I3L4CTK6IY2CMQDKTVCGPAR6VQHIKE2BKPIQQNGHA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF Jul 1 20:30:54.987028379 (203h20m29.757669714s) [noise=true , address=104.36.82.4:4804 , piece_id=HV3FD4MSGB3ARPAOJYNYLLXHUS7JAF6KAQWLMIYCXC4UGW5BETTQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g): protocol: read tcp 188.166.225.170:50928->104.36.82.4:4804: use of closed network connection; context canceled Jul 1 20:30:54.987039529 (203h20m29.757680864s) [seg_pos={0 0}, upload=162628]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 20:30:54.987097500 (203h20m29.757738835s) [upload=162628]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 20:30:54.987100907 (203h20m29.757742232s) [upload=162628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 20:30:55.290907064 (203h20m30.061548409s) [upload=162628]: Done uploading segments... Jul 1 20:30:55.290920750 (203h20m30.061562085s) [upload=162628]: Upload finished. err: <nil> Duration: 7.075317409s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 7.282954711s FAIL (2025-07-01 20:57:38 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== p 188.166.225.170:38826->45.91.116.14:4190: use of closed network connection Jul 1 20:30:07.397683164 (203h19m42.168324499s) [seg_pos={0 0}, upload=162621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 20:30:07.397793445 (203h19m42.16843478s) [upload=162621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 20:30:07.397832890 (203h19m42.168474225s) [upload=162621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 20:30:07.690755035 (203h19m42.46139637s) [upload=162621]: Done uploading segments... Jul 1 20:30:07.690777598 (203h19m42.461418933s) [upload=162621]: Upload finished. err: <nil> Jul 1 20:30:51.075923771 (203h20m25.846565096s) [upload=162628]: Starting upload Jul 1 20:30:51.075979769 (203h20m25.846621104s) [upload=162628]: Done starting upload Jul 1 20:30:51.076046185 (203h20m25.84668752s) [upload=162628]: Uploading segments... Jul 1 20:30:51.076156256 (203h20m25.846797591s) [upload=162628]: Got next segment. Inline: false Jul 1 20:30:51.076184720 (203h20m25.846826055s) [upload=162628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 1 20:30:51.076189279 (203h20m25.846830614s) [upload=162628]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 1 20:30:51.307264904 (203h20m26.077906239s) [seg_pos={0 0}, upload=162628]: Begin upload segment... Jul 1 20:30:51.307309248 (203h20m26.077950583s) [seg_pos={0 0}, upload=162628]: Done begin upload segment. Jul 1 20:30:51.307323446 (203h20m26.077964771s) [noise=true , address=45.91.116.8:4048 , piece_id=2G2OOQLJPTUDY5PZSHQ2MNAV7774DPK55SELX5STL5W35MXSFKNQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307341239 (203h20m26.077982574s) [noise=true , address=77.90.31.12:4589 , piece_id=OAQAOA63GE45RWO52GQFOO6FGD4M2AW6ALCPMKCB7T25UDBFOBIA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307377640 (203h20m26.078018965s) [noise=true , address=45.91.116.13:4154 , piece_id=CWIE4GHPWQCF7YHM2QG62RJMBQBNKNXRK2JI4G6OBTPKN4VV73BA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307671732 (203h20m26.078313057s) [noise=true , address=104.36.82.14:4221 , piece_id=JK73AQZVYWALWCBO7DORATYWJOIKWT2WBBHSZ26Q3TJLBYDTYO2Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307680439 (203h20m26.078321774s) [noise=true , address=104.36.82.7:4909 , piece_id=JNUIUO5MFV5I3L4CTK6IY2CMQDKTVCGPAR6VQHIKE2BKPIQQNGHA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307944213 (203h20m26.078585548s) [noise=true , address=45.91.116.5:5299 , piece_id=V6X7BVMX3IP23A65VFY7PIHGCJPGKLTZAYH4QVPPUFB34M3JUQYQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308197999 (203h20m26.078839334s) [noise=true , address=104.36.82.2:4731 , piece_id=JXQL75TODICFVUAIEE4TRGI2DUYVNC3ZR3RNEARTKQS56IIKZATQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308448899 (203h20m26.079090234s) [noise=true , address=45.91.116.4:4937 , piece_id=CMO4GLDKCZ7KQWHM5S4XX5QB2L3KAHUKRUYXWNE5OPEJ464X2NBA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308746398 (203h20m26.079387733s) [noise=true , address=77.90.31.17:4770 , piece_id=OFDOKUGNGNDMRFTF4HF3BHPZO3HSDDJZL7NC6G7PQSPKZRZVWGJA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308975577 (203h20m26.079616912s) [noise=true , address=45.91.116.13:4155 , piece_id=WN7BEIS5XO4K3BGAHLFDGBXUK52OHWYBPFFH6GCNADP6HWYBM73Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309167925 (203h20m26.07980926s) [noise=true , address=45.91.116.9:5262 , piece_id=N2SGOATWGVAKHJUCGXIUCMO5GTHQS4FHSFXZJBSGGT4HIQK4MFSQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309359802 (203h20m26.080001137s) [noise=true , address=45.91.116.6:4975 , piece_id=YUJIO2VMD53TDD66ANUI55LFMDTPHRMKV4Y7L7X66KA2BMKTIUQA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309548883 (203h20m26.080190218s) [noise=true , address=45.91.116.10:4082 , piece_id=U3OGQJQN3KWNAO2ALYP2OVAZFOE3PZHWZWY2HH64MFCO47TINKWA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309824350 (203h20m26.080465675s) [noise=true , address=104.36.82.8:4972 , piece_id=DA5ZEQHEMMJRTFRB4HMJL2OGGSA45P6UPNDJDKAU47S3A6OYQNMA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.310037578 (203h20m26.080678913s) [noise=true , address=104.36.82.4:4804 , piece_id=HV3FD4MSGB3ARPAOJYNYLLXHUS7JAF6KAQWLMIYCXC4UGW5BETTQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.311261871 (203h20m26.081903206s) [noise=true , address=77.90.31.12:4590 , piece_id=5XDULYYTTMHQXP4QSDT4M2W6NS7CM4ZYWH3OU32FMBAGXNQIVU6Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:53.080800025 (203h20m27.85144135s) [upload=162628]: Next returned nil segment Jul 1 20:30:53.080836496 (203h20m27.851477821s) [upload=162628]: Waiting for error group managing segments... Jul 1 20:30:53.362137719 (203h20m28.132806747s) [noise=true , address=45.91.116.4:4937 , piece_id=CMO4GLDKCZ7KQWHM5S4XX5QB2L3KAHUKRUYXWNE5OPEJ464X2NBA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.365537323 (203h20m28.136178648s) [noise=true , address=45.91.116.10:4082 , piece_id=U3OGQJQN3KWNAO2ALYP2OVAZFOE3PZHWZWY2HH64MFCO47TINKWA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.366047188 (203h20m28.136688523s) [noise=true , address=45.91.116.9:5262 , piece_id=N2SGOATWGVAKHJUCGXIUCMO5GTHQS4FHSFXZJBSGGT4HIQK4MFSQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.366428668 (203h20m28.137070003s) [noise=true , address=45.91.116.5:5299 , piece_id=V6X7BVMX3IP23A65VFY7PIHGCJPGKLTZAYH4QVPPUFB34M3JUQYQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.373588435 (203h20m28.14422977s) [noise=true , address=45.91.116.13:4155 , piece_id=WN7BEIS5XO4K3BGAHLFDGBXUK52OHWYBPFFH6GCNADP6HWYBM73Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.395606298 (203h20m28.166247633s) [noise=true , address=77.90.31.12:4589 , piece_id=OAQAOA63GE45RWO52GQFOO6FGD4M2AW6ALCPMKCB7T25UDBFOBIA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.399444591 (203h20m28.170085926s) [noise=true , address=77.90.31.17:4770 , piece_id=OFDOKUGNGNDMRFTF4HF3BHPZO3HSDDJZL7NC6G7PQSPKZRZVWGJA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.409917327 (203h20m28.180558662s) [noise=true , address=77.90.31.12:4590 , piece_id=5XDULYYTTMHQXP4QSDT4M2W6NS7CM4ZYWH3OU32FMBAGXNQIVU6Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.459664931 (203h20m28.230306266s) [noise=true , address=104.36.82.14:4221 , piece_id=JK73AQZVYWALWCBO7DORATYWJOIKWT2WBBHSZ26Q3TJLBYDTYO2Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.461422203 (203h20m28.232063538s) [noise=true , address=45.91.116.13:4154 , piece_id=CWIE4GHPWQCF7YHM2QG62RJMBQBNKNXRK2JI4G6OBTPKN4VV73BA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.506236628 (203h20m28.276877963s) [noise=true , address=45.91.116.6:4975 , piece_id=YUJIO2VMD53TDD66ANUI55LFMDTPHRMKV4Y7L7X66KA2BMKTIUQA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.855073943 (203h20m29.625715268s) [noise=true , address=104.36.82.2:4731 , piece_id=JXQL75TODICFVUAIEE4TRGI2DUYVNC3ZR3RNEARTKQS56IIKZATQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.986719438 (203h20m29.757360773s) [noise=true , address=104.36.82.8:4972 , piece_id=DA5ZEQHEMMJRTFRB4HMJL2OGGSA45P6UPNDJDKAU47S3A6OYQNMA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.986744686 (203h20m29.757386021s) [seg_pos={0 0}, upload=162628]: Segment reached optimal threshold of 13 pieces. Jul 1 20:30:54.986928978 (203h20m29.757570303s) [noise=true , address=45.91.116.8:4048 , piece_id=2G2OOQLJPTUDY5PZSHQ2MNAV7774DPK55SELX5STL5W35MXSFKNQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection; write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection Jul 1 20:30:54.986947524 (203h20m29.757588859s) [noise=true , address=104.36.82.7:4909 , piece_id=JNUIUO5MFV5I3L4CTK6IY2CMQDKTVCGPAR6VQHIKE2BKPIQQNGHA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF Jul 1 20:30:54.987028379 (203h20m29.757669714s) [noise=true , address=104.36.82.4:4804 , piece_id=HV3FD4MSGB3ARPAOJYNYLLXHUS7JAF6KAQWLMIYCXC4UGW5BETTQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g): protocol: read tcp 188.166.225.170:50928->104.36.82.4:4804: use of closed network connection; context canceled Jul 1 20:30:54.987039529 (203h20m29.757680864s) [seg_pos={0 0}, upload=162628]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 20:30:54.987097500 (203h20m29.757738835s) [upload=162628]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 20:30:54.987100907 (203h20m29.757742232s) [upload=162628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 20:30:55.290907064 (203h20m30.061548409s) [upload=162628]: Done uploading segments... Jul 1 20:30:55.290920750 (203h20m30.061562085s) [upload=162628]: Upload finished. err: <nil> Duration: 7.282978998s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 8.580448573s FAIL (2025-07-01 20:56:46 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== p 188.166.225.170:38826->45.91.116.14:4190: use of closed network connection Jul 1 20:30:07.397683164 (203h19m42.168324499s) [seg_pos={0 0}, upload=162621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 20:30:07.397793445 (203h19m42.16843478s) [upload=162621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 20:30:07.397832890 (203h19m42.168474225s) [upload=162621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 20:30:07.690755035 (203h19m42.46139637s) [upload=162621]: Done uploading segments... Jul 1 20:30:07.690777598 (203h19m42.461418933s) [upload=162621]: Upload finished. err: <nil> Jul 1 20:30:51.075923771 (203h20m25.846565096s) [upload=162628]: Starting upload Jul 1 20:30:51.075979769 (203h20m25.846621104s) [upload=162628]: Done starting upload Jul 1 20:30:51.076046185 (203h20m25.84668752s) [upload=162628]: Uploading segments... Jul 1 20:30:51.076156256 (203h20m25.846797591s) [upload=162628]: Got next segment. Inline: false Jul 1 20:30:51.076184720 (203h20m25.846826055s) [upload=162628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 1 20:30:51.076189279 (203h20m25.846830614s) [upload=162628]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 1 20:30:51.307264904 (203h20m26.077906239s) [seg_pos={0 0}, upload=162628]: Begin upload segment... Jul 1 20:30:51.307309248 (203h20m26.077950583s) [seg_pos={0 0}, upload=162628]: Done begin upload segment. Jul 1 20:30:51.307323446 (203h20m26.077964771s) [noise=true , address=45.91.116.8:4048 , piece_id=2G2OOQLJPTUDY5PZSHQ2MNAV7774DPK55SELX5STL5W35MXSFKNQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307341239 (203h20m26.077982574s) [noise=true , address=77.90.31.12:4589 , piece_id=OAQAOA63GE45RWO52GQFOO6FGD4M2AW6ALCPMKCB7T25UDBFOBIA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307377640 (203h20m26.078018965s) [noise=true , address=45.91.116.13:4154 , piece_id=CWIE4GHPWQCF7YHM2QG62RJMBQBNKNXRK2JI4G6OBTPKN4VV73BA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307671732 (203h20m26.078313057s) [noise=true , address=104.36.82.14:4221 , piece_id=JK73AQZVYWALWCBO7DORATYWJOIKWT2WBBHSZ26Q3TJLBYDTYO2Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307680439 (203h20m26.078321774s) [noise=true , address=104.36.82.7:4909 , piece_id=JNUIUO5MFV5I3L4CTK6IY2CMQDKTVCGPAR6VQHIKE2BKPIQQNGHA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307944213 (203h20m26.078585548s) [noise=true , address=45.91.116.5:5299 , piece_id=V6X7BVMX3IP23A65VFY7PIHGCJPGKLTZAYH4QVPPUFB34M3JUQYQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308197999 (203h20m26.078839334s) [noise=true , address=104.36.82.2:4731 , piece_id=JXQL75TODICFVUAIEE4TRGI2DUYVNC3ZR3RNEARTKQS56IIKZATQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308448899 (203h20m26.079090234s) [noise=true , address=45.91.116.4:4937 , piece_id=CMO4GLDKCZ7KQWHM5S4XX5QB2L3KAHUKRUYXWNE5OPEJ464X2NBA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308746398 (203h20m26.079387733s) [noise=true , address=77.90.31.17:4770 , piece_id=OFDOKUGNGNDMRFTF4HF3BHPZO3HSDDJZL7NC6G7PQSPKZRZVWGJA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308975577 (203h20m26.079616912s) [noise=true , address=45.91.116.13:4155 , piece_id=WN7BEIS5XO4K3BGAHLFDGBXUK52OHWYBPFFH6GCNADP6HWYBM73Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309167925 (203h20m26.07980926s) [noise=true , address=45.91.116.9:5262 , piece_id=N2SGOATWGVAKHJUCGXIUCMO5GTHQS4FHSFXZJBSGGT4HIQK4MFSQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309359802 (203h20m26.080001137s) [noise=true , address=45.91.116.6:4975 , piece_id=YUJIO2VMD53TDD66ANUI55LFMDTPHRMKV4Y7L7X66KA2BMKTIUQA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309548883 (203h20m26.080190218s) [noise=true , address=45.91.116.10:4082 , piece_id=U3OGQJQN3KWNAO2ALYP2OVAZFOE3PZHWZWY2HH64MFCO47TINKWA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309824350 (203h20m26.080465675s) [noise=true , address=104.36.82.8:4972 , piece_id=DA5ZEQHEMMJRTFRB4HMJL2OGGSA45P6UPNDJDKAU47S3A6OYQNMA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.310037578 (203h20m26.080678913s) [noise=true , address=104.36.82.4:4804 , piece_id=HV3FD4MSGB3ARPAOJYNYLLXHUS7JAF6KAQWLMIYCXC4UGW5BETTQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.311261871 (203h20m26.081903206s) [noise=true , address=77.90.31.12:4590 , piece_id=5XDULYYTTMHQXP4QSDT4M2W6NS7CM4ZYWH3OU32FMBAGXNQIVU6Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:53.080800025 (203h20m27.85144135s) [upload=162628]: Next returned nil segment Jul 1 20:30:53.080836496 (203h20m27.851477821s) [upload=162628]: Waiting for error group managing segments... Jul 1 20:30:53.362137719 (203h20m28.132806747s) [noise=true , address=45.91.116.4:4937 , piece_id=CMO4GLDKCZ7KQWHM5S4XX5QB2L3KAHUKRUYXWNE5OPEJ464X2NBA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.365537323 (203h20m28.136178648s) [noise=true , address=45.91.116.10:4082 , piece_id=U3OGQJQN3KWNAO2ALYP2OVAZFOE3PZHWZWY2HH64MFCO47TINKWA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.366047188 (203h20m28.136688523s) [noise=true , address=45.91.116.9:5262 , piece_id=N2SGOATWGVAKHJUCGXIUCMO5GTHQS4FHSFXZJBSGGT4HIQK4MFSQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.366428668 (203h20m28.137070003s) [noise=true , address=45.91.116.5:5299 , piece_id=V6X7BVMX3IP23A65VFY7PIHGCJPGKLTZAYH4QVPPUFB34M3JUQYQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.373588435 (203h20m28.14422977s) [noise=true , address=45.91.116.13:4155 , piece_id=WN7BEIS5XO4K3BGAHLFDGBXUK52OHWYBPFFH6GCNADP6HWYBM73Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.395606298 (203h20m28.166247633s) [noise=true , address=77.90.31.12:4589 , piece_id=OAQAOA63GE45RWO52GQFOO6FGD4M2AW6ALCPMKCB7T25UDBFOBIA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.399444591 (203h20m28.170085926s) [noise=true , address=77.90.31.17:4770 , piece_id=OFDOKUGNGNDMRFTF4HF3BHPZO3HSDDJZL7NC6G7PQSPKZRZVWGJA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.409917327 (203h20m28.180558662s) [noise=true , address=77.90.31.12:4590 , piece_id=5XDULYYTTMHQXP4QSDT4M2W6NS7CM4ZYWH3OU32FMBAGXNQIVU6Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.459664931 (203h20m28.230306266s) [noise=true , address=104.36.82.14:4221 , piece_id=JK73AQZVYWALWCBO7DORATYWJOIKWT2WBBHSZ26Q3TJLBYDTYO2Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.461422203 (203h20m28.232063538s) [noise=true , address=45.91.116.13:4154 , piece_id=CWIE4GHPWQCF7YHM2QG62RJMBQBNKNXRK2JI4G6OBTPKN4VV73BA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.506236628 (203h20m28.276877963s) [noise=true , address=45.91.116.6:4975 , piece_id=YUJIO2VMD53TDD66ANUI55LFMDTPHRMKV4Y7L7X66KA2BMKTIUQA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.855073943 (203h20m29.625715268s) [noise=true , address=104.36.82.2:4731 , piece_id=JXQL75TODICFVUAIEE4TRGI2DUYVNC3ZR3RNEARTKQS56IIKZATQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.986719438 (203h20m29.757360773s) [noise=true , address=104.36.82.8:4972 , piece_id=DA5ZEQHEMMJRTFRB4HMJL2OGGSA45P6UPNDJDKAU47S3A6OYQNMA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.986744686 (203h20m29.757386021s) [seg_pos={0 0}, upload=162628]: Segment reached optimal threshold of 13 pieces. Jul 1 20:30:54.986928978 (203h20m29.757570303s) [noise=true , address=45.91.116.8:4048 , piece_id=2G2OOQLJPTUDY5PZSHQ2MNAV7774DPK55SELX5STL5W35MXSFKNQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection; write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection Jul 1 20:30:54.986947524 (203h20m29.757588859s) [noise=true , address=104.36.82.7:4909 , piece_id=JNUIUO5MFV5I3L4CTK6IY2CMQDKTVCGPAR6VQHIKE2BKPIQQNGHA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF Jul 1 20:30:54.987028379 (203h20m29.757669714s) [noise=true , address=104.36.82.4:4804 , piece_id=HV3FD4MSGB3ARPAOJYNYLLXHUS7JAF6KAQWLMIYCXC4UGW5BETTQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g): protocol: read tcp 188.166.225.170:50928->104.36.82.4:4804: use of closed network connection; context canceled Jul 1 20:30:54.987039529 (203h20m29.757680864s) [seg_pos={0 0}, upload=162628]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 20:30:54.987097500 (203h20m29.757738835s) [upload=162628]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 20:30:54.987100907 (203h20m29.757742232s) [upload=162628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 20:30:55.290907064 (203h20m30.061548409s) [upload=162628]: Done uploading segments... Jul 1 20:30:55.290920750 (203h20m30.061562085s) [upload=162628]: Upload finished. err: <nil> Duration: 8.580475565s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 5.764053424s FAIL (2025-07-01 20:55:50 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== p 188.166.225.170:38826->45.91.116.14:4190: use of closed network connection Jul 1 20:30:07.397683164 (203h19m42.168324499s) [seg_pos={0 0}, upload=162621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 20:30:07.397793445 (203h19m42.16843478s) [upload=162621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 20:30:07.397832890 (203h19m42.168474225s) [upload=162621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 20:30:07.690755035 (203h19m42.46139637s) [upload=162621]: Done uploading segments... Jul 1 20:30:07.690777598 (203h19m42.461418933s) [upload=162621]: Upload finished. err: <nil> Jul 1 20:30:51.075923771 (203h20m25.846565096s) [upload=162628]: Starting upload Jul 1 20:30:51.075979769 (203h20m25.846621104s) [upload=162628]: Done starting upload Jul 1 20:30:51.076046185 (203h20m25.84668752s) [upload=162628]: Uploading segments... Jul 1 20:30:51.076156256 (203h20m25.846797591s) [upload=162628]: Got next segment. Inline: false Jul 1 20:30:51.076184720 (203h20m25.846826055s) [upload=162628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 1 20:30:51.076189279 (203h20m25.846830614s) [upload=162628]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 1 20:30:51.307264904 (203h20m26.077906239s) [seg_pos={0 0}, upload=162628]: Begin upload segment... Jul 1 20:30:51.307309248 (203h20m26.077950583s) [seg_pos={0 0}, upload=162628]: Done begin upload segment. Jul 1 20:30:51.307323446 (203h20m26.077964771s) [noise=true , address=45.91.116.8:4048 , piece_id=2G2OOQLJPTUDY5PZSHQ2MNAV7774DPK55SELX5STL5W35MXSFKNQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307341239 (203h20m26.077982574s) [noise=true , address=77.90.31.12:4589 , piece_id=OAQAOA63GE45RWO52GQFOO6FGD4M2AW6ALCPMKCB7T25UDBFOBIA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307377640 (203h20m26.078018965s) [noise=true , address=45.91.116.13:4154 , piece_id=CWIE4GHPWQCF7YHM2QG62RJMBQBNKNXRK2JI4G6OBTPKN4VV73BA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307671732 (203h20m26.078313057s) [noise=true , address=104.36.82.14:4221 , piece_id=JK73AQZVYWALWCBO7DORATYWJOIKWT2WBBHSZ26Q3TJLBYDTYO2Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307680439 (203h20m26.078321774s) [noise=true , address=104.36.82.7:4909 , piece_id=JNUIUO5MFV5I3L4CTK6IY2CMQDKTVCGPAR6VQHIKE2BKPIQQNGHA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307944213 (203h20m26.078585548s) [noise=true , address=45.91.116.5:5299 , piece_id=V6X7BVMX3IP23A65VFY7PIHGCJPGKLTZAYH4QVPPUFB34M3JUQYQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308197999 (203h20m26.078839334s) [noise=true , address=104.36.82.2:4731 , piece_id=JXQL75TODICFVUAIEE4TRGI2DUYVNC3ZR3RNEARTKQS56IIKZATQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308448899 (203h20m26.079090234s) [noise=true , address=45.91.116.4:4937 , piece_id=CMO4GLDKCZ7KQWHM5S4XX5QB2L3KAHUKRUYXWNE5OPEJ464X2NBA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308746398 (203h20m26.079387733s) [noise=true , address=77.90.31.17:4770 , piece_id=OFDOKUGNGNDMRFTF4HF3BHPZO3HSDDJZL7NC6G7PQSPKZRZVWGJA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308975577 (203h20m26.079616912s) [noise=true , address=45.91.116.13:4155 , piece_id=WN7BEIS5XO4K3BGAHLFDGBXUK52OHWYBPFFH6GCNADP6HWYBM73Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309167925 (203h20m26.07980926s) [noise=true , address=45.91.116.9:5262 , piece_id=N2SGOATWGVAKHJUCGXIUCMO5GTHQS4FHSFXZJBSGGT4HIQK4MFSQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309359802 (203h20m26.080001137s) [noise=true , address=45.91.116.6:4975 , piece_id=YUJIO2VMD53TDD66ANUI55LFMDTPHRMKV4Y7L7X66KA2BMKTIUQA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309548883 (203h20m26.080190218s) [noise=true , address=45.91.116.10:4082 , piece_id=U3OGQJQN3KWNAO2ALYP2OVAZFOE3PZHWZWY2HH64MFCO47TINKWA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309824350 (203h20m26.080465675s) [noise=true , address=104.36.82.8:4972 , piece_id=DA5ZEQHEMMJRTFRB4HMJL2OGGSA45P6UPNDJDKAU47S3A6OYQNMA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.310037578 (203h20m26.080678913s) [noise=true , address=104.36.82.4:4804 , piece_id=HV3FD4MSGB3ARPAOJYNYLLXHUS7JAF6KAQWLMIYCXC4UGW5BETTQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.311261871 (203h20m26.081903206s) [noise=true , address=77.90.31.12:4590 , piece_id=5XDULYYTTMHQXP4QSDT4M2W6NS7CM4ZYWH3OU32FMBAGXNQIVU6Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:53.080800025 (203h20m27.85144135s) [upload=162628]: Next returned nil segment Jul 1 20:30:53.080836496 (203h20m27.851477821s) [upload=162628]: Waiting for error group managing segments... Jul 1 20:30:53.362137719 (203h20m28.132806747s) [noise=true , address=45.91.116.4:4937 , piece_id=CMO4GLDKCZ7KQWHM5S4XX5QB2L3KAHUKRUYXWNE5OPEJ464X2NBA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.365537323 (203h20m28.136178648s) [noise=true , address=45.91.116.10:4082 , piece_id=U3OGQJQN3KWNAO2ALYP2OVAZFOE3PZHWZWY2HH64MFCO47TINKWA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.366047188 (203h20m28.136688523s) [noise=true , address=45.91.116.9:5262 , piece_id=N2SGOATWGVAKHJUCGXIUCMO5GTHQS4FHSFXZJBSGGT4HIQK4MFSQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.366428668 (203h20m28.137070003s) [noise=true , address=45.91.116.5:5299 , piece_id=V6X7BVMX3IP23A65VFY7PIHGCJPGKLTZAYH4QVPPUFB34M3JUQYQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.373588435 (203h20m28.14422977s) [noise=true , address=45.91.116.13:4155 , piece_id=WN7BEIS5XO4K3BGAHLFDGBXUK52OHWYBPFFH6GCNADP6HWYBM73Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.395606298 (203h20m28.166247633s) [noise=true , address=77.90.31.12:4589 , piece_id=OAQAOA63GE45RWO52GQFOO6FGD4M2AW6ALCPMKCB7T25UDBFOBIA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.399444591 (203h20m28.170085926s) [noise=true , address=77.90.31.17:4770 , piece_id=OFDOKUGNGNDMRFTF4HF3BHPZO3HSDDJZL7NC6G7PQSPKZRZVWGJA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.409917327 (203h20m28.180558662s) [noise=true , address=77.90.31.12:4590 , piece_id=5XDULYYTTMHQXP4QSDT4M2W6NS7CM4ZYWH3OU32FMBAGXNQIVU6Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.459664931 (203h20m28.230306266s) [noise=true , address=104.36.82.14:4221 , piece_id=JK73AQZVYWALWCBO7DORATYWJOIKWT2WBBHSZ26Q3TJLBYDTYO2Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.461422203 (203h20m28.232063538s) [noise=true , address=45.91.116.13:4154 , piece_id=CWIE4GHPWQCF7YHM2QG62RJMBQBNKNXRK2JI4G6OBTPKN4VV73BA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.506236628 (203h20m28.276877963s) [noise=true , address=45.91.116.6:4975 , piece_id=YUJIO2VMD53TDD66ANUI55LFMDTPHRMKV4Y7L7X66KA2BMKTIUQA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.855073943 (203h20m29.625715268s) [noise=true , address=104.36.82.2:4731 , piece_id=JXQL75TODICFVUAIEE4TRGI2DUYVNC3ZR3RNEARTKQS56IIKZATQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.986719438 (203h20m29.757360773s) [noise=true , address=104.36.82.8:4972 , piece_id=DA5ZEQHEMMJRTFRB4HMJL2OGGSA45P6UPNDJDKAU47S3A6OYQNMA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.986744686 (203h20m29.757386021s) [seg_pos={0 0}, upload=162628]: Segment reached optimal threshold of 13 pieces. Jul 1 20:30:54.986928978 (203h20m29.757570303s) [noise=true , address=45.91.116.8:4048 , piece_id=2G2OOQLJPTUDY5PZSHQ2MNAV7774DPK55SELX5STL5W35MXSFKNQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection; write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection Jul 1 20:30:54.986947524 (203h20m29.757588859s) [noise=true , address=104.36.82.7:4909 , piece_id=JNUIUO5MFV5I3L4CTK6IY2CMQDKTVCGPAR6VQHIKE2BKPIQQNGHA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF Jul 1 20:30:54.987028379 (203h20m29.757669714s) [noise=true , address=104.36.82.4:4804 , piece_id=HV3FD4MSGB3ARPAOJYNYLLXHUS7JAF6KAQWLMIYCXC4UGW5BETTQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g): protocol: read tcp 188.166.225.170:50928->104.36.82.4:4804: use of closed network connection; context canceled Jul 1 20:30:54.987039529 (203h20m29.757680864s) [seg_pos={0 0}, upload=162628]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 20:30:54.987097500 (203h20m29.757738835s) [upload=162628]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 20:30:54.987100907 (203h20m29.757742232s) [upload=162628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 20:30:55.290907064 (203h20m30.061548409s) [upload=162628]: Done uploading segments... Jul 1 20:30:55.290920750 (203h20m30.061562085s) [upload=162628]: Upload finished. err: <nil> Duration: 5.764079775s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 5.823548774s FAIL (2025-07-01 20:55:17 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== p 188.166.225.170:38826->45.91.116.14:4190: use of closed network connection Jul 1 20:30:07.397683164 (203h19m42.168324499s) [seg_pos={0 0}, upload=162621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 20:30:07.397793445 (203h19m42.16843478s) [upload=162621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 20:30:07.397832890 (203h19m42.168474225s) [upload=162621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 20:30:07.690755035 (203h19m42.46139637s) [upload=162621]: Done uploading segments... Jul 1 20:30:07.690777598 (203h19m42.461418933s) [upload=162621]: Upload finished. err: <nil> Jul 1 20:30:51.075923771 (203h20m25.846565096s) [upload=162628]: Starting upload Jul 1 20:30:51.075979769 (203h20m25.846621104s) [upload=162628]: Done starting upload Jul 1 20:30:51.076046185 (203h20m25.84668752s) [upload=162628]: Uploading segments... Jul 1 20:30:51.076156256 (203h20m25.846797591s) [upload=162628]: Got next segment. Inline: false Jul 1 20:30:51.076184720 (203h20m25.846826055s) [upload=162628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 1 20:30:51.076189279 (203h20m25.846830614s) [upload=162628]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 1 20:30:51.307264904 (203h20m26.077906239s) [seg_pos={0 0}, upload=162628]: Begin upload segment... Jul 1 20:30:51.307309248 (203h20m26.077950583s) [seg_pos={0 0}, upload=162628]: Done begin upload segment. Jul 1 20:30:51.307323446 (203h20m26.077964771s) [noise=true , address=45.91.116.8:4048 , piece_id=2G2OOQLJPTUDY5PZSHQ2MNAV7774DPK55SELX5STL5W35MXSFKNQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307341239 (203h20m26.077982574s) [noise=true , address=77.90.31.12:4589 , piece_id=OAQAOA63GE45RWO52GQFOO6FGD4M2AW6ALCPMKCB7T25UDBFOBIA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307377640 (203h20m26.078018965s) [noise=true , address=45.91.116.13:4154 , piece_id=CWIE4GHPWQCF7YHM2QG62RJMBQBNKNXRK2JI4G6OBTPKN4VV73BA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307671732 (203h20m26.078313057s) [noise=true , address=104.36.82.14:4221 , piece_id=JK73AQZVYWALWCBO7DORATYWJOIKWT2WBBHSZ26Q3TJLBYDTYO2Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307680439 (203h20m26.078321774s) [noise=true , address=104.36.82.7:4909 , piece_id=JNUIUO5MFV5I3L4CTK6IY2CMQDKTVCGPAR6VQHIKE2BKPIQQNGHA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307944213 (203h20m26.078585548s) [noise=true , address=45.91.116.5:5299 , piece_id=V6X7BVMX3IP23A65VFY7PIHGCJPGKLTZAYH4QVPPUFB34M3JUQYQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308197999 (203h20m26.078839334s) [noise=true , address=104.36.82.2:4731 , piece_id=JXQL75TODICFVUAIEE4TRGI2DUYVNC3ZR3RNEARTKQS56IIKZATQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308448899 (203h20m26.079090234s) [noise=true , address=45.91.116.4:4937 , piece_id=CMO4GLDKCZ7KQWHM5S4XX5QB2L3KAHUKRUYXWNE5OPEJ464X2NBA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308746398 (203h20m26.079387733s) [noise=true , address=77.90.31.17:4770 , piece_id=OFDOKUGNGNDMRFTF4HF3BHPZO3HSDDJZL7NC6G7PQSPKZRZVWGJA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308975577 (203h20m26.079616912s) [noise=true , address=45.91.116.13:4155 , piece_id=WN7BEIS5XO4K3BGAHLFDGBXUK52OHWYBPFFH6GCNADP6HWYBM73Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309167925 (203h20m26.07980926s) [noise=true , address=45.91.116.9:5262 , piece_id=N2SGOATWGVAKHJUCGXIUCMO5GTHQS4FHSFXZJBSGGT4HIQK4MFSQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309359802 (203h20m26.080001137s) [noise=true , address=45.91.116.6:4975 , piece_id=YUJIO2VMD53TDD66ANUI55LFMDTPHRMKV4Y7L7X66KA2BMKTIUQA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309548883 (203h20m26.080190218s) [noise=true , address=45.91.116.10:4082 , piece_id=U3OGQJQN3KWNAO2ALYP2OVAZFOE3PZHWZWY2HH64MFCO47TINKWA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309824350 (203h20m26.080465675s) [noise=true , address=104.36.82.8:4972 , piece_id=DA5ZEQHEMMJRTFRB4HMJL2OGGSA45P6UPNDJDKAU47S3A6OYQNMA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.310037578 (203h20m26.080678913s) [noise=true , address=104.36.82.4:4804 , piece_id=HV3FD4MSGB3ARPAOJYNYLLXHUS7JAF6KAQWLMIYCXC4UGW5BETTQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.311261871 (203h20m26.081903206s) [noise=true , address=77.90.31.12:4590 , piece_id=5XDULYYTTMHQXP4QSDT4M2W6NS7CM4ZYWH3OU32FMBAGXNQIVU6Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:53.080800025 (203h20m27.85144135s) [upload=162628]: Next returned nil segment Jul 1 20:30:53.080836496 (203h20m27.851477821s) [upload=162628]: Waiting for error group managing segments... Jul 1 20:30:53.362137719 (203h20m28.132806747s) [noise=true , address=45.91.116.4:4937 , piece_id=CMO4GLDKCZ7KQWHM5S4XX5QB2L3KAHUKRUYXWNE5OPEJ464X2NBA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.365537323 (203h20m28.136178648s) [noise=true , address=45.91.116.10:4082 , piece_id=U3OGQJQN3KWNAO2ALYP2OVAZFOE3PZHWZWY2HH64MFCO47TINKWA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.366047188 (203h20m28.136688523s) [noise=true , address=45.91.116.9:5262 , piece_id=N2SGOATWGVAKHJUCGXIUCMO5GTHQS4FHSFXZJBSGGT4HIQK4MFSQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.366428668 (203h20m28.137070003s) [noise=true , address=45.91.116.5:5299 , piece_id=V6X7BVMX3IP23A65VFY7PIHGCJPGKLTZAYH4QVPPUFB34M3JUQYQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.373588435 (203h20m28.14422977s) [noise=true , address=45.91.116.13:4155 , piece_id=WN7BEIS5XO4K3BGAHLFDGBXUK52OHWYBPFFH6GCNADP6HWYBM73Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.395606298 (203h20m28.166247633s) [noise=true , address=77.90.31.12:4589 , piece_id=OAQAOA63GE45RWO52GQFOO6FGD4M2AW6ALCPMKCB7T25UDBFOBIA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.399444591 (203h20m28.170085926s) [noise=true , address=77.90.31.17:4770 , piece_id=OFDOKUGNGNDMRFTF4HF3BHPZO3HSDDJZL7NC6G7PQSPKZRZVWGJA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.409917327 (203h20m28.180558662s) [noise=true , address=77.90.31.12:4590 , piece_id=5XDULYYTTMHQXP4QSDT4M2W6NS7CM4ZYWH3OU32FMBAGXNQIVU6Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.459664931 (203h20m28.230306266s) [noise=true , address=104.36.82.14:4221 , piece_id=JK73AQZVYWALWCBO7DORATYWJOIKWT2WBBHSZ26Q3TJLBYDTYO2Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.461422203 (203h20m28.232063538s) [noise=true , address=45.91.116.13:4154 , piece_id=CWIE4GHPWQCF7YHM2QG62RJMBQBNKNXRK2JI4G6OBTPKN4VV73BA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.506236628 (203h20m28.276877963s) [noise=true , address=45.91.116.6:4975 , piece_id=YUJIO2VMD53TDD66ANUI55LFMDTPHRMKV4Y7L7X66KA2BMKTIUQA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.855073943 (203h20m29.625715268s) [noise=true , address=104.36.82.2:4731 , piece_id=JXQL75TODICFVUAIEE4TRGI2DUYVNC3ZR3RNEARTKQS56IIKZATQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.986719438 (203h20m29.757360773s) [noise=true , address=104.36.82.8:4972 , piece_id=DA5ZEQHEMMJRTFRB4HMJL2OGGSA45P6UPNDJDKAU47S3A6OYQNMA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.986744686 (203h20m29.757386021s) [seg_pos={0 0}, upload=162628]: Segment reached optimal threshold of 13 pieces. Jul 1 20:30:54.986928978 (203h20m29.757570303s) [noise=true , address=45.91.116.8:4048 , piece_id=2G2OOQLJPTUDY5PZSHQ2MNAV7774DPK55SELX5STL5W35MXSFKNQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection; write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection Jul 1 20:30:54.986947524 (203h20m29.757588859s) [noise=true , address=104.36.82.7:4909 , piece_id=JNUIUO5MFV5I3L4CTK6IY2CMQDKTVCGPAR6VQHIKE2BKPIQQNGHA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF Jul 1 20:30:54.987028379 (203h20m29.757669714s) [noise=true , address=104.36.82.4:4804 , piece_id=HV3FD4MSGB3ARPAOJYNYLLXHUS7JAF6KAQWLMIYCXC4UGW5BETTQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g): protocol: read tcp 188.166.225.170:50928->104.36.82.4:4804: use of closed network connection; context canceled Jul 1 20:30:54.987039529 (203h20m29.757680864s) [seg_pos={0 0}, upload=162628]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 20:30:54.987097500 (203h20m29.757738835s) [upload=162628]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 20:30:54.987100907 (203h20m29.757742232s) [upload=162628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 20:30:55.290907064 (203h20m30.061548409s) [upload=162628]: Done uploading segments... Jul 1 20:30:55.290920750 (203h20m30.061562085s) [upload=162628]: Upload finished. err: <nil> Duration: 5.823576487s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 5.625306334s FAIL (2025-07-01 20:54:30 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== p 188.166.225.170:38826->45.91.116.14:4190: use of closed network connection Jul 1 20:30:07.397683164 (203h19m42.168324499s) [seg_pos={0 0}, upload=162621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 20:30:07.397793445 (203h19m42.16843478s) [upload=162621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 20:30:07.397832890 (203h19m42.168474225s) [upload=162621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 20:30:07.690755035 (203h19m42.46139637s) [upload=162621]: Done uploading segments... Jul 1 20:30:07.690777598 (203h19m42.461418933s) [upload=162621]: Upload finished. err: <nil> Jul 1 20:30:51.075923771 (203h20m25.846565096s) [upload=162628]: Starting upload Jul 1 20:30:51.075979769 (203h20m25.846621104s) [upload=162628]: Done starting upload Jul 1 20:30:51.076046185 (203h20m25.84668752s) [upload=162628]: Uploading segments... Jul 1 20:30:51.076156256 (203h20m25.846797591s) [upload=162628]: Got next segment. Inline: false Jul 1 20:30:51.076184720 (203h20m25.846826055s) [upload=162628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 1 20:30:51.076189279 (203h20m25.846830614s) [upload=162628]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 1 20:30:51.307264904 (203h20m26.077906239s) [seg_pos={0 0}, upload=162628]: Begin upload segment... Jul 1 20:30:51.307309248 (203h20m26.077950583s) [seg_pos={0 0}, upload=162628]: Done begin upload segment. Jul 1 20:30:51.307323446 (203h20m26.077964771s) [noise=true , address=45.91.116.8:4048 , piece_id=2G2OOQLJPTUDY5PZSHQ2MNAV7774DPK55SELX5STL5W35MXSFKNQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307341239 (203h20m26.077982574s) [noise=true , address=77.90.31.12:4589 , piece_id=OAQAOA63GE45RWO52GQFOO6FGD4M2AW6ALCPMKCB7T25UDBFOBIA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307377640 (203h20m26.078018965s) [noise=true , address=45.91.116.13:4154 , piece_id=CWIE4GHPWQCF7YHM2QG62RJMBQBNKNXRK2JI4G6OBTPKN4VV73BA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307671732 (203h20m26.078313057s) [noise=true , address=104.36.82.14:4221 , piece_id=JK73AQZVYWALWCBO7DORATYWJOIKWT2WBBHSZ26Q3TJLBYDTYO2Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307680439 (203h20m26.078321774s) [noise=true , address=104.36.82.7:4909 , piece_id=JNUIUO5MFV5I3L4CTK6IY2CMQDKTVCGPAR6VQHIKE2BKPIQQNGHA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.307944213 (203h20m26.078585548s) [noise=true , address=45.91.116.5:5299 , piece_id=V6X7BVMX3IP23A65VFY7PIHGCJPGKLTZAYH4QVPPUFB34M3JUQYQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308197999 (203h20m26.078839334s) [noise=true , address=104.36.82.2:4731 , piece_id=JXQL75TODICFVUAIEE4TRGI2DUYVNC3ZR3RNEARTKQS56IIKZATQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308448899 (203h20m26.079090234s) [noise=true , address=45.91.116.4:4937 , piece_id=CMO4GLDKCZ7KQWHM5S4XX5QB2L3KAHUKRUYXWNE5OPEJ464X2NBA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308746398 (203h20m26.079387733s) [noise=true , address=77.90.31.17:4770 , piece_id=OFDOKUGNGNDMRFTF4HF3BHPZO3HSDDJZL7NC6G7PQSPKZRZVWGJA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.308975577 (203h20m26.079616912s) [noise=true , address=45.91.116.13:4155 , piece_id=WN7BEIS5XO4K3BGAHLFDGBXUK52OHWYBPFFH6GCNADP6HWYBM73Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309167925 (203h20m26.07980926s) [noise=true , address=45.91.116.9:5262 , piece_id=N2SGOATWGVAKHJUCGXIUCMO5GTHQS4FHSFXZJBSGGT4HIQK4MFSQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309359802 (203h20m26.080001137s) [noise=true , address=45.91.116.6:4975 , piece_id=YUJIO2VMD53TDD66ANUI55LFMDTPHRMKV4Y7L7X66KA2BMKTIUQA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309548883 (203h20m26.080190218s) [noise=true , address=45.91.116.10:4082 , piece_id=U3OGQJQN3KWNAO2ALYP2OVAZFOE3PZHWZWY2HH64MFCO47TINKWA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.309824350 (203h20m26.080465675s) [noise=true , address=104.36.82.8:4972 , piece_id=DA5ZEQHEMMJRTFRB4HMJL2OGGSA45P6UPNDJDKAU47S3A6OYQNMA, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.310037578 (203h20m26.080678913s) [noise=true , address=104.36.82.4:4804 , piece_id=HV3FD4MSGB3ARPAOJYNYLLXHUS7JAF6KAQWLMIYCXC4UGW5BETTQ, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:51.311261871 (203h20m26.081903206s) [noise=true , address=77.90.31.12:4590 , piece_id=5XDULYYTTMHQXP4QSDT4M2W6NS7CM4ZYWH3OU32FMBAGXNQIVU6Q, seg_pos={0 0}, upload=162628]: Uploading piece... Jul 1 20:30:53.080800025 (203h20m27.85144135s) [upload=162628]: Next returned nil segment Jul 1 20:30:53.080836496 (203h20m27.851477821s) [upload=162628]: Waiting for error group managing segments... Jul 1 20:30:53.362137719 (203h20m28.132806747s) [noise=true , address=45.91.116.4:4937 , piece_id=CMO4GLDKCZ7KQWHM5S4XX5QB2L3KAHUKRUYXWNE5OPEJ464X2NBA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.365537323 (203h20m28.136178648s) [noise=true , address=45.91.116.10:4082 , piece_id=U3OGQJQN3KWNAO2ALYP2OVAZFOE3PZHWZWY2HH64MFCO47TINKWA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.366047188 (203h20m28.136688523s) [noise=true , address=45.91.116.9:5262 , piece_id=N2SGOATWGVAKHJUCGXIUCMO5GTHQS4FHSFXZJBSGGT4HIQK4MFSQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.366428668 (203h20m28.137070003s) [noise=true , address=45.91.116.5:5299 , piece_id=V6X7BVMX3IP23A65VFY7PIHGCJPGKLTZAYH4QVPPUFB34M3JUQYQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.373588435 (203h20m28.14422977s) [noise=true , address=45.91.116.13:4155 , piece_id=WN7BEIS5XO4K3BGAHLFDGBXUK52OHWYBPFFH6GCNADP6HWYBM73Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.395606298 (203h20m28.166247633s) [noise=true , address=77.90.31.12:4589 , piece_id=OAQAOA63GE45RWO52GQFOO6FGD4M2AW6ALCPMKCB7T25UDBFOBIA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.399444591 (203h20m28.170085926s) [noise=true , address=77.90.31.17:4770 , piece_id=OFDOKUGNGNDMRFTF4HF3BHPZO3HSDDJZL7NC6G7PQSPKZRZVWGJA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.409917327 (203h20m28.180558662s) [noise=true , address=77.90.31.12:4590 , piece_id=5XDULYYTTMHQXP4QSDT4M2W6NS7CM4ZYWH3OU32FMBAGXNQIVU6Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.459664931 (203h20m28.230306266s) [noise=true , address=104.36.82.14:4221 , piece_id=JK73AQZVYWALWCBO7DORATYWJOIKWT2WBBHSZ26Q3TJLBYDTYO2Q, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.461422203 (203h20m28.232063538s) [noise=true , address=45.91.116.13:4154 , piece_id=CWIE4GHPWQCF7YHM2QG62RJMBQBNKNXRK2JI4G6OBTPKN4VV73BA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:53.506236628 (203h20m28.276877963s) [noise=true , address=45.91.116.6:4975 , piece_id=YUJIO2VMD53TDD66ANUI55LFMDTPHRMKV4Y7L7X66KA2BMKTIUQA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.855073943 (203h20m29.625715268s) [noise=true , address=104.36.82.2:4731 , piece_id=JXQL75TODICFVUAIEE4TRGI2DUYVNC3ZR3RNEARTKQS56IIKZATQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.986719438 (203h20m29.757360773s) [noise=true , address=104.36.82.8:4972 , piece_id=DA5ZEQHEMMJRTFRB4HMJL2OGGSA45P6UPNDJDKAU47S3A6OYQNMA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: <nil> Jul 1 20:30:54.986744686 (203h20m29.757386021s) [seg_pos={0 0}, upload=162628]: Segment reached optimal threshold of 13 pieces. Jul 1 20:30:54.986928978 (203h20m29.757570303s) [noise=true , address=45.91.116.8:4048 , piece_id=2G2OOQLJPTUDY5PZSHQ2MNAV7774DPK55SELX5STL5W35MXSFKNQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection; write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56260->45.91.116.8:4048: use of closed network connection Jul 1 20:30:54.986947524 (203h20m29.757588859s) [noise=true , address=104.36.82.7:4909 , piece_id=JNUIUO5MFV5I3L4CTK6IY2CMQDKTVCGPAR6VQHIKE2BKPIQQNGHA, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF Jul 1 20:30:54.987028379 (203h20m29.757669714s) [noise=true , address=104.36.82.4:4804 , piece_id=HV3FD4MSGB3ARPAOJYNYLLXHUS7JAF6KAQWLMIYCXC4UGW5BETTQ, seg_pos={0 0}, upload=162628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g): protocol: read tcp 188.166.225.170:50928->104.36.82.4:4804: use of closed network connection; context canceled Jul 1 20:30:54.987039529 (203h20m29.757680864s) [seg_pos={0 0}, upload=162628]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 20:30:54.987097500 (203h20m29.757738835s) [upload=162628]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 20:30:54.987100907 (203h20m29.757742232s) [upload=162628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 20:30:55.290907064 (203h20m30.061548409s) [upload=162628]: Done uploading segments... Jul 1 20:30:55.290920750 (203h20m30.061562085s) [upload=162628]: Upload finished. err: <nil> Duration: 5.625347372s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)