Orbiter History

checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.........................................X..X..X......X.....] duration: 6.711224166s FAIL (2025-08-09 07:18:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.711250596s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 1.902654383s FAIL (2025-08-09 07:18:13 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 07:10:43.552862473 (13h44m37.983942604s) [upload=14343]: Starting upload Aug 9 07:10:43.552921626 (13h44m37.984001757s) [upload=14343]: Done starting upload Aug 9 07:10:43.553117772 (13h44m37.984197903s) [upload=14343]: Uploading segments... Aug 9 07:10:43.553148400 (13h44m37.984228531s) [upload=14343]: Got next segment. Inline: true Aug 9 07:10:43.553152388 (13h44m37.984232519s) [upload=14343]: Waiting for error group managing segments... Aug 9 07:10:43.553187505 (13h44m37.984267626s) [upload=14343]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 07:10:43.553191663 (13h44m37.984271794s) [upload=14343]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 07:10:43.553194108 (13h44m37.984274239s) [upload=14343]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 07:10:44.670265042 (13h44m39.101345173s) [upload=14343]: Done uploading segments... Aug 9 07:10:44.670283398 (13h44m39.101363529s) [upload=14343]: Upload finished. err: <nil> Duration:* 1.902685832s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [..........................................X..X..X......X....] duration: 14.820593088s FAIL (2025-08-09 07:17:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 14.820613326s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [...........................................X..X..X......X...] duration: 6.592851297s FAIL (2025-08-09 07:17:25 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.592876194s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....X.........................X....................X.......] duration: 5.803562224s FAIL (2025-08-09 07:17:20 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after e3ff044d6ae4076192b1e1fe513b8dabe6c767a5c3203dea27eaa2ec31688bdd != before 663c2bc3be3b2c93bc26181187625e6a4f7893b1381782a3fe391ac4fca8ac68 ======LOGS====== Aug 9 07:12:10.752933843 (13h46m5.184013974s) [upload=14368]: Starting upload Aug 9 07:12:10.752992164 (13h46m5.184072285s) [upload=14368]: Done starting upload Aug 9 07:12:10.753168141 (13h46m5.184248273s) [upload=14368]: Uploading segments... Aug 9 07:12:10.753297318 (13h46m5.184377449s) [upload=14368]: Got next segment. Inline: false Aug 9 07:12:10.753326153 (13h46m5.184406274s) [upload=14368]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 07:12:10.753330122 (13h46m5.184410253s) [upload=14368]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 07:12:11.207655625 (13h46m5.638735756s) [seg_pos={0 0}, upload=14368]: Begin upload segment... Aug 9 07:12:11.207720700 (13h46m5.638800831s) [seg_pos={0 0}, upload=14368]: Done begin upload segment. Aug 9 07:12:11.207743194 (13h46m5.638823325s) [noise=true , address=104.36.82.44:4896 , piece_id=OHFYRMATCJBA2K3HRJ77ZJTOJ3HT7MK7N5JC7NZ52PXEJ35JKWHQ, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.207765646 (13h46m5.638845767s) [noise=true , address=64.49.13.27:4961 , piece_id=GYEU7TP4OXYEYFXENUVQRUA4B6Q75NU52NLSADC2AQ3477QHTBSA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.208227149 (13h46m5.63930728s) [noise=true , address=64.49.13.139:4479 , piece_id=5IUHFINOLUATEGGJW3XJL4KPTUV2NC4YWICUUKHFEKBHSMRIA2RA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.208364321 (13h46m5.639444463s) [noise=true , address=104.36.82.60:4370 , piece_id=T3P6UIMSI73BKLVUYXHWEKOXTEXWVOGFSG2NSVJ3GK6M2LBXSKZA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.208698120 (13h46m5.639778251s) [noise=true , address=104.36.82.8:4981 , piece_id=FOIG62XE46FFMD5UHH2SN6SX7KGFEV5YK72DM6WBFROHGC665ZPA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.209043852 (13h46m5.640123983s) [noise=true , address=104.36.82.59:4324 , piece_id=ZWHTHIGUKE4BGL7XQGQ7SSQOKV2AS7KCKRU3IG7XOPN75FJCCIRA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.209320301 (13h46m5.640400432s) [noise=true , address=64.49.13.169:4715 , piece_id=F4XFTIMZVJQFZ7WPSM65CRORDOAJ5RXNFD2LW7JWRUISIB2OQQTQ, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.209683986 (13h46m5.640764117s) [noise=true , address=64.49.13.170:4724 , piece_id=NGADM4QFZPZV2ZQ3T7D55CW5YASOZA6NCPBA2RECAJQ543YBBXHA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.210169786 (13h46m5.641249917s) [noise=true , address=104.36.82.60:4371 , piece_id=7A4ZKM7IMWTIEPXVP4VWYWXEZZ322WJPV7FNFDHS67OFVQK4QASA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.210381952 (13h46m5.641462083s) [noise=true , address=104.36.82.61:4404 , piece_id=42LT6BXLMKSGA6Q7P3IR4SZZZLAMKUHJO4QWZYULTV5AFMCHPL3Q, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.210636339 (13h46m5.64171647s) [noise=true , address=104.36.82.43:4847 , piece_id=5KKBDZL65I2KSGRPO3OHVV4UBY7XVV2NLTTKOY2BP65ESCKFSSRA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.210856220 (13h46m5.641936351s) [noise=true , address=104.36.82.16:4316 , piece_id=4NPL3A5HFVERECAHTLPRIGBWPFA7QW4L2WTX55W7L2DCYUEG75XA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.211079006 (13h46m5.642159127s) [noise=true , address=104.36.82.14:4237 , piece_id=RLIE5EYM6A7VNRDTTFXJTUV7WJKJ5QDKZEAOMUZYA3QFNWXPQKNQ, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.211304737 (13h46m5.642384868s) [noise=true , address=45.91.116.7:4031 , piece_id=I3M2I7TE2HH6KKY4R7VB5PSNZJXAVCK36UULZ2BLWNKWKTYTJIQQ, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.211491064 (13h46m5.642571195s) [noise=true , address=104.36.82.37:4669 , piece_id=KK2GNVWD6EUIBG77ZIEAH3ZBDDXO4PX2DFCFPWDTCT4KFTG5ESLA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.211981352 (13h46m5.643061483s) [noise=true , address=104.36.82.15:4292 , piece_id=3FMM25ACGF4RPBO66JM4PMB2BC2DCVGCR3JCMWCONRBYSODONGFA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.212224658 (13h46m5.643304789s) [noise=true , address=104.36.82.3:4795 , piece_id=DDRQ7JUPFC5FTKGOT6J4YHIXJXEGPOVQYPV3EQ35RDGHVU3H4OUQ, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.212477902 (13h46m5.643558033s) [noise=true , address=104.36.82.39:4751 , piece_id=ZM64XI6VX7YENY6WSGRMS34XAATUXGEVWPISJMYOXXQB5LLSBJYA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:12.328114668 (13h46m6.759194799s) [upload=14368]: Next returned nil segment Aug 9 07:12:12.328130238 (13h46m6.759210359s) [upload=14368]: Waiting for error group managing segments... Aug 9 07:12:12.615123755 (13h46m7.046203886s) [noise=true , address=64.49.13.170:4724 , piece_id=NGADM4QFZPZV2ZQ3T7D55CW5YASOZA6NCPBA2RECAJQ543YBBXHA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:12.633849403 (13h46m7.064929534s) [noise=true , address=64.49.13.139:4479 , piece_id=5IUHFINOLUATEGGJW3XJL4KPTUV2NC4YWICUUKHFEKBHSMRIA2RA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:12.637449872 (13h46m7.068530003s) [noise=true , address=64.49.13.27:4961 , piece_id=GYEU7TP4OXYEYFXENUVQRUA4B6Q75NU52NLSADC2AQ3477QHTBSA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:12.650403255 (13h46m7.081483387s) [noise=true , address=64.49.13.169:4715 , piece_id=F4XFTIMZVJQFZ7WPSM65CRORDOAJ5RXNFD2LW7JWRUISIB2OQQTQ, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.137896401 (13h46m7.568976532s) [noise=true , address=104.36.82.60:4371 , piece_id=7A4ZKM7IMWTIEPXVP4VWYWXEZZ322WJPV7FNFDHS67OFVQK4QASA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.139324974 (13h46m7.570405095s) [noise=true , address=104.36.82.8:4981 , piece_id=FOIG62XE46FFMD5UHH2SN6SX7KGFEV5YK72DM6WBFROHGC665ZPA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.146401663 (13h46m7.577481794s) [noise=true , address=45.91.116.7:4031 , piece_id=I3M2I7TE2HH6KKY4R7VB5PSNZJXAVCK36UULZ2BLWNKWKTYTJIQQ, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.161160482 (13h46m7.592240603s) [noise=true , address=104.36.82.43:4847 , piece_id=5KKBDZL65I2KSGRPO3OHVV4UBY7XVV2NLTTKOY2BP65ESCKFSSRA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.165737920 (13h46m7.596818041s) [noise=true , address=104.36.82.15:4292 , piece_id=3FMM25ACGF4RPBO66JM4PMB2BC2DCVGCR3JCMWCONRBYSODONGFA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.168998608 (13h46m7.600078729s) [noise=true , address=104.36.82.60:4370 , piece_id=T3P6UIMSI73BKLVUYXHWEKOXTEXWVOGFSG2NSVJ3GK6M2LBXSKZA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.209005594 (13h46m7.640085725s) [noise=true , address=104.36.82.59:4324 , piece_id=ZWHTHIGUKE4BGL7XQGQ7SSQOKV2AS7KCKRU3IG7XOPN75FJCCIRA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.229451654 (13h46m7.660531785s) [noise=true , address=104.36.82.3:4795 , piece_id=DDRQ7JUPFC5FTKGOT6J4YHIXJXEGPOVQYPV3EQ35RDGHVU3H4OUQ, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.238304101 (13h46m7.669384232s) [noise=true , address=104.36.82.61:4404 , piece_id=42LT6BXLMKSGA6Q7P3IR4SZZZLAMKUHJO4QWZYULTV5AFMCHPL3Q, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.245475733 (13h46m7.676555854s) [noise=true , address=104.36.82.37:4669 , piece_id=KK2GNVWD6EUIBG77ZIEAH3ZBDDXO4PX2DFCFPWDTCT4KFTG5ESLA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.245503065 (13h46m7.676583196s) [seg_pos={0 0}, upload=14368]: Segment reached optimal threshold of 14 pieces. Aug 9 07:12:13.245606703 (13h46m7.676686834s) [noise=true , address=104.36.82.14:4237 , piece_id=RLIE5EYM6A7VNRDTTFXJTUV7WJKJ5QDKZEAOMUZYA3QFNWXPQKNQ, seg_pos={0 0}, upload=14368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1o2jLTwKNSjxjFEmckxkG1c5EuySK3o3sawGEikd2Ttz4CWfLa): protocol: expected piece hash; context canceled; EOF Aug 9 07:12:13.245678009 (13h46m7.67675814s) [noise=true , address=104.36.82.16:4316 , piece_id=4NPL3A5HFVERECAHTLPRIGBWPFA7QW4L2WTX55W7L2DCYUEG75XA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PPnXDzwXDVDKemw483GXuzQrPN48JJrjeeD7az2NPNawHNaXf): protocol: expected piece hash; context canceled; EOF Aug 9 07:12:13.245759245 (13h46m7.676839366s) [noise=true , address=104.36.82.44:4896 , piece_id=OHFYRMATCJBA2K3HRJ77ZJTOJ3HT7MK7N5JC7NZ52PXEJ35JKWHQ, seg_pos={0 0}, upload=14368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o): protocol: expected piece hash; context canceled; EOF Aug 9 07:12:13.245792349 (13h46m7.67687247s) [noise=true , address=104.36.82.39:4751 , piece_id=ZM64XI6VX7YENY6WSGRMS34XAATUXGEVWPISJMYOXXQB5LLSBJYA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128StmvpG1KYRXeu3gzEEfRmYZgR5ACJRf2xGZcEiZHsfk1KNyr): protocol: expected piece hash; context canceled; EOF Aug 9 07:12:13.245815813 (13h46m7.676895944s) [seg_pos={0 0}, upload=14368]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 07:12:13.245901858 (13h46m7.676981979s) [upload=14368]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 07:12:13.245907359 (13h46m7.67698749s) [upload=14368]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 07:12:13.789706183 (13h46m8.220786304s) [upload=14368]: Done uploading segments... Aug 9 07:12:13.789724909 (13h46m8.22080503s) [upload=14368]: Upload finished. err: <nil> Duration: 5.803593815s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 1.816948022s FAIL (2025-08-09 07:17:04 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 07:10:43.552862473 (13h44m37.983942604s) [upload=14343]: Starting upload Aug 9 07:10:43.552921626 (13h44m37.984001757s) [upload=14343]: Done starting upload Aug 9 07:10:43.553117772 (13h44m37.984197903s) [upload=14343]: Uploading segments... Aug 9 07:10:43.553148400 (13h44m37.984228531s) [upload=14343]: Got next segment. Inline: true Aug 9 07:10:43.553152388 (13h44m37.984232519s) [upload=14343]: Waiting for error group managing segments... Aug 9 07:10:43.553187505 (13h44m37.984267626s) [upload=14343]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 07:10:43.553191663 (13h44m37.984271794s) [upload=14343]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 07:10:43.553194108 (13h44m37.984274239s) [upload=14343]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 07:10:44.670265042 (13h44m39.101345173s) [upload=14343]: Done uploading segments... Aug 9 07:10:44.670283398 (13h44m39.101363529s) [upload=14343]: Upload finished. err: <nil> Duration:* 1.81698843s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [......X.........................X....................X......] duration: 6.040715628s FAIL (2025-08-09 07:16:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after e3ff044d6ae4076192b1e1fe513b8dabe6c767a5c3203dea27eaa2ec31688bdd != before 663c2bc3be3b2c93bc26181187625e6a4f7893b1381782a3fe391ac4fca8ac68 ======LOGS====== Aug 9 07:12:10.752933843 (13h46m5.184013974s) [upload=14368]: Starting upload Aug 9 07:12:10.752992164 (13h46m5.184072285s) [upload=14368]: Done starting upload Aug 9 07:12:10.753168141 (13h46m5.184248273s) [upload=14368]: Uploading segments... Aug 9 07:12:10.753297318 (13h46m5.184377449s) [upload=14368]: Got next segment. Inline: false Aug 9 07:12:10.753326153 (13h46m5.184406274s) [upload=14368]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 07:12:10.753330122 (13h46m5.184410253s) [upload=14368]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 07:12:11.207655625 (13h46m5.638735756s) [seg_pos={0 0}, upload=14368]: Begin upload segment... Aug 9 07:12:11.207720700 (13h46m5.638800831s) [seg_pos={0 0}, upload=14368]: Done begin upload segment. Aug 9 07:12:11.207743194 (13h46m5.638823325s) [noise=true , address=104.36.82.44:4896 , piece_id=OHFYRMATCJBA2K3HRJ77ZJTOJ3HT7MK7N5JC7NZ52PXEJ35JKWHQ, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.207765646 (13h46m5.638845767s) [noise=true , address=64.49.13.27:4961 , piece_id=GYEU7TP4OXYEYFXENUVQRUA4B6Q75NU52NLSADC2AQ3477QHTBSA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.208227149 (13h46m5.63930728s) [noise=true , address=64.49.13.139:4479 , piece_id=5IUHFINOLUATEGGJW3XJL4KPTUV2NC4YWICUUKHFEKBHSMRIA2RA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.208364321 (13h46m5.639444463s) [noise=true , address=104.36.82.60:4370 , piece_id=T3P6UIMSI73BKLVUYXHWEKOXTEXWVOGFSG2NSVJ3GK6M2LBXSKZA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.208698120 (13h46m5.639778251s) [noise=true , address=104.36.82.8:4981 , piece_id=FOIG62XE46FFMD5UHH2SN6SX7KGFEV5YK72DM6WBFROHGC665ZPA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.209043852 (13h46m5.640123983s) [noise=true , address=104.36.82.59:4324 , piece_id=ZWHTHIGUKE4BGL7XQGQ7SSQOKV2AS7KCKRU3IG7XOPN75FJCCIRA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.209320301 (13h46m5.640400432s) [noise=true , address=64.49.13.169:4715 , piece_id=F4XFTIMZVJQFZ7WPSM65CRORDOAJ5RXNFD2LW7JWRUISIB2OQQTQ, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.209683986 (13h46m5.640764117s) [noise=true , address=64.49.13.170:4724 , piece_id=NGADM4QFZPZV2ZQ3T7D55CW5YASOZA6NCPBA2RECAJQ543YBBXHA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.210169786 (13h46m5.641249917s) [noise=true , address=104.36.82.60:4371 , piece_id=7A4ZKM7IMWTIEPXVP4VWYWXEZZ322WJPV7FNFDHS67OFVQK4QASA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.210381952 (13h46m5.641462083s) [noise=true , address=104.36.82.61:4404 , piece_id=42LT6BXLMKSGA6Q7P3IR4SZZZLAMKUHJO4QWZYULTV5AFMCHPL3Q, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.210636339 (13h46m5.64171647s) [noise=true , address=104.36.82.43:4847 , piece_id=5KKBDZL65I2KSGRPO3OHVV4UBY7XVV2NLTTKOY2BP65ESCKFSSRA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.210856220 (13h46m5.641936351s) [noise=true , address=104.36.82.16:4316 , piece_id=4NPL3A5HFVERECAHTLPRIGBWPFA7QW4L2WTX55W7L2DCYUEG75XA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.211079006 (13h46m5.642159127s) [noise=true , address=104.36.82.14:4237 , piece_id=RLIE5EYM6A7VNRDTTFXJTUV7WJKJ5QDKZEAOMUZYA3QFNWXPQKNQ, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.211304737 (13h46m5.642384868s) [noise=true , address=45.91.116.7:4031 , piece_id=I3M2I7TE2HH6KKY4R7VB5PSNZJXAVCK36UULZ2BLWNKWKTYTJIQQ, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.211491064 (13h46m5.642571195s) [noise=true , address=104.36.82.37:4669 , piece_id=KK2GNVWD6EUIBG77ZIEAH3ZBDDXO4PX2DFCFPWDTCT4KFTG5ESLA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.211981352 (13h46m5.643061483s) [noise=true , address=104.36.82.15:4292 , piece_id=3FMM25ACGF4RPBO66JM4PMB2BC2DCVGCR3JCMWCONRBYSODONGFA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.212224658 (13h46m5.643304789s) [noise=true , address=104.36.82.3:4795 , piece_id=DDRQ7JUPFC5FTKGOT6J4YHIXJXEGPOVQYPV3EQ35RDGHVU3H4OUQ, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.212477902 (13h46m5.643558033s) [noise=true , address=104.36.82.39:4751 , piece_id=ZM64XI6VX7YENY6WSGRMS34XAATUXGEVWPISJMYOXXQB5LLSBJYA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:12.328114668 (13h46m6.759194799s) [upload=14368]: Next returned nil segment Aug 9 07:12:12.328130238 (13h46m6.759210359s) [upload=14368]: Waiting for error group managing segments... Aug 9 07:12:12.615123755 (13h46m7.046203886s) [noise=true , address=64.49.13.170:4724 , piece_id=NGADM4QFZPZV2ZQ3T7D55CW5YASOZA6NCPBA2RECAJQ543YBBXHA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:12.633849403 (13h46m7.064929534s) [noise=true , address=64.49.13.139:4479 , piece_id=5IUHFINOLUATEGGJW3XJL4KPTUV2NC4YWICUUKHFEKBHSMRIA2RA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:12.637449872 (13h46m7.068530003s) [noise=true , address=64.49.13.27:4961 , piece_id=GYEU7TP4OXYEYFXENUVQRUA4B6Q75NU52NLSADC2AQ3477QHTBSA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:12.650403255 (13h46m7.081483387s) [noise=true , address=64.49.13.169:4715 , piece_id=F4XFTIMZVJQFZ7WPSM65CRORDOAJ5RXNFD2LW7JWRUISIB2OQQTQ, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.137896401 (13h46m7.568976532s) [noise=true , address=104.36.82.60:4371 , piece_id=7A4ZKM7IMWTIEPXVP4VWYWXEZZ322WJPV7FNFDHS67OFVQK4QASA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.139324974 (13h46m7.570405095s) [noise=true , address=104.36.82.8:4981 , piece_id=FOIG62XE46FFMD5UHH2SN6SX7KGFEV5YK72DM6WBFROHGC665ZPA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.146401663 (13h46m7.577481794s) [noise=true , address=45.91.116.7:4031 , piece_id=I3M2I7TE2HH6KKY4R7VB5PSNZJXAVCK36UULZ2BLWNKWKTYTJIQQ, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.161160482 (13h46m7.592240603s) [noise=true , address=104.36.82.43:4847 , piece_id=5KKBDZL65I2KSGRPO3OHVV4UBY7XVV2NLTTKOY2BP65ESCKFSSRA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.165737920 (13h46m7.596818041s) [noise=true , address=104.36.82.15:4292 , piece_id=3FMM25ACGF4RPBO66JM4PMB2BC2DCVGCR3JCMWCONRBYSODONGFA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.168998608 (13h46m7.600078729s) [noise=true , address=104.36.82.60:4370 , piece_id=T3P6UIMSI73BKLVUYXHWEKOXTEXWVOGFSG2NSVJ3GK6M2LBXSKZA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.209005594 (13h46m7.640085725s) [noise=true , address=104.36.82.59:4324 , piece_id=ZWHTHIGUKE4BGL7XQGQ7SSQOKV2AS7KCKRU3IG7XOPN75FJCCIRA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.229451654 (13h46m7.660531785s) [noise=true , address=104.36.82.3:4795 , piece_id=DDRQ7JUPFC5FTKGOT6J4YHIXJXEGPOVQYPV3EQ35RDGHVU3H4OUQ, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.238304101 (13h46m7.669384232s) [noise=true , address=104.36.82.61:4404 , piece_id=42LT6BXLMKSGA6Q7P3IR4SZZZLAMKUHJO4QWZYULTV5AFMCHPL3Q, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.245475733 (13h46m7.676555854s) [noise=true , address=104.36.82.37:4669 , piece_id=KK2GNVWD6EUIBG77ZIEAH3ZBDDXO4PX2DFCFPWDTCT4KFTG5ESLA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.245503065 (13h46m7.676583196s) [seg_pos={0 0}, upload=14368]: Segment reached optimal threshold of 14 pieces. Aug 9 07:12:13.245606703 (13h46m7.676686834s) [noise=true , address=104.36.82.14:4237 , piece_id=RLIE5EYM6A7VNRDTTFXJTUV7WJKJ5QDKZEAOMUZYA3QFNWXPQKNQ, seg_pos={0 0}, upload=14368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1o2jLTwKNSjxjFEmckxkG1c5EuySK3o3sawGEikd2Ttz4CWfLa): protocol: expected piece hash; context canceled; EOF Aug 9 07:12:13.245678009 (13h46m7.67675814s) [noise=true , address=104.36.82.16:4316 , piece_id=4NPL3A5HFVERECAHTLPRIGBWPFA7QW4L2WTX55W7L2DCYUEG75XA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PPnXDzwXDVDKemw483GXuzQrPN48JJrjeeD7az2NPNawHNaXf): protocol: expected piece hash; context canceled; EOF Aug 9 07:12:13.245759245 (13h46m7.676839366s) [noise=true , address=104.36.82.44:4896 , piece_id=OHFYRMATCJBA2K3HRJ77ZJTOJ3HT7MK7N5JC7NZ52PXEJ35JKWHQ, seg_pos={0 0}, upload=14368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o): protocol: expected piece hash; context canceled; EOF Aug 9 07:12:13.245792349 (13h46m7.67687247s) [noise=true , address=104.36.82.39:4751 , piece_id=ZM64XI6VX7YENY6WSGRMS34XAATUXGEVWPISJMYOXXQB5LLSBJYA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128StmvpG1KYRXeu3gzEEfRmYZgR5ACJRf2xGZcEiZHsfk1KNyr): protocol: expected piece hash; context canceled; EOF Aug 9 07:12:13.245815813 (13h46m7.676895944s) [seg_pos={0 0}, upload=14368]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 07:12:13.245901858 (13h46m7.676981979s) [upload=14368]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 07:12:13.245907359 (13h46m7.67698749s) [upload=14368]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 07:12:13.789706183 (13h46m8.220786304s) [upload=14368]: Done uploading segments... Aug 9 07:12:13.789724909 (13h46m8.22080503s) [upload=14368]: Upload finished. err: <nil> Duration: 6.040747721s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [............................................X..X..X......X..] duration: 6.950170485s FAIL (2025-08-09 07:16:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.950221655s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 1.872183274s FAIL (2025-08-09 07:16:12 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 07:10:43.552862473 (13h44m37.983942604s) [upload=14343]: Starting upload Aug 9 07:10:43.552921626 (13h44m37.984001757s) [upload=14343]: Done starting upload Aug 9 07:10:43.553117772 (13h44m37.984197903s) [upload=14343]: Uploading segments... Aug 9 07:10:43.553148400 (13h44m37.984228531s) [upload=14343]: Got next segment. Inline: true Aug 9 07:10:43.553152388 (13h44m37.984232519s) [upload=14343]: Waiting for error group managing segments... Aug 9 07:10:43.553187505 (13h44m37.984267626s) [upload=14343]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 07:10:43.553191663 (13h44m37.984271794s) [upload=14343]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 07:10:43.553194108 (13h44m37.984274239s) [upload=14343]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 07:10:44.670265042 (13h44m39.101345173s) [upload=14343]: Done uploading segments... Aug 9 07:10:44.670283398 (13h44m39.101363529s) [upload=14343]: Upload finished. err: <nil> Duration:* 1.872256493s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.............................................X..X..X......X.] duration: 21.116467234s FAIL (2025-08-09 07:16:09 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 21.116487733s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......X.........................X....................X.....] duration: 5.747164847s FAIL (2025-08-09 07:16:07 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after e3ff044d6ae4076192b1e1fe513b8dabe6c767a5c3203dea27eaa2ec31688bdd != before 663c2bc3be3b2c93bc26181187625e6a4f7893b1381782a3fe391ac4fca8ac68 ======LOGS====== Aug 9 07:12:10.752933843 (13h46m5.184013974s) [upload=14368]: Starting upload Aug 9 07:12:10.752992164 (13h46m5.184072285s) [upload=14368]: Done starting upload Aug 9 07:12:10.753168141 (13h46m5.184248273s) [upload=14368]: Uploading segments... Aug 9 07:12:10.753297318 (13h46m5.184377449s) [upload=14368]: Got next segment. Inline: false Aug 9 07:12:10.753326153 (13h46m5.184406274s) [upload=14368]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 07:12:10.753330122 (13h46m5.184410253s) [upload=14368]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 07:12:11.207655625 (13h46m5.638735756s) [seg_pos={0 0}, upload=14368]: Begin upload segment... Aug 9 07:12:11.207720700 (13h46m5.638800831s) [seg_pos={0 0}, upload=14368]: Done begin upload segment. Aug 9 07:12:11.207743194 (13h46m5.638823325s) [noise=true , address=104.36.82.44:4896 , piece_id=OHFYRMATCJBA2K3HRJ77ZJTOJ3HT7MK7N5JC7NZ52PXEJ35JKWHQ, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.207765646 (13h46m5.638845767s) [noise=true , address=64.49.13.27:4961 , piece_id=GYEU7TP4OXYEYFXENUVQRUA4B6Q75NU52NLSADC2AQ3477QHTBSA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.208227149 (13h46m5.63930728s) [noise=true , address=64.49.13.139:4479 , piece_id=5IUHFINOLUATEGGJW3XJL4KPTUV2NC4YWICUUKHFEKBHSMRIA2RA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.208364321 (13h46m5.639444463s) [noise=true , address=104.36.82.60:4370 , piece_id=T3P6UIMSI73BKLVUYXHWEKOXTEXWVOGFSG2NSVJ3GK6M2LBXSKZA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.208698120 (13h46m5.639778251s) [noise=true , address=104.36.82.8:4981 , piece_id=FOIG62XE46FFMD5UHH2SN6SX7KGFEV5YK72DM6WBFROHGC665ZPA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.209043852 (13h46m5.640123983s) [noise=true , address=104.36.82.59:4324 , piece_id=ZWHTHIGUKE4BGL7XQGQ7SSQOKV2AS7KCKRU3IG7XOPN75FJCCIRA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.209320301 (13h46m5.640400432s) [noise=true , address=64.49.13.169:4715 , piece_id=F4XFTIMZVJQFZ7WPSM65CRORDOAJ5RXNFD2LW7JWRUISIB2OQQTQ, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.209683986 (13h46m5.640764117s) [noise=true , address=64.49.13.170:4724 , piece_id=NGADM4QFZPZV2ZQ3T7D55CW5YASOZA6NCPBA2RECAJQ543YBBXHA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.210169786 (13h46m5.641249917s) [noise=true , address=104.36.82.60:4371 , piece_id=7A4ZKM7IMWTIEPXVP4VWYWXEZZ322WJPV7FNFDHS67OFVQK4QASA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.210381952 (13h46m5.641462083s) [noise=true , address=104.36.82.61:4404 , piece_id=42LT6BXLMKSGA6Q7P3IR4SZZZLAMKUHJO4QWZYULTV5AFMCHPL3Q, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.210636339 (13h46m5.64171647s) [noise=true , address=104.36.82.43:4847 , piece_id=5KKBDZL65I2KSGRPO3OHVV4UBY7XVV2NLTTKOY2BP65ESCKFSSRA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.210856220 (13h46m5.641936351s) [noise=true , address=104.36.82.16:4316 , piece_id=4NPL3A5HFVERECAHTLPRIGBWPFA7QW4L2WTX55W7L2DCYUEG75XA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.211079006 (13h46m5.642159127s) [noise=true , address=104.36.82.14:4237 , piece_id=RLIE5EYM6A7VNRDTTFXJTUV7WJKJ5QDKZEAOMUZYA3QFNWXPQKNQ, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.211304737 (13h46m5.642384868s) [noise=true , address=45.91.116.7:4031 , piece_id=I3M2I7TE2HH6KKY4R7VB5PSNZJXAVCK36UULZ2BLWNKWKTYTJIQQ, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.211491064 (13h46m5.642571195s) [noise=true , address=104.36.82.37:4669 , piece_id=KK2GNVWD6EUIBG77ZIEAH3ZBDDXO4PX2DFCFPWDTCT4KFTG5ESLA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.211981352 (13h46m5.643061483s) [noise=true , address=104.36.82.15:4292 , piece_id=3FMM25ACGF4RPBO66JM4PMB2BC2DCVGCR3JCMWCONRBYSODONGFA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.212224658 (13h46m5.643304789s) [noise=true , address=104.36.82.3:4795 , piece_id=DDRQ7JUPFC5FTKGOT6J4YHIXJXEGPOVQYPV3EQ35RDGHVU3H4OUQ, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.212477902 (13h46m5.643558033s) [noise=true , address=104.36.82.39:4751 , piece_id=ZM64XI6VX7YENY6WSGRMS34XAATUXGEVWPISJMYOXXQB5LLSBJYA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:12.328114668 (13h46m6.759194799s) [upload=14368]: Next returned nil segment Aug 9 07:12:12.328130238 (13h46m6.759210359s) [upload=14368]: Waiting for error group managing segments... Aug 9 07:12:12.615123755 (13h46m7.046203886s) [noise=true , address=64.49.13.170:4724 , piece_id=NGADM4QFZPZV2ZQ3T7D55CW5YASOZA6NCPBA2RECAJQ543YBBXHA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:12.633849403 (13h46m7.064929534s) [noise=true , address=64.49.13.139:4479 , piece_id=5IUHFINOLUATEGGJW3XJL4KPTUV2NC4YWICUUKHFEKBHSMRIA2RA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:12.637449872 (13h46m7.068530003s) [noise=true , address=64.49.13.27:4961 , piece_id=GYEU7TP4OXYEYFXENUVQRUA4B6Q75NU52NLSADC2AQ3477QHTBSA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:12.650403255 (13h46m7.081483387s) [noise=true , address=64.49.13.169:4715 , piece_id=F4XFTIMZVJQFZ7WPSM65CRORDOAJ5RXNFD2LW7JWRUISIB2OQQTQ, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.137896401 (13h46m7.568976532s) [noise=true , address=104.36.82.60:4371 , piece_id=7A4ZKM7IMWTIEPXVP4VWYWXEZZ322WJPV7FNFDHS67OFVQK4QASA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.139324974 (13h46m7.570405095s) [noise=true , address=104.36.82.8:4981 , piece_id=FOIG62XE46FFMD5UHH2SN6SX7KGFEV5YK72DM6WBFROHGC665ZPA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.146401663 (13h46m7.577481794s) [noise=true , address=45.91.116.7:4031 , piece_id=I3M2I7TE2HH6KKY4R7VB5PSNZJXAVCK36UULZ2BLWNKWKTYTJIQQ, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.161160482 (13h46m7.592240603s) [noise=true , address=104.36.82.43:4847 , piece_id=5KKBDZL65I2KSGRPO3OHVV4UBY7XVV2NLTTKOY2BP65ESCKFSSRA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.165737920 (13h46m7.596818041s) [noise=true , address=104.36.82.15:4292 , piece_id=3FMM25ACGF4RPBO66JM4PMB2BC2DCVGCR3JCMWCONRBYSODONGFA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.168998608 (13h46m7.600078729s) [noise=true , address=104.36.82.60:4370 , piece_id=T3P6UIMSI73BKLVUYXHWEKOXTEXWVOGFSG2NSVJ3GK6M2LBXSKZA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.209005594 (13h46m7.640085725s) [noise=true , address=104.36.82.59:4324 , piece_id=ZWHTHIGUKE4BGL7XQGQ7SSQOKV2AS7KCKRU3IG7XOPN75FJCCIRA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.229451654 (13h46m7.660531785s) [noise=true , address=104.36.82.3:4795 , piece_id=DDRQ7JUPFC5FTKGOT6J4YHIXJXEGPOVQYPV3EQ35RDGHVU3H4OUQ, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.238304101 (13h46m7.669384232s) [noise=true , address=104.36.82.61:4404 , piece_id=42LT6BXLMKSGA6Q7P3IR4SZZZLAMKUHJO4QWZYULTV5AFMCHPL3Q, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.245475733 (13h46m7.676555854s) [noise=true , address=104.36.82.37:4669 , piece_id=KK2GNVWD6EUIBG77ZIEAH3ZBDDXO4PX2DFCFPWDTCT4KFTG5ESLA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.245503065 (13h46m7.676583196s) [seg_pos={0 0}, upload=14368]: Segment reached optimal threshold of 14 pieces. Aug 9 07:12:13.245606703 (13h46m7.676686834s) [noise=true , address=104.36.82.14:4237 , piece_id=RLIE5EYM6A7VNRDTTFXJTUV7WJKJ5QDKZEAOMUZYA3QFNWXPQKNQ, seg_pos={0 0}, upload=14368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1o2jLTwKNSjxjFEmckxkG1c5EuySK3o3sawGEikd2Ttz4CWfLa): protocol: expected piece hash; context canceled; EOF Aug 9 07:12:13.245678009 (13h46m7.67675814s) [noise=true , address=104.36.82.16:4316 , piece_id=4NPL3A5HFVERECAHTLPRIGBWPFA7QW4L2WTX55W7L2DCYUEG75XA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PPnXDzwXDVDKemw483GXuzQrPN48JJrjeeD7az2NPNawHNaXf): protocol: expected piece hash; context canceled; EOF Aug 9 07:12:13.245759245 (13h46m7.676839366s) [noise=true , address=104.36.82.44:4896 , piece_id=OHFYRMATCJBA2K3HRJ77ZJTOJ3HT7MK7N5JC7NZ52PXEJ35JKWHQ, seg_pos={0 0}, upload=14368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o): protocol: expected piece hash; context canceled; EOF Aug 9 07:12:13.245792349 (13h46m7.67687247s) [noise=true , address=104.36.82.39:4751 , piece_id=ZM64XI6VX7YENY6WSGRMS34XAATUXGEVWPISJMYOXXQB5LLSBJYA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128StmvpG1KYRXeu3gzEEfRmYZgR5ACJRf2xGZcEiZHsfk1KNyr): protocol: expected piece hash; context canceled; EOF Aug 9 07:12:13.245815813 (13h46m7.676895944s) [seg_pos={0 0}, upload=14368]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 07:12:13.245901858 (13h46m7.676981979s) [upload=14368]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 07:12:13.245907359 (13h46m7.67698749s) [upload=14368]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 07:12:13.789706183 (13h46m8.220786304s) [upload=14368]: Done uploading segments... Aug 9 07:12:13.789724909 (13h46m8.22080503s) [upload=14368]: Upload finished. err: <nil> Duration: 5.747190876s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [..............................................X..X..X......X] duration: 30.000883299s FAIL (2025-08-09 07:15:32 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.000903838s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [........X.........................X....................X....] duration: 5.60444438s FAIL (2025-08-09 07:15:21 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after e3ff044d6ae4076192b1e1fe513b8dabe6c767a5c3203dea27eaa2ec31688bdd != before 663c2bc3be3b2c93bc26181187625e6a4f7893b1381782a3fe391ac4fca8ac68 ======LOGS====== Aug 9 07:12:10.752933843 (13h46m5.184013974s) [upload=14368]: Starting upload Aug 9 07:12:10.752992164 (13h46m5.184072285s) [upload=14368]: Done starting upload Aug 9 07:12:10.753168141 (13h46m5.184248273s) [upload=14368]: Uploading segments... Aug 9 07:12:10.753297318 (13h46m5.184377449s) [upload=14368]: Got next segment. Inline: false Aug 9 07:12:10.753326153 (13h46m5.184406274s) [upload=14368]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 07:12:10.753330122 (13h46m5.184410253s) [upload=14368]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 07:12:11.207655625 (13h46m5.638735756s) [seg_pos={0 0}, upload=14368]: Begin upload segment... Aug 9 07:12:11.207720700 (13h46m5.638800831s) [seg_pos={0 0}, upload=14368]: Done begin upload segment. Aug 9 07:12:11.207743194 (13h46m5.638823325s) [noise=true , address=104.36.82.44:4896 , piece_id=OHFYRMATCJBA2K3HRJ77ZJTOJ3HT7MK7N5JC7NZ52PXEJ35JKWHQ, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.207765646 (13h46m5.638845767s) [noise=true , address=64.49.13.27:4961 , piece_id=GYEU7TP4OXYEYFXENUVQRUA4B6Q75NU52NLSADC2AQ3477QHTBSA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.208227149 (13h46m5.63930728s) [noise=true , address=64.49.13.139:4479 , piece_id=5IUHFINOLUATEGGJW3XJL4KPTUV2NC4YWICUUKHFEKBHSMRIA2RA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.208364321 (13h46m5.639444463s) [noise=true , address=104.36.82.60:4370 , piece_id=T3P6UIMSI73BKLVUYXHWEKOXTEXWVOGFSG2NSVJ3GK6M2LBXSKZA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.208698120 (13h46m5.639778251s) [noise=true , address=104.36.82.8:4981 , piece_id=FOIG62XE46FFMD5UHH2SN6SX7KGFEV5YK72DM6WBFROHGC665ZPA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.209043852 (13h46m5.640123983s) [noise=true , address=104.36.82.59:4324 , piece_id=ZWHTHIGUKE4BGL7XQGQ7SSQOKV2AS7KCKRU3IG7XOPN75FJCCIRA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.209320301 (13h46m5.640400432s) [noise=true , address=64.49.13.169:4715 , piece_id=F4XFTIMZVJQFZ7WPSM65CRORDOAJ5RXNFD2LW7JWRUISIB2OQQTQ, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.209683986 (13h46m5.640764117s) [noise=true , address=64.49.13.170:4724 , piece_id=NGADM4QFZPZV2ZQ3T7D55CW5YASOZA6NCPBA2RECAJQ543YBBXHA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.210169786 (13h46m5.641249917s) [noise=true , address=104.36.82.60:4371 , piece_id=7A4ZKM7IMWTIEPXVP4VWYWXEZZ322WJPV7FNFDHS67OFVQK4QASA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.210381952 (13h46m5.641462083s) [noise=true , address=104.36.82.61:4404 , piece_id=42LT6BXLMKSGA6Q7P3IR4SZZZLAMKUHJO4QWZYULTV5AFMCHPL3Q, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.210636339 (13h46m5.64171647s) [noise=true , address=104.36.82.43:4847 , piece_id=5KKBDZL65I2KSGRPO3OHVV4UBY7XVV2NLTTKOY2BP65ESCKFSSRA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.210856220 (13h46m5.641936351s) [noise=true , address=104.36.82.16:4316 , piece_id=4NPL3A5HFVERECAHTLPRIGBWPFA7QW4L2WTX55W7L2DCYUEG75XA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.211079006 (13h46m5.642159127s) [noise=true , address=104.36.82.14:4237 , piece_id=RLIE5EYM6A7VNRDTTFXJTUV7WJKJ5QDKZEAOMUZYA3QFNWXPQKNQ, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.211304737 (13h46m5.642384868s) [noise=true , address=45.91.116.7:4031 , piece_id=I3M2I7TE2HH6KKY4R7VB5PSNZJXAVCK36UULZ2BLWNKWKTYTJIQQ, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.211491064 (13h46m5.642571195s) [noise=true , address=104.36.82.37:4669 , piece_id=KK2GNVWD6EUIBG77ZIEAH3ZBDDXO4PX2DFCFPWDTCT4KFTG5ESLA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.211981352 (13h46m5.643061483s) [noise=true , address=104.36.82.15:4292 , piece_id=3FMM25ACGF4RPBO66JM4PMB2BC2DCVGCR3JCMWCONRBYSODONGFA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.212224658 (13h46m5.643304789s) [noise=true , address=104.36.82.3:4795 , piece_id=DDRQ7JUPFC5FTKGOT6J4YHIXJXEGPOVQYPV3EQ35RDGHVU3H4OUQ, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.212477902 (13h46m5.643558033s) [noise=true , address=104.36.82.39:4751 , piece_id=ZM64XI6VX7YENY6WSGRMS34XAATUXGEVWPISJMYOXXQB5LLSBJYA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:12.328114668 (13h46m6.759194799s) [upload=14368]: Next returned nil segment Aug 9 07:12:12.328130238 (13h46m6.759210359s) [upload=14368]: Waiting for error group managing segments... Aug 9 07:12:12.615123755 (13h46m7.046203886s) [noise=true , address=64.49.13.170:4724 , piece_id=NGADM4QFZPZV2ZQ3T7D55CW5YASOZA6NCPBA2RECAJQ543YBBXHA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:12.633849403 (13h46m7.064929534s) [noise=true , address=64.49.13.139:4479 , piece_id=5IUHFINOLUATEGGJW3XJL4KPTUV2NC4YWICUUKHFEKBHSMRIA2RA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:12.637449872 (13h46m7.068530003s) [noise=true , address=64.49.13.27:4961 , piece_id=GYEU7TP4OXYEYFXENUVQRUA4B6Q75NU52NLSADC2AQ3477QHTBSA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:12.650403255 (13h46m7.081483387s) [noise=true , address=64.49.13.169:4715 , piece_id=F4XFTIMZVJQFZ7WPSM65CRORDOAJ5RXNFD2LW7JWRUISIB2OQQTQ, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.137896401 (13h46m7.568976532s) [noise=true , address=104.36.82.60:4371 , piece_id=7A4ZKM7IMWTIEPXVP4VWYWXEZZ322WJPV7FNFDHS67OFVQK4QASA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.139324974 (13h46m7.570405095s) [noise=true , address=104.36.82.8:4981 , piece_id=FOIG62XE46FFMD5UHH2SN6SX7KGFEV5YK72DM6WBFROHGC665ZPA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.146401663 (13h46m7.577481794s) [noise=true , address=45.91.116.7:4031 , piece_id=I3M2I7TE2HH6KKY4R7VB5PSNZJXAVCK36UULZ2BLWNKWKTYTJIQQ, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.161160482 (13h46m7.592240603s) [noise=true , address=104.36.82.43:4847 , piece_id=5KKBDZL65I2KSGRPO3OHVV4UBY7XVV2NLTTKOY2BP65ESCKFSSRA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.165737920 (13h46m7.596818041s) [noise=true , address=104.36.82.15:4292 , piece_id=3FMM25ACGF4RPBO66JM4PMB2BC2DCVGCR3JCMWCONRBYSODONGFA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.168998608 (13h46m7.600078729s) [noise=true , address=104.36.82.60:4370 , piece_id=T3P6UIMSI73BKLVUYXHWEKOXTEXWVOGFSG2NSVJ3GK6M2LBXSKZA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.209005594 (13h46m7.640085725s) [noise=true , address=104.36.82.59:4324 , piece_id=ZWHTHIGUKE4BGL7XQGQ7SSQOKV2AS7KCKRU3IG7XOPN75FJCCIRA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.229451654 (13h46m7.660531785s) [noise=true , address=104.36.82.3:4795 , piece_id=DDRQ7JUPFC5FTKGOT6J4YHIXJXEGPOVQYPV3EQ35RDGHVU3H4OUQ, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.238304101 (13h46m7.669384232s) [noise=true , address=104.36.82.61:4404 , piece_id=42LT6BXLMKSGA6Q7P3IR4SZZZLAMKUHJO4QWZYULTV5AFMCHPL3Q, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.245475733 (13h46m7.676555854s) [noise=true , address=104.36.82.37:4669 , piece_id=KK2GNVWD6EUIBG77ZIEAH3ZBDDXO4PX2DFCFPWDTCT4KFTG5ESLA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.245503065 (13h46m7.676583196s) [seg_pos={0 0}, upload=14368]: Segment reached optimal threshold of 14 pieces. Aug 9 07:12:13.245606703 (13h46m7.676686834s) [noise=true , address=104.36.82.14:4237 , piece_id=RLIE5EYM6A7VNRDTTFXJTUV7WJKJ5QDKZEAOMUZYA3QFNWXPQKNQ, seg_pos={0 0}, upload=14368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1o2jLTwKNSjxjFEmckxkG1c5EuySK3o3sawGEikd2Ttz4CWfLa): protocol: expected piece hash; context canceled; EOF Aug 9 07:12:13.245678009 (13h46m7.67675814s) [noise=true , address=104.36.82.16:4316 , piece_id=4NPL3A5HFVERECAHTLPRIGBWPFA7QW4L2WTX55W7L2DCYUEG75XA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PPnXDzwXDVDKemw483GXuzQrPN48JJrjeeD7az2NPNawHNaXf): protocol: expected piece hash; context canceled; EOF Aug 9 07:12:13.245759245 (13h46m7.676839366s) [noise=true , address=104.36.82.44:4896 , piece_id=OHFYRMATCJBA2K3HRJ77ZJTOJ3HT7MK7N5JC7NZ52PXEJ35JKWHQ, seg_pos={0 0}, upload=14368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o): protocol: expected piece hash; context canceled; EOF Aug 9 07:12:13.245792349 (13h46m7.67687247s) [noise=true , address=104.36.82.39:4751 , piece_id=ZM64XI6VX7YENY6WSGRMS34XAATUXGEVWPISJMYOXXQB5LLSBJYA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128StmvpG1KYRXeu3gzEEfRmYZgR5ACJRf2xGZcEiZHsfk1KNyr): protocol: expected piece hash; context canceled; EOF Aug 9 07:12:13.245815813 (13h46m7.676895944s) [seg_pos={0 0}, upload=14368]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 07:12:13.245901858 (13h46m7.676981979s) [upload=14368]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 07:12:13.245907359 (13h46m7.67698749s) [upload=14368]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 07:12:13.789706183 (13h46m8.220786304s) [upload=14368]: Done uploading segments... Aug 9 07:12:13.789724909 (13h46m8.22080503s) [upload=14368]: Upload finished. err: <nil> Duration: 5.604470861s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 1.823437928s FAIL (2025-08-09 07:15:13 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 07:10:43.552862473 (13h44m37.983942604s) [upload=14343]: Starting upload Aug 9 07:10:43.552921626 (13h44m37.984001757s) [upload=14343]: Done starting upload Aug 9 07:10:43.553117772 (13h44m37.984197903s) [upload=14343]: Uploading segments... Aug 9 07:10:43.553148400 (13h44m37.984228531s) [upload=14343]: Got next segment. Inline: true Aug 9 07:10:43.553152388 (13h44m37.984232519s) [upload=14343]: Waiting for error group managing segments... Aug 9 07:10:43.553187505 (13h44m37.984267626s) [upload=14343]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 07:10:43.553191663 (13h44m37.984271794s) [upload=14343]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 07:10:43.553194108 (13h44m37.984274239s) [upload=14343]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 07:10:44.670265042 (13h44m39.101345173s) [upload=14343]: Done uploading segments... Aug 9 07:10:44.670283398 (13h44m39.101363529s) [upload=14343]: Upload finished. err: <nil> Duration:* 1.823466353s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........X.........................X....................X...] duration: 5.564459s FAIL (2025-08-09 07:14:51 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after e3ff044d6ae4076192b1e1fe513b8dabe6c767a5c3203dea27eaa2ec31688bdd != before 663c2bc3be3b2c93bc26181187625e6a4f7893b1381782a3fe391ac4fca8ac68 ======LOGS====== Aug 9 07:12:10.752933843 (13h46m5.184013974s) [upload=14368]: Starting upload Aug 9 07:12:10.752992164 (13h46m5.184072285s) [upload=14368]: Done starting upload Aug 9 07:12:10.753168141 (13h46m5.184248273s) [upload=14368]: Uploading segments... Aug 9 07:12:10.753297318 (13h46m5.184377449s) [upload=14368]: Got next segment. Inline: false Aug 9 07:12:10.753326153 (13h46m5.184406274s) [upload=14368]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 07:12:10.753330122 (13h46m5.184410253s) [upload=14368]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 07:12:11.207655625 (13h46m5.638735756s) [seg_pos={0 0}, upload=14368]: Begin upload segment... Aug 9 07:12:11.207720700 (13h46m5.638800831s) [seg_pos={0 0}, upload=14368]: Done begin upload segment. Aug 9 07:12:11.207743194 (13h46m5.638823325s) [noise=true , address=104.36.82.44:4896 , piece_id=OHFYRMATCJBA2K3HRJ77ZJTOJ3HT7MK7N5JC7NZ52PXEJ35JKWHQ, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.207765646 (13h46m5.638845767s) [noise=true , address=64.49.13.27:4961 , piece_id=GYEU7TP4OXYEYFXENUVQRUA4B6Q75NU52NLSADC2AQ3477QHTBSA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.208227149 (13h46m5.63930728s) [noise=true , address=64.49.13.139:4479 , piece_id=5IUHFINOLUATEGGJW3XJL4KPTUV2NC4YWICUUKHFEKBHSMRIA2RA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.208364321 (13h46m5.639444463s) [noise=true , address=104.36.82.60:4370 , piece_id=T3P6UIMSI73BKLVUYXHWEKOXTEXWVOGFSG2NSVJ3GK6M2LBXSKZA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.208698120 (13h46m5.639778251s) [noise=true , address=104.36.82.8:4981 , piece_id=FOIG62XE46FFMD5UHH2SN6SX7KGFEV5YK72DM6WBFROHGC665ZPA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.209043852 (13h46m5.640123983s) [noise=true , address=104.36.82.59:4324 , piece_id=ZWHTHIGUKE4BGL7XQGQ7SSQOKV2AS7KCKRU3IG7XOPN75FJCCIRA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.209320301 (13h46m5.640400432s) [noise=true , address=64.49.13.169:4715 , piece_id=F4XFTIMZVJQFZ7WPSM65CRORDOAJ5RXNFD2LW7JWRUISIB2OQQTQ, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.209683986 (13h46m5.640764117s) [noise=true , address=64.49.13.170:4724 , piece_id=NGADM4QFZPZV2ZQ3T7D55CW5YASOZA6NCPBA2RECAJQ543YBBXHA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.210169786 (13h46m5.641249917s) [noise=true , address=104.36.82.60:4371 , piece_id=7A4ZKM7IMWTIEPXVP4VWYWXEZZ322WJPV7FNFDHS67OFVQK4QASA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.210381952 (13h46m5.641462083s) [noise=true , address=104.36.82.61:4404 , piece_id=42LT6BXLMKSGA6Q7P3IR4SZZZLAMKUHJO4QWZYULTV5AFMCHPL3Q, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.210636339 (13h46m5.64171647s) [noise=true , address=104.36.82.43:4847 , piece_id=5KKBDZL65I2KSGRPO3OHVV4UBY7XVV2NLTTKOY2BP65ESCKFSSRA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.210856220 (13h46m5.641936351s) [noise=true , address=104.36.82.16:4316 , piece_id=4NPL3A5HFVERECAHTLPRIGBWPFA7QW4L2WTX55W7L2DCYUEG75XA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.211079006 (13h46m5.642159127s) [noise=true , address=104.36.82.14:4237 , piece_id=RLIE5EYM6A7VNRDTTFXJTUV7WJKJ5QDKZEAOMUZYA3QFNWXPQKNQ, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.211304737 (13h46m5.642384868s) [noise=true , address=45.91.116.7:4031 , piece_id=I3M2I7TE2HH6KKY4R7VB5PSNZJXAVCK36UULZ2BLWNKWKTYTJIQQ, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.211491064 (13h46m5.642571195s) [noise=true , address=104.36.82.37:4669 , piece_id=KK2GNVWD6EUIBG77ZIEAH3ZBDDXO4PX2DFCFPWDTCT4KFTG5ESLA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.211981352 (13h46m5.643061483s) [noise=true , address=104.36.82.15:4292 , piece_id=3FMM25ACGF4RPBO66JM4PMB2BC2DCVGCR3JCMWCONRBYSODONGFA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.212224658 (13h46m5.643304789s) [noise=true , address=104.36.82.3:4795 , piece_id=DDRQ7JUPFC5FTKGOT6J4YHIXJXEGPOVQYPV3EQ35RDGHVU3H4OUQ, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.212477902 (13h46m5.643558033s) [noise=true , address=104.36.82.39:4751 , piece_id=ZM64XI6VX7YENY6WSGRMS34XAATUXGEVWPISJMYOXXQB5LLSBJYA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:12.328114668 (13h46m6.759194799s) [upload=14368]: Next returned nil segment Aug 9 07:12:12.328130238 (13h46m6.759210359s) [upload=14368]: Waiting for error group managing segments... Aug 9 07:12:12.615123755 (13h46m7.046203886s) [noise=true , address=64.49.13.170:4724 , piece_id=NGADM4QFZPZV2ZQ3T7D55CW5YASOZA6NCPBA2RECAJQ543YBBXHA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:12.633849403 (13h46m7.064929534s) [noise=true , address=64.49.13.139:4479 , piece_id=5IUHFINOLUATEGGJW3XJL4KPTUV2NC4YWICUUKHFEKBHSMRIA2RA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:12.637449872 (13h46m7.068530003s) [noise=true , address=64.49.13.27:4961 , piece_id=GYEU7TP4OXYEYFXENUVQRUA4B6Q75NU52NLSADC2AQ3477QHTBSA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:12.650403255 (13h46m7.081483387s) [noise=true , address=64.49.13.169:4715 , piece_id=F4XFTIMZVJQFZ7WPSM65CRORDOAJ5RXNFD2LW7JWRUISIB2OQQTQ, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.137896401 (13h46m7.568976532s) [noise=true , address=104.36.82.60:4371 , piece_id=7A4ZKM7IMWTIEPXVP4VWYWXEZZ322WJPV7FNFDHS67OFVQK4QASA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.139324974 (13h46m7.570405095s) [noise=true , address=104.36.82.8:4981 , piece_id=FOIG62XE46FFMD5UHH2SN6SX7KGFEV5YK72DM6WBFROHGC665ZPA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.146401663 (13h46m7.577481794s) [noise=true , address=45.91.116.7:4031 , piece_id=I3M2I7TE2HH6KKY4R7VB5PSNZJXAVCK36UULZ2BLWNKWKTYTJIQQ, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.161160482 (13h46m7.592240603s) [noise=true , address=104.36.82.43:4847 , piece_id=5KKBDZL65I2KSGRPO3OHVV4UBY7XVV2NLTTKOY2BP65ESCKFSSRA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.165737920 (13h46m7.596818041s) [noise=true , address=104.36.82.15:4292 , piece_id=3FMM25ACGF4RPBO66JM4PMB2BC2DCVGCR3JCMWCONRBYSODONGFA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.168998608 (13h46m7.600078729s) [noise=true , address=104.36.82.60:4370 , piece_id=T3P6UIMSI73BKLVUYXHWEKOXTEXWVOGFSG2NSVJ3GK6M2LBXSKZA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.209005594 (13h46m7.640085725s) [noise=true , address=104.36.82.59:4324 , piece_id=ZWHTHIGUKE4BGL7XQGQ7SSQOKV2AS7KCKRU3IG7XOPN75FJCCIRA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.229451654 (13h46m7.660531785s) [noise=true , address=104.36.82.3:4795 , piece_id=DDRQ7JUPFC5FTKGOT6J4YHIXJXEGPOVQYPV3EQ35RDGHVU3H4OUQ, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.238304101 (13h46m7.669384232s) [noise=true , address=104.36.82.61:4404 , piece_id=42LT6BXLMKSGA6Q7P3IR4SZZZLAMKUHJO4QWZYULTV5AFMCHPL3Q, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.245475733 (13h46m7.676555854s) [noise=true , address=104.36.82.37:4669 , piece_id=KK2GNVWD6EUIBG77ZIEAH3ZBDDXO4PX2DFCFPWDTCT4KFTG5ESLA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.245503065 (13h46m7.676583196s) [seg_pos={0 0}, upload=14368]: Segment reached optimal threshold of 14 pieces. Aug 9 07:12:13.245606703 (13h46m7.676686834s) [noise=true , address=104.36.82.14:4237 , piece_id=RLIE5EYM6A7VNRDTTFXJTUV7WJKJ5QDKZEAOMUZYA3QFNWXPQKNQ, seg_pos={0 0}, upload=14368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1o2jLTwKNSjxjFEmckxkG1c5EuySK3o3sawGEikd2Ttz4CWfLa): protocol: expected piece hash; context canceled; EOF Aug 9 07:12:13.245678009 (13h46m7.67675814s) [noise=true , address=104.36.82.16:4316 , piece_id=4NPL3A5HFVERECAHTLPRIGBWPFA7QW4L2WTX55W7L2DCYUEG75XA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PPnXDzwXDVDKemw483GXuzQrPN48JJrjeeD7az2NPNawHNaXf): protocol: expected piece hash; context canceled; EOF Aug 9 07:12:13.245759245 (13h46m7.676839366s) [noise=true , address=104.36.82.44:4896 , piece_id=OHFYRMATCJBA2K3HRJ77ZJTOJ3HT7MK7N5JC7NZ52PXEJ35JKWHQ, seg_pos={0 0}, upload=14368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o): protocol: expected piece hash; context canceled; EOF Aug 9 07:12:13.245792349 (13h46m7.67687247s) [noise=true , address=104.36.82.39:4751 , piece_id=ZM64XI6VX7YENY6WSGRMS34XAATUXGEVWPISJMYOXXQB5LLSBJYA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128StmvpG1KYRXeu3gzEEfRmYZgR5ACJRf2xGZcEiZHsfk1KNyr): protocol: expected piece hash; context canceled; EOF Aug 9 07:12:13.245815813 (13h46m7.676895944s) [seg_pos={0 0}, upload=14368]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 07:12:13.245901858 (13h46m7.676981979s) [upload=14368]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 07:12:13.245907359 (13h46m7.67698749s) [upload=14368]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 07:12:13.789706183 (13h46m8.220786304s) [upload=14368]: Done uploading segments... Aug 9 07:12:13.789724909 (13h46m8.22080503s) [upload=14368]: Upload finished. err: <nil> Duration: 5.564484289s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 1.926428129s FAIL (2025-08-09 07:14:37 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 07:10:43.552862473 (13h44m37.983942604s) [upload=14343]: Starting upload Aug 9 07:10:43.552921626 (13h44m37.984001757s) [upload=14343]: Done starting upload Aug 9 07:10:43.553117772 (13h44m37.984197903s) [upload=14343]: Uploading segments... Aug 9 07:10:43.553148400 (13h44m37.984228531s) [upload=14343]: Got next segment. Inline: true Aug 9 07:10:43.553152388 (13h44m37.984232519s) [upload=14343]: Waiting for error group managing segments... Aug 9 07:10:43.553187505 (13h44m37.984267626s) [upload=14343]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 07:10:43.553191663 (13h44m37.984271794s) [upload=14343]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 07:10:43.553194108 (13h44m37.984274239s) [upload=14343]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 07:10:44.670265042 (13h44m39.101345173s) [upload=14343]: Done uploading segments... Aug 9 07:10:44.670283398 (13h44m39.101363529s) [upload=14343]: Upload finished. err: <nil> Duration:* 1.926457826s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [...............................................X..X..X......] duration: 8.168175834s FAIL (2025-08-09 07:14:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 8.168209881s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..........X.........................X....................X..] duration: 5.803021436s FAIL (2025-08-09 07:13:53 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after e3ff044d6ae4076192b1e1fe513b8dabe6c767a5c3203dea27eaa2ec31688bdd != before 663c2bc3be3b2c93bc26181187625e6a4f7893b1381782a3fe391ac4fca8ac68 ======LOGS====== Aug 9 07:12:10.752933843 (13h46m5.184013974s) [upload=14368]: Starting upload Aug 9 07:12:10.752992164 (13h46m5.184072285s) [upload=14368]: Done starting upload Aug 9 07:12:10.753168141 (13h46m5.184248273s) [upload=14368]: Uploading segments... Aug 9 07:12:10.753297318 (13h46m5.184377449s) [upload=14368]: Got next segment. Inline: false Aug 9 07:12:10.753326153 (13h46m5.184406274s) [upload=14368]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 07:12:10.753330122 (13h46m5.184410253s) [upload=14368]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 07:12:11.207655625 (13h46m5.638735756s) [seg_pos={0 0}, upload=14368]: Begin upload segment... Aug 9 07:12:11.207720700 (13h46m5.638800831s) [seg_pos={0 0}, upload=14368]: Done begin upload segment. Aug 9 07:12:11.207743194 (13h46m5.638823325s) [noise=true , address=104.36.82.44:4896 , piece_id=OHFYRMATCJBA2K3HRJ77ZJTOJ3HT7MK7N5JC7NZ52PXEJ35JKWHQ, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.207765646 (13h46m5.638845767s) [noise=true , address=64.49.13.27:4961 , piece_id=GYEU7TP4OXYEYFXENUVQRUA4B6Q75NU52NLSADC2AQ3477QHTBSA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.208227149 (13h46m5.63930728s) [noise=true , address=64.49.13.139:4479 , piece_id=5IUHFINOLUATEGGJW3XJL4KPTUV2NC4YWICUUKHFEKBHSMRIA2RA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.208364321 (13h46m5.639444463s) [noise=true , address=104.36.82.60:4370 , piece_id=T3P6UIMSI73BKLVUYXHWEKOXTEXWVOGFSG2NSVJ3GK6M2LBXSKZA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.208698120 (13h46m5.639778251s) [noise=true , address=104.36.82.8:4981 , piece_id=FOIG62XE46FFMD5UHH2SN6SX7KGFEV5YK72DM6WBFROHGC665ZPA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.209043852 (13h46m5.640123983s) [noise=true , address=104.36.82.59:4324 , piece_id=ZWHTHIGUKE4BGL7XQGQ7SSQOKV2AS7KCKRU3IG7XOPN75FJCCIRA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.209320301 (13h46m5.640400432s) [noise=true , address=64.49.13.169:4715 , piece_id=F4XFTIMZVJQFZ7WPSM65CRORDOAJ5RXNFD2LW7JWRUISIB2OQQTQ, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.209683986 (13h46m5.640764117s) [noise=true , address=64.49.13.170:4724 , piece_id=NGADM4QFZPZV2ZQ3T7D55CW5YASOZA6NCPBA2RECAJQ543YBBXHA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.210169786 (13h46m5.641249917s) [noise=true , address=104.36.82.60:4371 , piece_id=7A4ZKM7IMWTIEPXVP4VWYWXEZZ322WJPV7FNFDHS67OFVQK4QASA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.210381952 (13h46m5.641462083s) [noise=true , address=104.36.82.61:4404 , piece_id=42LT6BXLMKSGA6Q7P3IR4SZZZLAMKUHJO4QWZYULTV5AFMCHPL3Q, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.210636339 (13h46m5.64171647s) [noise=true , address=104.36.82.43:4847 , piece_id=5KKBDZL65I2KSGRPO3OHVV4UBY7XVV2NLTTKOY2BP65ESCKFSSRA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.210856220 (13h46m5.641936351s) [noise=true , address=104.36.82.16:4316 , piece_id=4NPL3A5HFVERECAHTLPRIGBWPFA7QW4L2WTX55W7L2DCYUEG75XA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.211079006 (13h46m5.642159127s) [noise=true , address=104.36.82.14:4237 , piece_id=RLIE5EYM6A7VNRDTTFXJTUV7WJKJ5QDKZEAOMUZYA3QFNWXPQKNQ, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.211304737 (13h46m5.642384868s) [noise=true , address=45.91.116.7:4031 , piece_id=I3M2I7TE2HH6KKY4R7VB5PSNZJXAVCK36UULZ2BLWNKWKTYTJIQQ, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.211491064 (13h46m5.642571195s) [noise=true , address=104.36.82.37:4669 , piece_id=KK2GNVWD6EUIBG77ZIEAH3ZBDDXO4PX2DFCFPWDTCT4KFTG5ESLA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.211981352 (13h46m5.643061483s) [noise=true , address=104.36.82.15:4292 , piece_id=3FMM25ACGF4RPBO66JM4PMB2BC2DCVGCR3JCMWCONRBYSODONGFA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.212224658 (13h46m5.643304789s) [noise=true , address=104.36.82.3:4795 , piece_id=DDRQ7JUPFC5FTKGOT6J4YHIXJXEGPOVQYPV3EQ35RDGHVU3H4OUQ, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.212477902 (13h46m5.643558033s) [noise=true , address=104.36.82.39:4751 , piece_id=ZM64XI6VX7YENY6WSGRMS34XAATUXGEVWPISJMYOXXQB5LLSBJYA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:12.328114668 (13h46m6.759194799s) [upload=14368]: Next returned nil segment Aug 9 07:12:12.328130238 (13h46m6.759210359s) [upload=14368]: Waiting for error group managing segments... Aug 9 07:12:12.615123755 (13h46m7.046203886s) [noise=true , address=64.49.13.170:4724 , piece_id=NGADM4QFZPZV2ZQ3T7D55CW5YASOZA6NCPBA2RECAJQ543YBBXHA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:12.633849403 (13h46m7.064929534s) [noise=true , address=64.49.13.139:4479 , piece_id=5IUHFINOLUATEGGJW3XJL4KPTUV2NC4YWICUUKHFEKBHSMRIA2RA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:12.637449872 (13h46m7.068530003s) [noise=true , address=64.49.13.27:4961 , piece_id=GYEU7TP4OXYEYFXENUVQRUA4B6Q75NU52NLSADC2AQ3477QHTBSA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:12.650403255 (13h46m7.081483387s) [noise=true , address=64.49.13.169:4715 , piece_id=F4XFTIMZVJQFZ7WPSM65CRORDOAJ5RXNFD2LW7JWRUISIB2OQQTQ, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.137896401 (13h46m7.568976532s) [noise=true , address=104.36.82.60:4371 , piece_id=7A4ZKM7IMWTIEPXVP4VWYWXEZZ322WJPV7FNFDHS67OFVQK4QASA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.139324974 (13h46m7.570405095s) [noise=true , address=104.36.82.8:4981 , piece_id=FOIG62XE46FFMD5UHH2SN6SX7KGFEV5YK72DM6WBFROHGC665ZPA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.146401663 (13h46m7.577481794s) [noise=true , address=45.91.116.7:4031 , piece_id=I3M2I7TE2HH6KKY4R7VB5PSNZJXAVCK36UULZ2BLWNKWKTYTJIQQ, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.161160482 (13h46m7.592240603s) [noise=true , address=104.36.82.43:4847 , piece_id=5KKBDZL65I2KSGRPO3OHVV4UBY7XVV2NLTTKOY2BP65ESCKFSSRA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.165737920 (13h46m7.596818041s) [noise=true , address=104.36.82.15:4292 , piece_id=3FMM25ACGF4RPBO66JM4PMB2BC2DCVGCR3JCMWCONRBYSODONGFA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.168998608 (13h46m7.600078729s) [noise=true , address=104.36.82.60:4370 , piece_id=T3P6UIMSI73BKLVUYXHWEKOXTEXWVOGFSG2NSVJ3GK6M2LBXSKZA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.209005594 (13h46m7.640085725s) [noise=true , address=104.36.82.59:4324 , piece_id=ZWHTHIGUKE4BGL7XQGQ7SSQOKV2AS7KCKRU3IG7XOPN75FJCCIRA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.229451654 (13h46m7.660531785s) [noise=true , address=104.36.82.3:4795 , piece_id=DDRQ7JUPFC5FTKGOT6J4YHIXJXEGPOVQYPV3EQ35RDGHVU3H4OUQ, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.238304101 (13h46m7.669384232s) [noise=true , address=104.36.82.61:4404 , piece_id=42LT6BXLMKSGA6Q7P3IR4SZZZLAMKUHJO4QWZYULTV5AFMCHPL3Q, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.245475733 (13h46m7.676555854s) [noise=true , address=104.36.82.37:4669 , piece_id=KK2GNVWD6EUIBG77ZIEAH3ZBDDXO4PX2DFCFPWDTCT4KFTG5ESLA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.245503065 (13h46m7.676583196s) [seg_pos={0 0}, upload=14368]: Segment reached optimal threshold of 14 pieces. Aug 9 07:12:13.245606703 (13h46m7.676686834s) [noise=true , address=104.36.82.14:4237 , piece_id=RLIE5EYM6A7VNRDTTFXJTUV7WJKJ5QDKZEAOMUZYA3QFNWXPQKNQ, seg_pos={0 0}, upload=14368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1o2jLTwKNSjxjFEmckxkG1c5EuySK3o3sawGEikd2Ttz4CWfLa): protocol: expected piece hash; context canceled; EOF Aug 9 07:12:13.245678009 (13h46m7.67675814s) [noise=true , address=104.36.82.16:4316 , piece_id=4NPL3A5HFVERECAHTLPRIGBWPFA7QW4L2WTX55W7L2DCYUEG75XA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PPnXDzwXDVDKemw483GXuzQrPN48JJrjeeD7az2NPNawHNaXf): protocol: expected piece hash; context canceled; EOF Aug 9 07:12:13.245759245 (13h46m7.676839366s) [noise=true , address=104.36.82.44:4896 , piece_id=OHFYRMATCJBA2K3HRJ77ZJTOJ3HT7MK7N5JC7NZ52PXEJ35JKWHQ, seg_pos={0 0}, upload=14368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o): protocol: expected piece hash; context canceled; EOF Aug 9 07:12:13.245792349 (13h46m7.67687247s) [noise=true , address=104.36.82.39:4751 , piece_id=ZM64XI6VX7YENY6WSGRMS34XAATUXGEVWPISJMYOXXQB5LLSBJYA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128StmvpG1KYRXeu3gzEEfRmYZgR5ACJRf2xGZcEiZHsfk1KNyr): protocol: expected piece hash; context canceled; EOF Aug 9 07:12:13.245815813 (13h46m7.676895944s) [seg_pos={0 0}, upload=14368]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 07:12:13.245901858 (13h46m7.676981979s) [upload=14368]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 07:12:13.245907359 (13h46m7.67698749s) [upload=14368]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 07:12:13.789706183 (13h46m8.220786304s) [upload=14368]: Done uploading segments... Aug 9 07:12:13.789724909 (13h46m8.22080503s) [upload=14368]: Upload finished. err: <nil> Duration: 5.803040572s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 2.561992811s FAIL (2025-08-09 07:13:46 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 07:10:43.552862473 (13h44m37.983942604s) [upload=14343]: Starting upload Aug 9 07:10:43.552921626 (13h44m37.984001757s) [upload=14343]: Done starting upload Aug 9 07:10:43.553117772 (13h44m37.984197903s) [upload=14343]: Uploading segments... Aug 9 07:10:43.553148400 (13h44m37.984228531s) [upload=14343]: Got next segment. Inline: true Aug 9 07:10:43.553152388 (13h44m37.984232519s) [upload=14343]: Waiting for error group managing segments... Aug 9 07:10:43.553187505 (13h44m37.984267626s) [upload=14343]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 07:10:43.553191663 (13h44m37.984271794s) [upload=14343]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 07:10:43.553194108 (13h44m37.984274239s) [upload=14343]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 07:10:44.670265042 (13h44m39.101345173s) [upload=14343]: Done uploading segments... Aug 9 07:10:44.670283398 (13h44m39.101363529s) [upload=14343]: Upload finished. err: <nil> Duration:* 2.562017448s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 1.935798741s FAIL (2025-08-09 07:13:26 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 07:10:43.552862473 (13h44m37.983942604s) [upload=14343]: Starting upload Aug 9 07:10:43.552921626 (13h44m37.984001757s) [upload=14343]: Done starting upload Aug 9 07:10:43.553117772 (13h44m37.984197903s) [upload=14343]: Uploading segments... Aug 9 07:10:43.553148400 (13h44m37.984228531s) [upload=14343]: Got next segment. Inline: true Aug 9 07:10:43.553152388 (13h44m37.984232519s) [upload=14343]: Waiting for error group managing segments... Aug 9 07:10:43.553187505 (13h44m37.984267626s) [upload=14343]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 07:10:43.553191663 (13h44m37.984271794s) [upload=14343]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 07:10:43.553194108 (13h44m37.984274239s) [upload=14343]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 07:10:44.670265042 (13h44m39.101345173s) [upload=14343]: Done uploading segments... Aug 9 07:10:44.670283398 (13h44m39.101363529s) [upload=14343]: Upload finished. err: <nil> Duration:* 1.935814552s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [................................................X..X..X.....] duration: 6.456115936s FAIL (2025-08-09 07:13:13 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.456143679s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.................................................X..X..X....] duration: 6.254728993s FAIL (2025-08-09 07:12:46 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.25476402s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...........X.........................X....................X.] duration: 5.581825972s FAIL (2025-08-09 07:12:44 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after e3ff044d6ae4076192b1e1fe513b8dabe6c767a5c3203dea27eaa2ec31688bdd != before 663c2bc3be3b2c93bc26181187625e6a4f7893b1381782a3fe391ac4fca8ac68 ======LOGS====== Aug 9 07:12:10.752933843 (13h46m5.184013974s) [upload=14368]: Starting upload Aug 9 07:12:10.752992164 (13h46m5.184072285s) [upload=14368]: Done starting upload Aug 9 07:12:10.753168141 (13h46m5.184248273s) [upload=14368]: Uploading segments... Aug 9 07:12:10.753297318 (13h46m5.184377449s) [upload=14368]: Got next segment. Inline: false Aug 9 07:12:10.753326153 (13h46m5.184406274s) [upload=14368]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 07:12:10.753330122 (13h46m5.184410253s) [upload=14368]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 07:12:11.207655625 (13h46m5.638735756s) [seg_pos={0 0}, upload=14368]: Begin upload segment... Aug 9 07:12:11.207720700 (13h46m5.638800831s) [seg_pos={0 0}, upload=14368]: Done begin upload segment. Aug 9 07:12:11.207743194 (13h46m5.638823325s) [noise=true , address=104.36.82.44:4896 , piece_id=OHFYRMATCJBA2K3HRJ77ZJTOJ3HT7MK7N5JC7NZ52PXEJ35JKWHQ, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.207765646 (13h46m5.638845767s) [noise=true , address=64.49.13.27:4961 , piece_id=GYEU7TP4OXYEYFXENUVQRUA4B6Q75NU52NLSADC2AQ3477QHTBSA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.208227149 (13h46m5.63930728s) [noise=true , address=64.49.13.139:4479 , piece_id=5IUHFINOLUATEGGJW3XJL4KPTUV2NC4YWICUUKHFEKBHSMRIA2RA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.208364321 (13h46m5.639444463s) [noise=true , address=104.36.82.60:4370 , piece_id=T3P6UIMSI73BKLVUYXHWEKOXTEXWVOGFSG2NSVJ3GK6M2LBXSKZA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.208698120 (13h46m5.639778251s) [noise=true , address=104.36.82.8:4981 , piece_id=FOIG62XE46FFMD5UHH2SN6SX7KGFEV5YK72DM6WBFROHGC665ZPA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.209043852 (13h46m5.640123983s) [noise=true , address=104.36.82.59:4324 , piece_id=ZWHTHIGUKE4BGL7XQGQ7SSQOKV2AS7KCKRU3IG7XOPN75FJCCIRA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.209320301 (13h46m5.640400432s) [noise=true , address=64.49.13.169:4715 , piece_id=F4XFTIMZVJQFZ7WPSM65CRORDOAJ5RXNFD2LW7JWRUISIB2OQQTQ, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.209683986 (13h46m5.640764117s) [noise=true , address=64.49.13.170:4724 , piece_id=NGADM4QFZPZV2ZQ3T7D55CW5YASOZA6NCPBA2RECAJQ543YBBXHA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.210169786 (13h46m5.641249917s) [noise=true , address=104.36.82.60:4371 , piece_id=7A4ZKM7IMWTIEPXVP4VWYWXEZZ322WJPV7FNFDHS67OFVQK4QASA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.210381952 (13h46m5.641462083s) [noise=true , address=104.36.82.61:4404 , piece_id=42LT6BXLMKSGA6Q7P3IR4SZZZLAMKUHJO4QWZYULTV5AFMCHPL3Q, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.210636339 (13h46m5.64171647s) [noise=true , address=104.36.82.43:4847 , piece_id=5KKBDZL65I2KSGRPO3OHVV4UBY7XVV2NLTTKOY2BP65ESCKFSSRA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.210856220 (13h46m5.641936351s) [noise=true , address=104.36.82.16:4316 , piece_id=4NPL3A5HFVERECAHTLPRIGBWPFA7QW4L2WTX55W7L2DCYUEG75XA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.211079006 (13h46m5.642159127s) [noise=true , address=104.36.82.14:4237 , piece_id=RLIE5EYM6A7VNRDTTFXJTUV7WJKJ5QDKZEAOMUZYA3QFNWXPQKNQ, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.211304737 (13h46m5.642384868s) [noise=true , address=45.91.116.7:4031 , piece_id=I3M2I7TE2HH6KKY4R7VB5PSNZJXAVCK36UULZ2BLWNKWKTYTJIQQ, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.211491064 (13h46m5.642571195s) [noise=true , address=104.36.82.37:4669 , piece_id=KK2GNVWD6EUIBG77ZIEAH3ZBDDXO4PX2DFCFPWDTCT4KFTG5ESLA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.211981352 (13h46m5.643061483s) [noise=true , address=104.36.82.15:4292 , piece_id=3FMM25ACGF4RPBO66JM4PMB2BC2DCVGCR3JCMWCONRBYSODONGFA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.212224658 (13h46m5.643304789s) [noise=true , address=104.36.82.3:4795 , piece_id=DDRQ7JUPFC5FTKGOT6J4YHIXJXEGPOVQYPV3EQ35RDGHVU3H4OUQ, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.212477902 (13h46m5.643558033s) [noise=true , address=104.36.82.39:4751 , piece_id=ZM64XI6VX7YENY6WSGRMS34XAATUXGEVWPISJMYOXXQB5LLSBJYA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:12.328114668 (13h46m6.759194799s) [upload=14368]: Next returned nil segment Aug 9 07:12:12.328130238 (13h46m6.759210359s) [upload=14368]: Waiting for error group managing segments... Aug 9 07:12:12.615123755 (13h46m7.046203886s) [noise=true , address=64.49.13.170:4724 , piece_id=NGADM4QFZPZV2ZQ3T7D55CW5YASOZA6NCPBA2RECAJQ543YBBXHA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:12.633849403 (13h46m7.064929534s) [noise=true , address=64.49.13.139:4479 , piece_id=5IUHFINOLUATEGGJW3XJL4KPTUV2NC4YWICUUKHFEKBHSMRIA2RA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:12.637449872 (13h46m7.068530003s) [noise=true , address=64.49.13.27:4961 , piece_id=GYEU7TP4OXYEYFXENUVQRUA4B6Q75NU52NLSADC2AQ3477QHTBSA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:12.650403255 (13h46m7.081483387s) [noise=true , address=64.49.13.169:4715 , piece_id=F4XFTIMZVJQFZ7WPSM65CRORDOAJ5RXNFD2LW7JWRUISIB2OQQTQ, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.137896401 (13h46m7.568976532s) [noise=true , address=104.36.82.60:4371 , piece_id=7A4ZKM7IMWTIEPXVP4VWYWXEZZ322WJPV7FNFDHS67OFVQK4QASA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.139324974 (13h46m7.570405095s) [noise=true , address=104.36.82.8:4981 , piece_id=FOIG62XE46FFMD5UHH2SN6SX7KGFEV5YK72DM6WBFROHGC665ZPA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.146401663 (13h46m7.577481794s) [noise=true , address=45.91.116.7:4031 , piece_id=I3M2I7TE2HH6KKY4R7VB5PSNZJXAVCK36UULZ2BLWNKWKTYTJIQQ, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.161160482 (13h46m7.592240603s) [noise=true , address=104.36.82.43:4847 , piece_id=5KKBDZL65I2KSGRPO3OHVV4UBY7XVV2NLTTKOY2BP65ESCKFSSRA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.165737920 (13h46m7.596818041s) [noise=true , address=104.36.82.15:4292 , piece_id=3FMM25ACGF4RPBO66JM4PMB2BC2DCVGCR3JCMWCONRBYSODONGFA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.168998608 (13h46m7.600078729s) [noise=true , address=104.36.82.60:4370 , piece_id=T3P6UIMSI73BKLVUYXHWEKOXTEXWVOGFSG2NSVJ3GK6M2LBXSKZA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.209005594 (13h46m7.640085725s) [noise=true , address=104.36.82.59:4324 , piece_id=ZWHTHIGUKE4BGL7XQGQ7SSQOKV2AS7KCKRU3IG7XOPN75FJCCIRA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.229451654 (13h46m7.660531785s) [noise=true , address=104.36.82.3:4795 , piece_id=DDRQ7JUPFC5FTKGOT6J4YHIXJXEGPOVQYPV3EQ35RDGHVU3H4OUQ, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.238304101 (13h46m7.669384232s) [noise=true , address=104.36.82.61:4404 , piece_id=42LT6BXLMKSGA6Q7P3IR4SZZZLAMKUHJO4QWZYULTV5AFMCHPL3Q, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.245475733 (13h46m7.676555854s) [noise=true , address=104.36.82.37:4669 , piece_id=KK2GNVWD6EUIBG77ZIEAH3ZBDDXO4PX2DFCFPWDTCT4KFTG5ESLA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.245503065 (13h46m7.676583196s) [seg_pos={0 0}, upload=14368]: Segment reached optimal threshold of 14 pieces. Aug 9 07:12:13.245606703 (13h46m7.676686834s) [noise=true , address=104.36.82.14:4237 , piece_id=RLIE5EYM6A7VNRDTTFXJTUV7WJKJ5QDKZEAOMUZYA3QFNWXPQKNQ, seg_pos={0 0}, upload=14368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1o2jLTwKNSjxjFEmckxkG1c5EuySK3o3sawGEikd2Ttz4CWfLa): protocol: expected piece hash; context canceled; EOF Aug 9 07:12:13.245678009 (13h46m7.67675814s) [noise=true , address=104.36.82.16:4316 , piece_id=4NPL3A5HFVERECAHTLPRIGBWPFA7QW4L2WTX55W7L2DCYUEG75XA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PPnXDzwXDVDKemw483GXuzQrPN48JJrjeeD7az2NPNawHNaXf): protocol: expected piece hash; context canceled; EOF Aug 9 07:12:13.245759245 (13h46m7.676839366s) [noise=true , address=104.36.82.44:4896 , piece_id=OHFYRMATCJBA2K3HRJ77ZJTOJ3HT7MK7N5JC7NZ52PXEJ35JKWHQ, seg_pos={0 0}, upload=14368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o): protocol: expected piece hash; context canceled; EOF Aug 9 07:12:13.245792349 (13h46m7.67687247s) [noise=true , address=104.36.82.39:4751 , piece_id=ZM64XI6VX7YENY6WSGRMS34XAATUXGEVWPISJMYOXXQB5LLSBJYA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128StmvpG1KYRXeu3gzEEfRmYZgR5ACJRf2xGZcEiZHsfk1KNyr): protocol: expected piece hash; context canceled; EOF Aug 9 07:12:13.245815813 (13h46m7.676895944s) [seg_pos={0 0}, upload=14368]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 07:12:13.245901858 (13h46m7.676981979s) [upload=14368]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 07:12:13.245907359 (13h46m7.67698749s) [upload=14368]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 07:12:13.789706183 (13h46m8.220786304s) [upload=14368]: Done uploading segments... Aug 9 07:12:13.789724909 (13h46m8.22080503s) [upload=14368]: Upload finished. err: <nil> Duration: 5.581855989s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 2.230900972s FAIL (2025-08-09 07:12:32 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 07:10:43.552862473 (13h44m37.983942604s) [upload=14343]: Starting upload Aug 9 07:10:43.552921626 (13h44m37.984001757s) [upload=14343]: Done starting upload Aug 9 07:10:43.553117772 (13h44m37.984197903s) [upload=14343]: Uploading segments... Aug 9 07:10:43.553148400 (13h44m37.984228531s) [upload=14343]: Got next segment. Inline: true Aug 9 07:10:43.553152388 (13h44m37.984232519s) [upload=14343]: Waiting for error group managing segments... Aug 9 07:10:43.553187505 (13h44m37.984267626s) [upload=14343]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 07:10:43.553191663 (13h44m37.984271794s) [upload=14343]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 07:10:43.553194108 (13h44m37.984274239s) [upload=14343]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 07:10:44.670265042 (13h44m39.101345173s) [upload=14343]: Done uploading segments... Aug 9 07:10:44.670283398 (13h44m39.101363529s) [upload=14343]: Upload finished. err: <nil> Duration:* 2.230929637s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [X...........X.........................X....................X] duration: 5.863364912s FAIL (2025-08-09 07:12:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after e3ff044d6ae4076192b1e1fe513b8dabe6c767a5c3203dea27eaa2ec31688bdd != before 663c2bc3be3b2c93bc26181187625e6a4f7893b1381782a3fe391ac4fca8ac68 ======LOGS====== Aug 9 07:12:10.752933843 (13h46m5.184013974s) [upload=14368]: Starting upload Aug 9 07:12:10.752992164 (13h46m5.184072285s) [upload=14368]: Done starting upload Aug 9 07:12:10.753168141 (13h46m5.184248273s) [upload=14368]: Uploading segments... Aug 9 07:12:10.753297318 (13h46m5.184377449s) [upload=14368]: Got next segment. Inline: false Aug 9 07:12:10.753326153 (13h46m5.184406274s) [upload=14368]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 07:12:10.753330122 (13h46m5.184410253s) [upload=14368]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 07:12:11.207655625 (13h46m5.638735756s) [seg_pos={0 0}, upload=14368]: Begin upload segment... Aug 9 07:12:11.207720700 (13h46m5.638800831s) [seg_pos={0 0}, upload=14368]: Done begin upload segment. Aug 9 07:12:11.207743194 (13h46m5.638823325s) [noise=true , address=104.36.82.44:4896 , piece_id=OHFYRMATCJBA2K3HRJ77ZJTOJ3HT7MK7N5JC7NZ52PXEJ35JKWHQ, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.207765646 (13h46m5.638845767s) [noise=true , address=64.49.13.27:4961 , piece_id=GYEU7TP4OXYEYFXENUVQRUA4B6Q75NU52NLSADC2AQ3477QHTBSA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.208227149 (13h46m5.63930728s) [noise=true , address=64.49.13.139:4479 , piece_id=5IUHFINOLUATEGGJW3XJL4KPTUV2NC4YWICUUKHFEKBHSMRIA2RA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.208364321 (13h46m5.639444463s) [noise=true , address=104.36.82.60:4370 , piece_id=T3P6UIMSI73BKLVUYXHWEKOXTEXWVOGFSG2NSVJ3GK6M2LBXSKZA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.208698120 (13h46m5.639778251s) [noise=true , address=104.36.82.8:4981 , piece_id=FOIG62XE46FFMD5UHH2SN6SX7KGFEV5YK72DM6WBFROHGC665ZPA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.209043852 (13h46m5.640123983s) [noise=true , address=104.36.82.59:4324 , piece_id=ZWHTHIGUKE4BGL7XQGQ7SSQOKV2AS7KCKRU3IG7XOPN75FJCCIRA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.209320301 (13h46m5.640400432s) [noise=true , address=64.49.13.169:4715 , piece_id=F4XFTIMZVJQFZ7WPSM65CRORDOAJ5RXNFD2LW7JWRUISIB2OQQTQ, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.209683986 (13h46m5.640764117s) [noise=true , address=64.49.13.170:4724 , piece_id=NGADM4QFZPZV2ZQ3T7D55CW5YASOZA6NCPBA2RECAJQ543YBBXHA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.210169786 (13h46m5.641249917s) [noise=true , address=104.36.82.60:4371 , piece_id=7A4ZKM7IMWTIEPXVP4VWYWXEZZ322WJPV7FNFDHS67OFVQK4QASA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.210381952 (13h46m5.641462083s) [noise=true , address=104.36.82.61:4404 , piece_id=42LT6BXLMKSGA6Q7P3IR4SZZZLAMKUHJO4QWZYULTV5AFMCHPL3Q, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.210636339 (13h46m5.64171647s) [noise=true , address=104.36.82.43:4847 , piece_id=5KKBDZL65I2KSGRPO3OHVV4UBY7XVV2NLTTKOY2BP65ESCKFSSRA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.210856220 (13h46m5.641936351s) [noise=true , address=104.36.82.16:4316 , piece_id=4NPL3A5HFVERECAHTLPRIGBWPFA7QW4L2WTX55W7L2DCYUEG75XA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.211079006 (13h46m5.642159127s) [noise=true , address=104.36.82.14:4237 , piece_id=RLIE5EYM6A7VNRDTTFXJTUV7WJKJ5QDKZEAOMUZYA3QFNWXPQKNQ, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.211304737 (13h46m5.642384868s) [noise=true , address=45.91.116.7:4031 , piece_id=I3M2I7TE2HH6KKY4R7VB5PSNZJXAVCK36UULZ2BLWNKWKTYTJIQQ, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.211491064 (13h46m5.642571195s) [noise=true , address=104.36.82.37:4669 , piece_id=KK2GNVWD6EUIBG77ZIEAH3ZBDDXO4PX2DFCFPWDTCT4KFTG5ESLA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.211981352 (13h46m5.643061483s) [noise=true , address=104.36.82.15:4292 , piece_id=3FMM25ACGF4RPBO66JM4PMB2BC2DCVGCR3JCMWCONRBYSODONGFA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.212224658 (13h46m5.643304789s) [noise=true , address=104.36.82.3:4795 , piece_id=DDRQ7JUPFC5FTKGOT6J4YHIXJXEGPOVQYPV3EQ35RDGHVU3H4OUQ, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:11.212477902 (13h46m5.643558033s) [noise=true , address=104.36.82.39:4751 , piece_id=ZM64XI6VX7YENY6WSGRMS34XAATUXGEVWPISJMYOXXQB5LLSBJYA, seg_pos={0 0}, upload=14368]: Uploading piece... Aug 9 07:12:12.328114668 (13h46m6.759194799s) [upload=14368]: Next returned nil segment Aug 9 07:12:12.328130238 (13h46m6.759210359s) [upload=14368]: Waiting for error group managing segments... Aug 9 07:12:12.615123755 (13h46m7.046203886s) [noise=true , address=64.49.13.170:4724 , piece_id=NGADM4QFZPZV2ZQ3T7D55CW5YASOZA6NCPBA2RECAJQ543YBBXHA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:12.633849403 (13h46m7.064929534s) [noise=true , address=64.49.13.139:4479 , piece_id=5IUHFINOLUATEGGJW3XJL4KPTUV2NC4YWICUUKHFEKBHSMRIA2RA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:12.637449872 (13h46m7.068530003s) [noise=true , address=64.49.13.27:4961 , piece_id=GYEU7TP4OXYEYFXENUVQRUA4B6Q75NU52NLSADC2AQ3477QHTBSA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:12.650403255 (13h46m7.081483387s) [noise=true , address=64.49.13.169:4715 , piece_id=F4XFTIMZVJQFZ7WPSM65CRORDOAJ5RXNFD2LW7JWRUISIB2OQQTQ, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.137896401 (13h46m7.568976532s) [noise=true , address=104.36.82.60:4371 , piece_id=7A4ZKM7IMWTIEPXVP4VWYWXEZZ322WJPV7FNFDHS67OFVQK4QASA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.139324974 (13h46m7.570405095s) [noise=true , address=104.36.82.8:4981 , piece_id=FOIG62XE46FFMD5UHH2SN6SX7KGFEV5YK72DM6WBFROHGC665ZPA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.146401663 (13h46m7.577481794s) [noise=true , address=45.91.116.7:4031 , piece_id=I3M2I7TE2HH6KKY4R7VB5PSNZJXAVCK36UULZ2BLWNKWKTYTJIQQ, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.161160482 (13h46m7.592240603s) [noise=true , address=104.36.82.43:4847 , piece_id=5KKBDZL65I2KSGRPO3OHVV4UBY7XVV2NLTTKOY2BP65ESCKFSSRA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.165737920 (13h46m7.596818041s) [noise=true , address=104.36.82.15:4292 , piece_id=3FMM25ACGF4RPBO66JM4PMB2BC2DCVGCR3JCMWCONRBYSODONGFA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.168998608 (13h46m7.600078729s) [noise=true , address=104.36.82.60:4370 , piece_id=T3P6UIMSI73BKLVUYXHWEKOXTEXWVOGFSG2NSVJ3GK6M2LBXSKZA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.209005594 (13h46m7.640085725s) [noise=true , address=104.36.82.59:4324 , piece_id=ZWHTHIGUKE4BGL7XQGQ7SSQOKV2AS7KCKRU3IG7XOPN75FJCCIRA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.229451654 (13h46m7.660531785s) [noise=true , address=104.36.82.3:4795 , piece_id=DDRQ7JUPFC5FTKGOT6J4YHIXJXEGPOVQYPV3EQ35RDGHVU3H4OUQ, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.238304101 (13h46m7.669384232s) [noise=true , address=104.36.82.61:4404 , piece_id=42LT6BXLMKSGA6Q7P3IR4SZZZLAMKUHJO4QWZYULTV5AFMCHPL3Q, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.245475733 (13h46m7.676555854s) [noise=true , address=104.36.82.37:4669 , piece_id=KK2GNVWD6EUIBG77ZIEAH3ZBDDXO4PX2DFCFPWDTCT4KFTG5ESLA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: <nil> Aug 9 07:12:13.245503065 (13h46m7.676583196s) [seg_pos={0 0}, upload=14368]: Segment reached optimal threshold of 14 pieces. Aug 9 07:12:13.245606703 (13h46m7.676686834s) [noise=true , address=104.36.82.14:4237 , piece_id=RLIE5EYM6A7VNRDTTFXJTUV7WJKJ5QDKZEAOMUZYA3QFNWXPQKNQ, seg_pos={0 0}, upload=14368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1o2jLTwKNSjxjFEmckxkG1c5EuySK3o3sawGEikd2Ttz4CWfLa): protocol: expected piece hash; context canceled; EOF Aug 9 07:12:13.245678009 (13h46m7.67675814s) [noise=true , address=104.36.82.16:4316 , piece_id=4NPL3A5HFVERECAHTLPRIGBWPFA7QW4L2WTX55W7L2DCYUEG75XA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PPnXDzwXDVDKemw483GXuzQrPN48JJrjeeD7az2NPNawHNaXf): protocol: expected piece hash; context canceled; EOF Aug 9 07:12:13.245759245 (13h46m7.676839366s) [noise=true , address=104.36.82.44:4896 , piece_id=OHFYRMATCJBA2K3HRJ77ZJTOJ3HT7MK7N5JC7NZ52PXEJ35JKWHQ, seg_pos={0 0}, upload=14368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o): protocol: expected piece hash; context canceled; EOF Aug 9 07:12:13.245792349 (13h46m7.67687247s) [noise=true , address=104.36.82.39:4751 , piece_id=ZM64XI6VX7YENY6WSGRMS34XAATUXGEVWPISJMYOXXQB5LLSBJYA, seg_pos={0 0}, upload=14368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128StmvpG1KYRXeu3gzEEfRmYZgR5ACJRf2xGZcEiZHsfk1KNyr): protocol: expected piece hash; context canceled; EOF Aug 9 07:12:13.245815813 (13h46m7.676895944s) [seg_pos={0 0}, upload=14368]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 07:12:13.245901858 (13h46m7.676981979s) [upload=14368]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 07:12:13.245907359 (13h46m7.67698749s) [upload=14368]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 07:12:13.789706183 (13h46m8.220786304s) [upload=14368]: Done uploading segments... Aug 9 07:12:13.789724909 (13h46m8.22080503s) [upload=14368]: Upload finished. err: <nil> Duration: 5.863385972s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 1.796890316s FAIL (2025-08-09 07:11:49 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 07:10:43.552862473 (13h44m37.983942604s) [upload=14343]: Starting upload Aug 9 07:10:43.552921626 (13h44m37.984001757s) [upload=14343]: Done starting upload Aug 9 07:10:43.553117772 (13h44m37.984197903s) [upload=14343]: Uploading segments... Aug 9 07:10:43.553148400 (13h44m37.984228531s) [upload=14343]: Got next segment. Inline: true Aug 9 07:10:43.553152388 (13h44m37.984232519s) [upload=14343]: Waiting for error group managing segments... Aug 9 07:10:43.553187505 (13h44m37.984267626s) [upload=14343]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 07:10:43.553191663 (13h44m37.984271794s) [upload=14343]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 07:10:43.553194108 (13h44m37.984274239s) [upload=14343]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 07:10:44.670265042 (13h44m39.101345173s) [upload=14343]: Done uploading segments... Aug 9 07:10:44.670283398 (13h44m39.101363529s) [upload=14343]: Upload finished. err: <nil> Duration:* 1.796916627s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [..................................................X..X..X...] duration: 6.655088265s FAIL (2025-08-09 07:11:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.65511208s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.X...........X.........................X....................] duration: 5.644416825s FAIL (2025-08-09 07:11:17 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 06:53:23.698655854 (13h27m18.129735985s) [upload=14047]: Starting upload Aug 9 06:53:23.698701853 (13h27m18.129781984s) [upload=14047]: Done starting upload Aug 9 06:53:23.698818386 (13h27m18.129898517s) [upload=14047]: Uploading segments... Aug 9 06:53:23.698936432 (13h27m18.130016563s) [upload=14047]: Got next segment. Inline: false Aug 9 06:53:23.698961630 (13h27m18.130041751s) [upload=14047]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 06:53:23.698965578 (13h27m18.130045709s) [upload=14047]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 06:53:24.147107598 (13h27m18.578187729s) [seg_pos={0 0}, upload=14047]: Begin upload segment... Aug 9 06:53:24.147148396 (13h27m18.578228527s) [seg_pos={0 0}, upload=14047]: Done begin upload segment. Aug 9 06:53:24.147167211 (13h27m18.578247332s) [noise=true , address=104.36.82.53:4148 , piece_id=PBFRQR2HU2V6CKDDHTWDSTZOLENV5CF62TVT27MB3FTQFKHC52EA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147175809 (13h27m18.57825594s) [noise=true , address=64.49.13.138:4488 , piece_id=F5IF7WY3WR47RA4YVR4STHJWU42I4DOBWU6TBXLNFBC66E4DWIFA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147518354 (13h27m18.578598485s) [noise=true , address=104.36.82.62:4415 , piece_id=X4UVHS5A7SSUREOM2Q7BKZMNMGWHMLTSZJJ3GEOB4YYIVEZTFVQQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147522181 (13h27m18.578602312s) [noise=true , address=104.36.82.56:4240 , piece_id=VOC4BN7IZPU5CHDJNZZ4KABZ4HAZDGUWSBE77SISEHXVYN7XXPCQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147796335 (13h27m18.578876466s) [noise=true , address=104.36.82.46:4507 , piece_id=YEY6UXEN3NOPA2K7MDIFOAALSFEZBOLIIBC5MJHLCJMDDUIH3TLQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147802567 (13h27m18.578882698s) [noise=true , address=104.36.82.2:4759 , piece_id=666T4FY5B22N44774DXRPYMDDHV7RIYBTKW6SRP6N72T3Y5MOXRA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148101780 (13h27m18.579181911s) [noise=true , address=104.36.82.37:4676 , piece_id=KZTTGDTIL7SZWAXQTHCFHAWAHQ7YA7ABCFKJDNTGHXASIA757BOA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148146495 (13h27m18.579226627s) [noise=true , address=104.36.82.35:4609 , piece_id=QDZD247HRDA66EXEE7YDK6K3OSBG5ILBLAWGPHX7QT4RBHD4A5XA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148380853 (13h27m18.579460984s) [noise=true , address=104.36.82.23:4473 , piece_id=PMYUW3E2H7D7SLPNMU4VYGFIVZVVY5WG3NKAQ725IQCEZADLZO4Q, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148440258 (13h27m18.579520379s) [noise=true , address=104.36.82.43:4843 , piece_id=QHDB7EE2RAOL4FHF2KSPIHFJJJ66ZSMYSMWQEDF2HMPNG6RCQZSA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148676068 (13h27m18.57975622s) [noise=true , address=104.36.82.44:4903 , piece_id=LXHMV2U2MJCTDODM5FGN6LVBA43FPJ74CNJCTTGUGD6DEODIFNNA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148708771 (13h27m18.579788902s) [noise=true , address=104.36.82.17:4339 , piece_id=IDJB6R6JA3UEX2NSOLS32F2GGPDYK2YOJDPMFCBDVPHHX4NYC4FQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148907121 (13h27m18.579987252s) [noise=true , address=104.36.82.58:4274 , piece_id=ORKTJIO2PWDE42CILRXXLGMVWGTMHN4UMHNVOY6GYF5INLX7SDYQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148929253 (13h27m18.580009374s) [noise=true , address=104.36.82.9:4009 , piece_id=XHFRPO3N3UZ3P6EJQNXOUTEPEZ47QRMPUF67SDYD7N6BXZJKMKHQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.149162189 (13h27m18.58024232s) [noise=true , address=104.36.82.35:4586 , piece_id=ST4P74ZRAEEKG3SYKKUGDJO7YBKTK257QHACXEEORBO2ZF6HD5SQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.149190884 (13h27m18.580271015s) [noise=true , address=104.36.82.59:4304 , piece_id=YZGOJYVR5IKG6VJKBVSSEFUKI4OHH6WZ3RZDOZGNWOFZYONQ7PQA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.149437786 (13h27m18.580517917s) [noise=true , address=104.36.82.20:4459 , piece_id=KLMZ23ZYRGLMIT7W6HNYPLAZTBY3RYRB6MX6AJMXHXPUXPA2SYFA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.149710999 (13h27m18.58079113s) [noise=true , address=104.36.82.19:4405 , piece_id=B45PJFW7IS5AFP6M6A22RJ362ZY6KXIL2UFZKWLAKJPRUVEMRYWQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:25.315864117 (13h27m19.746944248s) [upload=14047]: Next returned nil segment Aug 9 06:53:25.315886619 (13h27m19.746966751s) [upload=14047]: Waiting for error group managing segments... Aug 9 06:53:25.610133629 (13h27m20.04121375s) [noise=true , address=64.49.13.138:4488 , piece_id=F5IF7WY3WR47RA4YVR4STHJWU42I4DOBWU6TBXLNFBC66E4DWIFA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.044777484 (13h27m20.475857615s) [noise=true , address=104.36.82.59:4304 , piece_id=YZGOJYVR5IKG6VJKBVSSEFUKI4OHH6WZ3RZDOZGNWOFZYONQ7PQA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.049095655 (13h27m20.480175786s) [noise=true , address=104.36.82.62:4415 , piece_id=X4UVHS5A7SSUREOM2Q7BKZMNMGWHMLTSZJJ3GEOB4YYIVEZTFVQQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.053167005 (13h27m20.484247126s) [noise=true , address=104.36.82.35:4609 , piece_id=QDZD247HRDA66EXEE7YDK6K3OSBG5ILBLAWGPHX7QT4RBHD4A5XA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.073521951 (13h27m20.504602082s) [noise=true , address=104.36.82.19:4405 , piece_id=B45PJFW7IS5AFP6M6A22RJ362ZY6KXIL2UFZKWLAKJPRUVEMRYWQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.080957829 (13h27m20.51203796s) [noise=true , address=104.36.82.17:4339 , piece_id=IDJB6R6JA3UEX2NSOLS32F2GGPDYK2YOJDPMFCBDVPHHX4NYC4FQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.114325732 (13h27m20.545405863s) [noise=true , address=104.36.82.46:4507 , piece_id=YEY6UXEN3NOPA2K7MDIFOAALSFEZBOLIIBC5MJHLCJMDDUIH3TLQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.115488496 (13h27m20.546568617s) [noise=true , address=104.36.82.9:4009 , piece_id=XHFRPO3N3UZ3P6EJQNXOUTEPEZ47QRMPUF67SDYD7N6BXZJKMKHQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.137155292 (13h27m20.568235433s) [noise=true , address=104.36.82.35:4586 , piece_id=ST4P74ZRAEEKG3SYKKUGDJO7YBKTK257QHACXEEORBO2ZF6HD5SQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.137440217 (13h27m20.568520338s) [noise=true , address=104.36.82.2:4759 , piece_id=666T4FY5B22N44774DXRPYMDDHV7RIYBTKW6SRP6N72T3Y5MOXRA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.143705214 (13h27m20.574785335s) [noise=true , address=104.36.82.43:4843 , piece_id=QHDB7EE2RAOL4FHF2KSPIHFJJJ66ZSMYSMWQEDF2HMPNG6RCQZSA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.148334121 (13h27m20.579414252s) [noise=true , address=104.36.82.20:4459 , piece_id=KLMZ23ZYRGLMIT7W6HNYPLAZTBY3RYRB6MX6AJMXHXPUXPA2SYFA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.158708109 (13h27m20.589788241s) [noise=true , address=104.36.82.58:4274 , piece_id=ORKTJIO2PWDE42CILRXXLGMVWGTMHN4UMHNVOY6GYF5INLX7SDYQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.165754843 (13h27m20.596834974s) [noise=true , address=104.36.82.56:4240 , piece_id=VOC4BN7IZPU5CHDJNZZ4KABZ4HAZDGUWSBE77SISEHXVYN7XXPCQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.165787094 (13h27m20.596867225s) [seg_pos={0 0}, upload=14047]: Segment reached optimal threshold of 14 pieces. Aug 9 06:53:26.165906083 (13h27m20.596986214s) [noise=true , address=104.36.82.44:4903 , piece_id=LXHMV2U2MJCTDODM5FGN6LVBA43FPJ74CNJCTTGUGD6DEODIFNNA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq): protocol: expected piece hash; context canceled; EOF Aug 9 06:53:26.165964404 (13h27m20.597044535s) [noise=true , address=104.36.82.37:4676 , piece_id=KZTTGDTIL7SZWAXQTHCFHAWAHQ7YA7ABCFKJDNTGHXASIA757BOA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yqKh7gMSrXWavfChEJRX7tV5rS9xTSo4SbmgPMtnYKfgbvF8): protocol: expected piece hash; context canceled; EOF Aug 9 06:53:26.166011994 (13h27m20.597092125s) [noise=true , address=104.36.82.23:4473 , piece_id=PMYUW3E2H7D7SLPNMU4VYGFIVZVVY5WG3NKAQ725IQCEZADLZO4Q, seg_pos={0 0}, upload=14047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 9 06:53:26.166086076 (13h27m20.597166207s) [noise=true , address=104.36.82.53:4148 , piece_id=PBFRQR2HU2V6CKDDHTWDSTZOLENV5CF62TVT27MB3FTQFKHC52EA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GGwKp8TvH5JJ8mcR4sqKcGMCc56hMEgWpAR3zqTWerqTLQ9Rv): protocol: expected piece hash; context canceled; EOF Aug 9 06:53:26.166132165 (13h27m20.597212286s) [seg_pos={0 0}, upload=14047]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 06:53:26.166221175 (13h27m20.597301306s) [upload=14047]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 06:53:26.166226024 (13h27m20.597306145s) [upload=14047]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 06:53:26.553951687 (13h27m20.985031819s) [upload=14047]: Done uploading segments... Aug 9 06:53:26.553971185 (13h27m20.985051316s) [upload=14047]: Upload finished. err: <nil> Duration: 5.644441452s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 2.223860903s FAIL (2025-08-09 07:10:45 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 07:10:43.552862473 (13h44m37.983942604s) [upload=14343]: Starting upload Aug 9 07:10:43.552921626 (13h44m37.984001757s) [upload=14343]: Done starting upload Aug 9 07:10:43.553117772 (13h44m37.984197903s) [upload=14343]: Uploading segments... Aug 9 07:10:43.553148400 (13h44m37.984228531s) [upload=14343]: Got next segment. Inline: true Aug 9 07:10:43.553152388 (13h44m37.984232519s) [upload=14343]: Waiting for error group managing segments... Aug 9 07:10:43.553187505 (13h44m37.984267626s) [upload=14343]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 07:10:43.553191663 (13h44m37.984271794s) [upload=14343]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 07:10:43.553194108 (13h44m37.984274239s) [upload=14343]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 07:10:44.670265042 (13h44m39.101345173s) [upload=14343]: Done uploading segments... Aug 9 07:10:44.670283398 (13h44m39.101363529s) [upload=14343]: Upload finished. err: <nil> Duration:* 2.22388652s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..X...........X.........................X...................] duration: 5.825645995s FAIL (2025-08-09 07:10:24 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 06:53:23.698655854 (13h27m18.129735985s) [upload=14047]: Starting upload Aug 9 06:53:23.698701853 (13h27m18.129781984s) [upload=14047]: Done starting upload Aug 9 06:53:23.698818386 (13h27m18.129898517s) [upload=14047]: Uploading segments... Aug 9 06:53:23.698936432 (13h27m18.130016563s) [upload=14047]: Got next segment. Inline: false Aug 9 06:53:23.698961630 (13h27m18.130041751s) [upload=14047]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 06:53:23.698965578 (13h27m18.130045709s) [upload=14047]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 06:53:24.147107598 (13h27m18.578187729s) [seg_pos={0 0}, upload=14047]: Begin upload segment... Aug 9 06:53:24.147148396 (13h27m18.578228527s) [seg_pos={0 0}, upload=14047]: Done begin upload segment. Aug 9 06:53:24.147167211 (13h27m18.578247332s) [noise=true , address=104.36.82.53:4148 , piece_id=PBFRQR2HU2V6CKDDHTWDSTZOLENV5CF62TVT27MB3FTQFKHC52EA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147175809 (13h27m18.57825594s) [noise=true , address=64.49.13.138:4488 , piece_id=F5IF7WY3WR47RA4YVR4STHJWU42I4DOBWU6TBXLNFBC66E4DWIFA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147518354 (13h27m18.578598485s) [noise=true , address=104.36.82.62:4415 , piece_id=X4UVHS5A7SSUREOM2Q7BKZMNMGWHMLTSZJJ3GEOB4YYIVEZTFVQQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147522181 (13h27m18.578602312s) [noise=true , address=104.36.82.56:4240 , piece_id=VOC4BN7IZPU5CHDJNZZ4KABZ4HAZDGUWSBE77SISEHXVYN7XXPCQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147796335 (13h27m18.578876466s) [noise=true , address=104.36.82.46:4507 , piece_id=YEY6UXEN3NOPA2K7MDIFOAALSFEZBOLIIBC5MJHLCJMDDUIH3TLQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147802567 (13h27m18.578882698s) [noise=true , address=104.36.82.2:4759 , piece_id=666T4FY5B22N44774DXRPYMDDHV7RIYBTKW6SRP6N72T3Y5MOXRA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148101780 (13h27m18.579181911s) [noise=true , address=104.36.82.37:4676 , piece_id=KZTTGDTIL7SZWAXQTHCFHAWAHQ7YA7ABCFKJDNTGHXASIA757BOA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148146495 (13h27m18.579226627s) [noise=true , address=104.36.82.35:4609 , piece_id=QDZD247HRDA66EXEE7YDK6K3OSBG5ILBLAWGPHX7QT4RBHD4A5XA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148380853 (13h27m18.579460984s) [noise=true , address=104.36.82.23:4473 , piece_id=PMYUW3E2H7D7SLPNMU4VYGFIVZVVY5WG3NKAQ725IQCEZADLZO4Q, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148440258 (13h27m18.579520379s) [noise=true , address=104.36.82.43:4843 , piece_id=QHDB7EE2RAOL4FHF2KSPIHFJJJ66ZSMYSMWQEDF2HMPNG6RCQZSA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148676068 (13h27m18.57975622s) [noise=true , address=104.36.82.44:4903 , piece_id=LXHMV2U2MJCTDODM5FGN6LVBA43FPJ74CNJCTTGUGD6DEODIFNNA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148708771 (13h27m18.579788902s) [noise=true , address=104.36.82.17:4339 , piece_id=IDJB6R6JA3UEX2NSOLS32F2GGPDYK2YOJDPMFCBDVPHHX4NYC4FQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148907121 (13h27m18.579987252s) [noise=true , address=104.36.82.58:4274 , piece_id=ORKTJIO2PWDE42CILRXXLGMVWGTMHN4UMHNVOY6GYF5INLX7SDYQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148929253 (13h27m18.580009374s) [noise=true , address=104.36.82.9:4009 , piece_id=XHFRPO3N3UZ3P6EJQNXOUTEPEZ47QRMPUF67SDYD7N6BXZJKMKHQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.149162189 (13h27m18.58024232s) [noise=true , address=104.36.82.35:4586 , piece_id=ST4P74ZRAEEKG3SYKKUGDJO7YBKTK257QHACXEEORBO2ZF6HD5SQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.149190884 (13h27m18.580271015s) [noise=true , address=104.36.82.59:4304 , piece_id=YZGOJYVR5IKG6VJKBVSSEFUKI4OHH6WZ3RZDOZGNWOFZYONQ7PQA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.149437786 (13h27m18.580517917s) [noise=true , address=104.36.82.20:4459 , piece_id=KLMZ23ZYRGLMIT7W6HNYPLAZTBY3RYRB6MX6AJMXHXPUXPA2SYFA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.149710999 (13h27m18.58079113s) [noise=true , address=104.36.82.19:4405 , piece_id=B45PJFW7IS5AFP6M6A22RJ362ZY6KXIL2UFZKWLAKJPRUVEMRYWQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:25.315864117 (13h27m19.746944248s) [upload=14047]: Next returned nil segment Aug 9 06:53:25.315886619 (13h27m19.746966751s) [upload=14047]: Waiting for error group managing segments... Aug 9 06:53:25.610133629 (13h27m20.04121375s) [noise=true , address=64.49.13.138:4488 , piece_id=F5IF7WY3WR47RA4YVR4STHJWU42I4DOBWU6TBXLNFBC66E4DWIFA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.044777484 (13h27m20.475857615s) [noise=true , address=104.36.82.59:4304 , piece_id=YZGOJYVR5IKG6VJKBVSSEFUKI4OHH6WZ3RZDOZGNWOFZYONQ7PQA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.049095655 (13h27m20.480175786s) [noise=true , address=104.36.82.62:4415 , piece_id=X4UVHS5A7SSUREOM2Q7BKZMNMGWHMLTSZJJ3GEOB4YYIVEZTFVQQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.053167005 (13h27m20.484247126s) [noise=true , address=104.36.82.35:4609 , piece_id=QDZD247HRDA66EXEE7YDK6K3OSBG5ILBLAWGPHX7QT4RBHD4A5XA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.073521951 (13h27m20.504602082s) [noise=true , address=104.36.82.19:4405 , piece_id=B45PJFW7IS5AFP6M6A22RJ362ZY6KXIL2UFZKWLAKJPRUVEMRYWQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.080957829 (13h27m20.51203796s) [noise=true , address=104.36.82.17:4339 , piece_id=IDJB6R6JA3UEX2NSOLS32F2GGPDYK2YOJDPMFCBDVPHHX4NYC4FQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.114325732 (13h27m20.545405863s) [noise=true , address=104.36.82.46:4507 , piece_id=YEY6UXEN3NOPA2K7MDIFOAALSFEZBOLIIBC5MJHLCJMDDUIH3TLQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.115488496 (13h27m20.546568617s) [noise=true , address=104.36.82.9:4009 , piece_id=XHFRPO3N3UZ3P6EJQNXOUTEPEZ47QRMPUF67SDYD7N6BXZJKMKHQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.137155292 (13h27m20.568235433s) [noise=true , address=104.36.82.35:4586 , piece_id=ST4P74ZRAEEKG3SYKKUGDJO7YBKTK257QHACXEEORBO2ZF6HD5SQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.137440217 (13h27m20.568520338s) [noise=true , address=104.36.82.2:4759 , piece_id=666T4FY5B22N44774DXRPYMDDHV7RIYBTKW6SRP6N72T3Y5MOXRA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.143705214 (13h27m20.574785335s) [noise=true , address=104.36.82.43:4843 , piece_id=QHDB7EE2RAOL4FHF2KSPIHFJJJ66ZSMYSMWQEDF2HMPNG6RCQZSA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.148334121 (13h27m20.579414252s) [noise=true , address=104.36.82.20:4459 , piece_id=KLMZ23ZYRGLMIT7W6HNYPLAZTBY3RYRB6MX6AJMXHXPUXPA2SYFA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.158708109 (13h27m20.589788241s) [noise=true , address=104.36.82.58:4274 , piece_id=ORKTJIO2PWDE42CILRXXLGMVWGTMHN4UMHNVOY6GYF5INLX7SDYQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.165754843 (13h27m20.596834974s) [noise=true , address=104.36.82.56:4240 , piece_id=VOC4BN7IZPU5CHDJNZZ4KABZ4HAZDGUWSBE77SISEHXVYN7XXPCQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.165787094 (13h27m20.596867225s) [seg_pos={0 0}, upload=14047]: Segment reached optimal threshold of 14 pieces. Aug 9 06:53:26.165906083 (13h27m20.596986214s) [noise=true , address=104.36.82.44:4903 , piece_id=LXHMV2U2MJCTDODM5FGN6LVBA43FPJ74CNJCTTGUGD6DEODIFNNA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq): protocol: expected piece hash; context canceled; EOF Aug 9 06:53:26.165964404 (13h27m20.597044535s) [noise=true , address=104.36.82.37:4676 , piece_id=KZTTGDTIL7SZWAXQTHCFHAWAHQ7YA7ABCFKJDNTGHXASIA757BOA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yqKh7gMSrXWavfChEJRX7tV5rS9xTSo4SbmgPMtnYKfgbvF8): protocol: expected piece hash; context canceled; EOF Aug 9 06:53:26.166011994 (13h27m20.597092125s) [noise=true , address=104.36.82.23:4473 , piece_id=PMYUW3E2H7D7SLPNMU4VYGFIVZVVY5WG3NKAQ725IQCEZADLZO4Q, seg_pos={0 0}, upload=14047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 9 06:53:26.166086076 (13h27m20.597166207s) [noise=true , address=104.36.82.53:4148 , piece_id=PBFRQR2HU2V6CKDDHTWDSTZOLENV5CF62TVT27MB3FTQFKHC52EA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GGwKp8TvH5JJ8mcR4sqKcGMCc56hMEgWpAR3zqTWerqTLQ9Rv): protocol: expected piece hash; context canceled; EOF Aug 9 06:53:26.166132165 (13h27m20.597212286s) [seg_pos={0 0}, upload=14047]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 06:53:26.166221175 (13h27m20.597301306s) [upload=14047]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 06:53:26.166226024 (13h27m20.597306145s) [upload=14047]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 06:53:26.553951687 (13h27m20.985031819s) [upload=14047]: Done uploading segments... Aug 9 06:53:26.553971185 (13h27m20.985051316s) [upload=14047]: Upload finished. err: <nil> Duration: 5.825673186s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [...................................................X..X..X..] duration: 7.262333525s FAIL (2025-08-09 07:10:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.262349035s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [....................................................X..X..X.] duration: 6.710097894s FAIL (2025-08-09 07:09:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.710136306s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...X...........X.........................X..................] duration: 11.759714634s FAIL (2025-08-09 07:09:16 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 06:53:23.698655854 (13h27m18.129735985s) [upload=14047]: Starting upload Aug 9 06:53:23.698701853 (13h27m18.129781984s) [upload=14047]: Done starting upload Aug 9 06:53:23.698818386 (13h27m18.129898517s) [upload=14047]: Uploading segments... Aug 9 06:53:23.698936432 (13h27m18.130016563s) [upload=14047]: Got next segment. Inline: false Aug 9 06:53:23.698961630 (13h27m18.130041751s) [upload=14047]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 06:53:23.698965578 (13h27m18.130045709s) [upload=14047]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 06:53:24.147107598 (13h27m18.578187729s) [seg_pos={0 0}, upload=14047]: Begin upload segment... Aug 9 06:53:24.147148396 (13h27m18.578228527s) [seg_pos={0 0}, upload=14047]: Done begin upload segment. Aug 9 06:53:24.147167211 (13h27m18.578247332s) [noise=true , address=104.36.82.53:4148 , piece_id=PBFRQR2HU2V6CKDDHTWDSTZOLENV5CF62TVT27MB3FTQFKHC52EA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147175809 (13h27m18.57825594s) [noise=true , address=64.49.13.138:4488 , piece_id=F5IF7WY3WR47RA4YVR4STHJWU42I4DOBWU6TBXLNFBC66E4DWIFA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147518354 (13h27m18.578598485s) [noise=true , address=104.36.82.62:4415 , piece_id=X4UVHS5A7SSUREOM2Q7BKZMNMGWHMLTSZJJ3GEOB4YYIVEZTFVQQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147522181 (13h27m18.578602312s) [noise=true , address=104.36.82.56:4240 , piece_id=VOC4BN7IZPU5CHDJNZZ4KABZ4HAZDGUWSBE77SISEHXVYN7XXPCQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147796335 (13h27m18.578876466s) [noise=true , address=104.36.82.46:4507 , piece_id=YEY6UXEN3NOPA2K7MDIFOAALSFEZBOLIIBC5MJHLCJMDDUIH3TLQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147802567 (13h27m18.578882698s) [noise=true , address=104.36.82.2:4759 , piece_id=666T4FY5B22N44774DXRPYMDDHV7RIYBTKW6SRP6N72T3Y5MOXRA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148101780 (13h27m18.579181911s) [noise=true , address=104.36.82.37:4676 , piece_id=KZTTGDTIL7SZWAXQTHCFHAWAHQ7YA7ABCFKJDNTGHXASIA757BOA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148146495 (13h27m18.579226627s) [noise=true , address=104.36.82.35:4609 , piece_id=QDZD247HRDA66EXEE7YDK6K3OSBG5ILBLAWGPHX7QT4RBHD4A5XA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148380853 (13h27m18.579460984s) [noise=true , address=104.36.82.23:4473 , piece_id=PMYUW3E2H7D7SLPNMU4VYGFIVZVVY5WG3NKAQ725IQCEZADLZO4Q, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148440258 (13h27m18.579520379s) [noise=true , address=104.36.82.43:4843 , piece_id=QHDB7EE2RAOL4FHF2KSPIHFJJJ66ZSMYSMWQEDF2HMPNG6RCQZSA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148676068 (13h27m18.57975622s) [noise=true , address=104.36.82.44:4903 , piece_id=LXHMV2U2MJCTDODM5FGN6LVBA43FPJ74CNJCTTGUGD6DEODIFNNA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148708771 (13h27m18.579788902s) [noise=true , address=104.36.82.17:4339 , piece_id=IDJB6R6JA3UEX2NSOLS32F2GGPDYK2YOJDPMFCBDVPHHX4NYC4FQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148907121 (13h27m18.579987252s) [noise=true , address=104.36.82.58:4274 , piece_id=ORKTJIO2PWDE42CILRXXLGMVWGTMHN4UMHNVOY6GYF5INLX7SDYQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148929253 (13h27m18.580009374s) [noise=true , address=104.36.82.9:4009 , piece_id=XHFRPO3N3UZ3P6EJQNXOUTEPEZ47QRMPUF67SDYD7N6BXZJKMKHQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.149162189 (13h27m18.58024232s) [noise=true , address=104.36.82.35:4586 , piece_id=ST4P74ZRAEEKG3SYKKUGDJO7YBKTK257QHACXEEORBO2ZF6HD5SQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.149190884 (13h27m18.580271015s) [noise=true , address=104.36.82.59:4304 , piece_id=YZGOJYVR5IKG6VJKBVSSEFUKI4OHH6WZ3RZDOZGNWOFZYONQ7PQA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.149437786 (13h27m18.580517917s) [noise=true , address=104.36.82.20:4459 , piece_id=KLMZ23ZYRGLMIT7W6HNYPLAZTBY3RYRB6MX6AJMXHXPUXPA2SYFA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.149710999 (13h27m18.58079113s) [noise=true , address=104.36.82.19:4405 , piece_id=B45PJFW7IS5AFP6M6A22RJ362ZY6KXIL2UFZKWLAKJPRUVEMRYWQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:25.315864117 (13h27m19.746944248s) [upload=14047]: Next returned nil segment Aug 9 06:53:25.315886619 (13h27m19.746966751s) [upload=14047]: Waiting for error group managing segments... Aug 9 06:53:25.610133629 (13h27m20.04121375s) [noise=true , address=64.49.13.138:4488 , piece_id=F5IF7WY3WR47RA4YVR4STHJWU42I4DOBWU6TBXLNFBC66E4DWIFA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.044777484 (13h27m20.475857615s) [noise=true , address=104.36.82.59:4304 , piece_id=YZGOJYVR5IKG6VJKBVSSEFUKI4OHH6WZ3RZDOZGNWOFZYONQ7PQA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.049095655 (13h27m20.480175786s) [noise=true , address=104.36.82.62:4415 , piece_id=X4UVHS5A7SSUREOM2Q7BKZMNMGWHMLTSZJJ3GEOB4YYIVEZTFVQQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.053167005 (13h27m20.484247126s) [noise=true , address=104.36.82.35:4609 , piece_id=QDZD247HRDA66EXEE7YDK6K3OSBG5ILBLAWGPHX7QT4RBHD4A5XA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.073521951 (13h27m20.504602082s) [noise=true , address=104.36.82.19:4405 , piece_id=B45PJFW7IS5AFP6M6A22RJ362ZY6KXIL2UFZKWLAKJPRUVEMRYWQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.080957829 (13h27m20.51203796s) [noise=true , address=104.36.82.17:4339 , piece_id=IDJB6R6JA3UEX2NSOLS32F2GGPDYK2YOJDPMFCBDVPHHX4NYC4FQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.114325732 (13h27m20.545405863s) [noise=true , address=104.36.82.46:4507 , piece_id=YEY6UXEN3NOPA2K7MDIFOAALSFEZBOLIIBC5MJHLCJMDDUIH3TLQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.115488496 (13h27m20.546568617s) [noise=true , address=104.36.82.9:4009 , piece_id=XHFRPO3N3UZ3P6EJQNXOUTEPEZ47QRMPUF67SDYD7N6BXZJKMKHQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.137155292 (13h27m20.568235433s) [noise=true , address=104.36.82.35:4586 , piece_id=ST4P74ZRAEEKG3SYKKUGDJO7YBKTK257QHACXEEORBO2ZF6HD5SQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.137440217 (13h27m20.568520338s) [noise=true , address=104.36.82.2:4759 , piece_id=666T4FY5B22N44774DXRPYMDDHV7RIYBTKW6SRP6N72T3Y5MOXRA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.143705214 (13h27m20.574785335s) [noise=true , address=104.36.82.43:4843 , piece_id=QHDB7EE2RAOL4FHF2KSPIHFJJJ66ZSMYSMWQEDF2HMPNG6RCQZSA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.148334121 (13h27m20.579414252s) [noise=true , address=104.36.82.20:4459 , piece_id=KLMZ23ZYRGLMIT7W6HNYPLAZTBY3RYRB6MX6AJMXHXPUXPA2SYFA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.158708109 (13h27m20.589788241s) [noise=true , address=104.36.82.58:4274 , piece_id=ORKTJIO2PWDE42CILRXXLGMVWGTMHN4UMHNVOY6GYF5INLX7SDYQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.165754843 (13h27m20.596834974s) [noise=true , address=104.36.82.56:4240 , piece_id=VOC4BN7IZPU5CHDJNZZ4KABZ4HAZDGUWSBE77SISEHXVYN7XXPCQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.165787094 (13h27m20.596867225s) [seg_pos={0 0}, upload=14047]: Segment reached optimal threshold of 14 pieces. Aug 9 06:53:26.165906083 (13h27m20.596986214s) [noise=true , address=104.36.82.44:4903 , piece_id=LXHMV2U2MJCTDODM5FGN6LVBA43FPJ74CNJCTTGUGD6DEODIFNNA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq): protocol: expected piece hash; context canceled; EOF Aug 9 06:53:26.165964404 (13h27m20.597044535s) [noise=true , address=104.36.82.37:4676 , piece_id=KZTTGDTIL7SZWAXQTHCFHAWAHQ7YA7ABCFKJDNTGHXASIA757BOA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yqKh7gMSrXWavfChEJRX7tV5rS9xTSo4SbmgPMtnYKfgbvF8): protocol: expected piece hash; context canceled; EOF Aug 9 06:53:26.166011994 (13h27m20.597092125s) [noise=true , address=104.36.82.23:4473 , piece_id=PMYUW3E2H7D7SLPNMU4VYGFIVZVVY5WG3NKAQ725IQCEZADLZO4Q, seg_pos={0 0}, upload=14047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 9 06:53:26.166086076 (13h27m20.597166207s) [noise=true , address=104.36.82.53:4148 , piece_id=PBFRQR2HU2V6CKDDHTWDSTZOLENV5CF62TVT27MB3FTQFKHC52EA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GGwKp8TvH5JJ8mcR4sqKcGMCc56hMEgWpAR3zqTWerqTLQ9Rv): protocol: expected piece hash; context canceled; EOF Aug 9 06:53:26.166132165 (13h27m20.597212286s) [seg_pos={0 0}, upload=14047]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 06:53:26.166221175 (13h27m20.597301306s) [upload=14047]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 06:53:26.166226024 (13h27m20.597306145s) [upload=14047]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 06:53:26.553951687 (13h27m20.985031819s) [upload=14047]: Done uploading segments... Aug 9 06:53:26.553971185 (13h27m20.985051316s) [upload=14047]: Upload finished. err: <nil> Duration: 11.759741547s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....................................................X..X..X] duration: 30.001255941s FAIL (2025-08-09 07:08:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.00128198s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [....X...........X.........................X.................] duration: 7.137141239s FAIL (2025-08-09 07:08:28 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 06:53:23.698655854 (13h27m18.129735985s) [upload=14047]: Starting upload Aug 9 06:53:23.698701853 (13h27m18.129781984s) [upload=14047]: Done starting upload Aug 9 06:53:23.698818386 (13h27m18.129898517s) [upload=14047]: Uploading segments... Aug 9 06:53:23.698936432 (13h27m18.130016563s) [upload=14047]: Got next segment. Inline: false Aug 9 06:53:23.698961630 (13h27m18.130041751s) [upload=14047]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 06:53:23.698965578 (13h27m18.130045709s) [upload=14047]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 06:53:24.147107598 (13h27m18.578187729s) [seg_pos={0 0}, upload=14047]: Begin upload segment... Aug 9 06:53:24.147148396 (13h27m18.578228527s) [seg_pos={0 0}, upload=14047]: Done begin upload segment. Aug 9 06:53:24.147167211 (13h27m18.578247332s) [noise=true , address=104.36.82.53:4148 , piece_id=PBFRQR2HU2V6CKDDHTWDSTZOLENV5CF62TVT27MB3FTQFKHC52EA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147175809 (13h27m18.57825594s) [noise=true , address=64.49.13.138:4488 , piece_id=F5IF7WY3WR47RA4YVR4STHJWU42I4DOBWU6TBXLNFBC66E4DWIFA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147518354 (13h27m18.578598485s) [noise=true , address=104.36.82.62:4415 , piece_id=X4UVHS5A7SSUREOM2Q7BKZMNMGWHMLTSZJJ3GEOB4YYIVEZTFVQQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147522181 (13h27m18.578602312s) [noise=true , address=104.36.82.56:4240 , piece_id=VOC4BN7IZPU5CHDJNZZ4KABZ4HAZDGUWSBE77SISEHXVYN7XXPCQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147796335 (13h27m18.578876466s) [noise=true , address=104.36.82.46:4507 , piece_id=YEY6UXEN3NOPA2K7MDIFOAALSFEZBOLIIBC5MJHLCJMDDUIH3TLQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147802567 (13h27m18.578882698s) [noise=true , address=104.36.82.2:4759 , piece_id=666T4FY5B22N44774DXRPYMDDHV7RIYBTKW6SRP6N72T3Y5MOXRA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148101780 (13h27m18.579181911s) [noise=true , address=104.36.82.37:4676 , piece_id=KZTTGDTIL7SZWAXQTHCFHAWAHQ7YA7ABCFKJDNTGHXASIA757BOA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148146495 (13h27m18.579226627s) [noise=true , address=104.36.82.35:4609 , piece_id=QDZD247HRDA66EXEE7YDK6K3OSBG5ILBLAWGPHX7QT4RBHD4A5XA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148380853 (13h27m18.579460984s) [noise=true , address=104.36.82.23:4473 , piece_id=PMYUW3E2H7D7SLPNMU4VYGFIVZVVY5WG3NKAQ725IQCEZADLZO4Q, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148440258 (13h27m18.579520379s) [noise=true , address=104.36.82.43:4843 , piece_id=QHDB7EE2RAOL4FHF2KSPIHFJJJ66ZSMYSMWQEDF2HMPNG6RCQZSA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148676068 (13h27m18.57975622s) [noise=true , address=104.36.82.44:4903 , piece_id=LXHMV2U2MJCTDODM5FGN6LVBA43FPJ74CNJCTTGUGD6DEODIFNNA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148708771 (13h27m18.579788902s) [noise=true , address=104.36.82.17:4339 , piece_id=IDJB6R6JA3UEX2NSOLS32F2GGPDYK2YOJDPMFCBDVPHHX4NYC4FQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148907121 (13h27m18.579987252s) [noise=true , address=104.36.82.58:4274 , piece_id=ORKTJIO2PWDE42CILRXXLGMVWGTMHN4UMHNVOY6GYF5INLX7SDYQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148929253 (13h27m18.580009374s) [noise=true , address=104.36.82.9:4009 , piece_id=XHFRPO3N3UZ3P6EJQNXOUTEPEZ47QRMPUF67SDYD7N6BXZJKMKHQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.149162189 (13h27m18.58024232s) [noise=true , address=104.36.82.35:4586 , piece_id=ST4P74ZRAEEKG3SYKKUGDJO7YBKTK257QHACXEEORBO2ZF6HD5SQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.149190884 (13h27m18.580271015s) [noise=true , address=104.36.82.59:4304 , piece_id=YZGOJYVR5IKG6VJKBVSSEFUKI4OHH6WZ3RZDOZGNWOFZYONQ7PQA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.149437786 (13h27m18.580517917s) [noise=true , address=104.36.82.20:4459 , piece_id=KLMZ23ZYRGLMIT7W6HNYPLAZTBY3RYRB6MX6AJMXHXPUXPA2SYFA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.149710999 (13h27m18.58079113s) [noise=true , address=104.36.82.19:4405 , piece_id=B45PJFW7IS5AFP6M6A22RJ362ZY6KXIL2UFZKWLAKJPRUVEMRYWQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:25.315864117 (13h27m19.746944248s) [upload=14047]: Next returned nil segment Aug 9 06:53:25.315886619 (13h27m19.746966751s) [upload=14047]: Waiting for error group managing segments... Aug 9 06:53:25.610133629 (13h27m20.04121375s) [noise=true , address=64.49.13.138:4488 , piece_id=F5IF7WY3WR47RA4YVR4STHJWU42I4DOBWU6TBXLNFBC66E4DWIFA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.044777484 (13h27m20.475857615s) [noise=true , address=104.36.82.59:4304 , piece_id=YZGOJYVR5IKG6VJKBVSSEFUKI4OHH6WZ3RZDOZGNWOFZYONQ7PQA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.049095655 (13h27m20.480175786s) [noise=true , address=104.36.82.62:4415 , piece_id=X4UVHS5A7SSUREOM2Q7BKZMNMGWHMLTSZJJ3GEOB4YYIVEZTFVQQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.053167005 (13h27m20.484247126s) [noise=true , address=104.36.82.35:4609 , piece_id=QDZD247HRDA66EXEE7YDK6K3OSBG5ILBLAWGPHX7QT4RBHD4A5XA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.073521951 (13h27m20.504602082s) [noise=true , address=104.36.82.19:4405 , piece_id=B45PJFW7IS5AFP6M6A22RJ362ZY6KXIL2UFZKWLAKJPRUVEMRYWQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.080957829 (13h27m20.51203796s) [noise=true , address=104.36.82.17:4339 , piece_id=IDJB6R6JA3UEX2NSOLS32F2GGPDYK2YOJDPMFCBDVPHHX4NYC4FQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.114325732 (13h27m20.545405863s) [noise=true , address=104.36.82.46:4507 , piece_id=YEY6UXEN3NOPA2K7MDIFOAALSFEZBOLIIBC5MJHLCJMDDUIH3TLQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.115488496 (13h27m20.546568617s) [noise=true , address=104.36.82.9:4009 , piece_id=XHFRPO3N3UZ3P6EJQNXOUTEPEZ47QRMPUF67SDYD7N6BXZJKMKHQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.137155292 (13h27m20.568235433s) [noise=true , address=104.36.82.35:4586 , piece_id=ST4P74ZRAEEKG3SYKKUGDJO7YBKTK257QHACXEEORBO2ZF6HD5SQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.137440217 (13h27m20.568520338s) [noise=true , address=104.36.82.2:4759 , piece_id=666T4FY5B22N44774DXRPYMDDHV7RIYBTKW6SRP6N72T3Y5MOXRA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.143705214 (13h27m20.574785335s) [noise=true , address=104.36.82.43:4843 , piece_id=QHDB7EE2RAOL4FHF2KSPIHFJJJ66ZSMYSMWQEDF2HMPNG6RCQZSA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.148334121 (13h27m20.579414252s) [noise=true , address=104.36.82.20:4459 , piece_id=KLMZ23ZYRGLMIT7W6HNYPLAZTBY3RYRB6MX6AJMXHXPUXPA2SYFA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.158708109 (13h27m20.589788241s) [noise=true , address=104.36.82.58:4274 , piece_id=ORKTJIO2PWDE42CILRXXLGMVWGTMHN4UMHNVOY6GYF5INLX7SDYQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.165754843 (13h27m20.596834974s) [noise=true , address=104.36.82.56:4240 , piece_id=VOC4BN7IZPU5CHDJNZZ4KABZ4HAZDGUWSBE77SISEHXVYN7XXPCQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.165787094 (13h27m20.596867225s) [seg_pos={0 0}, upload=14047]: Segment reached optimal threshold of 14 pieces. Aug 9 06:53:26.165906083 (13h27m20.596986214s) [noise=true , address=104.36.82.44:4903 , piece_id=LXHMV2U2MJCTDODM5FGN6LVBA43FPJ74CNJCTTGUGD6DEODIFNNA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq): protocol: expected piece hash; context canceled; EOF Aug 9 06:53:26.165964404 (13h27m20.597044535s) [noise=true , address=104.36.82.37:4676 , piece_id=KZTTGDTIL7SZWAXQTHCFHAWAHQ7YA7ABCFKJDNTGHXASIA757BOA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yqKh7gMSrXWavfChEJRX7tV5rS9xTSo4SbmgPMtnYKfgbvF8): protocol: expected piece hash; context canceled; EOF Aug 9 06:53:26.166011994 (13h27m20.597092125s) [noise=true , address=104.36.82.23:4473 , piece_id=PMYUW3E2H7D7SLPNMU4VYGFIVZVVY5WG3NKAQ725IQCEZADLZO4Q, seg_pos={0 0}, upload=14047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 9 06:53:26.166086076 (13h27m20.597166207s) [noise=true , address=104.36.82.53:4148 , piece_id=PBFRQR2HU2V6CKDDHTWDSTZOLENV5CF62TVT27MB3FTQFKHC52EA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GGwKp8TvH5JJ8mcR4sqKcGMCc56hMEgWpAR3zqTWerqTLQ9Rv): protocol: expected piece hash; context canceled; EOF Aug 9 06:53:26.166132165 (13h27m20.597212286s) [seg_pos={0 0}, upload=14047]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 06:53:26.166221175 (13h27m20.597301306s) [upload=14047]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 06:53:26.166226024 (13h27m20.597306145s) [upload=14047]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 06:53:26.553951687 (13h27m20.985031819s) [upload=14047]: Done uploading segments... Aug 9 06:53:26.553971185 (13h27m20.985051316s) [upload=14047]: Upload finished. err: <nil> Duration: 7.137174745s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....X...........X.........................X................] duration: 5.953987162s FAIL (2025-08-09 07:08:00 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 06:53:23.698655854 (13h27m18.129735985s) [upload=14047]: Starting upload Aug 9 06:53:23.698701853 (13h27m18.129781984s) [upload=14047]: Done starting upload Aug 9 06:53:23.698818386 (13h27m18.129898517s) [upload=14047]: Uploading segments... Aug 9 06:53:23.698936432 (13h27m18.130016563s) [upload=14047]: Got next segment. Inline: false Aug 9 06:53:23.698961630 (13h27m18.130041751s) [upload=14047]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 06:53:23.698965578 (13h27m18.130045709s) [upload=14047]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 06:53:24.147107598 (13h27m18.578187729s) [seg_pos={0 0}, upload=14047]: Begin upload segment... Aug 9 06:53:24.147148396 (13h27m18.578228527s) [seg_pos={0 0}, upload=14047]: Done begin upload segment. Aug 9 06:53:24.147167211 (13h27m18.578247332s) [noise=true , address=104.36.82.53:4148 , piece_id=PBFRQR2HU2V6CKDDHTWDSTZOLENV5CF62TVT27MB3FTQFKHC52EA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147175809 (13h27m18.57825594s) [noise=true , address=64.49.13.138:4488 , piece_id=F5IF7WY3WR47RA4YVR4STHJWU42I4DOBWU6TBXLNFBC66E4DWIFA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147518354 (13h27m18.578598485s) [noise=true , address=104.36.82.62:4415 , piece_id=X4UVHS5A7SSUREOM2Q7BKZMNMGWHMLTSZJJ3GEOB4YYIVEZTFVQQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147522181 (13h27m18.578602312s) [noise=true , address=104.36.82.56:4240 , piece_id=VOC4BN7IZPU5CHDJNZZ4KABZ4HAZDGUWSBE77SISEHXVYN7XXPCQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147796335 (13h27m18.578876466s) [noise=true , address=104.36.82.46:4507 , piece_id=YEY6UXEN3NOPA2K7MDIFOAALSFEZBOLIIBC5MJHLCJMDDUIH3TLQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147802567 (13h27m18.578882698s) [noise=true , address=104.36.82.2:4759 , piece_id=666T4FY5B22N44774DXRPYMDDHV7RIYBTKW6SRP6N72T3Y5MOXRA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148101780 (13h27m18.579181911s) [noise=true , address=104.36.82.37:4676 , piece_id=KZTTGDTIL7SZWAXQTHCFHAWAHQ7YA7ABCFKJDNTGHXASIA757BOA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148146495 (13h27m18.579226627s) [noise=true , address=104.36.82.35:4609 , piece_id=QDZD247HRDA66EXEE7YDK6K3OSBG5ILBLAWGPHX7QT4RBHD4A5XA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148380853 (13h27m18.579460984s) [noise=true , address=104.36.82.23:4473 , piece_id=PMYUW3E2H7D7SLPNMU4VYGFIVZVVY5WG3NKAQ725IQCEZADLZO4Q, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148440258 (13h27m18.579520379s) [noise=true , address=104.36.82.43:4843 , piece_id=QHDB7EE2RAOL4FHF2KSPIHFJJJ66ZSMYSMWQEDF2HMPNG6RCQZSA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148676068 (13h27m18.57975622s) [noise=true , address=104.36.82.44:4903 , piece_id=LXHMV2U2MJCTDODM5FGN6LVBA43FPJ74CNJCTTGUGD6DEODIFNNA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148708771 (13h27m18.579788902s) [noise=true , address=104.36.82.17:4339 , piece_id=IDJB6R6JA3UEX2NSOLS32F2GGPDYK2YOJDPMFCBDVPHHX4NYC4FQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148907121 (13h27m18.579987252s) [noise=true , address=104.36.82.58:4274 , piece_id=ORKTJIO2PWDE42CILRXXLGMVWGTMHN4UMHNVOY6GYF5INLX7SDYQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148929253 (13h27m18.580009374s) [noise=true , address=104.36.82.9:4009 , piece_id=XHFRPO3N3UZ3P6EJQNXOUTEPEZ47QRMPUF67SDYD7N6BXZJKMKHQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.149162189 (13h27m18.58024232s) [noise=true , address=104.36.82.35:4586 , piece_id=ST4P74ZRAEEKG3SYKKUGDJO7YBKTK257QHACXEEORBO2ZF6HD5SQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.149190884 (13h27m18.580271015s) [noise=true , address=104.36.82.59:4304 , piece_id=YZGOJYVR5IKG6VJKBVSSEFUKI4OHH6WZ3RZDOZGNWOFZYONQ7PQA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.149437786 (13h27m18.580517917s) [noise=true , address=104.36.82.20:4459 , piece_id=KLMZ23ZYRGLMIT7W6HNYPLAZTBY3RYRB6MX6AJMXHXPUXPA2SYFA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.149710999 (13h27m18.58079113s) [noise=true , address=104.36.82.19:4405 , piece_id=B45PJFW7IS5AFP6M6A22RJ362ZY6KXIL2UFZKWLAKJPRUVEMRYWQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:25.315864117 (13h27m19.746944248s) [upload=14047]: Next returned nil segment Aug 9 06:53:25.315886619 (13h27m19.746966751s) [upload=14047]: Waiting for error group managing segments... Aug 9 06:53:25.610133629 (13h27m20.04121375s) [noise=true , address=64.49.13.138:4488 , piece_id=F5IF7WY3WR47RA4YVR4STHJWU42I4DOBWU6TBXLNFBC66E4DWIFA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.044777484 (13h27m20.475857615s) [noise=true , address=104.36.82.59:4304 , piece_id=YZGOJYVR5IKG6VJKBVSSEFUKI4OHH6WZ3RZDOZGNWOFZYONQ7PQA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.049095655 (13h27m20.480175786s) [noise=true , address=104.36.82.62:4415 , piece_id=X4UVHS5A7SSUREOM2Q7BKZMNMGWHMLTSZJJ3GEOB4YYIVEZTFVQQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.053167005 (13h27m20.484247126s) [noise=true , address=104.36.82.35:4609 , piece_id=QDZD247HRDA66EXEE7YDK6K3OSBG5ILBLAWGPHX7QT4RBHD4A5XA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.073521951 (13h27m20.504602082s) [noise=true , address=104.36.82.19:4405 , piece_id=B45PJFW7IS5AFP6M6A22RJ362ZY6KXIL2UFZKWLAKJPRUVEMRYWQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.080957829 (13h27m20.51203796s) [noise=true , address=104.36.82.17:4339 , piece_id=IDJB6R6JA3UEX2NSOLS32F2GGPDYK2YOJDPMFCBDVPHHX4NYC4FQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.114325732 (13h27m20.545405863s) [noise=true , address=104.36.82.46:4507 , piece_id=YEY6UXEN3NOPA2K7MDIFOAALSFEZBOLIIBC5MJHLCJMDDUIH3TLQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.115488496 (13h27m20.546568617s) [noise=true , address=104.36.82.9:4009 , piece_id=XHFRPO3N3UZ3P6EJQNXOUTEPEZ47QRMPUF67SDYD7N6BXZJKMKHQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.137155292 (13h27m20.568235433s) [noise=true , address=104.36.82.35:4586 , piece_id=ST4P74ZRAEEKG3SYKKUGDJO7YBKTK257QHACXEEORBO2ZF6HD5SQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.137440217 (13h27m20.568520338s) [noise=true , address=104.36.82.2:4759 , piece_id=666T4FY5B22N44774DXRPYMDDHV7RIYBTKW6SRP6N72T3Y5MOXRA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.143705214 (13h27m20.574785335s) [noise=true , address=104.36.82.43:4843 , piece_id=QHDB7EE2RAOL4FHF2KSPIHFJJJ66ZSMYSMWQEDF2HMPNG6RCQZSA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.148334121 (13h27m20.579414252s) [noise=true , address=104.36.82.20:4459 , piece_id=KLMZ23ZYRGLMIT7W6HNYPLAZTBY3RYRB6MX6AJMXHXPUXPA2SYFA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.158708109 (13h27m20.589788241s) [noise=true , address=104.36.82.58:4274 , piece_id=ORKTJIO2PWDE42CILRXXLGMVWGTMHN4UMHNVOY6GYF5INLX7SDYQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.165754843 (13h27m20.596834974s) [noise=true , address=104.36.82.56:4240 , piece_id=VOC4BN7IZPU5CHDJNZZ4KABZ4HAZDGUWSBE77SISEHXVYN7XXPCQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.165787094 (13h27m20.596867225s) [seg_pos={0 0}, upload=14047]: Segment reached optimal threshold of 14 pieces. Aug 9 06:53:26.165906083 (13h27m20.596986214s) [noise=true , address=104.36.82.44:4903 , piece_id=LXHMV2U2MJCTDODM5FGN6LVBA43FPJ74CNJCTTGUGD6DEODIFNNA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq): protocol: expected piece hash; context canceled; EOF Aug 9 06:53:26.165964404 (13h27m20.597044535s) [noise=true , address=104.36.82.37:4676 , piece_id=KZTTGDTIL7SZWAXQTHCFHAWAHQ7YA7ABCFKJDNTGHXASIA757BOA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yqKh7gMSrXWavfChEJRX7tV5rS9xTSo4SbmgPMtnYKfgbvF8): protocol: expected piece hash; context canceled; EOF Aug 9 06:53:26.166011994 (13h27m20.597092125s) [noise=true , address=104.36.82.23:4473 , piece_id=PMYUW3E2H7D7SLPNMU4VYGFIVZVVY5WG3NKAQ725IQCEZADLZO4Q, seg_pos={0 0}, upload=14047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 9 06:53:26.166086076 (13h27m20.597166207s) [noise=true , address=104.36.82.53:4148 , piece_id=PBFRQR2HU2V6CKDDHTWDSTZOLENV5CF62TVT27MB3FTQFKHC52EA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GGwKp8TvH5JJ8mcR4sqKcGMCc56hMEgWpAR3zqTWerqTLQ9Rv): protocol: expected piece hash; context canceled; EOF Aug 9 06:53:26.166132165 (13h27m20.597212286s) [seg_pos={0 0}, upload=14047]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 06:53:26.166221175 (13h27m20.597301306s) [upload=14047]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 06:53:26.166226024 (13h27m20.597306145s) [upload=14047]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 06:53:26.553951687 (13h27m20.985031819s) [upload=14047]: Done uploading segments... Aug 9 06:53:26.553971185 (13h27m20.985051316s) [upload=14047]: Upload finished. err: <nil> Duration: 5.954012381s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................................................X..X..] duration: 6.114882892s FAIL (2025-08-09 07:07:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.114906327s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......................................................X..X.] duration: 7.402377151s FAIL (2025-08-09 07:07:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.402397791s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [........................................................X..X] duration: 30.000828875s FAIL (2025-08-09 07:07:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.000846568s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [......X...........X.........................X...............] duration: 5.909735842s FAIL (2025-08-09 07:06:49 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 06:53:23.698655854 (13h27m18.129735985s) [upload=14047]: Starting upload Aug 9 06:53:23.698701853 (13h27m18.129781984s) [upload=14047]: Done starting upload Aug 9 06:53:23.698818386 (13h27m18.129898517s) [upload=14047]: Uploading segments... Aug 9 06:53:23.698936432 (13h27m18.130016563s) [upload=14047]: Got next segment. Inline: false Aug 9 06:53:23.698961630 (13h27m18.130041751s) [upload=14047]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 06:53:23.698965578 (13h27m18.130045709s) [upload=14047]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 06:53:24.147107598 (13h27m18.578187729s) [seg_pos={0 0}, upload=14047]: Begin upload segment... Aug 9 06:53:24.147148396 (13h27m18.578228527s) [seg_pos={0 0}, upload=14047]: Done begin upload segment. Aug 9 06:53:24.147167211 (13h27m18.578247332s) [noise=true , address=104.36.82.53:4148 , piece_id=PBFRQR2HU2V6CKDDHTWDSTZOLENV5CF62TVT27MB3FTQFKHC52EA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147175809 (13h27m18.57825594s) [noise=true , address=64.49.13.138:4488 , piece_id=F5IF7WY3WR47RA4YVR4STHJWU42I4DOBWU6TBXLNFBC66E4DWIFA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147518354 (13h27m18.578598485s) [noise=true , address=104.36.82.62:4415 , piece_id=X4UVHS5A7SSUREOM2Q7BKZMNMGWHMLTSZJJ3GEOB4YYIVEZTFVQQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147522181 (13h27m18.578602312s) [noise=true , address=104.36.82.56:4240 , piece_id=VOC4BN7IZPU5CHDJNZZ4KABZ4HAZDGUWSBE77SISEHXVYN7XXPCQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147796335 (13h27m18.578876466s) [noise=true , address=104.36.82.46:4507 , piece_id=YEY6UXEN3NOPA2K7MDIFOAALSFEZBOLIIBC5MJHLCJMDDUIH3TLQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147802567 (13h27m18.578882698s) [noise=true , address=104.36.82.2:4759 , piece_id=666T4FY5B22N44774DXRPYMDDHV7RIYBTKW6SRP6N72T3Y5MOXRA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148101780 (13h27m18.579181911s) [noise=true , address=104.36.82.37:4676 , piece_id=KZTTGDTIL7SZWAXQTHCFHAWAHQ7YA7ABCFKJDNTGHXASIA757BOA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148146495 (13h27m18.579226627s) [noise=true , address=104.36.82.35:4609 , piece_id=QDZD247HRDA66EXEE7YDK6K3OSBG5ILBLAWGPHX7QT4RBHD4A5XA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148380853 (13h27m18.579460984s) [noise=true , address=104.36.82.23:4473 , piece_id=PMYUW3E2H7D7SLPNMU4VYGFIVZVVY5WG3NKAQ725IQCEZADLZO4Q, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148440258 (13h27m18.579520379s) [noise=true , address=104.36.82.43:4843 , piece_id=QHDB7EE2RAOL4FHF2KSPIHFJJJ66ZSMYSMWQEDF2HMPNG6RCQZSA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148676068 (13h27m18.57975622s) [noise=true , address=104.36.82.44:4903 , piece_id=LXHMV2U2MJCTDODM5FGN6LVBA43FPJ74CNJCTTGUGD6DEODIFNNA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148708771 (13h27m18.579788902s) [noise=true , address=104.36.82.17:4339 , piece_id=IDJB6R6JA3UEX2NSOLS32F2GGPDYK2YOJDPMFCBDVPHHX4NYC4FQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148907121 (13h27m18.579987252s) [noise=true , address=104.36.82.58:4274 , piece_id=ORKTJIO2PWDE42CILRXXLGMVWGTMHN4UMHNVOY6GYF5INLX7SDYQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148929253 (13h27m18.580009374s) [noise=true , address=104.36.82.9:4009 , piece_id=XHFRPO3N3UZ3P6EJQNXOUTEPEZ47QRMPUF67SDYD7N6BXZJKMKHQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.149162189 (13h27m18.58024232s) [noise=true , address=104.36.82.35:4586 , piece_id=ST4P74ZRAEEKG3SYKKUGDJO7YBKTK257QHACXEEORBO2ZF6HD5SQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.149190884 (13h27m18.580271015s) [noise=true , address=104.36.82.59:4304 , piece_id=YZGOJYVR5IKG6VJKBVSSEFUKI4OHH6WZ3RZDOZGNWOFZYONQ7PQA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.149437786 (13h27m18.580517917s) [noise=true , address=104.36.82.20:4459 , piece_id=KLMZ23ZYRGLMIT7W6HNYPLAZTBY3RYRB6MX6AJMXHXPUXPA2SYFA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.149710999 (13h27m18.58079113s) [noise=true , address=104.36.82.19:4405 , piece_id=B45PJFW7IS5AFP6M6A22RJ362ZY6KXIL2UFZKWLAKJPRUVEMRYWQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:25.315864117 (13h27m19.746944248s) [upload=14047]: Next returned nil segment Aug 9 06:53:25.315886619 (13h27m19.746966751s) [upload=14047]: Waiting for error group managing segments... Aug 9 06:53:25.610133629 (13h27m20.04121375s) [noise=true , address=64.49.13.138:4488 , piece_id=F5IF7WY3WR47RA4YVR4STHJWU42I4DOBWU6TBXLNFBC66E4DWIFA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.044777484 (13h27m20.475857615s) [noise=true , address=104.36.82.59:4304 , piece_id=YZGOJYVR5IKG6VJKBVSSEFUKI4OHH6WZ3RZDOZGNWOFZYONQ7PQA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.049095655 (13h27m20.480175786s) [noise=true , address=104.36.82.62:4415 , piece_id=X4UVHS5A7SSUREOM2Q7BKZMNMGWHMLTSZJJ3GEOB4YYIVEZTFVQQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.053167005 (13h27m20.484247126s) [noise=true , address=104.36.82.35:4609 , piece_id=QDZD247HRDA66EXEE7YDK6K3OSBG5ILBLAWGPHX7QT4RBHD4A5XA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.073521951 (13h27m20.504602082s) [noise=true , address=104.36.82.19:4405 , piece_id=B45PJFW7IS5AFP6M6A22RJ362ZY6KXIL2UFZKWLAKJPRUVEMRYWQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.080957829 (13h27m20.51203796s) [noise=true , address=104.36.82.17:4339 , piece_id=IDJB6R6JA3UEX2NSOLS32F2GGPDYK2YOJDPMFCBDVPHHX4NYC4FQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.114325732 (13h27m20.545405863s) [noise=true , address=104.36.82.46:4507 , piece_id=YEY6UXEN3NOPA2K7MDIFOAALSFEZBOLIIBC5MJHLCJMDDUIH3TLQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.115488496 (13h27m20.546568617s) [noise=true , address=104.36.82.9:4009 , piece_id=XHFRPO3N3UZ3P6EJQNXOUTEPEZ47QRMPUF67SDYD7N6BXZJKMKHQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.137155292 (13h27m20.568235433s) [noise=true , address=104.36.82.35:4586 , piece_id=ST4P74ZRAEEKG3SYKKUGDJO7YBKTK257QHACXEEORBO2ZF6HD5SQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.137440217 (13h27m20.568520338s) [noise=true , address=104.36.82.2:4759 , piece_id=666T4FY5B22N44774DXRPYMDDHV7RIYBTKW6SRP6N72T3Y5MOXRA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.143705214 (13h27m20.574785335s) [noise=true , address=104.36.82.43:4843 , piece_id=QHDB7EE2RAOL4FHF2KSPIHFJJJ66ZSMYSMWQEDF2HMPNG6RCQZSA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.148334121 (13h27m20.579414252s) [noise=true , address=104.36.82.20:4459 , piece_id=KLMZ23ZYRGLMIT7W6HNYPLAZTBY3RYRB6MX6AJMXHXPUXPA2SYFA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.158708109 (13h27m20.589788241s) [noise=true , address=104.36.82.58:4274 , piece_id=ORKTJIO2PWDE42CILRXXLGMVWGTMHN4UMHNVOY6GYF5INLX7SDYQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.165754843 (13h27m20.596834974s) [noise=true , address=104.36.82.56:4240 , piece_id=VOC4BN7IZPU5CHDJNZZ4KABZ4HAZDGUWSBE77SISEHXVYN7XXPCQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.165787094 (13h27m20.596867225s) [seg_pos={0 0}, upload=14047]: Segment reached optimal threshold of 14 pieces. Aug 9 06:53:26.165906083 (13h27m20.596986214s) [noise=true , address=104.36.82.44:4903 , piece_id=LXHMV2U2MJCTDODM5FGN6LVBA43FPJ74CNJCTTGUGD6DEODIFNNA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq): protocol: expected piece hash; context canceled; EOF Aug 9 06:53:26.165964404 (13h27m20.597044535s) [noise=true , address=104.36.82.37:4676 , piece_id=KZTTGDTIL7SZWAXQTHCFHAWAHQ7YA7ABCFKJDNTGHXASIA757BOA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yqKh7gMSrXWavfChEJRX7tV5rS9xTSo4SbmgPMtnYKfgbvF8): protocol: expected piece hash; context canceled; EOF Aug 9 06:53:26.166011994 (13h27m20.597092125s) [noise=true , address=104.36.82.23:4473 , piece_id=PMYUW3E2H7D7SLPNMU4VYGFIVZVVY5WG3NKAQ725IQCEZADLZO4Q, seg_pos={0 0}, upload=14047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 9 06:53:26.166086076 (13h27m20.597166207s) [noise=true , address=104.36.82.53:4148 , piece_id=PBFRQR2HU2V6CKDDHTWDSTZOLENV5CF62TVT27MB3FTQFKHC52EA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GGwKp8TvH5JJ8mcR4sqKcGMCc56hMEgWpAR3zqTWerqTLQ9Rv): protocol: expected piece hash; context canceled; EOF Aug 9 06:53:26.166132165 (13h27m20.597212286s) [seg_pos={0 0}, upload=14047]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 06:53:26.166221175 (13h27m20.597301306s) [upload=14047]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 06:53:26.166226024 (13h27m20.597306145s) [upload=14047]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 06:53:26.553951687 (13h27m20.985031819s) [upload=14047]: Done uploading segments... Aug 9 06:53:26.553971185 (13h27m20.985051316s) [upload=14047]: Upload finished. err: <nil> Duration: 5.909757794s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......X...........X.........................X..............] duration: 5.840441402s FAIL (2025-08-09 07:06:28 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 06:53:23.698655854 (13h27m18.129735985s) [upload=14047]: Starting upload Aug 9 06:53:23.698701853 (13h27m18.129781984s) [upload=14047]: Done starting upload Aug 9 06:53:23.698818386 (13h27m18.129898517s) [upload=14047]: Uploading segments... Aug 9 06:53:23.698936432 (13h27m18.130016563s) [upload=14047]: Got next segment. Inline: false Aug 9 06:53:23.698961630 (13h27m18.130041751s) [upload=14047]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 06:53:23.698965578 (13h27m18.130045709s) [upload=14047]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 06:53:24.147107598 (13h27m18.578187729s) [seg_pos={0 0}, upload=14047]: Begin upload segment... Aug 9 06:53:24.147148396 (13h27m18.578228527s) [seg_pos={0 0}, upload=14047]: Done begin upload segment. Aug 9 06:53:24.147167211 (13h27m18.578247332s) [noise=true , address=104.36.82.53:4148 , piece_id=PBFRQR2HU2V6CKDDHTWDSTZOLENV5CF62TVT27MB3FTQFKHC52EA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147175809 (13h27m18.57825594s) [noise=true , address=64.49.13.138:4488 , piece_id=F5IF7WY3WR47RA4YVR4STHJWU42I4DOBWU6TBXLNFBC66E4DWIFA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147518354 (13h27m18.578598485s) [noise=true , address=104.36.82.62:4415 , piece_id=X4UVHS5A7SSUREOM2Q7BKZMNMGWHMLTSZJJ3GEOB4YYIVEZTFVQQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147522181 (13h27m18.578602312s) [noise=true , address=104.36.82.56:4240 , piece_id=VOC4BN7IZPU5CHDJNZZ4KABZ4HAZDGUWSBE77SISEHXVYN7XXPCQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147796335 (13h27m18.578876466s) [noise=true , address=104.36.82.46:4507 , piece_id=YEY6UXEN3NOPA2K7MDIFOAALSFEZBOLIIBC5MJHLCJMDDUIH3TLQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147802567 (13h27m18.578882698s) [noise=true , address=104.36.82.2:4759 , piece_id=666T4FY5B22N44774DXRPYMDDHV7RIYBTKW6SRP6N72T3Y5MOXRA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148101780 (13h27m18.579181911s) [noise=true , address=104.36.82.37:4676 , piece_id=KZTTGDTIL7SZWAXQTHCFHAWAHQ7YA7ABCFKJDNTGHXASIA757BOA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148146495 (13h27m18.579226627s) [noise=true , address=104.36.82.35:4609 , piece_id=QDZD247HRDA66EXEE7YDK6K3OSBG5ILBLAWGPHX7QT4RBHD4A5XA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148380853 (13h27m18.579460984s) [noise=true , address=104.36.82.23:4473 , piece_id=PMYUW3E2H7D7SLPNMU4VYGFIVZVVY5WG3NKAQ725IQCEZADLZO4Q, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148440258 (13h27m18.579520379s) [noise=true , address=104.36.82.43:4843 , piece_id=QHDB7EE2RAOL4FHF2KSPIHFJJJ66ZSMYSMWQEDF2HMPNG6RCQZSA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148676068 (13h27m18.57975622s) [noise=true , address=104.36.82.44:4903 , piece_id=LXHMV2U2MJCTDODM5FGN6LVBA43FPJ74CNJCTTGUGD6DEODIFNNA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148708771 (13h27m18.579788902s) [noise=true , address=104.36.82.17:4339 , piece_id=IDJB6R6JA3UEX2NSOLS32F2GGPDYK2YOJDPMFCBDVPHHX4NYC4FQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148907121 (13h27m18.579987252s) [noise=true , address=104.36.82.58:4274 , piece_id=ORKTJIO2PWDE42CILRXXLGMVWGTMHN4UMHNVOY6GYF5INLX7SDYQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148929253 (13h27m18.580009374s) [noise=true , address=104.36.82.9:4009 , piece_id=XHFRPO3N3UZ3P6EJQNXOUTEPEZ47QRMPUF67SDYD7N6BXZJKMKHQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.149162189 (13h27m18.58024232s) [noise=true , address=104.36.82.35:4586 , piece_id=ST4P74ZRAEEKG3SYKKUGDJO7YBKTK257QHACXEEORBO2ZF6HD5SQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.149190884 (13h27m18.580271015s) [noise=true , address=104.36.82.59:4304 , piece_id=YZGOJYVR5IKG6VJKBVSSEFUKI4OHH6WZ3RZDOZGNWOFZYONQ7PQA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.149437786 (13h27m18.580517917s) [noise=true , address=104.36.82.20:4459 , piece_id=KLMZ23ZYRGLMIT7W6HNYPLAZTBY3RYRB6MX6AJMXHXPUXPA2SYFA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.149710999 (13h27m18.58079113s) [noise=true , address=104.36.82.19:4405 , piece_id=B45PJFW7IS5AFP6M6A22RJ362ZY6KXIL2UFZKWLAKJPRUVEMRYWQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:25.315864117 (13h27m19.746944248s) [upload=14047]: Next returned nil segment Aug 9 06:53:25.315886619 (13h27m19.746966751s) [upload=14047]: Waiting for error group managing segments... Aug 9 06:53:25.610133629 (13h27m20.04121375s) [noise=true , address=64.49.13.138:4488 , piece_id=F5IF7WY3WR47RA4YVR4STHJWU42I4DOBWU6TBXLNFBC66E4DWIFA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.044777484 (13h27m20.475857615s) [noise=true , address=104.36.82.59:4304 , piece_id=YZGOJYVR5IKG6VJKBVSSEFUKI4OHH6WZ3RZDOZGNWOFZYONQ7PQA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.049095655 (13h27m20.480175786s) [noise=true , address=104.36.82.62:4415 , piece_id=X4UVHS5A7SSUREOM2Q7BKZMNMGWHMLTSZJJ3GEOB4YYIVEZTFVQQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.053167005 (13h27m20.484247126s) [noise=true , address=104.36.82.35:4609 , piece_id=QDZD247HRDA66EXEE7YDK6K3OSBG5ILBLAWGPHX7QT4RBHD4A5XA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.073521951 (13h27m20.504602082s) [noise=true , address=104.36.82.19:4405 , piece_id=B45PJFW7IS5AFP6M6A22RJ362ZY6KXIL2UFZKWLAKJPRUVEMRYWQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.080957829 (13h27m20.51203796s) [noise=true , address=104.36.82.17:4339 , piece_id=IDJB6R6JA3UEX2NSOLS32F2GGPDYK2YOJDPMFCBDVPHHX4NYC4FQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.114325732 (13h27m20.545405863s) [noise=true , address=104.36.82.46:4507 , piece_id=YEY6UXEN3NOPA2K7MDIFOAALSFEZBOLIIBC5MJHLCJMDDUIH3TLQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.115488496 (13h27m20.546568617s) [noise=true , address=104.36.82.9:4009 , piece_id=XHFRPO3N3UZ3P6EJQNXOUTEPEZ47QRMPUF67SDYD7N6BXZJKMKHQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.137155292 (13h27m20.568235433s) [noise=true , address=104.36.82.35:4586 , piece_id=ST4P74ZRAEEKG3SYKKUGDJO7YBKTK257QHACXEEORBO2ZF6HD5SQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.137440217 (13h27m20.568520338s) [noise=true , address=104.36.82.2:4759 , piece_id=666T4FY5B22N44774DXRPYMDDHV7RIYBTKW6SRP6N72T3Y5MOXRA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.143705214 (13h27m20.574785335s) [noise=true , address=104.36.82.43:4843 , piece_id=QHDB7EE2RAOL4FHF2KSPIHFJJJ66ZSMYSMWQEDF2HMPNG6RCQZSA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.148334121 (13h27m20.579414252s) [noise=true , address=104.36.82.20:4459 , piece_id=KLMZ23ZYRGLMIT7W6HNYPLAZTBY3RYRB6MX6AJMXHXPUXPA2SYFA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.158708109 (13h27m20.589788241s) [noise=true , address=104.36.82.58:4274 , piece_id=ORKTJIO2PWDE42CILRXXLGMVWGTMHN4UMHNVOY6GYF5INLX7SDYQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.165754843 (13h27m20.596834974s) [noise=true , address=104.36.82.56:4240 , piece_id=VOC4BN7IZPU5CHDJNZZ4KABZ4HAZDGUWSBE77SISEHXVYN7XXPCQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.165787094 (13h27m20.596867225s) [seg_pos={0 0}, upload=14047]: Segment reached optimal threshold of 14 pieces. Aug 9 06:53:26.165906083 (13h27m20.596986214s) [noise=true , address=104.36.82.44:4903 , piece_id=LXHMV2U2MJCTDODM5FGN6LVBA43FPJ74CNJCTTGUGD6DEODIFNNA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq): protocol: expected piece hash; context canceled; EOF Aug 9 06:53:26.165964404 (13h27m20.597044535s) [noise=true , address=104.36.82.37:4676 , piece_id=KZTTGDTIL7SZWAXQTHCFHAWAHQ7YA7ABCFKJDNTGHXASIA757BOA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yqKh7gMSrXWavfChEJRX7tV5rS9xTSo4SbmgPMtnYKfgbvF8): protocol: expected piece hash; context canceled; EOF Aug 9 06:53:26.166011994 (13h27m20.597092125s) [noise=true , address=104.36.82.23:4473 , piece_id=PMYUW3E2H7D7SLPNMU4VYGFIVZVVY5WG3NKAQ725IQCEZADLZO4Q, seg_pos={0 0}, upload=14047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 9 06:53:26.166086076 (13h27m20.597166207s) [noise=true , address=104.36.82.53:4148 , piece_id=PBFRQR2HU2V6CKDDHTWDSTZOLENV5CF62TVT27MB3FTQFKHC52EA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GGwKp8TvH5JJ8mcR4sqKcGMCc56hMEgWpAR3zqTWerqTLQ9Rv): protocol: expected piece hash; context canceled; EOF Aug 9 06:53:26.166132165 (13h27m20.597212286s) [seg_pos={0 0}, upload=14047]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 06:53:26.166221175 (13h27m20.597301306s) [upload=14047]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 06:53:26.166226024 (13h27m20.597306145s) [upload=14047]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 06:53:26.553951687 (13h27m20.985031819s) [upload=14047]: Done uploading segments... Aug 9 06:53:26.553971185 (13h27m20.985051316s) [upload=14047]: Upload finished. err: <nil> Duration: 5.840471389s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 7.438907689s FAIL (2025-08-09 07:05:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.43893407s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [........X...........X.........................X.............] duration: 5.839083241s FAIL (2025-08-09 07:05:20 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 06:53:23.698655854 (13h27m18.129735985s) [upload=14047]: Starting upload Aug 9 06:53:23.698701853 (13h27m18.129781984s) [upload=14047]: Done starting upload Aug 9 06:53:23.698818386 (13h27m18.129898517s) [upload=14047]: Uploading segments... Aug 9 06:53:23.698936432 (13h27m18.130016563s) [upload=14047]: Got next segment. Inline: false Aug 9 06:53:23.698961630 (13h27m18.130041751s) [upload=14047]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 06:53:23.698965578 (13h27m18.130045709s) [upload=14047]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 06:53:24.147107598 (13h27m18.578187729s) [seg_pos={0 0}, upload=14047]: Begin upload segment... Aug 9 06:53:24.147148396 (13h27m18.578228527s) [seg_pos={0 0}, upload=14047]: Done begin upload segment. Aug 9 06:53:24.147167211 (13h27m18.578247332s) [noise=true , address=104.36.82.53:4148 , piece_id=PBFRQR2HU2V6CKDDHTWDSTZOLENV5CF62TVT27MB3FTQFKHC52EA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147175809 (13h27m18.57825594s) [noise=true , address=64.49.13.138:4488 , piece_id=F5IF7WY3WR47RA4YVR4STHJWU42I4DOBWU6TBXLNFBC66E4DWIFA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147518354 (13h27m18.578598485s) [noise=true , address=104.36.82.62:4415 , piece_id=X4UVHS5A7SSUREOM2Q7BKZMNMGWHMLTSZJJ3GEOB4YYIVEZTFVQQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147522181 (13h27m18.578602312s) [noise=true , address=104.36.82.56:4240 , piece_id=VOC4BN7IZPU5CHDJNZZ4KABZ4HAZDGUWSBE77SISEHXVYN7XXPCQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147796335 (13h27m18.578876466s) [noise=true , address=104.36.82.46:4507 , piece_id=YEY6UXEN3NOPA2K7MDIFOAALSFEZBOLIIBC5MJHLCJMDDUIH3TLQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147802567 (13h27m18.578882698s) [noise=true , address=104.36.82.2:4759 , piece_id=666T4FY5B22N44774DXRPYMDDHV7RIYBTKW6SRP6N72T3Y5MOXRA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148101780 (13h27m18.579181911s) [noise=true , address=104.36.82.37:4676 , piece_id=KZTTGDTIL7SZWAXQTHCFHAWAHQ7YA7ABCFKJDNTGHXASIA757BOA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148146495 (13h27m18.579226627s) [noise=true , address=104.36.82.35:4609 , piece_id=QDZD247HRDA66EXEE7YDK6K3OSBG5ILBLAWGPHX7QT4RBHD4A5XA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148380853 (13h27m18.579460984s) [noise=true , address=104.36.82.23:4473 , piece_id=PMYUW3E2H7D7SLPNMU4VYGFIVZVVY5WG3NKAQ725IQCEZADLZO4Q, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148440258 (13h27m18.579520379s) [noise=true , address=104.36.82.43:4843 , piece_id=QHDB7EE2RAOL4FHF2KSPIHFJJJ66ZSMYSMWQEDF2HMPNG6RCQZSA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148676068 (13h27m18.57975622s) [noise=true , address=104.36.82.44:4903 , piece_id=LXHMV2U2MJCTDODM5FGN6LVBA43FPJ74CNJCTTGUGD6DEODIFNNA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148708771 (13h27m18.579788902s) [noise=true , address=104.36.82.17:4339 , piece_id=IDJB6R6JA3UEX2NSOLS32F2GGPDYK2YOJDPMFCBDVPHHX4NYC4FQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148907121 (13h27m18.579987252s) [noise=true , address=104.36.82.58:4274 , piece_id=ORKTJIO2PWDE42CILRXXLGMVWGTMHN4UMHNVOY6GYF5INLX7SDYQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148929253 (13h27m18.580009374s) [noise=true , address=104.36.82.9:4009 , piece_id=XHFRPO3N3UZ3P6EJQNXOUTEPEZ47QRMPUF67SDYD7N6BXZJKMKHQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.149162189 (13h27m18.58024232s) [noise=true , address=104.36.82.35:4586 , piece_id=ST4P74ZRAEEKG3SYKKUGDJO7YBKTK257QHACXEEORBO2ZF6HD5SQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.149190884 (13h27m18.580271015s) [noise=true , address=104.36.82.59:4304 , piece_id=YZGOJYVR5IKG6VJKBVSSEFUKI4OHH6WZ3RZDOZGNWOFZYONQ7PQA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.149437786 (13h27m18.580517917s) [noise=true , address=104.36.82.20:4459 , piece_id=KLMZ23ZYRGLMIT7W6HNYPLAZTBY3RYRB6MX6AJMXHXPUXPA2SYFA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.149710999 (13h27m18.58079113s) [noise=true , address=104.36.82.19:4405 , piece_id=B45PJFW7IS5AFP6M6A22RJ362ZY6KXIL2UFZKWLAKJPRUVEMRYWQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:25.315864117 (13h27m19.746944248s) [upload=14047]: Next returned nil segment Aug 9 06:53:25.315886619 (13h27m19.746966751s) [upload=14047]: Waiting for error group managing segments... Aug 9 06:53:25.610133629 (13h27m20.04121375s) [noise=true , address=64.49.13.138:4488 , piece_id=F5IF7WY3WR47RA4YVR4STHJWU42I4DOBWU6TBXLNFBC66E4DWIFA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.044777484 (13h27m20.475857615s) [noise=true , address=104.36.82.59:4304 , piece_id=YZGOJYVR5IKG6VJKBVSSEFUKI4OHH6WZ3RZDOZGNWOFZYONQ7PQA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.049095655 (13h27m20.480175786s) [noise=true , address=104.36.82.62:4415 , piece_id=X4UVHS5A7SSUREOM2Q7BKZMNMGWHMLTSZJJ3GEOB4YYIVEZTFVQQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.053167005 (13h27m20.484247126s) [noise=true , address=104.36.82.35:4609 , piece_id=QDZD247HRDA66EXEE7YDK6K3OSBG5ILBLAWGPHX7QT4RBHD4A5XA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.073521951 (13h27m20.504602082s) [noise=true , address=104.36.82.19:4405 , piece_id=B45PJFW7IS5AFP6M6A22RJ362ZY6KXIL2UFZKWLAKJPRUVEMRYWQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.080957829 (13h27m20.51203796s) [noise=true , address=104.36.82.17:4339 , piece_id=IDJB6R6JA3UEX2NSOLS32F2GGPDYK2YOJDPMFCBDVPHHX4NYC4FQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.114325732 (13h27m20.545405863s) [noise=true , address=104.36.82.46:4507 , piece_id=YEY6UXEN3NOPA2K7MDIFOAALSFEZBOLIIBC5MJHLCJMDDUIH3TLQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.115488496 (13h27m20.546568617s) [noise=true , address=104.36.82.9:4009 , piece_id=XHFRPO3N3UZ3P6EJQNXOUTEPEZ47QRMPUF67SDYD7N6BXZJKMKHQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.137155292 (13h27m20.568235433s) [noise=true , address=104.36.82.35:4586 , piece_id=ST4P74ZRAEEKG3SYKKUGDJO7YBKTK257QHACXEEORBO2ZF6HD5SQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.137440217 (13h27m20.568520338s) [noise=true , address=104.36.82.2:4759 , piece_id=666T4FY5B22N44774DXRPYMDDHV7RIYBTKW6SRP6N72T3Y5MOXRA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.143705214 (13h27m20.574785335s) [noise=true , address=104.36.82.43:4843 , piece_id=QHDB7EE2RAOL4FHF2KSPIHFJJJ66ZSMYSMWQEDF2HMPNG6RCQZSA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.148334121 (13h27m20.579414252s) [noise=true , address=104.36.82.20:4459 , piece_id=KLMZ23ZYRGLMIT7W6HNYPLAZTBY3RYRB6MX6AJMXHXPUXPA2SYFA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.158708109 (13h27m20.589788241s) [noise=true , address=104.36.82.58:4274 , piece_id=ORKTJIO2PWDE42CILRXXLGMVWGTMHN4UMHNVOY6GYF5INLX7SDYQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.165754843 (13h27m20.596834974s) [noise=true , address=104.36.82.56:4240 , piece_id=VOC4BN7IZPU5CHDJNZZ4KABZ4HAZDGUWSBE77SISEHXVYN7XXPCQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.165787094 (13h27m20.596867225s) [seg_pos={0 0}, upload=14047]: Segment reached optimal threshold of 14 pieces. Aug 9 06:53:26.165906083 (13h27m20.596986214s) [noise=true , address=104.36.82.44:4903 , piece_id=LXHMV2U2MJCTDODM5FGN6LVBA43FPJ74CNJCTTGUGD6DEODIFNNA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq): protocol: expected piece hash; context canceled; EOF Aug 9 06:53:26.165964404 (13h27m20.597044535s) [noise=true , address=104.36.82.37:4676 , piece_id=KZTTGDTIL7SZWAXQTHCFHAWAHQ7YA7ABCFKJDNTGHXASIA757BOA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yqKh7gMSrXWavfChEJRX7tV5rS9xTSo4SbmgPMtnYKfgbvF8): protocol: expected piece hash; context canceled; EOF Aug 9 06:53:26.166011994 (13h27m20.597092125s) [noise=true , address=104.36.82.23:4473 , piece_id=PMYUW3E2H7D7SLPNMU4VYGFIVZVVY5WG3NKAQ725IQCEZADLZO4Q, seg_pos={0 0}, upload=14047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 9 06:53:26.166086076 (13h27m20.597166207s) [noise=true , address=104.36.82.53:4148 , piece_id=PBFRQR2HU2V6CKDDHTWDSTZOLENV5CF62TVT27MB3FTQFKHC52EA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GGwKp8TvH5JJ8mcR4sqKcGMCc56hMEgWpAR3zqTWerqTLQ9Rv): protocol: expected piece hash; context canceled; EOF Aug 9 06:53:26.166132165 (13h27m20.597212286s) [seg_pos={0 0}, upload=14047]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 06:53:26.166221175 (13h27m20.597301306s) [upload=14047]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 06:53:26.166226024 (13h27m20.597306145s) [upload=14047]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 06:53:26.553951687 (13h27m20.985031819s) [upload=14047]: Done uploading segments... Aug 9 06:53:26.553971185 (13h27m20.985051316s) [upload=14047]: Upload finished. err: <nil> Duration: 5.83910938s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 8.99492208s FAIL (2025-08-09 07:04:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 8.994954671s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.001793639s FAIL (2025-08-09 07:04:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.001815392s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........X...........X.........................X............] duration: 5.709930726s FAIL (2025-08-09 07:04:15 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 06:53:23.698655854 (13h27m18.129735985s) [upload=14047]: Starting upload Aug 9 06:53:23.698701853 (13h27m18.129781984s) [upload=14047]: Done starting upload Aug 9 06:53:23.698818386 (13h27m18.129898517s) [upload=14047]: Uploading segments... Aug 9 06:53:23.698936432 (13h27m18.130016563s) [upload=14047]: Got next segment. Inline: false Aug 9 06:53:23.698961630 (13h27m18.130041751s) [upload=14047]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 06:53:23.698965578 (13h27m18.130045709s) [upload=14047]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 06:53:24.147107598 (13h27m18.578187729s) [seg_pos={0 0}, upload=14047]: Begin upload segment... Aug 9 06:53:24.147148396 (13h27m18.578228527s) [seg_pos={0 0}, upload=14047]: Done begin upload segment. Aug 9 06:53:24.147167211 (13h27m18.578247332s) [noise=true , address=104.36.82.53:4148 , piece_id=PBFRQR2HU2V6CKDDHTWDSTZOLENV5CF62TVT27MB3FTQFKHC52EA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147175809 (13h27m18.57825594s) [noise=true , address=64.49.13.138:4488 , piece_id=F5IF7WY3WR47RA4YVR4STHJWU42I4DOBWU6TBXLNFBC66E4DWIFA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147518354 (13h27m18.578598485s) [noise=true , address=104.36.82.62:4415 , piece_id=X4UVHS5A7SSUREOM2Q7BKZMNMGWHMLTSZJJ3GEOB4YYIVEZTFVQQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147522181 (13h27m18.578602312s) [noise=true , address=104.36.82.56:4240 , piece_id=VOC4BN7IZPU5CHDJNZZ4KABZ4HAZDGUWSBE77SISEHXVYN7XXPCQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147796335 (13h27m18.578876466s) [noise=true , address=104.36.82.46:4507 , piece_id=YEY6UXEN3NOPA2K7MDIFOAALSFEZBOLIIBC5MJHLCJMDDUIH3TLQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147802567 (13h27m18.578882698s) [noise=true , address=104.36.82.2:4759 , piece_id=666T4FY5B22N44774DXRPYMDDHV7RIYBTKW6SRP6N72T3Y5MOXRA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148101780 (13h27m18.579181911s) [noise=true , address=104.36.82.37:4676 , piece_id=KZTTGDTIL7SZWAXQTHCFHAWAHQ7YA7ABCFKJDNTGHXASIA757BOA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148146495 (13h27m18.579226627s) [noise=true , address=104.36.82.35:4609 , piece_id=QDZD247HRDA66EXEE7YDK6K3OSBG5ILBLAWGPHX7QT4RBHD4A5XA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148380853 (13h27m18.579460984s) [noise=true , address=104.36.82.23:4473 , piece_id=PMYUW3E2H7D7SLPNMU4VYGFIVZVVY5WG3NKAQ725IQCEZADLZO4Q, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148440258 (13h27m18.579520379s) [noise=true , address=104.36.82.43:4843 , piece_id=QHDB7EE2RAOL4FHF2KSPIHFJJJ66ZSMYSMWQEDF2HMPNG6RCQZSA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148676068 (13h27m18.57975622s) [noise=true , address=104.36.82.44:4903 , piece_id=LXHMV2U2MJCTDODM5FGN6LVBA43FPJ74CNJCTTGUGD6DEODIFNNA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148708771 (13h27m18.579788902s) [noise=true , address=104.36.82.17:4339 , piece_id=IDJB6R6JA3UEX2NSOLS32F2GGPDYK2YOJDPMFCBDVPHHX4NYC4FQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148907121 (13h27m18.579987252s) [noise=true , address=104.36.82.58:4274 , piece_id=ORKTJIO2PWDE42CILRXXLGMVWGTMHN4UMHNVOY6GYF5INLX7SDYQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148929253 (13h27m18.580009374s) [noise=true , address=104.36.82.9:4009 , piece_id=XHFRPO3N3UZ3P6EJQNXOUTEPEZ47QRMPUF67SDYD7N6BXZJKMKHQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.149162189 (13h27m18.58024232s) [noise=true , address=104.36.82.35:4586 , piece_id=ST4P74ZRAEEKG3SYKKUGDJO7YBKTK257QHACXEEORBO2ZF6HD5SQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.149190884 (13h27m18.580271015s) [noise=true , address=104.36.82.59:4304 , piece_id=YZGOJYVR5IKG6VJKBVSSEFUKI4OHH6WZ3RZDOZGNWOFZYONQ7PQA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.149437786 (13h27m18.580517917s) [noise=true , address=104.36.82.20:4459 , piece_id=KLMZ23ZYRGLMIT7W6HNYPLAZTBY3RYRB6MX6AJMXHXPUXPA2SYFA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.149710999 (13h27m18.58079113s) [noise=true , address=104.36.82.19:4405 , piece_id=B45PJFW7IS5AFP6M6A22RJ362ZY6KXIL2UFZKWLAKJPRUVEMRYWQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:25.315864117 (13h27m19.746944248s) [upload=14047]: Next returned nil segment Aug 9 06:53:25.315886619 (13h27m19.746966751s) [upload=14047]: Waiting for error group managing segments... Aug 9 06:53:25.610133629 (13h27m20.04121375s) [noise=true , address=64.49.13.138:4488 , piece_id=F5IF7WY3WR47RA4YVR4STHJWU42I4DOBWU6TBXLNFBC66E4DWIFA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.044777484 (13h27m20.475857615s) [noise=true , address=104.36.82.59:4304 , piece_id=YZGOJYVR5IKG6VJKBVSSEFUKI4OHH6WZ3RZDOZGNWOFZYONQ7PQA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.049095655 (13h27m20.480175786s) [noise=true , address=104.36.82.62:4415 , piece_id=X4UVHS5A7SSUREOM2Q7BKZMNMGWHMLTSZJJ3GEOB4YYIVEZTFVQQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.053167005 (13h27m20.484247126s) [noise=true , address=104.36.82.35:4609 , piece_id=QDZD247HRDA66EXEE7YDK6K3OSBG5ILBLAWGPHX7QT4RBHD4A5XA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.073521951 (13h27m20.504602082s) [noise=true , address=104.36.82.19:4405 , piece_id=B45PJFW7IS5AFP6M6A22RJ362ZY6KXIL2UFZKWLAKJPRUVEMRYWQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.080957829 (13h27m20.51203796s) [noise=true , address=104.36.82.17:4339 , piece_id=IDJB6R6JA3UEX2NSOLS32F2GGPDYK2YOJDPMFCBDVPHHX4NYC4FQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.114325732 (13h27m20.545405863s) [noise=true , address=104.36.82.46:4507 , piece_id=YEY6UXEN3NOPA2K7MDIFOAALSFEZBOLIIBC5MJHLCJMDDUIH3TLQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.115488496 (13h27m20.546568617s) [noise=true , address=104.36.82.9:4009 , piece_id=XHFRPO3N3UZ3P6EJQNXOUTEPEZ47QRMPUF67SDYD7N6BXZJKMKHQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.137155292 (13h27m20.568235433s) [noise=true , address=104.36.82.35:4586 , piece_id=ST4P74ZRAEEKG3SYKKUGDJO7YBKTK257QHACXEEORBO2ZF6HD5SQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.137440217 (13h27m20.568520338s) [noise=true , address=104.36.82.2:4759 , piece_id=666T4FY5B22N44774DXRPYMDDHV7RIYBTKW6SRP6N72T3Y5MOXRA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.143705214 (13h27m20.574785335s) [noise=true , address=104.36.82.43:4843 , piece_id=QHDB7EE2RAOL4FHF2KSPIHFJJJ66ZSMYSMWQEDF2HMPNG6RCQZSA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.148334121 (13h27m20.579414252s) [noise=true , address=104.36.82.20:4459 , piece_id=KLMZ23ZYRGLMIT7W6HNYPLAZTBY3RYRB6MX6AJMXHXPUXPA2SYFA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.158708109 (13h27m20.589788241s) [noise=true , address=104.36.82.58:4274 , piece_id=ORKTJIO2PWDE42CILRXXLGMVWGTMHN4UMHNVOY6GYF5INLX7SDYQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.165754843 (13h27m20.596834974s) [noise=true , address=104.36.82.56:4240 , piece_id=VOC4BN7IZPU5CHDJNZZ4KABZ4HAZDGUWSBE77SISEHXVYN7XXPCQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.165787094 (13h27m20.596867225s) [seg_pos={0 0}, upload=14047]: Segment reached optimal threshold of 14 pieces. Aug 9 06:53:26.165906083 (13h27m20.596986214s) [noise=true , address=104.36.82.44:4903 , piece_id=LXHMV2U2MJCTDODM5FGN6LVBA43FPJ74CNJCTTGUGD6DEODIFNNA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq): protocol: expected piece hash; context canceled; EOF Aug 9 06:53:26.165964404 (13h27m20.597044535s) [noise=true , address=104.36.82.37:4676 , piece_id=KZTTGDTIL7SZWAXQTHCFHAWAHQ7YA7ABCFKJDNTGHXASIA757BOA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yqKh7gMSrXWavfChEJRX7tV5rS9xTSo4SbmgPMtnYKfgbvF8): protocol: expected piece hash; context canceled; EOF Aug 9 06:53:26.166011994 (13h27m20.597092125s) [noise=true , address=104.36.82.23:4473 , piece_id=PMYUW3E2H7D7SLPNMU4VYGFIVZVVY5WG3NKAQ725IQCEZADLZO4Q, seg_pos={0 0}, upload=14047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 9 06:53:26.166086076 (13h27m20.597166207s) [noise=true , address=104.36.82.53:4148 , piece_id=PBFRQR2HU2V6CKDDHTWDSTZOLENV5CF62TVT27MB3FTQFKHC52EA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GGwKp8TvH5JJ8mcR4sqKcGMCc56hMEgWpAR3zqTWerqTLQ9Rv): protocol: expected piece hash; context canceled; EOF Aug 9 06:53:26.166132165 (13h27m20.597212286s) [seg_pos={0 0}, upload=14047]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 06:53:26.166221175 (13h27m20.597301306s) [upload=14047]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 06:53:26.166226024 (13h27m20.597306145s) [upload=14047]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 06:53:26.553951687 (13h27m20.985031819s) [upload=14047]: Done uploading segments... Aug 9 06:53:26.553971185 (13h27m20.985051316s) [upload=14047]: Upload finished. err: <nil> Duration: 5.709950043s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..........X...........X.........................X...........] duration: 5.817342015s FAIL (2025-08-09 07:03:45 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 06:53:23.698655854 (13h27m18.129735985s) [upload=14047]: Starting upload Aug 9 06:53:23.698701853 (13h27m18.129781984s) [upload=14047]: Done starting upload Aug 9 06:53:23.698818386 (13h27m18.129898517s) [upload=14047]: Uploading segments... Aug 9 06:53:23.698936432 (13h27m18.130016563s) [upload=14047]: Got next segment. Inline: false Aug 9 06:53:23.698961630 (13h27m18.130041751s) [upload=14047]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 06:53:23.698965578 (13h27m18.130045709s) [upload=14047]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 06:53:24.147107598 (13h27m18.578187729s) [seg_pos={0 0}, upload=14047]: Begin upload segment... Aug 9 06:53:24.147148396 (13h27m18.578228527s) [seg_pos={0 0}, upload=14047]: Done begin upload segment. Aug 9 06:53:24.147167211 (13h27m18.578247332s) [noise=true , address=104.36.82.53:4148 , piece_id=PBFRQR2HU2V6CKDDHTWDSTZOLENV5CF62TVT27MB3FTQFKHC52EA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147175809 (13h27m18.57825594s) [noise=true , address=64.49.13.138:4488 , piece_id=F5IF7WY3WR47RA4YVR4STHJWU42I4DOBWU6TBXLNFBC66E4DWIFA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147518354 (13h27m18.578598485s) [noise=true , address=104.36.82.62:4415 , piece_id=X4UVHS5A7SSUREOM2Q7BKZMNMGWHMLTSZJJ3GEOB4YYIVEZTFVQQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147522181 (13h27m18.578602312s) [noise=true , address=104.36.82.56:4240 , piece_id=VOC4BN7IZPU5CHDJNZZ4KABZ4HAZDGUWSBE77SISEHXVYN7XXPCQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147796335 (13h27m18.578876466s) [noise=true , address=104.36.82.46:4507 , piece_id=YEY6UXEN3NOPA2K7MDIFOAALSFEZBOLIIBC5MJHLCJMDDUIH3TLQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147802567 (13h27m18.578882698s) [noise=true , address=104.36.82.2:4759 , piece_id=666T4FY5B22N44774DXRPYMDDHV7RIYBTKW6SRP6N72T3Y5MOXRA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148101780 (13h27m18.579181911s) [noise=true , address=104.36.82.37:4676 , piece_id=KZTTGDTIL7SZWAXQTHCFHAWAHQ7YA7ABCFKJDNTGHXASIA757BOA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148146495 (13h27m18.579226627s) [noise=true , address=104.36.82.35:4609 , piece_id=QDZD247HRDA66EXEE7YDK6K3OSBG5ILBLAWGPHX7QT4RBHD4A5XA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148380853 (13h27m18.579460984s) [noise=true , address=104.36.82.23:4473 , piece_id=PMYUW3E2H7D7SLPNMU4VYGFIVZVVY5WG3NKAQ725IQCEZADLZO4Q, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148440258 (13h27m18.579520379s) [noise=true , address=104.36.82.43:4843 , piece_id=QHDB7EE2RAOL4FHF2KSPIHFJJJ66ZSMYSMWQEDF2HMPNG6RCQZSA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148676068 (13h27m18.57975622s) [noise=true , address=104.36.82.44:4903 , piece_id=LXHMV2U2MJCTDODM5FGN6LVBA43FPJ74CNJCTTGUGD6DEODIFNNA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148708771 (13h27m18.579788902s) [noise=true , address=104.36.82.17:4339 , piece_id=IDJB6R6JA3UEX2NSOLS32F2GGPDYK2YOJDPMFCBDVPHHX4NYC4FQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148907121 (13h27m18.579987252s) [noise=true , address=104.36.82.58:4274 , piece_id=ORKTJIO2PWDE42CILRXXLGMVWGTMHN4UMHNVOY6GYF5INLX7SDYQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148929253 (13h27m18.580009374s) [noise=true , address=104.36.82.9:4009 , piece_id=XHFRPO3N3UZ3P6EJQNXOUTEPEZ47QRMPUF67SDYD7N6BXZJKMKHQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.149162189 (13h27m18.58024232s) [noise=true , address=104.36.82.35:4586 , piece_id=ST4P74ZRAEEKG3SYKKUGDJO7YBKTK257QHACXEEORBO2ZF6HD5SQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.149190884 (13h27m18.580271015s) [noise=true , address=104.36.82.59:4304 , piece_id=YZGOJYVR5IKG6VJKBVSSEFUKI4OHH6WZ3RZDOZGNWOFZYONQ7PQA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.149437786 (13h27m18.580517917s) [noise=true , address=104.36.82.20:4459 , piece_id=KLMZ23ZYRGLMIT7W6HNYPLAZTBY3RYRB6MX6AJMXHXPUXPA2SYFA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.149710999 (13h27m18.58079113s) [noise=true , address=104.36.82.19:4405 , piece_id=B45PJFW7IS5AFP6M6A22RJ362ZY6KXIL2UFZKWLAKJPRUVEMRYWQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:25.315864117 (13h27m19.746944248s) [upload=14047]: Next returned nil segment Aug 9 06:53:25.315886619 (13h27m19.746966751s) [upload=14047]: Waiting for error group managing segments... Aug 9 06:53:25.610133629 (13h27m20.04121375s) [noise=true , address=64.49.13.138:4488 , piece_id=F5IF7WY3WR47RA4YVR4STHJWU42I4DOBWU6TBXLNFBC66E4DWIFA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.044777484 (13h27m20.475857615s) [noise=true , address=104.36.82.59:4304 , piece_id=YZGOJYVR5IKG6VJKBVSSEFUKI4OHH6WZ3RZDOZGNWOFZYONQ7PQA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.049095655 (13h27m20.480175786s) [noise=true , address=104.36.82.62:4415 , piece_id=X4UVHS5A7SSUREOM2Q7BKZMNMGWHMLTSZJJ3GEOB4YYIVEZTFVQQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.053167005 (13h27m20.484247126s) [noise=true , address=104.36.82.35:4609 , piece_id=QDZD247HRDA66EXEE7YDK6K3OSBG5ILBLAWGPHX7QT4RBHD4A5XA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.073521951 (13h27m20.504602082s) [noise=true , address=104.36.82.19:4405 , piece_id=B45PJFW7IS5AFP6M6A22RJ362ZY6KXIL2UFZKWLAKJPRUVEMRYWQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.080957829 (13h27m20.51203796s) [noise=true , address=104.36.82.17:4339 , piece_id=IDJB6R6JA3UEX2NSOLS32F2GGPDYK2YOJDPMFCBDVPHHX4NYC4FQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.114325732 (13h27m20.545405863s) [noise=true , address=104.36.82.46:4507 , piece_id=YEY6UXEN3NOPA2K7MDIFOAALSFEZBOLIIBC5MJHLCJMDDUIH3TLQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.115488496 (13h27m20.546568617s) [noise=true , address=104.36.82.9:4009 , piece_id=XHFRPO3N3UZ3P6EJQNXOUTEPEZ47QRMPUF67SDYD7N6BXZJKMKHQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.137155292 (13h27m20.568235433s) [noise=true , address=104.36.82.35:4586 , piece_id=ST4P74ZRAEEKG3SYKKUGDJO7YBKTK257QHACXEEORBO2ZF6HD5SQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.137440217 (13h27m20.568520338s) [noise=true , address=104.36.82.2:4759 , piece_id=666T4FY5B22N44774DXRPYMDDHV7RIYBTKW6SRP6N72T3Y5MOXRA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.143705214 (13h27m20.574785335s) [noise=true , address=104.36.82.43:4843 , piece_id=QHDB7EE2RAOL4FHF2KSPIHFJJJ66ZSMYSMWQEDF2HMPNG6RCQZSA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.148334121 (13h27m20.579414252s) [noise=true , address=104.36.82.20:4459 , piece_id=KLMZ23ZYRGLMIT7W6HNYPLAZTBY3RYRB6MX6AJMXHXPUXPA2SYFA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.158708109 (13h27m20.589788241s) [noise=true , address=104.36.82.58:4274 , piece_id=ORKTJIO2PWDE42CILRXXLGMVWGTMHN4UMHNVOY6GYF5INLX7SDYQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.165754843 (13h27m20.596834974s) [noise=true , address=104.36.82.56:4240 , piece_id=VOC4BN7IZPU5CHDJNZZ4KABZ4HAZDGUWSBE77SISEHXVYN7XXPCQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.165787094 (13h27m20.596867225s) [seg_pos={0 0}, upload=14047]: Segment reached optimal threshold of 14 pieces. Aug 9 06:53:26.165906083 (13h27m20.596986214s) [noise=true , address=104.36.82.44:4903 , piece_id=LXHMV2U2MJCTDODM5FGN6LVBA43FPJ74CNJCTTGUGD6DEODIFNNA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq): protocol: expected piece hash; context canceled; EOF Aug 9 06:53:26.165964404 (13h27m20.597044535s) [noise=true , address=104.36.82.37:4676 , piece_id=KZTTGDTIL7SZWAXQTHCFHAWAHQ7YA7ABCFKJDNTGHXASIA757BOA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yqKh7gMSrXWavfChEJRX7tV5rS9xTSo4SbmgPMtnYKfgbvF8): protocol: expected piece hash; context canceled; EOF Aug 9 06:53:26.166011994 (13h27m20.597092125s) [noise=true , address=104.36.82.23:4473 , piece_id=PMYUW3E2H7D7SLPNMU4VYGFIVZVVY5WG3NKAQ725IQCEZADLZO4Q, seg_pos={0 0}, upload=14047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 9 06:53:26.166086076 (13h27m20.597166207s) [noise=true , address=104.36.82.53:4148 , piece_id=PBFRQR2HU2V6CKDDHTWDSTZOLENV5CF62TVT27MB3FTQFKHC52EA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GGwKp8TvH5JJ8mcR4sqKcGMCc56hMEgWpAR3zqTWerqTLQ9Rv): protocol: expected piece hash; context canceled; EOF Aug 9 06:53:26.166132165 (13h27m20.597212286s) [seg_pos={0 0}, upload=14047]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 06:53:26.166221175 (13h27m20.597301306s) [upload=14047]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 06:53:26.166226024 (13h27m20.597306145s) [upload=14047]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 06:53:26.553951687 (13h27m20.985031819s) [upload=14047]: Done uploading segments... Aug 9 06:53:26.553971185 (13h27m20.985051316s) [upload=14047]: Upload finished. err: <nil> Duration: 5.817372545s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...........X...........X.........................X..........] duration: 5.941742006s FAIL (2025-08-09 07:02:35 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 06:53:23.698655854 (13h27m18.129735985s) [upload=14047]: Starting upload Aug 9 06:53:23.698701853 (13h27m18.129781984s) [upload=14047]: Done starting upload Aug 9 06:53:23.698818386 (13h27m18.129898517s) [upload=14047]: Uploading segments... Aug 9 06:53:23.698936432 (13h27m18.130016563s) [upload=14047]: Got next segment. Inline: false Aug 9 06:53:23.698961630 (13h27m18.130041751s) [upload=14047]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 06:53:23.698965578 (13h27m18.130045709s) [upload=14047]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 06:53:24.147107598 (13h27m18.578187729s) [seg_pos={0 0}, upload=14047]: Begin upload segment... Aug 9 06:53:24.147148396 (13h27m18.578228527s) [seg_pos={0 0}, upload=14047]: Done begin upload segment. Aug 9 06:53:24.147167211 (13h27m18.578247332s) [noise=true , address=104.36.82.53:4148 , piece_id=PBFRQR2HU2V6CKDDHTWDSTZOLENV5CF62TVT27MB3FTQFKHC52EA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147175809 (13h27m18.57825594s) [noise=true , address=64.49.13.138:4488 , piece_id=F5IF7WY3WR47RA4YVR4STHJWU42I4DOBWU6TBXLNFBC66E4DWIFA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147518354 (13h27m18.578598485s) [noise=true , address=104.36.82.62:4415 , piece_id=X4UVHS5A7SSUREOM2Q7BKZMNMGWHMLTSZJJ3GEOB4YYIVEZTFVQQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147522181 (13h27m18.578602312s) [noise=true , address=104.36.82.56:4240 , piece_id=VOC4BN7IZPU5CHDJNZZ4KABZ4HAZDGUWSBE77SISEHXVYN7XXPCQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147796335 (13h27m18.578876466s) [noise=true , address=104.36.82.46:4507 , piece_id=YEY6UXEN3NOPA2K7MDIFOAALSFEZBOLIIBC5MJHLCJMDDUIH3TLQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147802567 (13h27m18.578882698s) [noise=true , address=104.36.82.2:4759 , piece_id=666T4FY5B22N44774DXRPYMDDHV7RIYBTKW6SRP6N72T3Y5MOXRA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148101780 (13h27m18.579181911s) [noise=true , address=104.36.82.37:4676 , piece_id=KZTTGDTIL7SZWAXQTHCFHAWAHQ7YA7ABCFKJDNTGHXASIA757BOA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148146495 (13h27m18.579226627s) [noise=true , address=104.36.82.35:4609 , piece_id=QDZD247HRDA66EXEE7YDK6K3OSBG5ILBLAWGPHX7QT4RBHD4A5XA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148380853 (13h27m18.579460984s) [noise=true , address=104.36.82.23:4473 , piece_id=PMYUW3E2H7D7SLPNMU4VYGFIVZVVY5WG3NKAQ725IQCEZADLZO4Q, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148440258 (13h27m18.579520379s) [noise=true , address=104.36.82.43:4843 , piece_id=QHDB7EE2RAOL4FHF2KSPIHFJJJ66ZSMYSMWQEDF2HMPNG6RCQZSA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148676068 (13h27m18.57975622s) [noise=true , address=104.36.82.44:4903 , piece_id=LXHMV2U2MJCTDODM5FGN6LVBA43FPJ74CNJCTTGUGD6DEODIFNNA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148708771 (13h27m18.579788902s) [noise=true , address=104.36.82.17:4339 , piece_id=IDJB6R6JA3UEX2NSOLS32F2GGPDYK2YOJDPMFCBDVPHHX4NYC4FQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148907121 (13h27m18.579987252s) [noise=true , address=104.36.82.58:4274 , piece_id=ORKTJIO2PWDE42CILRXXLGMVWGTMHN4UMHNVOY6GYF5INLX7SDYQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148929253 (13h27m18.580009374s) [noise=true , address=104.36.82.9:4009 , piece_id=XHFRPO3N3UZ3P6EJQNXOUTEPEZ47QRMPUF67SDYD7N6BXZJKMKHQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.149162189 (13h27m18.58024232s) [noise=true , address=104.36.82.35:4586 , piece_id=ST4P74ZRAEEKG3SYKKUGDJO7YBKTK257QHACXEEORBO2ZF6HD5SQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.149190884 (13h27m18.580271015s) [noise=true , address=104.36.82.59:4304 , piece_id=YZGOJYVR5IKG6VJKBVSSEFUKI4OHH6WZ3RZDOZGNWOFZYONQ7PQA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.149437786 (13h27m18.580517917s) [noise=true , address=104.36.82.20:4459 , piece_id=KLMZ23ZYRGLMIT7W6HNYPLAZTBY3RYRB6MX6AJMXHXPUXPA2SYFA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.149710999 (13h27m18.58079113s) [noise=true , address=104.36.82.19:4405 , piece_id=B45PJFW7IS5AFP6M6A22RJ362ZY6KXIL2UFZKWLAKJPRUVEMRYWQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:25.315864117 (13h27m19.746944248s) [upload=14047]: Next returned nil segment Aug 9 06:53:25.315886619 (13h27m19.746966751s) [upload=14047]: Waiting for error group managing segments... Aug 9 06:53:25.610133629 (13h27m20.04121375s) [noise=true , address=64.49.13.138:4488 , piece_id=F5IF7WY3WR47RA4YVR4STHJWU42I4DOBWU6TBXLNFBC66E4DWIFA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.044777484 (13h27m20.475857615s) [noise=true , address=104.36.82.59:4304 , piece_id=YZGOJYVR5IKG6VJKBVSSEFUKI4OHH6WZ3RZDOZGNWOFZYONQ7PQA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.049095655 (13h27m20.480175786s) [noise=true , address=104.36.82.62:4415 , piece_id=X4UVHS5A7SSUREOM2Q7BKZMNMGWHMLTSZJJ3GEOB4YYIVEZTFVQQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.053167005 (13h27m20.484247126s) [noise=true , address=104.36.82.35:4609 , piece_id=QDZD247HRDA66EXEE7YDK6K3OSBG5ILBLAWGPHX7QT4RBHD4A5XA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.073521951 (13h27m20.504602082s) [noise=true , address=104.36.82.19:4405 , piece_id=B45PJFW7IS5AFP6M6A22RJ362ZY6KXIL2UFZKWLAKJPRUVEMRYWQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.080957829 (13h27m20.51203796s) [noise=true , address=104.36.82.17:4339 , piece_id=IDJB6R6JA3UEX2NSOLS32F2GGPDYK2YOJDPMFCBDVPHHX4NYC4FQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.114325732 (13h27m20.545405863s) [noise=true , address=104.36.82.46:4507 , piece_id=YEY6UXEN3NOPA2K7MDIFOAALSFEZBOLIIBC5MJHLCJMDDUIH3TLQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.115488496 (13h27m20.546568617s) [noise=true , address=104.36.82.9:4009 , piece_id=XHFRPO3N3UZ3P6EJQNXOUTEPEZ47QRMPUF67SDYD7N6BXZJKMKHQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.137155292 (13h27m20.568235433s) [noise=true , address=104.36.82.35:4586 , piece_id=ST4P74ZRAEEKG3SYKKUGDJO7YBKTK257QHACXEEORBO2ZF6HD5SQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.137440217 (13h27m20.568520338s) [noise=true , address=104.36.82.2:4759 , piece_id=666T4FY5B22N44774DXRPYMDDHV7RIYBTKW6SRP6N72T3Y5MOXRA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.143705214 (13h27m20.574785335s) [noise=true , address=104.36.82.43:4843 , piece_id=QHDB7EE2RAOL4FHF2KSPIHFJJJ66ZSMYSMWQEDF2HMPNG6RCQZSA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.148334121 (13h27m20.579414252s) [noise=true , address=104.36.82.20:4459 , piece_id=KLMZ23ZYRGLMIT7W6HNYPLAZTBY3RYRB6MX6AJMXHXPUXPA2SYFA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.158708109 (13h27m20.589788241s) [noise=true , address=104.36.82.58:4274 , piece_id=ORKTJIO2PWDE42CILRXXLGMVWGTMHN4UMHNVOY6GYF5INLX7SDYQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.165754843 (13h27m20.596834974s) [noise=true , address=104.36.82.56:4240 , piece_id=VOC4BN7IZPU5CHDJNZZ4KABZ4HAZDGUWSBE77SISEHXVYN7XXPCQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.165787094 (13h27m20.596867225s) [seg_pos={0 0}, upload=14047]: Segment reached optimal threshold of 14 pieces. Aug 9 06:53:26.165906083 (13h27m20.596986214s) [noise=true , address=104.36.82.44:4903 , piece_id=LXHMV2U2MJCTDODM5FGN6LVBA43FPJ74CNJCTTGUGD6DEODIFNNA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq): protocol: expected piece hash; context canceled; EOF Aug 9 06:53:26.165964404 (13h27m20.597044535s) [noise=true , address=104.36.82.37:4676 , piece_id=KZTTGDTIL7SZWAXQTHCFHAWAHQ7YA7ABCFKJDNTGHXASIA757BOA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yqKh7gMSrXWavfChEJRX7tV5rS9xTSo4SbmgPMtnYKfgbvF8): protocol: expected piece hash; context canceled; EOF Aug 9 06:53:26.166011994 (13h27m20.597092125s) [noise=true , address=104.36.82.23:4473 , piece_id=PMYUW3E2H7D7SLPNMU4VYGFIVZVVY5WG3NKAQ725IQCEZADLZO4Q, seg_pos={0 0}, upload=14047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 9 06:53:26.166086076 (13h27m20.597166207s) [noise=true , address=104.36.82.53:4148 , piece_id=PBFRQR2HU2V6CKDDHTWDSTZOLENV5CF62TVT27MB3FTQFKHC52EA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GGwKp8TvH5JJ8mcR4sqKcGMCc56hMEgWpAR3zqTWerqTLQ9Rv): protocol: expected piece hash; context canceled; EOF Aug 9 06:53:26.166132165 (13h27m20.597212286s) [seg_pos={0 0}, upload=14047]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 06:53:26.166221175 (13h27m20.597301306s) [upload=14047]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 06:53:26.166226024 (13h27m20.597306145s) [upload=14047]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 06:53:26.553951687 (13h27m20.985031819s) [upload=14047]: Done uploading segments... Aug 9 06:53:26.553971185 (13h27m20.985051316s) [upload=14047]: Upload finished. err: <nil> Duration: 5.941762265s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [............X...........X.........................X.........] duration: 6.139719068s FAIL (2025-08-09 07:01:48 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 06:53:23.698655854 (13h27m18.129735985s) [upload=14047]: Starting upload Aug 9 06:53:23.698701853 (13h27m18.129781984s) [upload=14047]: Done starting upload Aug 9 06:53:23.698818386 (13h27m18.129898517s) [upload=14047]: Uploading segments... Aug 9 06:53:23.698936432 (13h27m18.130016563s) [upload=14047]: Got next segment. Inline: false Aug 9 06:53:23.698961630 (13h27m18.130041751s) [upload=14047]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 06:53:23.698965578 (13h27m18.130045709s) [upload=14047]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 06:53:24.147107598 (13h27m18.578187729s) [seg_pos={0 0}, upload=14047]: Begin upload segment... Aug 9 06:53:24.147148396 (13h27m18.578228527s) [seg_pos={0 0}, upload=14047]: Done begin upload segment. Aug 9 06:53:24.147167211 (13h27m18.578247332s) [noise=true , address=104.36.82.53:4148 , piece_id=PBFRQR2HU2V6CKDDHTWDSTZOLENV5CF62TVT27MB3FTQFKHC52EA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147175809 (13h27m18.57825594s) [noise=true , address=64.49.13.138:4488 , piece_id=F5IF7WY3WR47RA4YVR4STHJWU42I4DOBWU6TBXLNFBC66E4DWIFA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147518354 (13h27m18.578598485s) [noise=true , address=104.36.82.62:4415 , piece_id=X4UVHS5A7SSUREOM2Q7BKZMNMGWHMLTSZJJ3GEOB4YYIVEZTFVQQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147522181 (13h27m18.578602312s) [noise=true , address=104.36.82.56:4240 , piece_id=VOC4BN7IZPU5CHDJNZZ4KABZ4HAZDGUWSBE77SISEHXVYN7XXPCQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147796335 (13h27m18.578876466s) [noise=true , address=104.36.82.46:4507 , piece_id=YEY6UXEN3NOPA2K7MDIFOAALSFEZBOLIIBC5MJHLCJMDDUIH3TLQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147802567 (13h27m18.578882698s) [noise=true , address=104.36.82.2:4759 , piece_id=666T4FY5B22N44774DXRPYMDDHV7RIYBTKW6SRP6N72T3Y5MOXRA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148101780 (13h27m18.579181911s) [noise=true , address=104.36.82.37:4676 , piece_id=KZTTGDTIL7SZWAXQTHCFHAWAHQ7YA7ABCFKJDNTGHXASIA757BOA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148146495 (13h27m18.579226627s) [noise=true , address=104.36.82.35:4609 , piece_id=QDZD247HRDA66EXEE7YDK6K3OSBG5ILBLAWGPHX7QT4RBHD4A5XA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148380853 (13h27m18.579460984s) [noise=true , address=104.36.82.23:4473 , piece_id=PMYUW3E2H7D7SLPNMU4VYGFIVZVVY5WG3NKAQ725IQCEZADLZO4Q, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148440258 (13h27m18.579520379s) [noise=true , address=104.36.82.43:4843 , piece_id=QHDB7EE2RAOL4FHF2KSPIHFJJJ66ZSMYSMWQEDF2HMPNG6RCQZSA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148676068 (13h27m18.57975622s) [noise=true , address=104.36.82.44:4903 , piece_id=LXHMV2U2MJCTDODM5FGN6LVBA43FPJ74CNJCTTGUGD6DEODIFNNA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148708771 (13h27m18.579788902s) [noise=true , address=104.36.82.17:4339 , piece_id=IDJB6R6JA3UEX2NSOLS32F2GGPDYK2YOJDPMFCBDVPHHX4NYC4FQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148907121 (13h27m18.579987252s) [noise=true , address=104.36.82.58:4274 , piece_id=ORKTJIO2PWDE42CILRXXLGMVWGTMHN4UMHNVOY6GYF5INLX7SDYQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148929253 (13h27m18.580009374s) [noise=true , address=104.36.82.9:4009 , piece_id=XHFRPO3N3UZ3P6EJQNXOUTEPEZ47QRMPUF67SDYD7N6BXZJKMKHQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.149162189 (13h27m18.58024232s) [noise=true , address=104.36.82.35:4586 , piece_id=ST4P74ZRAEEKG3SYKKUGDJO7YBKTK257QHACXEEORBO2ZF6HD5SQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.149190884 (13h27m18.580271015s) [noise=true , address=104.36.82.59:4304 , piece_id=YZGOJYVR5IKG6VJKBVSSEFUKI4OHH6WZ3RZDOZGNWOFZYONQ7PQA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.149437786 (13h27m18.580517917s) [noise=true , address=104.36.82.20:4459 , piece_id=KLMZ23ZYRGLMIT7W6HNYPLAZTBY3RYRB6MX6AJMXHXPUXPA2SYFA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.149710999 (13h27m18.58079113s) [noise=true , address=104.36.82.19:4405 , piece_id=B45PJFW7IS5AFP6M6A22RJ362ZY6KXIL2UFZKWLAKJPRUVEMRYWQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:25.315864117 (13h27m19.746944248s) [upload=14047]: Next returned nil segment Aug 9 06:53:25.315886619 (13h27m19.746966751s) [upload=14047]: Waiting for error group managing segments... Aug 9 06:53:25.610133629 (13h27m20.04121375s) [noise=true , address=64.49.13.138:4488 , piece_id=F5IF7WY3WR47RA4YVR4STHJWU42I4DOBWU6TBXLNFBC66E4DWIFA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.044777484 (13h27m20.475857615s) [noise=true , address=104.36.82.59:4304 , piece_id=YZGOJYVR5IKG6VJKBVSSEFUKI4OHH6WZ3RZDOZGNWOFZYONQ7PQA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.049095655 (13h27m20.480175786s) [noise=true , address=104.36.82.62:4415 , piece_id=X4UVHS5A7SSUREOM2Q7BKZMNMGWHMLTSZJJ3GEOB4YYIVEZTFVQQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.053167005 (13h27m20.484247126s) [noise=true , address=104.36.82.35:4609 , piece_id=QDZD247HRDA66EXEE7YDK6K3OSBG5ILBLAWGPHX7QT4RBHD4A5XA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.073521951 (13h27m20.504602082s) [noise=true , address=104.36.82.19:4405 , piece_id=B45PJFW7IS5AFP6M6A22RJ362ZY6KXIL2UFZKWLAKJPRUVEMRYWQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.080957829 (13h27m20.51203796s) [noise=true , address=104.36.82.17:4339 , piece_id=IDJB6R6JA3UEX2NSOLS32F2GGPDYK2YOJDPMFCBDVPHHX4NYC4FQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.114325732 (13h27m20.545405863s) [noise=true , address=104.36.82.46:4507 , piece_id=YEY6UXEN3NOPA2K7MDIFOAALSFEZBOLIIBC5MJHLCJMDDUIH3TLQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.115488496 (13h27m20.546568617s) [noise=true , address=104.36.82.9:4009 , piece_id=XHFRPO3N3UZ3P6EJQNXOUTEPEZ47QRMPUF67SDYD7N6BXZJKMKHQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.137155292 (13h27m20.568235433s) [noise=true , address=104.36.82.35:4586 , piece_id=ST4P74ZRAEEKG3SYKKUGDJO7YBKTK257QHACXEEORBO2ZF6HD5SQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.137440217 (13h27m20.568520338s) [noise=true , address=104.36.82.2:4759 , piece_id=666T4FY5B22N44774DXRPYMDDHV7RIYBTKW6SRP6N72T3Y5MOXRA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.143705214 (13h27m20.574785335s) [noise=true , address=104.36.82.43:4843 , piece_id=QHDB7EE2RAOL4FHF2KSPIHFJJJ66ZSMYSMWQEDF2HMPNG6RCQZSA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.148334121 (13h27m20.579414252s) [noise=true , address=104.36.82.20:4459 , piece_id=KLMZ23ZYRGLMIT7W6HNYPLAZTBY3RYRB6MX6AJMXHXPUXPA2SYFA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.158708109 (13h27m20.589788241s) [noise=true , address=104.36.82.58:4274 , piece_id=ORKTJIO2PWDE42CILRXXLGMVWGTMHN4UMHNVOY6GYF5INLX7SDYQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.165754843 (13h27m20.596834974s) [noise=true , address=104.36.82.56:4240 , piece_id=VOC4BN7IZPU5CHDJNZZ4KABZ4HAZDGUWSBE77SISEHXVYN7XXPCQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.165787094 (13h27m20.596867225s) [seg_pos={0 0}, upload=14047]: Segment reached optimal threshold of 14 pieces. Aug 9 06:53:26.165906083 (13h27m20.596986214s) [noise=true , address=104.36.82.44:4903 , piece_id=LXHMV2U2MJCTDODM5FGN6LVBA43FPJ74CNJCTTGUGD6DEODIFNNA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq): protocol: expected piece hash; context canceled; EOF Aug 9 06:53:26.165964404 (13h27m20.597044535s) [noise=true , address=104.36.82.37:4676 , piece_id=KZTTGDTIL7SZWAXQTHCFHAWAHQ7YA7ABCFKJDNTGHXASIA757BOA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yqKh7gMSrXWavfChEJRX7tV5rS9xTSo4SbmgPMtnYKfgbvF8): protocol: expected piece hash; context canceled; EOF Aug 9 06:53:26.166011994 (13h27m20.597092125s) [noise=true , address=104.36.82.23:4473 , piece_id=PMYUW3E2H7D7SLPNMU4VYGFIVZVVY5WG3NKAQ725IQCEZADLZO4Q, seg_pos={0 0}, upload=14047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 9 06:53:26.166086076 (13h27m20.597166207s) [noise=true , address=104.36.82.53:4148 , piece_id=PBFRQR2HU2V6CKDDHTWDSTZOLENV5CF62TVT27MB3FTQFKHC52EA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GGwKp8TvH5JJ8mcR4sqKcGMCc56hMEgWpAR3zqTWerqTLQ9Rv): protocol: expected piece hash; context canceled; EOF Aug 9 06:53:26.166132165 (13h27m20.597212286s) [seg_pos={0 0}, upload=14047]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 06:53:26.166221175 (13h27m20.597301306s) [upload=14047]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 06:53:26.166226024 (13h27m20.597306145s) [upload=14047]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 06:53:26.553951687 (13h27m20.985031819s) [upload=14047]: Done uploading segments... Aug 9 06:53:26.553971185 (13h27m20.985051316s) [upload=14047]: Upload finished. err: <nil> Duration: 6.139743666s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.............X...........X.........................X........] duration: 5.708167352s FAIL (2025-08-09 07:00:47 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 06:53:23.698655854 (13h27m18.129735985s) [upload=14047]: Starting upload Aug 9 06:53:23.698701853 (13h27m18.129781984s) [upload=14047]: Done starting upload Aug 9 06:53:23.698818386 (13h27m18.129898517s) [upload=14047]: Uploading segments... Aug 9 06:53:23.698936432 (13h27m18.130016563s) [upload=14047]: Got next segment. Inline: false Aug 9 06:53:23.698961630 (13h27m18.130041751s) [upload=14047]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 06:53:23.698965578 (13h27m18.130045709s) [upload=14047]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 06:53:24.147107598 (13h27m18.578187729s) [seg_pos={0 0}, upload=14047]: Begin upload segment... Aug 9 06:53:24.147148396 (13h27m18.578228527s) [seg_pos={0 0}, upload=14047]: Done begin upload segment. Aug 9 06:53:24.147167211 (13h27m18.578247332s) [noise=true , address=104.36.82.53:4148 , piece_id=PBFRQR2HU2V6CKDDHTWDSTZOLENV5CF62TVT27MB3FTQFKHC52EA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147175809 (13h27m18.57825594s) [noise=true , address=64.49.13.138:4488 , piece_id=F5IF7WY3WR47RA4YVR4STHJWU42I4DOBWU6TBXLNFBC66E4DWIFA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147518354 (13h27m18.578598485s) [noise=true , address=104.36.82.62:4415 , piece_id=X4UVHS5A7SSUREOM2Q7BKZMNMGWHMLTSZJJ3GEOB4YYIVEZTFVQQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147522181 (13h27m18.578602312s) [noise=true , address=104.36.82.56:4240 , piece_id=VOC4BN7IZPU5CHDJNZZ4KABZ4HAZDGUWSBE77SISEHXVYN7XXPCQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147796335 (13h27m18.578876466s) [noise=true , address=104.36.82.46:4507 , piece_id=YEY6UXEN3NOPA2K7MDIFOAALSFEZBOLIIBC5MJHLCJMDDUIH3TLQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.147802567 (13h27m18.578882698s) [noise=true , address=104.36.82.2:4759 , piece_id=666T4FY5B22N44774DXRPYMDDHV7RIYBTKW6SRP6N72T3Y5MOXRA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148101780 (13h27m18.579181911s) [noise=true , address=104.36.82.37:4676 , piece_id=KZTTGDTIL7SZWAXQTHCFHAWAHQ7YA7ABCFKJDNTGHXASIA757BOA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148146495 (13h27m18.579226627s) [noise=true , address=104.36.82.35:4609 , piece_id=QDZD247HRDA66EXEE7YDK6K3OSBG5ILBLAWGPHX7QT4RBHD4A5XA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148380853 (13h27m18.579460984s) [noise=true , address=104.36.82.23:4473 , piece_id=PMYUW3E2H7D7SLPNMU4VYGFIVZVVY5WG3NKAQ725IQCEZADLZO4Q, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148440258 (13h27m18.579520379s) [noise=true , address=104.36.82.43:4843 , piece_id=QHDB7EE2RAOL4FHF2KSPIHFJJJ66ZSMYSMWQEDF2HMPNG6RCQZSA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148676068 (13h27m18.57975622s) [noise=true , address=104.36.82.44:4903 , piece_id=LXHMV2U2MJCTDODM5FGN6LVBA43FPJ74CNJCTTGUGD6DEODIFNNA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148708771 (13h27m18.579788902s) [noise=true , address=104.36.82.17:4339 , piece_id=IDJB6R6JA3UEX2NSOLS32F2GGPDYK2YOJDPMFCBDVPHHX4NYC4FQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148907121 (13h27m18.579987252s) [noise=true , address=104.36.82.58:4274 , piece_id=ORKTJIO2PWDE42CILRXXLGMVWGTMHN4UMHNVOY6GYF5INLX7SDYQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.148929253 (13h27m18.580009374s) [noise=true , address=104.36.82.9:4009 , piece_id=XHFRPO3N3UZ3P6EJQNXOUTEPEZ47QRMPUF67SDYD7N6BXZJKMKHQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.149162189 (13h27m18.58024232s) [noise=true , address=104.36.82.35:4586 , piece_id=ST4P74ZRAEEKG3SYKKUGDJO7YBKTK257QHACXEEORBO2ZF6HD5SQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.149190884 (13h27m18.580271015s) [noise=true , address=104.36.82.59:4304 , piece_id=YZGOJYVR5IKG6VJKBVSSEFUKI4OHH6WZ3RZDOZGNWOFZYONQ7PQA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.149437786 (13h27m18.580517917s) [noise=true , address=104.36.82.20:4459 , piece_id=KLMZ23ZYRGLMIT7W6HNYPLAZTBY3RYRB6MX6AJMXHXPUXPA2SYFA, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:24.149710999 (13h27m18.58079113s) [noise=true , address=104.36.82.19:4405 , piece_id=B45PJFW7IS5AFP6M6A22RJ362ZY6KXIL2UFZKWLAKJPRUVEMRYWQ, seg_pos={0 0}, upload=14047]: Uploading piece... Aug 9 06:53:25.315864117 (13h27m19.746944248s) [upload=14047]: Next returned nil segment Aug 9 06:53:25.315886619 (13h27m19.746966751s) [upload=14047]: Waiting for error group managing segments... Aug 9 06:53:25.610133629 (13h27m20.04121375s) [noise=true , address=64.49.13.138:4488 , piece_id=F5IF7WY3WR47RA4YVR4STHJWU42I4DOBWU6TBXLNFBC66E4DWIFA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.044777484 (13h27m20.475857615s) [noise=true , address=104.36.82.59:4304 , piece_id=YZGOJYVR5IKG6VJKBVSSEFUKI4OHH6WZ3RZDOZGNWOFZYONQ7PQA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.049095655 (13h27m20.480175786s) [noise=true , address=104.36.82.62:4415 , piece_id=X4UVHS5A7SSUREOM2Q7BKZMNMGWHMLTSZJJ3GEOB4YYIVEZTFVQQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.053167005 (13h27m20.484247126s) [noise=true , address=104.36.82.35:4609 , piece_id=QDZD247HRDA66EXEE7YDK6K3OSBG5ILBLAWGPHX7QT4RBHD4A5XA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.073521951 (13h27m20.504602082s) [noise=true , address=104.36.82.19:4405 , piece_id=B45PJFW7IS5AFP6M6A22RJ362ZY6KXIL2UFZKWLAKJPRUVEMRYWQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.080957829 (13h27m20.51203796s) [noise=true , address=104.36.82.17:4339 , piece_id=IDJB6R6JA3UEX2NSOLS32F2GGPDYK2YOJDPMFCBDVPHHX4NYC4FQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.114325732 (13h27m20.545405863s) [noise=true , address=104.36.82.46:4507 , piece_id=YEY6UXEN3NOPA2K7MDIFOAALSFEZBOLIIBC5MJHLCJMDDUIH3TLQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.115488496 (13h27m20.546568617s) [noise=true , address=104.36.82.9:4009 , piece_id=XHFRPO3N3UZ3P6EJQNXOUTEPEZ47QRMPUF67SDYD7N6BXZJKMKHQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.137155292 (13h27m20.568235433s) [noise=true , address=104.36.82.35:4586 , piece_id=ST4P74ZRAEEKG3SYKKUGDJO7YBKTK257QHACXEEORBO2ZF6HD5SQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.137440217 (13h27m20.568520338s) [noise=true , address=104.36.82.2:4759 , piece_id=666T4FY5B22N44774DXRPYMDDHV7RIYBTKW6SRP6N72T3Y5MOXRA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.143705214 (13h27m20.574785335s) [noise=true , address=104.36.82.43:4843 , piece_id=QHDB7EE2RAOL4FHF2KSPIHFJJJ66ZSMYSMWQEDF2HMPNG6RCQZSA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.148334121 (13h27m20.579414252s) [noise=true , address=104.36.82.20:4459 , piece_id=KLMZ23ZYRGLMIT7W6HNYPLAZTBY3RYRB6MX6AJMXHXPUXPA2SYFA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.158708109 (13h27m20.589788241s) [noise=true , address=104.36.82.58:4274 , piece_id=ORKTJIO2PWDE42CILRXXLGMVWGTMHN4UMHNVOY6GYF5INLX7SDYQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.165754843 (13h27m20.596834974s) [noise=true , address=104.36.82.56:4240 , piece_id=VOC4BN7IZPU5CHDJNZZ4KABZ4HAZDGUWSBE77SISEHXVYN7XXPCQ, seg_pos={0 0}, upload=14047]: Done uploading piece. err: <nil> Aug 9 06:53:26.165787094 (13h27m20.596867225s) [seg_pos={0 0}, upload=14047]: Segment reached optimal threshold of 14 pieces. Aug 9 06:53:26.165906083 (13h27m20.596986214s) [noise=true , address=104.36.82.44:4903 , piece_id=LXHMV2U2MJCTDODM5FGN6LVBA43FPJ74CNJCTTGUGD6DEODIFNNA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq): protocol: expected piece hash; context canceled; EOF Aug 9 06:53:26.165964404 (13h27m20.597044535s) [noise=true , address=104.36.82.37:4676 , piece_id=KZTTGDTIL7SZWAXQTHCFHAWAHQ7YA7ABCFKJDNTGHXASIA757BOA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yqKh7gMSrXWavfChEJRX7tV5rS9xTSo4SbmgPMtnYKfgbvF8): protocol: expected piece hash; context canceled; EOF Aug 9 06:53:26.166011994 (13h27m20.597092125s) [noise=true , address=104.36.82.23:4473 , piece_id=PMYUW3E2H7D7SLPNMU4VYGFIVZVVY5WG3NKAQ725IQCEZADLZO4Q, seg_pos={0 0}, upload=14047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 9 06:53:26.166086076 (13h27m20.597166207s) [noise=true , address=104.36.82.53:4148 , piece_id=PBFRQR2HU2V6CKDDHTWDSTZOLENV5CF62TVT27MB3FTQFKHC52EA, seg_pos={0 0}, upload=14047]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GGwKp8TvH5JJ8mcR4sqKcGMCc56hMEgWpAR3zqTWerqTLQ9Rv): protocol: expected piece hash; context canceled; EOF Aug 9 06:53:26.166132165 (13h27m20.597212286s) [seg_pos={0 0}, upload=14047]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 06:53:26.166221175 (13h27m20.597301306s) [upload=14047]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 06:53:26.166226024 (13h27m20.597306145s) [upload=14047]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 06:53:26.553951687 (13h27m20.985031819s) [upload=14047]: Done uploading segments... Aug 9 06:53:26.553971185 (13h27m20.985051316s) [upload=14047]: Upload finished. err: <nil> Duration: 5.708196788s core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)