Orbiter History

checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 9.613028676s FAIL (2025-08-08 18:15:31 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 9.613048694s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [............................X..........X....................] duration: 2.026495562s FAIL (2025-08-08 18:15:16 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 8 17:58:37.957200338 (32m32.388280469s) [upload=582]: Starting upload Aug 8 17:58:37.957297144 (32m32.388377275s) [upload=582]: Done starting upload Aug 8 17:58:37.957394770 (32m32.388474901s) [upload=582]: Uploading segments... Aug 8 17:58:37.957482327 (32m32.388562459s) [upload=582]: Got next segment. Inline: true Aug 8 17:58:37.957488490 (32m32.388568631s) [upload=582]: Waiting for error group managing segments... Aug 8 17:58:37.957554776 (32m32.388634907s) [upload=582]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 17:58:37.957561689 (32m32.38864182s) [upload=582]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 17:58:37.957565306 (32m32.388645427s) [upload=582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 17:58:38.276535375 (32m32.707615516s) [upload=582]: Done uploading segments... Aug 8 17:58:38.276578197 (32m32.707658339s) [upload=582]: Upload finished. err: <nil> Duration:* 2.026527252s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...X................................X........X...X..........] duration: 6.097767675s FAIL (2025-08-08 18:15:02 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 8 18:08:32.158878721 (42m26.589958852s) [upload=750]: Starting upload Aug 8 18:08:32.158934127 (42m26.590014258s) [upload=750]: Done starting upload Aug 8 18:08:32.159014300 (42m26.590094431s) [upload=750]: Uploading segments... Aug 8 18:08:32.159154128 (42m26.590234329s) [upload=750]: Got next segment. Inline: false Aug 8 18:08:32.159193062 (42m26.590273183s) [upload=750]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 18:08:32.159249370 (42m26.590329521s) [upload=750]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 18:08:32.619210358 (42m27.050290489s) [seg_pos={0 0}, upload=750]: Begin upload segment... Aug 8 18:08:32.619249643 (42m27.050329774s) [seg_pos={0 0}, upload=750]: Done begin upload segment. Aug 8 18:08:32.619270152 (42m27.050350273s) [noise=true , address=64.49.13.154:4936 , piece_id=5JHATRFSB42SUVQG4LYG2UKJIVVZAPOYWRX2FAFEALXIWH4MWXDA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.619823210 (42m27.050903341s) [noise=true , address=104.36.82.44:4871 , piece_id=GQ57M3NGW7RHAEUVFICZJLXRY3D5LZOWSRZPUBE42RODCI565KXA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.620150026 (42m27.051230147s) [noise=true , address=104.36.82.45:4929 , piece_id=ILJY377CZ5FBRVCFZCHZEMOLQZBM2LHQ67M7KOWHSXJQJOJTKKJQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.620523119 (42m27.05160325s) [noise=true , address=104.36.82.46:4509 , piece_id=B46DOEJWSMG4M57P6VE3FT2EVG5G3VKJIC4YBGVVNBKMU3X2PGHQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.620844254 (42m27.051924385s) [noise=true , address=45.91.116.11:4129 , piece_id=BBCWG6ULHGBJKI42DQUAYTAG63VOM2UFV2KHCKUZH45TWCCDKA2A, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.621137575 (42m27.052217706s) [noise=true , address=104.36.82.60:4345 , piece_id=TX4PHOR2JBPYTIPEGZ7AIYZPBKCSCY2J3GVSEADUCT53WZBFVDQQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.621411269 (42m27.0524914s) [noise=true , address=104.36.82.59:4327 , piece_id=LF3HMRWMP4I26KPCKXVZ7T72B2WQVGZY7HM35VINRLGSPVSOJDNA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.621701694 (42m27.052781825s) [noise=true , address=79.127.205.233:4648 , piece_id=33KAEXCMQFSYG25BFZIGFNH5HANBOOTGIKL5KFKE7QSSO44JKIMQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.621960069 (42m27.0530402s) [noise=true , address=104.36.82.15:4281 , piece_id=3SI2GJNEQ2PN5B76ZRNXAATOVLLRPETTQQXC53ZGPFDAIW7BO5XQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.622234775 (42m27.053314906s) [noise=true , address=104.36.82.61:4379 , piece_id=3GYYNOMAMRBWYWEN23XBFOG5IZEFVFUEJWGPSXT6G2UADKIWE6WA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.622468722 (42m27.053548853s) [noise=true , address=64.49.13.26:4948 , piece_id=LHQGTA554IREULAHP3Q3QSGY523MRWSGI45FPOBOW4PRGCJBPAMA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.623280185 (42m27.054360316s) [noise=true , address=104.36.82.11:4143 , piece_id=OIYZCCHPFACRG7BCSOP2USITVTN6ZTY6JA5GI2R2WCBBWKOIQXPQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.623774060 (42m27.054854181s) [noise=true , address=104.36.82.60:4341 , piece_id=WTK3IBRT23CBOPSXSYUKRHGQSG622T2AUES376DCIKO66DSAOCUQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.624530928 (42m27.055611059s) [noise=true , address=104.36.82.37:4654 , piece_id=MECYP7EZZFUPMAFEUFCVUE2WQTP5WRFOYTAKU6HUXHCX7IPNDMAQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.625404930 (42m27.056485061s) [noise=true , address=104.36.82.52:4103 , piece_id=P6QV3H5NKFRSXXQKKVW3V5E2W6CQ6PGWITESTGATQYTLRNUHJNCQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.626153493 (42m27.057233624s) [noise=true , address=104.36.82.35:4598 , piece_id=7JCMFN57EF2KRSJ4MGJOUILBK2DZABEVAHZMGDB2M6DKI3CHU7VQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.626989051 (42m27.058069182s) [noise=true , address=104.36.82.62:4416 , piece_id=UZECRJN7M6HC2Q5EOL5QEFBRHLVVTVS7NAU3E7HZSUEB434IXPKQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.627383686 (42m27.058463817s) [noise=true , address=104.36.82.5:4858 , piece_id=KR2DROY56ECMCJ55VPXQSOOPVXJP6ZZCSI4BVPXLITAXB6PPKJBA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:33.730137164 (42m28.161217295s) [upload=750]: Next returned nil segment Aug 8 18:08:33.730151332 (42m28.161231463s) [upload=750]: Waiting for error group managing segments... Aug 8 18:08:34.014807988 (42m28.445888119s) [noise=true , address=79.127.205.233:4648 , piece_id=33KAEXCMQFSYG25BFZIGFNH5HANBOOTGIKL5KFKE7QSSO44JKIMQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.082739832 (42m28.513819963s) [noise=true , address=64.49.13.26:4948 , piece_id=LHQGTA554IREULAHP3Q3QSGY523MRWSGI45FPOBOW4PRGCJBPAMA, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.104574428 (42m28.535654559s) [noise=true , address=64.49.13.154:4936 , piece_id=5JHATRFSB42SUVQG4LYG2UKJIVVZAPOYWRX2FAFEALXIWH4MWXDA, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.560367250 (42m28.991447381s) [noise=true , address=104.36.82.60:4345 , piece_id=TX4PHOR2JBPYTIPEGZ7AIYZPBKCSCY2J3GVSEADUCT53WZBFVDQQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.573255500 (42m29.004335621s) [noise=true , address=104.36.82.60:4341 , piece_id=WTK3IBRT23CBOPSXSYUKRHGQSG622T2AUES376DCIKO66DSAOCUQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.642428328 (42m29.073508449s) [noise=true , address=104.36.82.59:4327 , piece_id=LF3HMRWMP4I26KPCKXVZ7T72B2WQVGZY7HM35VINRLGSPVSOJDNA, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.649042744 (42m29.080122875s) [noise=true , address=104.36.82.35:4598 , piece_id=7JCMFN57EF2KRSJ4MGJOUILBK2DZABEVAHZMGDB2M6DKI3CHU7VQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.672062137 (42m29.103142268s) [noise=true , address=45.91.116.11:4129 , piece_id=BBCWG6ULHGBJKI42DQUAYTAG63VOM2UFV2KHCKUZH45TWCCDKA2A, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.683197252 (42m29.114277383s) [noise=true , address=104.36.82.46:4509 , piece_id=B46DOEJWSMG4M57P6VE3FT2EVG5G3VKJIC4YBGVVNBKMU3X2PGHQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.690802193 (42m29.121882314s) [noise=true , address=104.36.82.37:4654 , piece_id=MECYP7EZZFUPMAFEUFCVUE2WQTP5WRFOYTAKU6HUXHCX7IPNDMAQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.730638302 (42m29.161718433s) [noise=true , address=104.36.82.61:4379 , piece_id=3GYYNOMAMRBWYWEN23XBFOG5IZEFVFUEJWGPSXT6G2UADKIWE6WA, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.756068527 (42m29.187148648s) [noise=true , address=104.36.82.52:4103 , piece_id=P6QV3H5NKFRSXXQKKVW3V5E2W6CQ6PGWITESTGATQYTLRNUHJNCQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.760324190 (42m29.191404321s) [noise=true , address=104.36.82.5:4858 , piece_id=KR2DROY56ECMCJ55VPXQSOOPVXJP6ZZCSI4BVPXLITAXB6PPKJBA, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.770480252 (42m29.201560383s) [noise=true , address=104.36.82.15:4281 , piece_id=3SI2GJNEQ2PN5B76ZRNXAATOVLLRPETTQQXC53ZGPFDAIW7BO5XQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.770502485 (42m29.201582616s) [seg_pos={0 0}, upload=750]: Segment reached optimal threshold of 14 pieces. Aug 8 18:08:34.770595502 (42m29.201675623s) [noise=true , address=104.36.82.11:4143 , piece_id=OIYZCCHPFACRG7BCSOP2USITVTN6ZTY6JA5GI2R2WCBBWKOIQXPQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ipThd6PwZUpCXy3ML4qqMd9dmRLmxKjVNCNoT5wCg1szdWp8U): protocol: expected piece hash; context canceled; EOF Aug 8 18:08:34.770652110 (42m29.201732241s) [noise=true , address=104.36.82.44:4871 , piece_id=GQ57M3NGW7RHAEUVFICZJLXRY3D5LZOWSRZPUBE42RODCI565KXA, seg_pos={0 0}, upload=750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t3N84zSSMtzRBs1H47Szc2xAHwqmyr9szJahRkxMYDLto8DAx): protocol: expected piece hash; context canceled; EOF Aug 8 18:08:34.770818338 (42m29.201898469s) [noise=true , address=104.36.82.45:4929 , piece_id=ILJY377CZ5FBRVCFZCHZEMOLQZBM2LHQ67M7KOWHSXJQJOJTKKJQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VxQN6CV1ogwKcs27ho2ayknnPi7BDEcA9ZFbgsUacuQNFAdmm): protocol: expected piece hash; context canceled; EOF Aug 8 18:08:34.770822646 (42m29.201902778s) [noise=true , address=104.36.82.62:4416 , piece_id=UZECRJN7M6HC2Q5EOL5QEFBRHLVVTVS7NAU3E7HZSUEB434IXPKQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12syasUPsyYf4UstQ6cFAr6qamze3vCyAm9dnobk5e83w4bTz69): protocol: expected piece hash; context canceled; EOF Aug 8 18:08:34.770897630 (42m29.201977761s) [seg_pos={0 0}, upload=750]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 18:08:34.771018311 (42m29.202098442s) [upload=750]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 18:08:34.771025956 (42m29.202106127s) [upload=750]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 18:08:35.092714666 (42m29.523794797s) [upload=750]: Done uploading segments... Aug 8 18:08:35.092729535 (42m29.523809666s) [upload=750]: Upload finished. err: <nil> Duration: 6.097816979s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.............................X..........X...................] duration: 1.93450727s FAIL (2025-08-08 18:14:25 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 8 17:58:37.957200338 (32m32.388280469s) [upload=582]: Starting upload Aug 8 17:58:37.957297144 (32m32.388377275s) [upload=582]: Done starting upload Aug 8 17:58:37.957394770 (32m32.388474901s) [upload=582]: Uploading segments... Aug 8 17:58:37.957482327 (32m32.388562459s) [upload=582]: Got next segment. Inline: true Aug 8 17:58:37.957488490 (32m32.388568631s) [upload=582]: Waiting for error group managing segments... Aug 8 17:58:37.957554776 (32m32.388634907s) [upload=582]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 17:58:37.957561689 (32m32.38864182s) [upload=582]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 17:58:37.957565306 (32m32.388645427s) [upload=582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 17:58:38.276535375 (32m32.707615516s) [upload=582]: Done uploading segments... Aug 8 17:58:38.276578197 (32m32.707658339s) [upload=582]: Upload finished. err: <nil> Duration:* 1.934536997s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 6.860858518s FAIL (2025-08-08 18:14:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.860876582s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [....X................................X........X...X.........] duration: 5.846570329s FAIL (2025-08-08 18:14:15 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 8 18:08:32.158878721 (42m26.589958852s) [upload=750]: Starting upload Aug 8 18:08:32.158934127 (42m26.590014258s) [upload=750]: Done starting upload Aug 8 18:08:32.159014300 (42m26.590094431s) [upload=750]: Uploading segments... Aug 8 18:08:32.159154128 (42m26.590234329s) [upload=750]: Got next segment. Inline: false Aug 8 18:08:32.159193062 (42m26.590273183s) [upload=750]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 18:08:32.159249370 (42m26.590329521s) [upload=750]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 18:08:32.619210358 (42m27.050290489s) [seg_pos={0 0}, upload=750]: Begin upload segment... Aug 8 18:08:32.619249643 (42m27.050329774s) [seg_pos={0 0}, upload=750]: Done begin upload segment. Aug 8 18:08:32.619270152 (42m27.050350273s) [noise=true , address=64.49.13.154:4936 , piece_id=5JHATRFSB42SUVQG4LYG2UKJIVVZAPOYWRX2FAFEALXIWH4MWXDA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.619823210 (42m27.050903341s) [noise=true , address=104.36.82.44:4871 , piece_id=GQ57M3NGW7RHAEUVFICZJLXRY3D5LZOWSRZPUBE42RODCI565KXA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.620150026 (42m27.051230147s) [noise=true , address=104.36.82.45:4929 , piece_id=ILJY377CZ5FBRVCFZCHZEMOLQZBM2LHQ67M7KOWHSXJQJOJTKKJQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.620523119 (42m27.05160325s) [noise=true , address=104.36.82.46:4509 , piece_id=B46DOEJWSMG4M57P6VE3FT2EVG5G3VKJIC4YBGVVNBKMU3X2PGHQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.620844254 (42m27.051924385s) [noise=true , address=45.91.116.11:4129 , piece_id=BBCWG6ULHGBJKI42DQUAYTAG63VOM2UFV2KHCKUZH45TWCCDKA2A, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.621137575 (42m27.052217706s) [noise=true , address=104.36.82.60:4345 , piece_id=TX4PHOR2JBPYTIPEGZ7AIYZPBKCSCY2J3GVSEADUCT53WZBFVDQQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.621411269 (42m27.0524914s) [noise=true , address=104.36.82.59:4327 , piece_id=LF3HMRWMP4I26KPCKXVZ7T72B2WQVGZY7HM35VINRLGSPVSOJDNA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.621701694 (42m27.052781825s) [noise=true , address=79.127.205.233:4648 , piece_id=33KAEXCMQFSYG25BFZIGFNH5HANBOOTGIKL5KFKE7QSSO44JKIMQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.621960069 (42m27.0530402s) [noise=true , address=104.36.82.15:4281 , piece_id=3SI2GJNEQ2PN5B76ZRNXAATOVLLRPETTQQXC53ZGPFDAIW7BO5XQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.622234775 (42m27.053314906s) [noise=true , address=104.36.82.61:4379 , piece_id=3GYYNOMAMRBWYWEN23XBFOG5IZEFVFUEJWGPSXT6G2UADKIWE6WA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.622468722 (42m27.053548853s) [noise=true , address=64.49.13.26:4948 , piece_id=LHQGTA554IREULAHP3Q3QSGY523MRWSGI45FPOBOW4PRGCJBPAMA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.623280185 (42m27.054360316s) [noise=true , address=104.36.82.11:4143 , piece_id=OIYZCCHPFACRG7BCSOP2USITVTN6ZTY6JA5GI2R2WCBBWKOIQXPQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.623774060 (42m27.054854181s) [noise=true , address=104.36.82.60:4341 , piece_id=WTK3IBRT23CBOPSXSYUKRHGQSG622T2AUES376DCIKO66DSAOCUQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.624530928 (42m27.055611059s) [noise=true , address=104.36.82.37:4654 , piece_id=MECYP7EZZFUPMAFEUFCVUE2WQTP5WRFOYTAKU6HUXHCX7IPNDMAQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.625404930 (42m27.056485061s) [noise=true , address=104.36.82.52:4103 , piece_id=P6QV3H5NKFRSXXQKKVW3V5E2W6CQ6PGWITESTGATQYTLRNUHJNCQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.626153493 (42m27.057233624s) [noise=true , address=104.36.82.35:4598 , piece_id=7JCMFN57EF2KRSJ4MGJOUILBK2DZABEVAHZMGDB2M6DKI3CHU7VQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.626989051 (42m27.058069182s) [noise=true , address=104.36.82.62:4416 , piece_id=UZECRJN7M6HC2Q5EOL5QEFBRHLVVTVS7NAU3E7HZSUEB434IXPKQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.627383686 (42m27.058463817s) [noise=true , address=104.36.82.5:4858 , piece_id=KR2DROY56ECMCJ55VPXQSOOPVXJP6ZZCSI4BVPXLITAXB6PPKJBA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:33.730137164 (42m28.161217295s) [upload=750]: Next returned nil segment Aug 8 18:08:33.730151332 (42m28.161231463s) [upload=750]: Waiting for error group managing segments... Aug 8 18:08:34.014807988 (42m28.445888119s) [noise=true , address=79.127.205.233:4648 , piece_id=33KAEXCMQFSYG25BFZIGFNH5HANBOOTGIKL5KFKE7QSSO44JKIMQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.082739832 (42m28.513819963s) [noise=true , address=64.49.13.26:4948 , piece_id=LHQGTA554IREULAHP3Q3QSGY523MRWSGI45FPOBOW4PRGCJBPAMA, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.104574428 (42m28.535654559s) [noise=true , address=64.49.13.154:4936 , piece_id=5JHATRFSB42SUVQG4LYG2UKJIVVZAPOYWRX2FAFEALXIWH4MWXDA, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.560367250 (42m28.991447381s) [noise=true , address=104.36.82.60:4345 , piece_id=TX4PHOR2JBPYTIPEGZ7AIYZPBKCSCY2J3GVSEADUCT53WZBFVDQQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.573255500 (42m29.004335621s) [noise=true , address=104.36.82.60:4341 , piece_id=WTK3IBRT23CBOPSXSYUKRHGQSG622T2AUES376DCIKO66DSAOCUQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.642428328 (42m29.073508449s) [noise=true , address=104.36.82.59:4327 , piece_id=LF3HMRWMP4I26KPCKXVZ7T72B2WQVGZY7HM35VINRLGSPVSOJDNA, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.649042744 (42m29.080122875s) [noise=true , address=104.36.82.35:4598 , piece_id=7JCMFN57EF2KRSJ4MGJOUILBK2DZABEVAHZMGDB2M6DKI3CHU7VQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.672062137 (42m29.103142268s) [noise=true , address=45.91.116.11:4129 , piece_id=BBCWG6ULHGBJKI42DQUAYTAG63VOM2UFV2KHCKUZH45TWCCDKA2A, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.683197252 (42m29.114277383s) [noise=true , address=104.36.82.46:4509 , piece_id=B46DOEJWSMG4M57P6VE3FT2EVG5G3VKJIC4YBGVVNBKMU3X2PGHQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.690802193 (42m29.121882314s) [noise=true , address=104.36.82.37:4654 , piece_id=MECYP7EZZFUPMAFEUFCVUE2WQTP5WRFOYTAKU6HUXHCX7IPNDMAQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.730638302 (42m29.161718433s) [noise=true , address=104.36.82.61:4379 , piece_id=3GYYNOMAMRBWYWEN23XBFOG5IZEFVFUEJWGPSXT6G2UADKIWE6WA, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.756068527 (42m29.187148648s) [noise=true , address=104.36.82.52:4103 , piece_id=P6QV3H5NKFRSXXQKKVW3V5E2W6CQ6PGWITESTGATQYTLRNUHJNCQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.760324190 (42m29.191404321s) [noise=true , address=104.36.82.5:4858 , piece_id=KR2DROY56ECMCJ55VPXQSOOPVXJP6ZZCSI4BVPXLITAXB6PPKJBA, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.770480252 (42m29.201560383s) [noise=true , address=104.36.82.15:4281 , piece_id=3SI2GJNEQ2PN5B76ZRNXAATOVLLRPETTQQXC53ZGPFDAIW7BO5XQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.770502485 (42m29.201582616s) [seg_pos={0 0}, upload=750]: Segment reached optimal threshold of 14 pieces. Aug 8 18:08:34.770595502 (42m29.201675623s) [noise=true , address=104.36.82.11:4143 , piece_id=OIYZCCHPFACRG7BCSOP2USITVTN6ZTY6JA5GI2R2WCBBWKOIQXPQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ipThd6PwZUpCXy3ML4qqMd9dmRLmxKjVNCNoT5wCg1szdWp8U): protocol: expected piece hash; context canceled; EOF Aug 8 18:08:34.770652110 (42m29.201732241s) [noise=true , address=104.36.82.44:4871 , piece_id=GQ57M3NGW7RHAEUVFICZJLXRY3D5LZOWSRZPUBE42RODCI565KXA, seg_pos={0 0}, upload=750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t3N84zSSMtzRBs1H47Szc2xAHwqmyr9szJahRkxMYDLto8DAx): protocol: expected piece hash; context canceled; EOF Aug 8 18:08:34.770818338 (42m29.201898469s) [noise=true , address=104.36.82.45:4929 , piece_id=ILJY377CZ5FBRVCFZCHZEMOLQZBM2LHQ67M7KOWHSXJQJOJTKKJQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VxQN6CV1ogwKcs27ho2ayknnPi7BDEcA9ZFbgsUacuQNFAdmm): protocol: expected piece hash; context canceled; EOF Aug 8 18:08:34.770822646 (42m29.201902778s) [noise=true , address=104.36.82.62:4416 , piece_id=UZECRJN7M6HC2Q5EOL5QEFBRHLVVTVS7NAU3E7HZSUEB434IXPKQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12syasUPsyYf4UstQ6cFAr6qamze3vCyAm9dnobk5e83w4bTz69): protocol: expected piece hash; context canceled; EOF Aug 8 18:08:34.770897630 (42m29.201977761s) [seg_pos={0 0}, upload=750]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 18:08:34.771018311 (42m29.202098442s) [upload=750]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 18:08:34.771025956 (42m29.202106127s) [upload=750]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 18:08:35.092714666 (42m29.523794797s) [upload=750]: Done uploading segments... Aug 8 18:08:35.092729535 (42m29.523809666s) [upload=750]: Upload finished. err: <nil> Duration: 5.846591179s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..............................X..........X..................] duration: 1.907032322s FAIL (2025-08-08 18:13:44 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 8 17:58:37.957200338 (32m32.388280469s) [upload=582]: Starting upload Aug 8 17:58:37.957297144 (32m32.388377275s) [upload=582]: Done starting upload Aug 8 17:58:37.957394770 (32m32.388474901s) [upload=582]: Uploading segments... Aug 8 17:58:37.957482327 (32m32.388562459s) [upload=582]: Got next segment. Inline: true Aug 8 17:58:37.957488490 (32m32.388568631s) [upload=582]: Waiting for error group managing segments... Aug 8 17:58:37.957554776 (32m32.388634907s) [upload=582]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 17:58:37.957561689 (32m32.38864182s) [upload=582]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 17:58:37.957565306 (32m32.388645427s) [upload=582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 17:58:38.276535375 (32m32.707615516s) [upload=582]: Done uploading segments... Aug 8 17:58:38.276578197 (32m32.707658339s) [upload=582]: Upload finished. err: <nil> Duration:* 1.907052921s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 6.00478601s FAIL (2025-08-08 18:13:36 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.00480639s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.....X................................X........X...X........] duration: 5.870107444s FAIL (2025-08-08 18:13:25 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 8 18:08:32.158878721 (42m26.589958852s) [upload=750]: Starting upload Aug 8 18:08:32.158934127 (42m26.590014258s) [upload=750]: Done starting upload Aug 8 18:08:32.159014300 (42m26.590094431s) [upload=750]: Uploading segments... Aug 8 18:08:32.159154128 (42m26.590234329s) [upload=750]: Got next segment. Inline: false Aug 8 18:08:32.159193062 (42m26.590273183s) [upload=750]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 18:08:32.159249370 (42m26.590329521s) [upload=750]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 18:08:32.619210358 (42m27.050290489s) [seg_pos={0 0}, upload=750]: Begin upload segment... Aug 8 18:08:32.619249643 (42m27.050329774s) [seg_pos={0 0}, upload=750]: Done begin upload segment. Aug 8 18:08:32.619270152 (42m27.050350273s) [noise=true , address=64.49.13.154:4936 , piece_id=5JHATRFSB42SUVQG4LYG2UKJIVVZAPOYWRX2FAFEALXIWH4MWXDA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.619823210 (42m27.050903341s) [noise=true , address=104.36.82.44:4871 , piece_id=GQ57M3NGW7RHAEUVFICZJLXRY3D5LZOWSRZPUBE42RODCI565KXA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.620150026 (42m27.051230147s) [noise=true , address=104.36.82.45:4929 , piece_id=ILJY377CZ5FBRVCFZCHZEMOLQZBM2LHQ67M7KOWHSXJQJOJTKKJQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.620523119 (42m27.05160325s) [noise=true , address=104.36.82.46:4509 , piece_id=B46DOEJWSMG4M57P6VE3FT2EVG5G3VKJIC4YBGVVNBKMU3X2PGHQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.620844254 (42m27.051924385s) [noise=true , address=45.91.116.11:4129 , piece_id=BBCWG6ULHGBJKI42DQUAYTAG63VOM2UFV2KHCKUZH45TWCCDKA2A, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.621137575 (42m27.052217706s) [noise=true , address=104.36.82.60:4345 , piece_id=TX4PHOR2JBPYTIPEGZ7AIYZPBKCSCY2J3GVSEADUCT53WZBFVDQQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.621411269 (42m27.0524914s) [noise=true , address=104.36.82.59:4327 , piece_id=LF3HMRWMP4I26KPCKXVZ7T72B2WQVGZY7HM35VINRLGSPVSOJDNA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.621701694 (42m27.052781825s) [noise=true , address=79.127.205.233:4648 , piece_id=33KAEXCMQFSYG25BFZIGFNH5HANBOOTGIKL5KFKE7QSSO44JKIMQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.621960069 (42m27.0530402s) [noise=true , address=104.36.82.15:4281 , piece_id=3SI2GJNEQ2PN5B76ZRNXAATOVLLRPETTQQXC53ZGPFDAIW7BO5XQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.622234775 (42m27.053314906s) [noise=true , address=104.36.82.61:4379 , piece_id=3GYYNOMAMRBWYWEN23XBFOG5IZEFVFUEJWGPSXT6G2UADKIWE6WA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.622468722 (42m27.053548853s) [noise=true , address=64.49.13.26:4948 , piece_id=LHQGTA554IREULAHP3Q3QSGY523MRWSGI45FPOBOW4PRGCJBPAMA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.623280185 (42m27.054360316s) [noise=true , address=104.36.82.11:4143 , piece_id=OIYZCCHPFACRG7BCSOP2USITVTN6ZTY6JA5GI2R2WCBBWKOIQXPQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.623774060 (42m27.054854181s) [noise=true , address=104.36.82.60:4341 , piece_id=WTK3IBRT23CBOPSXSYUKRHGQSG622T2AUES376DCIKO66DSAOCUQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.624530928 (42m27.055611059s) [noise=true , address=104.36.82.37:4654 , piece_id=MECYP7EZZFUPMAFEUFCVUE2WQTP5WRFOYTAKU6HUXHCX7IPNDMAQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.625404930 (42m27.056485061s) [noise=true , address=104.36.82.52:4103 , piece_id=P6QV3H5NKFRSXXQKKVW3V5E2W6CQ6PGWITESTGATQYTLRNUHJNCQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.626153493 (42m27.057233624s) [noise=true , address=104.36.82.35:4598 , piece_id=7JCMFN57EF2KRSJ4MGJOUILBK2DZABEVAHZMGDB2M6DKI3CHU7VQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.626989051 (42m27.058069182s) [noise=true , address=104.36.82.62:4416 , piece_id=UZECRJN7M6HC2Q5EOL5QEFBRHLVVTVS7NAU3E7HZSUEB434IXPKQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.627383686 (42m27.058463817s) [noise=true , address=104.36.82.5:4858 , piece_id=KR2DROY56ECMCJ55VPXQSOOPVXJP6ZZCSI4BVPXLITAXB6PPKJBA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:33.730137164 (42m28.161217295s) [upload=750]: Next returned nil segment Aug 8 18:08:33.730151332 (42m28.161231463s) [upload=750]: Waiting for error group managing segments... Aug 8 18:08:34.014807988 (42m28.445888119s) [noise=true , address=79.127.205.233:4648 , piece_id=33KAEXCMQFSYG25BFZIGFNH5HANBOOTGIKL5KFKE7QSSO44JKIMQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.082739832 (42m28.513819963s) [noise=true , address=64.49.13.26:4948 , piece_id=LHQGTA554IREULAHP3Q3QSGY523MRWSGI45FPOBOW4PRGCJBPAMA, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.104574428 (42m28.535654559s) [noise=true , address=64.49.13.154:4936 , piece_id=5JHATRFSB42SUVQG4LYG2UKJIVVZAPOYWRX2FAFEALXIWH4MWXDA, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.560367250 (42m28.991447381s) [noise=true , address=104.36.82.60:4345 , piece_id=TX4PHOR2JBPYTIPEGZ7AIYZPBKCSCY2J3GVSEADUCT53WZBFVDQQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.573255500 (42m29.004335621s) [noise=true , address=104.36.82.60:4341 , piece_id=WTK3IBRT23CBOPSXSYUKRHGQSG622T2AUES376DCIKO66DSAOCUQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.642428328 (42m29.073508449s) [noise=true , address=104.36.82.59:4327 , piece_id=LF3HMRWMP4I26KPCKXVZ7T72B2WQVGZY7HM35VINRLGSPVSOJDNA, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.649042744 (42m29.080122875s) [noise=true , address=104.36.82.35:4598 , piece_id=7JCMFN57EF2KRSJ4MGJOUILBK2DZABEVAHZMGDB2M6DKI3CHU7VQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.672062137 (42m29.103142268s) [noise=true , address=45.91.116.11:4129 , piece_id=BBCWG6ULHGBJKI42DQUAYTAG63VOM2UFV2KHCKUZH45TWCCDKA2A, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.683197252 (42m29.114277383s) [noise=true , address=104.36.82.46:4509 , piece_id=B46DOEJWSMG4M57P6VE3FT2EVG5G3VKJIC4YBGVVNBKMU3X2PGHQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.690802193 (42m29.121882314s) [noise=true , address=104.36.82.37:4654 , piece_id=MECYP7EZZFUPMAFEUFCVUE2WQTP5WRFOYTAKU6HUXHCX7IPNDMAQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.730638302 (42m29.161718433s) [noise=true , address=104.36.82.61:4379 , piece_id=3GYYNOMAMRBWYWEN23XBFOG5IZEFVFUEJWGPSXT6G2UADKIWE6WA, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.756068527 (42m29.187148648s) [noise=true , address=104.36.82.52:4103 , piece_id=P6QV3H5NKFRSXXQKKVW3V5E2W6CQ6PGWITESTGATQYTLRNUHJNCQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.760324190 (42m29.191404321s) [noise=true , address=104.36.82.5:4858 , piece_id=KR2DROY56ECMCJ55VPXQSOOPVXJP6ZZCSI4BVPXLITAXB6PPKJBA, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.770480252 (42m29.201560383s) [noise=true , address=104.36.82.15:4281 , piece_id=3SI2GJNEQ2PN5B76ZRNXAATOVLLRPETTQQXC53ZGPFDAIW7BO5XQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.770502485 (42m29.201582616s) [seg_pos={0 0}, upload=750]: Segment reached optimal threshold of 14 pieces. Aug 8 18:08:34.770595502 (42m29.201675623s) [noise=true , address=104.36.82.11:4143 , piece_id=OIYZCCHPFACRG7BCSOP2USITVTN6ZTY6JA5GI2R2WCBBWKOIQXPQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ipThd6PwZUpCXy3ML4qqMd9dmRLmxKjVNCNoT5wCg1szdWp8U): protocol: expected piece hash; context canceled; EOF Aug 8 18:08:34.770652110 (42m29.201732241s) [noise=true , address=104.36.82.44:4871 , piece_id=GQ57M3NGW7RHAEUVFICZJLXRY3D5LZOWSRZPUBE42RODCI565KXA, seg_pos={0 0}, upload=750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t3N84zSSMtzRBs1H47Szc2xAHwqmyr9szJahRkxMYDLto8DAx): protocol: expected piece hash; context canceled; EOF Aug 8 18:08:34.770818338 (42m29.201898469s) [noise=true , address=104.36.82.45:4929 , piece_id=ILJY377CZ5FBRVCFZCHZEMOLQZBM2LHQ67M7KOWHSXJQJOJTKKJQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VxQN6CV1ogwKcs27ho2ayknnPi7BDEcA9ZFbgsUacuQNFAdmm): protocol: expected piece hash; context canceled; EOF Aug 8 18:08:34.770822646 (42m29.201902778s) [noise=true , address=104.36.82.62:4416 , piece_id=UZECRJN7M6HC2Q5EOL5QEFBRHLVVTVS7NAU3E7HZSUEB434IXPKQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12syasUPsyYf4UstQ6cFAr6qamze3vCyAm9dnobk5e83w4bTz69): protocol: expected piece hash; context canceled; EOF Aug 8 18:08:34.770897630 (42m29.201977761s) [seg_pos={0 0}, upload=750]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 18:08:34.771018311 (42m29.202098442s) [upload=750]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 18:08:34.771025956 (42m29.202106127s) [upload=750]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 18:08:35.092714666 (42m29.523794797s) [upload=750]: Done uploading segments... Aug 8 18:08:35.092729535 (42m29.523809666s) [upload=750]: Upload finished. err: <nil> Duration: 5.870130688s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...............................X..........X.................] duration: 2.085492169s FAIL (2025-08-08 18:12:37 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 8 17:58:37.957200338 (32m32.388280469s) [upload=582]: Starting upload Aug 8 17:58:37.957297144 (32m32.388377275s) [upload=582]: Done starting upload Aug 8 17:58:37.957394770 (32m32.388474901s) [upload=582]: Uploading segments... Aug 8 17:58:37.957482327 (32m32.388562459s) [upload=582]: Got next segment. Inline: true Aug 8 17:58:37.957488490 (32m32.388568631s) [upload=582]: Waiting for error group managing segments... Aug 8 17:58:37.957554776 (32m32.388634907s) [upload=582]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 17:58:37.957561689 (32m32.38864182s) [upload=582]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 17:58:37.957565306 (32m32.388645427s) [upload=582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 17:58:38.276535375 (32m32.707615516s) [upload=582]: Done uploading segments... Aug 8 17:58:38.276578197 (32m32.707658339s) [upload=582]: Upload finished. err: <nil> Duration:* 2.085540582s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 6.335621927s FAIL (2025-08-08 18:12:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.335637847s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [................................X..........X................] duration: 2.018605115s FAIL (2025-08-08 18:12:20 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 8 17:58:37.957200338 (32m32.388280469s) [upload=582]: Starting upload Aug 8 17:58:37.957297144 (32m32.388377275s) [upload=582]: Done starting upload Aug 8 17:58:37.957394770 (32m32.388474901s) [upload=582]: Uploading segments... Aug 8 17:58:37.957482327 (32m32.388562459s) [upload=582]: Got next segment. Inline: true Aug 8 17:58:37.957488490 (32m32.388568631s) [upload=582]: Waiting for error group managing segments... Aug 8 17:58:37.957554776 (32m32.388634907s) [upload=582]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 17:58:37.957561689 (32m32.38864182s) [upload=582]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 17:58:37.957565306 (32m32.388645427s) [upload=582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 17:58:38.276535375 (32m32.707615516s) [upload=582]: Done uploading segments... Aug 8 17:58:38.276578197 (32m32.707658339s) [upload=582]: Upload finished. err: <nil> Duration:* 2.018631836s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [......X................................X........X...X.......] duration: 5.857421333s FAIL (2025-08-08 18:12:19 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 8 18:08:32.158878721 (42m26.589958852s) [upload=750]: Starting upload Aug 8 18:08:32.158934127 (42m26.590014258s) [upload=750]: Done starting upload Aug 8 18:08:32.159014300 (42m26.590094431s) [upload=750]: Uploading segments... Aug 8 18:08:32.159154128 (42m26.590234329s) [upload=750]: Got next segment. Inline: false Aug 8 18:08:32.159193062 (42m26.590273183s) [upload=750]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 18:08:32.159249370 (42m26.590329521s) [upload=750]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 18:08:32.619210358 (42m27.050290489s) [seg_pos={0 0}, upload=750]: Begin upload segment... Aug 8 18:08:32.619249643 (42m27.050329774s) [seg_pos={0 0}, upload=750]: Done begin upload segment. Aug 8 18:08:32.619270152 (42m27.050350273s) [noise=true , address=64.49.13.154:4936 , piece_id=5JHATRFSB42SUVQG4LYG2UKJIVVZAPOYWRX2FAFEALXIWH4MWXDA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.619823210 (42m27.050903341s) [noise=true , address=104.36.82.44:4871 , piece_id=GQ57M3NGW7RHAEUVFICZJLXRY3D5LZOWSRZPUBE42RODCI565KXA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.620150026 (42m27.051230147s) [noise=true , address=104.36.82.45:4929 , piece_id=ILJY377CZ5FBRVCFZCHZEMOLQZBM2LHQ67M7KOWHSXJQJOJTKKJQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.620523119 (42m27.05160325s) [noise=true , address=104.36.82.46:4509 , piece_id=B46DOEJWSMG4M57P6VE3FT2EVG5G3VKJIC4YBGVVNBKMU3X2PGHQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.620844254 (42m27.051924385s) [noise=true , address=45.91.116.11:4129 , piece_id=BBCWG6ULHGBJKI42DQUAYTAG63VOM2UFV2KHCKUZH45TWCCDKA2A, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.621137575 (42m27.052217706s) [noise=true , address=104.36.82.60:4345 , piece_id=TX4PHOR2JBPYTIPEGZ7AIYZPBKCSCY2J3GVSEADUCT53WZBFVDQQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.621411269 (42m27.0524914s) [noise=true , address=104.36.82.59:4327 , piece_id=LF3HMRWMP4I26KPCKXVZ7T72B2WQVGZY7HM35VINRLGSPVSOJDNA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.621701694 (42m27.052781825s) [noise=true , address=79.127.205.233:4648 , piece_id=33KAEXCMQFSYG25BFZIGFNH5HANBOOTGIKL5KFKE7QSSO44JKIMQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.621960069 (42m27.0530402s) [noise=true , address=104.36.82.15:4281 , piece_id=3SI2GJNEQ2PN5B76ZRNXAATOVLLRPETTQQXC53ZGPFDAIW7BO5XQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.622234775 (42m27.053314906s) [noise=true , address=104.36.82.61:4379 , piece_id=3GYYNOMAMRBWYWEN23XBFOG5IZEFVFUEJWGPSXT6G2UADKIWE6WA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.622468722 (42m27.053548853s) [noise=true , address=64.49.13.26:4948 , piece_id=LHQGTA554IREULAHP3Q3QSGY523MRWSGI45FPOBOW4PRGCJBPAMA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.623280185 (42m27.054360316s) [noise=true , address=104.36.82.11:4143 , piece_id=OIYZCCHPFACRG7BCSOP2USITVTN6ZTY6JA5GI2R2WCBBWKOIQXPQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.623774060 (42m27.054854181s) [noise=true , address=104.36.82.60:4341 , piece_id=WTK3IBRT23CBOPSXSYUKRHGQSG622T2AUES376DCIKO66DSAOCUQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.624530928 (42m27.055611059s) [noise=true , address=104.36.82.37:4654 , piece_id=MECYP7EZZFUPMAFEUFCVUE2WQTP5WRFOYTAKU6HUXHCX7IPNDMAQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.625404930 (42m27.056485061s) [noise=true , address=104.36.82.52:4103 , piece_id=P6QV3H5NKFRSXXQKKVW3V5E2W6CQ6PGWITESTGATQYTLRNUHJNCQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.626153493 (42m27.057233624s) [noise=true , address=104.36.82.35:4598 , piece_id=7JCMFN57EF2KRSJ4MGJOUILBK2DZABEVAHZMGDB2M6DKI3CHU7VQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.626989051 (42m27.058069182s) [noise=true , address=104.36.82.62:4416 , piece_id=UZECRJN7M6HC2Q5EOL5QEFBRHLVVTVS7NAU3E7HZSUEB434IXPKQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.627383686 (42m27.058463817s) [noise=true , address=104.36.82.5:4858 , piece_id=KR2DROY56ECMCJ55VPXQSOOPVXJP6ZZCSI4BVPXLITAXB6PPKJBA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:33.730137164 (42m28.161217295s) [upload=750]: Next returned nil segment Aug 8 18:08:33.730151332 (42m28.161231463s) [upload=750]: Waiting for error group managing segments... Aug 8 18:08:34.014807988 (42m28.445888119s) [noise=true , address=79.127.205.233:4648 , piece_id=33KAEXCMQFSYG25BFZIGFNH5HANBOOTGIKL5KFKE7QSSO44JKIMQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.082739832 (42m28.513819963s) [noise=true , address=64.49.13.26:4948 , piece_id=LHQGTA554IREULAHP3Q3QSGY523MRWSGI45FPOBOW4PRGCJBPAMA, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.104574428 (42m28.535654559s) [noise=true , address=64.49.13.154:4936 , piece_id=5JHATRFSB42SUVQG4LYG2UKJIVVZAPOYWRX2FAFEALXIWH4MWXDA, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.560367250 (42m28.991447381s) [noise=true , address=104.36.82.60:4345 , piece_id=TX4PHOR2JBPYTIPEGZ7AIYZPBKCSCY2J3GVSEADUCT53WZBFVDQQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.573255500 (42m29.004335621s) [noise=true , address=104.36.82.60:4341 , piece_id=WTK3IBRT23CBOPSXSYUKRHGQSG622T2AUES376DCIKO66DSAOCUQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.642428328 (42m29.073508449s) [noise=true , address=104.36.82.59:4327 , piece_id=LF3HMRWMP4I26KPCKXVZ7T72B2WQVGZY7HM35VINRLGSPVSOJDNA, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.649042744 (42m29.080122875s) [noise=true , address=104.36.82.35:4598 , piece_id=7JCMFN57EF2KRSJ4MGJOUILBK2DZABEVAHZMGDB2M6DKI3CHU7VQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.672062137 (42m29.103142268s) [noise=true , address=45.91.116.11:4129 , piece_id=BBCWG6ULHGBJKI42DQUAYTAG63VOM2UFV2KHCKUZH45TWCCDKA2A, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.683197252 (42m29.114277383s) [noise=true , address=104.36.82.46:4509 , piece_id=B46DOEJWSMG4M57P6VE3FT2EVG5G3VKJIC4YBGVVNBKMU3X2PGHQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.690802193 (42m29.121882314s) [noise=true , address=104.36.82.37:4654 , piece_id=MECYP7EZZFUPMAFEUFCVUE2WQTP5WRFOYTAKU6HUXHCX7IPNDMAQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.730638302 (42m29.161718433s) [noise=true , address=104.36.82.61:4379 , piece_id=3GYYNOMAMRBWYWEN23XBFOG5IZEFVFUEJWGPSXT6G2UADKIWE6WA, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.756068527 (42m29.187148648s) [noise=true , address=104.36.82.52:4103 , piece_id=P6QV3H5NKFRSXXQKKVW3V5E2W6CQ6PGWITESTGATQYTLRNUHJNCQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.760324190 (42m29.191404321s) [noise=true , address=104.36.82.5:4858 , piece_id=KR2DROY56ECMCJ55VPXQSOOPVXJP6ZZCSI4BVPXLITAXB6PPKJBA, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.770480252 (42m29.201560383s) [noise=true , address=104.36.82.15:4281 , piece_id=3SI2GJNEQ2PN5B76ZRNXAATOVLLRPETTQQXC53ZGPFDAIW7BO5XQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.770502485 (42m29.201582616s) [seg_pos={0 0}, upload=750]: Segment reached optimal threshold of 14 pieces. Aug 8 18:08:34.770595502 (42m29.201675623s) [noise=true , address=104.36.82.11:4143 , piece_id=OIYZCCHPFACRG7BCSOP2USITVTN6ZTY6JA5GI2R2WCBBWKOIQXPQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ipThd6PwZUpCXy3ML4qqMd9dmRLmxKjVNCNoT5wCg1szdWp8U): protocol: expected piece hash; context canceled; EOF Aug 8 18:08:34.770652110 (42m29.201732241s) [noise=true , address=104.36.82.44:4871 , piece_id=GQ57M3NGW7RHAEUVFICZJLXRY3D5LZOWSRZPUBE42RODCI565KXA, seg_pos={0 0}, upload=750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t3N84zSSMtzRBs1H47Szc2xAHwqmyr9szJahRkxMYDLto8DAx): protocol: expected piece hash; context canceled; EOF Aug 8 18:08:34.770818338 (42m29.201898469s) [noise=true , address=104.36.82.45:4929 , piece_id=ILJY377CZ5FBRVCFZCHZEMOLQZBM2LHQ67M7KOWHSXJQJOJTKKJQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VxQN6CV1ogwKcs27ho2ayknnPi7BDEcA9ZFbgsUacuQNFAdmm): protocol: expected piece hash; context canceled; EOF Aug 8 18:08:34.770822646 (42m29.201902778s) [noise=true , address=104.36.82.62:4416 , piece_id=UZECRJN7M6HC2Q5EOL5QEFBRHLVVTVS7NAU3E7HZSUEB434IXPKQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12syasUPsyYf4UstQ6cFAr6qamze3vCyAm9dnobk5e83w4bTz69): protocol: expected piece hash; context canceled; EOF Aug 8 18:08:34.770897630 (42m29.201977761s) [seg_pos={0 0}, upload=750]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 18:08:34.771018311 (42m29.202098442s) [upload=750]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 18:08:34.771025956 (42m29.202106127s) [upload=750]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 18:08:35.092714666 (42m29.523794797s) [upload=750]: Done uploading segments... Aug 8 18:08:35.092729535 (42m29.523809666s) [upload=750]: Upload finished. err: <nil> Duration: 5.857444258s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.......X................................X........X...X......] duration: 5.765331272s FAIL (2025-08-08 18:11:53 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 8 18:08:32.158878721 (42m26.589958852s) [upload=750]: Starting upload Aug 8 18:08:32.158934127 (42m26.590014258s) [upload=750]: Done starting upload Aug 8 18:08:32.159014300 (42m26.590094431s) [upload=750]: Uploading segments... Aug 8 18:08:32.159154128 (42m26.590234329s) [upload=750]: Got next segment. Inline: false Aug 8 18:08:32.159193062 (42m26.590273183s) [upload=750]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 18:08:32.159249370 (42m26.590329521s) [upload=750]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 18:08:32.619210358 (42m27.050290489s) [seg_pos={0 0}, upload=750]: Begin upload segment... Aug 8 18:08:32.619249643 (42m27.050329774s) [seg_pos={0 0}, upload=750]: Done begin upload segment. Aug 8 18:08:32.619270152 (42m27.050350273s) [noise=true , address=64.49.13.154:4936 , piece_id=5JHATRFSB42SUVQG4LYG2UKJIVVZAPOYWRX2FAFEALXIWH4MWXDA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.619823210 (42m27.050903341s) [noise=true , address=104.36.82.44:4871 , piece_id=GQ57M3NGW7RHAEUVFICZJLXRY3D5LZOWSRZPUBE42RODCI565KXA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.620150026 (42m27.051230147s) [noise=true , address=104.36.82.45:4929 , piece_id=ILJY377CZ5FBRVCFZCHZEMOLQZBM2LHQ67M7KOWHSXJQJOJTKKJQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.620523119 (42m27.05160325s) [noise=true , address=104.36.82.46:4509 , piece_id=B46DOEJWSMG4M57P6VE3FT2EVG5G3VKJIC4YBGVVNBKMU3X2PGHQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.620844254 (42m27.051924385s) [noise=true , address=45.91.116.11:4129 , piece_id=BBCWG6ULHGBJKI42DQUAYTAG63VOM2UFV2KHCKUZH45TWCCDKA2A, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.621137575 (42m27.052217706s) [noise=true , address=104.36.82.60:4345 , piece_id=TX4PHOR2JBPYTIPEGZ7AIYZPBKCSCY2J3GVSEADUCT53WZBFVDQQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.621411269 (42m27.0524914s) [noise=true , address=104.36.82.59:4327 , piece_id=LF3HMRWMP4I26KPCKXVZ7T72B2WQVGZY7HM35VINRLGSPVSOJDNA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.621701694 (42m27.052781825s) [noise=true , address=79.127.205.233:4648 , piece_id=33KAEXCMQFSYG25BFZIGFNH5HANBOOTGIKL5KFKE7QSSO44JKIMQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.621960069 (42m27.0530402s) [noise=true , address=104.36.82.15:4281 , piece_id=3SI2GJNEQ2PN5B76ZRNXAATOVLLRPETTQQXC53ZGPFDAIW7BO5XQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.622234775 (42m27.053314906s) [noise=true , address=104.36.82.61:4379 , piece_id=3GYYNOMAMRBWYWEN23XBFOG5IZEFVFUEJWGPSXT6G2UADKIWE6WA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.622468722 (42m27.053548853s) [noise=true , address=64.49.13.26:4948 , piece_id=LHQGTA554IREULAHP3Q3QSGY523MRWSGI45FPOBOW4PRGCJBPAMA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.623280185 (42m27.054360316s) [noise=true , address=104.36.82.11:4143 , piece_id=OIYZCCHPFACRG7BCSOP2USITVTN6ZTY6JA5GI2R2WCBBWKOIQXPQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.623774060 (42m27.054854181s) [noise=true , address=104.36.82.60:4341 , piece_id=WTK3IBRT23CBOPSXSYUKRHGQSG622T2AUES376DCIKO66DSAOCUQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.624530928 (42m27.055611059s) [noise=true , address=104.36.82.37:4654 , piece_id=MECYP7EZZFUPMAFEUFCVUE2WQTP5WRFOYTAKU6HUXHCX7IPNDMAQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.625404930 (42m27.056485061s) [noise=true , address=104.36.82.52:4103 , piece_id=P6QV3H5NKFRSXXQKKVW3V5E2W6CQ6PGWITESTGATQYTLRNUHJNCQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.626153493 (42m27.057233624s) [noise=true , address=104.36.82.35:4598 , piece_id=7JCMFN57EF2KRSJ4MGJOUILBK2DZABEVAHZMGDB2M6DKI3CHU7VQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.626989051 (42m27.058069182s) [noise=true , address=104.36.82.62:4416 , piece_id=UZECRJN7M6HC2Q5EOL5QEFBRHLVVTVS7NAU3E7HZSUEB434IXPKQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.627383686 (42m27.058463817s) [noise=true , address=104.36.82.5:4858 , piece_id=KR2DROY56ECMCJ55VPXQSOOPVXJP6ZZCSI4BVPXLITAXB6PPKJBA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:33.730137164 (42m28.161217295s) [upload=750]: Next returned nil segment Aug 8 18:08:33.730151332 (42m28.161231463s) [upload=750]: Waiting for error group managing segments... Aug 8 18:08:34.014807988 (42m28.445888119s) [noise=true , address=79.127.205.233:4648 , piece_id=33KAEXCMQFSYG25BFZIGFNH5HANBOOTGIKL5KFKE7QSSO44JKIMQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.082739832 (42m28.513819963s) [noise=true , address=64.49.13.26:4948 , piece_id=LHQGTA554IREULAHP3Q3QSGY523MRWSGI45FPOBOW4PRGCJBPAMA, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.104574428 (42m28.535654559s) [noise=true , address=64.49.13.154:4936 , piece_id=5JHATRFSB42SUVQG4LYG2UKJIVVZAPOYWRX2FAFEALXIWH4MWXDA, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.560367250 (42m28.991447381s) [noise=true , address=104.36.82.60:4345 , piece_id=TX4PHOR2JBPYTIPEGZ7AIYZPBKCSCY2J3GVSEADUCT53WZBFVDQQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.573255500 (42m29.004335621s) [noise=true , address=104.36.82.60:4341 , piece_id=WTK3IBRT23CBOPSXSYUKRHGQSG622T2AUES376DCIKO66DSAOCUQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.642428328 (42m29.073508449s) [noise=true , address=104.36.82.59:4327 , piece_id=LF3HMRWMP4I26KPCKXVZ7T72B2WQVGZY7HM35VINRLGSPVSOJDNA, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.649042744 (42m29.080122875s) [noise=true , address=104.36.82.35:4598 , piece_id=7JCMFN57EF2KRSJ4MGJOUILBK2DZABEVAHZMGDB2M6DKI3CHU7VQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.672062137 (42m29.103142268s) [noise=true , address=45.91.116.11:4129 , piece_id=BBCWG6ULHGBJKI42DQUAYTAG63VOM2UFV2KHCKUZH45TWCCDKA2A, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.683197252 (42m29.114277383s) [noise=true , address=104.36.82.46:4509 , piece_id=B46DOEJWSMG4M57P6VE3FT2EVG5G3VKJIC4YBGVVNBKMU3X2PGHQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.690802193 (42m29.121882314s) [noise=true , address=104.36.82.37:4654 , piece_id=MECYP7EZZFUPMAFEUFCVUE2WQTP5WRFOYTAKU6HUXHCX7IPNDMAQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.730638302 (42m29.161718433s) [noise=true , address=104.36.82.61:4379 , piece_id=3GYYNOMAMRBWYWEN23XBFOG5IZEFVFUEJWGPSXT6G2UADKIWE6WA, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.756068527 (42m29.187148648s) [noise=true , address=104.36.82.52:4103 , piece_id=P6QV3H5NKFRSXXQKKVW3V5E2W6CQ6PGWITESTGATQYTLRNUHJNCQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.760324190 (42m29.191404321s) [noise=true , address=104.36.82.5:4858 , piece_id=KR2DROY56ECMCJ55VPXQSOOPVXJP6ZZCSI4BVPXLITAXB6PPKJBA, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.770480252 (42m29.201560383s) [noise=true , address=104.36.82.15:4281 , piece_id=3SI2GJNEQ2PN5B76ZRNXAATOVLLRPETTQQXC53ZGPFDAIW7BO5XQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.770502485 (42m29.201582616s) [seg_pos={0 0}, upload=750]: Segment reached optimal threshold of 14 pieces. Aug 8 18:08:34.770595502 (42m29.201675623s) [noise=true , address=104.36.82.11:4143 , piece_id=OIYZCCHPFACRG7BCSOP2USITVTN6ZTY6JA5GI2R2WCBBWKOIQXPQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ipThd6PwZUpCXy3ML4qqMd9dmRLmxKjVNCNoT5wCg1szdWp8U): protocol: expected piece hash; context canceled; EOF Aug 8 18:08:34.770652110 (42m29.201732241s) [noise=true , address=104.36.82.44:4871 , piece_id=GQ57M3NGW7RHAEUVFICZJLXRY3D5LZOWSRZPUBE42RODCI565KXA, seg_pos={0 0}, upload=750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t3N84zSSMtzRBs1H47Szc2xAHwqmyr9szJahRkxMYDLto8DAx): protocol: expected piece hash; context canceled; EOF Aug 8 18:08:34.770818338 (42m29.201898469s) [noise=true , address=104.36.82.45:4929 , piece_id=ILJY377CZ5FBRVCFZCHZEMOLQZBM2LHQ67M7KOWHSXJQJOJTKKJQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VxQN6CV1ogwKcs27ho2ayknnPi7BDEcA9ZFbgsUacuQNFAdmm): protocol: expected piece hash; context canceled; EOF Aug 8 18:08:34.770822646 (42m29.201902778s) [noise=true , address=104.36.82.62:4416 , piece_id=UZECRJN7M6HC2Q5EOL5QEFBRHLVVTVS7NAU3E7HZSUEB434IXPKQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12syasUPsyYf4UstQ6cFAr6qamze3vCyAm9dnobk5e83w4bTz69): protocol: expected piece hash; context canceled; EOF Aug 8 18:08:34.770897630 (42m29.201977761s) [seg_pos={0 0}, upload=750]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 18:08:34.771018311 (42m29.202098442s) [upload=750]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 18:08:34.771025956 (42m29.202106127s) [upload=750]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 18:08:35.092714666 (42m29.523794797s) [upload=750]: Done uploading segments... Aug 8 18:08:35.092729535 (42m29.523809666s) [upload=750]: Upload finished. err: <nil> Duration: 5.765353415s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.................................X..........X...............] duration: 1.829028188s FAIL (2025-08-08 18:11:53 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 8 17:58:37.957200338 (32m32.388280469s) [upload=582]: Starting upload Aug 8 17:58:37.957297144 (32m32.388377275s) [upload=582]: Done starting upload Aug 8 17:58:37.957394770 (32m32.388474901s) [upload=582]: Uploading segments... Aug 8 17:58:37.957482327 (32m32.388562459s) [upload=582]: Got next segment. Inline: true Aug 8 17:58:37.957488490 (32m32.388568631s) [upload=582]: Waiting for error group managing segments... Aug 8 17:58:37.957554776 (32m32.388634907s) [upload=582]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 17:58:37.957561689 (32m32.38864182s) [upload=582]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 17:58:37.957565306 (32m32.388645427s) [upload=582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 17:58:38.276535375 (32m32.707615516s) [upload=582]: Done uploading segments... Aug 8 17:58:38.276578197 (32m32.707658339s) [upload=582]: Upload finished. err: <nil> Duration:* 1.829058406s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 6.145065903s FAIL (2025-08-08 18:11:31 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.145083306s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..................................X..........X..............] duration: 1.830791822s FAIL (2025-08-08 18:10:54 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 8 17:58:37.957200338 (32m32.388280469s) [upload=582]: Starting upload Aug 8 17:58:37.957297144 (32m32.388377275s) [upload=582]: Done starting upload Aug 8 17:58:37.957394770 (32m32.388474901s) [upload=582]: Uploading segments... Aug 8 17:58:37.957482327 (32m32.388562459s) [upload=582]: Got next segment. Inline: true Aug 8 17:58:37.957488490 (32m32.388568631s) [upload=582]: Waiting for error group managing segments... Aug 8 17:58:37.957554776 (32m32.388634907s) [upload=582]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 17:58:37.957561689 (32m32.38864182s) [upload=582]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 17:58:37.957565306 (32m32.388645427s) [upload=582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 17:58:38.276535375 (32m32.707615516s) [upload=582]: Done uploading segments... Aug 8 17:58:38.276578197 (32m32.707658339s) [upload=582]: Upload finished. err: <nil> Duration:* 1.830817972s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 6.040891458s FAIL (2025-08-08 18:10:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.040930111s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [........X................................X........X...X.....] duration: 5.747629927s FAIL (2025-08-08 18:10:40 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 8 18:08:32.158878721 (42m26.589958852s) [upload=750]: Starting upload Aug 8 18:08:32.158934127 (42m26.590014258s) [upload=750]: Done starting upload Aug 8 18:08:32.159014300 (42m26.590094431s) [upload=750]: Uploading segments... Aug 8 18:08:32.159154128 (42m26.590234329s) [upload=750]: Got next segment. Inline: false Aug 8 18:08:32.159193062 (42m26.590273183s) [upload=750]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 18:08:32.159249370 (42m26.590329521s) [upload=750]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 18:08:32.619210358 (42m27.050290489s) [seg_pos={0 0}, upload=750]: Begin upload segment... Aug 8 18:08:32.619249643 (42m27.050329774s) [seg_pos={0 0}, upload=750]: Done begin upload segment. Aug 8 18:08:32.619270152 (42m27.050350273s) [noise=true , address=64.49.13.154:4936 , piece_id=5JHATRFSB42SUVQG4LYG2UKJIVVZAPOYWRX2FAFEALXIWH4MWXDA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.619823210 (42m27.050903341s) [noise=true , address=104.36.82.44:4871 , piece_id=GQ57M3NGW7RHAEUVFICZJLXRY3D5LZOWSRZPUBE42RODCI565KXA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.620150026 (42m27.051230147s) [noise=true , address=104.36.82.45:4929 , piece_id=ILJY377CZ5FBRVCFZCHZEMOLQZBM2LHQ67M7KOWHSXJQJOJTKKJQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.620523119 (42m27.05160325s) [noise=true , address=104.36.82.46:4509 , piece_id=B46DOEJWSMG4M57P6VE3FT2EVG5G3VKJIC4YBGVVNBKMU3X2PGHQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.620844254 (42m27.051924385s) [noise=true , address=45.91.116.11:4129 , piece_id=BBCWG6ULHGBJKI42DQUAYTAG63VOM2UFV2KHCKUZH45TWCCDKA2A, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.621137575 (42m27.052217706s) [noise=true , address=104.36.82.60:4345 , piece_id=TX4PHOR2JBPYTIPEGZ7AIYZPBKCSCY2J3GVSEADUCT53WZBFVDQQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.621411269 (42m27.0524914s) [noise=true , address=104.36.82.59:4327 , piece_id=LF3HMRWMP4I26KPCKXVZ7T72B2WQVGZY7HM35VINRLGSPVSOJDNA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.621701694 (42m27.052781825s) [noise=true , address=79.127.205.233:4648 , piece_id=33KAEXCMQFSYG25BFZIGFNH5HANBOOTGIKL5KFKE7QSSO44JKIMQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.621960069 (42m27.0530402s) [noise=true , address=104.36.82.15:4281 , piece_id=3SI2GJNEQ2PN5B76ZRNXAATOVLLRPETTQQXC53ZGPFDAIW7BO5XQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.622234775 (42m27.053314906s) [noise=true , address=104.36.82.61:4379 , piece_id=3GYYNOMAMRBWYWEN23XBFOG5IZEFVFUEJWGPSXT6G2UADKIWE6WA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.622468722 (42m27.053548853s) [noise=true , address=64.49.13.26:4948 , piece_id=LHQGTA554IREULAHP3Q3QSGY523MRWSGI45FPOBOW4PRGCJBPAMA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.623280185 (42m27.054360316s) [noise=true , address=104.36.82.11:4143 , piece_id=OIYZCCHPFACRG7BCSOP2USITVTN6ZTY6JA5GI2R2WCBBWKOIQXPQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.623774060 (42m27.054854181s) [noise=true , address=104.36.82.60:4341 , piece_id=WTK3IBRT23CBOPSXSYUKRHGQSG622T2AUES376DCIKO66DSAOCUQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.624530928 (42m27.055611059s) [noise=true , address=104.36.82.37:4654 , piece_id=MECYP7EZZFUPMAFEUFCVUE2WQTP5WRFOYTAKU6HUXHCX7IPNDMAQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.625404930 (42m27.056485061s) [noise=true , address=104.36.82.52:4103 , piece_id=P6QV3H5NKFRSXXQKKVW3V5E2W6CQ6PGWITESTGATQYTLRNUHJNCQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.626153493 (42m27.057233624s) [noise=true , address=104.36.82.35:4598 , piece_id=7JCMFN57EF2KRSJ4MGJOUILBK2DZABEVAHZMGDB2M6DKI3CHU7VQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.626989051 (42m27.058069182s) [noise=true , address=104.36.82.62:4416 , piece_id=UZECRJN7M6HC2Q5EOL5QEFBRHLVVTVS7NAU3E7HZSUEB434IXPKQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.627383686 (42m27.058463817s) [noise=true , address=104.36.82.5:4858 , piece_id=KR2DROY56ECMCJ55VPXQSOOPVXJP6ZZCSI4BVPXLITAXB6PPKJBA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:33.730137164 (42m28.161217295s) [upload=750]: Next returned nil segment Aug 8 18:08:33.730151332 (42m28.161231463s) [upload=750]: Waiting for error group managing segments... Aug 8 18:08:34.014807988 (42m28.445888119s) [noise=true , address=79.127.205.233:4648 , piece_id=33KAEXCMQFSYG25BFZIGFNH5HANBOOTGIKL5KFKE7QSSO44JKIMQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.082739832 (42m28.513819963s) [noise=true , address=64.49.13.26:4948 , piece_id=LHQGTA554IREULAHP3Q3QSGY523MRWSGI45FPOBOW4PRGCJBPAMA, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.104574428 (42m28.535654559s) [noise=true , address=64.49.13.154:4936 , piece_id=5JHATRFSB42SUVQG4LYG2UKJIVVZAPOYWRX2FAFEALXIWH4MWXDA, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.560367250 (42m28.991447381s) [noise=true , address=104.36.82.60:4345 , piece_id=TX4PHOR2JBPYTIPEGZ7AIYZPBKCSCY2J3GVSEADUCT53WZBFVDQQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.573255500 (42m29.004335621s) [noise=true , address=104.36.82.60:4341 , piece_id=WTK3IBRT23CBOPSXSYUKRHGQSG622T2AUES376DCIKO66DSAOCUQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.642428328 (42m29.073508449s) [noise=true , address=104.36.82.59:4327 , piece_id=LF3HMRWMP4I26KPCKXVZ7T72B2WQVGZY7HM35VINRLGSPVSOJDNA, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.649042744 (42m29.080122875s) [noise=true , address=104.36.82.35:4598 , piece_id=7JCMFN57EF2KRSJ4MGJOUILBK2DZABEVAHZMGDB2M6DKI3CHU7VQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.672062137 (42m29.103142268s) [noise=true , address=45.91.116.11:4129 , piece_id=BBCWG6ULHGBJKI42DQUAYTAG63VOM2UFV2KHCKUZH45TWCCDKA2A, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.683197252 (42m29.114277383s) [noise=true , address=104.36.82.46:4509 , piece_id=B46DOEJWSMG4M57P6VE3FT2EVG5G3VKJIC4YBGVVNBKMU3X2PGHQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.690802193 (42m29.121882314s) [noise=true , address=104.36.82.37:4654 , piece_id=MECYP7EZZFUPMAFEUFCVUE2WQTP5WRFOYTAKU6HUXHCX7IPNDMAQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.730638302 (42m29.161718433s) [noise=true , address=104.36.82.61:4379 , piece_id=3GYYNOMAMRBWYWEN23XBFOG5IZEFVFUEJWGPSXT6G2UADKIWE6WA, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.756068527 (42m29.187148648s) [noise=true , address=104.36.82.52:4103 , piece_id=P6QV3H5NKFRSXXQKKVW3V5E2W6CQ6PGWITESTGATQYTLRNUHJNCQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.760324190 (42m29.191404321s) [noise=true , address=104.36.82.5:4858 , piece_id=KR2DROY56ECMCJ55VPXQSOOPVXJP6ZZCSI4BVPXLITAXB6PPKJBA, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.770480252 (42m29.201560383s) [noise=true , address=104.36.82.15:4281 , piece_id=3SI2GJNEQ2PN5B76ZRNXAATOVLLRPETTQQXC53ZGPFDAIW7BO5XQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.770502485 (42m29.201582616s) [seg_pos={0 0}, upload=750]: Segment reached optimal threshold of 14 pieces. Aug 8 18:08:34.770595502 (42m29.201675623s) [noise=true , address=104.36.82.11:4143 , piece_id=OIYZCCHPFACRG7BCSOP2USITVTN6ZTY6JA5GI2R2WCBBWKOIQXPQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ipThd6PwZUpCXy3ML4qqMd9dmRLmxKjVNCNoT5wCg1szdWp8U): protocol: expected piece hash; context canceled; EOF Aug 8 18:08:34.770652110 (42m29.201732241s) [noise=true , address=104.36.82.44:4871 , piece_id=GQ57M3NGW7RHAEUVFICZJLXRY3D5LZOWSRZPUBE42RODCI565KXA, seg_pos={0 0}, upload=750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t3N84zSSMtzRBs1H47Szc2xAHwqmyr9szJahRkxMYDLto8DAx): protocol: expected piece hash; context canceled; EOF Aug 8 18:08:34.770818338 (42m29.201898469s) [noise=true , address=104.36.82.45:4929 , piece_id=ILJY377CZ5FBRVCFZCHZEMOLQZBM2LHQ67M7KOWHSXJQJOJTKKJQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VxQN6CV1ogwKcs27ho2ayknnPi7BDEcA9ZFbgsUacuQNFAdmm): protocol: expected piece hash; context canceled; EOF Aug 8 18:08:34.770822646 (42m29.201902778s) [noise=true , address=104.36.82.62:4416 , piece_id=UZECRJN7M6HC2Q5EOL5QEFBRHLVVTVS7NAU3E7HZSUEB434IXPKQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12syasUPsyYf4UstQ6cFAr6qamze3vCyAm9dnobk5e83w4bTz69): protocol: expected piece hash; context canceled; EOF Aug 8 18:08:34.770897630 (42m29.201977761s) [seg_pos={0 0}, upload=750]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 18:08:34.771018311 (42m29.202098442s) [upload=750]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 18:08:34.771025956 (42m29.202106127s) [upload=750]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 18:08:35.092714666 (42m29.523794797s) [upload=750]: Done uploading segments... Aug 8 18:08:35.092729535 (42m29.523809666s) [upload=750]: Upload finished. err: <nil> Duration: 5.747662659s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.........X................................X........X...X....] duration: 5.755963809s FAIL (2025-08-08 18:10:19 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 8 18:08:32.158878721 (42m26.589958852s) [upload=750]: Starting upload Aug 8 18:08:32.158934127 (42m26.590014258s) [upload=750]: Done starting upload Aug 8 18:08:32.159014300 (42m26.590094431s) [upload=750]: Uploading segments... Aug 8 18:08:32.159154128 (42m26.590234329s) [upload=750]: Got next segment. Inline: false Aug 8 18:08:32.159193062 (42m26.590273183s) [upload=750]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 18:08:32.159249370 (42m26.590329521s) [upload=750]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 18:08:32.619210358 (42m27.050290489s) [seg_pos={0 0}, upload=750]: Begin upload segment... Aug 8 18:08:32.619249643 (42m27.050329774s) [seg_pos={0 0}, upload=750]: Done begin upload segment. Aug 8 18:08:32.619270152 (42m27.050350273s) [noise=true , address=64.49.13.154:4936 , piece_id=5JHATRFSB42SUVQG4LYG2UKJIVVZAPOYWRX2FAFEALXIWH4MWXDA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.619823210 (42m27.050903341s) [noise=true , address=104.36.82.44:4871 , piece_id=GQ57M3NGW7RHAEUVFICZJLXRY3D5LZOWSRZPUBE42RODCI565KXA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.620150026 (42m27.051230147s) [noise=true , address=104.36.82.45:4929 , piece_id=ILJY377CZ5FBRVCFZCHZEMOLQZBM2LHQ67M7KOWHSXJQJOJTKKJQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.620523119 (42m27.05160325s) [noise=true , address=104.36.82.46:4509 , piece_id=B46DOEJWSMG4M57P6VE3FT2EVG5G3VKJIC4YBGVVNBKMU3X2PGHQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.620844254 (42m27.051924385s) [noise=true , address=45.91.116.11:4129 , piece_id=BBCWG6ULHGBJKI42DQUAYTAG63VOM2UFV2KHCKUZH45TWCCDKA2A, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.621137575 (42m27.052217706s) [noise=true , address=104.36.82.60:4345 , piece_id=TX4PHOR2JBPYTIPEGZ7AIYZPBKCSCY2J3GVSEADUCT53WZBFVDQQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.621411269 (42m27.0524914s) [noise=true , address=104.36.82.59:4327 , piece_id=LF3HMRWMP4I26KPCKXVZ7T72B2WQVGZY7HM35VINRLGSPVSOJDNA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.621701694 (42m27.052781825s) [noise=true , address=79.127.205.233:4648 , piece_id=33KAEXCMQFSYG25BFZIGFNH5HANBOOTGIKL5KFKE7QSSO44JKIMQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.621960069 (42m27.0530402s) [noise=true , address=104.36.82.15:4281 , piece_id=3SI2GJNEQ2PN5B76ZRNXAATOVLLRPETTQQXC53ZGPFDAIW7BO5XQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.622234775 (42m27.053314906s) [noise=true , address=104.36.82.61:4379 , piece_id=3GYYNOMAMRBWYWEN23XBFOG5IZEFVFUEJWGPSXT6G2UADKIWE6WA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.622468722 (42m27.053548853s) [noise=true , address=64.49.13.26:4948 , piece_id=LHQGTA554IREULAHP3Q3QSGY523MRWSGI45FPOBOW4PRGCJBPAMA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.623280185 (42m27.054360316s) [noise=true , address=104.36.82.11:4143 , piece_id=OIYZCCHPFACRG7BCSOP2USITVTN6ZTY6JA5GI2R2WCBBWKOIQXPQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.623774060 (42m27.054854181s) [noise=true , address=104.36.82.60:4341 , piece_id=WTK3IBRT23CBOPSXSYUKRHGQSG622T2AUES376DCIKO66DSAOCUQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.624530928 (42m27.055611059s) [noise=true , address=104.36.82.37:4654 , piece_id=MECYP7EZZFUPMAFEUFCVUE2WQTP5WRFOYTAKU6HUXHCX7IPNDMAQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.625404930 (42m27.056485061s) [noise=true , address=104.36.82.52:4103 , piece_id=P6QV3H5NKFRSXXQKKVW3V5E2W6CQ6PGWITESTGATQYTLRNUHJNCQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.626153493 (42m27.057233624s) [noise=true , address=104.36.82.35:4598 , piece_id=7JCMFN57EF2KRSJ4MGJOUILBK2DZABEVAHZMGDB2M6DKI3CHU7VQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.626989051 (42m27.058069182s) [noise=true , address=104.36.82.62:4416 , piece_id=UZECRJN7M6HC2Q5EOL5QEFBRHLVVTVS7NAU3E7HZSUEB434IXPKQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.627383686 (42m27.058463817s) [noise=true , address=104.36.82.5:4858 , piece_id=KR2DROY56ECMCJ55VPXQSOOPVXJP6ZZCSI4BVPXLITAXB6PPKJBA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:33.730137164 (42m28.161217295s) [upload=750]: Next returned nil segment Aug 8 18:08:33.730151332 (42m28.161231463s) [upload=750]: Waiting for error group managing segments... Aug 8 18:08:34.014807988 (42m28.445888119s) [noise=true , address=79.127.205.233:4648 , piece_id=33KAEXCMQFSYG25BFZIGFNH5HANBOOTGIKL5KFKE7QSSO44JKIMQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.082739832 (42m28.513819963s) [noise=true , address=64.49.13.26:4948 , piece_id=LHQGTA554IREULAHP3Q3QSGY523MRWSGI45FPOBOW4PRGCJBPAMA, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.104574428 (42m28.535654559s) [noise=true , address=64.49.13.154:4936 , piece_id=5JHATRFSB42SUVQG4LYG2UKJIVVZAPOYWRX2FAFEALXIWH4MWXDA, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.560367250 (42m28.991447381s) [noise=true , address=104.36.82.60:4345 , piece_id=TX4PHOR2JBPYTIPEGZ7AIYZPBKCSCY2J3GVSEADUCT53WZBFVDQQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.573255500 (42m29.004335621s) [noise=true , address=104.36.82.60:4341 , piece_id=WTK3IBRT23CBOPSXSYUKRHGQSG622T2AUES376DCIKO66DSAOCUQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.642428328 (42m29.073508449s) [noise=true , address=104.36.82.59:4327 , piece_id=LF3HMRWMP4I26KPCKXVZ7T72B2WQVGZY7HM35VINRLGSPVSOJDNA, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.649042744 (42m29.080122875s) [noise=true , address=104.36.82.35:4598 , piece_id=7JCMFN57EF2KRSJ4MGJOUILBK2DZABEVAHZMGDB2M6DKI3CHU7VQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.672062137 (42m29.103142268s) [noise=true , address=45.91.116.11:4129 , piece_id=BBCWG6ULHGBJKI42DQUAYTAG63VOM2UFV2KHCKUZH45TWCCDKA2A, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.683197252 (42m29.114277383s) [noise=true , address=104.36.82.46:4509 , piece_id=B46DOEJWSMG4M57P6VE3FT2EVG5G3VKJIC4YBGVVNBKMU3X2PGHQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.690802193 (42m29.121882314s) [noise=true , address=104.36.82.37:4654 , piece_id=MECYP7EZZFUPMAFEUFCVUE2WQTP5WRFOYTAKU6HUXHCX7IPNDMAQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.730638302 (42m29.161718433s) [noise=true , address=104.36.82.61:4379 , piece_id=3GYYNOMAMRBWYWEN23XBFOG5IZEFVFUEJWGPSXT6G2UADKIWE6WA, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.756068527 (42m29.187148648s) [noise=true , address=104.36.82.52:4103 , piece_id=P6QV3H5NKFRSXXQKKVW3V5E2W6CQ6PGWITESTGATQYTLRNUHJNCQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.760324190 (42m29.191404321s) [noise=true , address=104.36.82.5:4858 , piece_id=KR2DROY56ECMCJ55VPXQSOOPVXJP6ZZCSI4BVPXLITAXB6PPKJBA, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.770480252 (42m29.201560383s) [noise=true , address=104.36.82.15:4281 , piece_id=3SI2GJNEQ2PN5B76ZRNXAATOVLLRPETTQQXC53ZGPFDAIW7BO5XQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.770502485 (42m29.201582616s) [seg_pos={0 0}, upload=750]: Segment reached optimal threshold of 14 pieces. Aug 8 18:08:34.770595502 (42m29.201675623s) [noise=true , address=104.36.82.11:4143 , piece_id=OIYZCCHPFACRG7BCSOP2USITVTN6ZTY6JA5GI2R2WCBBWKOIQXPQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ipThd6PwZUpCXy3ML4qqMd9dmRLmxKjVNCNoT5wCg1szdWp8U): protocol: expected piece hash; context canceled; EOF Aug 8 18:08:34.770652110 (42m29.201732241s) [noise=true , address=104.36.82.44:4871 , piece_id=GQ57M3NGW7RHAEUVFICZJLXRY3D5LZOWSRZPUBE42RODCI565KXA, seg_pos={0 0}, upload=750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t3N84zSSMtzRBs1H47Szc2xAHwqmyr9szJahRkxMYDLto8DAx): protocol: expected piece hash; context canceled; EOF Aug 8 18:08:34.770818338 (42m29.201898469s) [noise=true , address=104.36.82.45:4929 , piece_id=ILJY377CZ5FBRVCFZCHZEMOLQZBM2LHQ67M7KOWHSXJQJOJTKKJQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VxQN6CV1ogwKcs27ho2ayknnPi7BDEcA9ZFbgsUacuQNFAdmm): protocol: expected piece hash; context canceled; EOF Aug 8 18:08:34.770822646 (42m29.201902778s) [noise=true , address=104.36.82.62:4416 , piece_id=UZECRJN7M6HC2Q5EOL5QEFBRHLVVTVS7NAU3E7HZSUEB434IXPKQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12syasUPsyYf4UstQ6cFAr6qamze3vCyAm9dnobk5e83w4bTz69): protocol: expected piece hash; context canceled; EOF Aug 8 18:08:34.770897630 (42m29.201977761s) [seg_pos={0 0}, upload=750]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 18:08:34.771018311 (42m29.202098442s) [upload=750]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 18:08:34.771025956 (42m29.202106127s) [upload=750]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 18:08:35.092714666 (42m29.523794797s) [upload=750]: Done uploading segments... Aug 8 18:08:35.092729535 (42m29.523809666s) [upload=750]: Upload finished. err: <nil> Duration: 5.755989057s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...................................X..........X.............] duration: 2.034604476s FAIL (2025-08-08 18:10:02 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 8 17:58:37.957200338 (32m32.388280469s) [upload=582]: Starting upload Aug 8 17:58:37.957297144 (32m32.388377275s) [upload=582]: Done starting upload Aug 8 17:58:37.957394770 (32m32.388474901s) [upload=582]: Uploading segments... Aug 8 17:58:37.957482327 (32m32.388562459s) [upload=582]: Got next segment. Inline: true Aug 8 17:58:37.957488490 (32m32.388568631s) [upload=582]: Waiting for error group managing segments... Aug 8 17:58:37.957554776 (32m32.388634907s) [upload=582]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 17:58:37.957561689 (32m32.38864182s) [upload=582]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 17:58:37.957565306 (32m32.388645427s) [upload=582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 17:58:38.276535375 (32m32.707615516s) [upload=582]: Done uploading segments... Aug 8 17:58:38.276578197 (32m32.707658339s) [upload=582]: Upload finished. err: <nil> Duration:* 2.034630878s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..........X................................X........X...X...] duration: 5.968337308s FAIL (2025-08-08 18:09:42 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 8 18:08:32.158878721 (42m26.589958852s) [upload=750]: Starting upload Aug 8 18:08:32.158934127 (42m26.590014258s) [upload=750]: Done starting upload Aug 8 18:08:32.159014300 (42m26.590094431s) [upload=750]: Uploading segments... Aug 8 18:08:32.159154128 (42m26.590234329s) [upload=750]: Got next segment. Inline: false Aug 8 18:08:32.159193062 (42m26.590273183s) [upload=750]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 18:08:32.159249370 (42m26.590329521s) [upload=750]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 18:08:32.619210358 (42m27.050290489s) [seg_pos={0 0}, upload=750]: Begin upload segment... Aug 8 18:08:32.619249643 (42m27.050329774s) [seg_pos={0 0}, upload=750]: Done begin upload segment. Aug 8 18:08:32.619270152 (42m27.050350273s) [noise=true , address=64.49.13.154:4936 , piece_id=5JHATRFSB42SUVQG4LYG2UKJIVVZAPOYWRX2FAFEALXIWH4MWXDA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.619823210 (42m27.050903341s) [noise=true , address=104.36.82.44:4871 , piece_id=GQ57M3NGW7RHAEUVFICZJLXRY3D5LZOWSRZPUBE42RODCI565KXA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.620150026 (42m27.051230147s) [noise=true , address=104.36.82.45:4929 , piece_id=ILJY377CZ5FBRVCFZCHZEMOLQZBM2LHQ67M7KOWHSXJQJOJTKKJQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.620523119 (42m27.05160325s) [noise=true , address=104.36.82.46:4509 , piece_id=B46DOEJWSMG4M57P6VE3FT2EVG5G3VKJIC4YBGVVNBKMU3X2PGHQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.620844254 (42m27.051924385s) [noise=true , address=45.91.116.11:4129 , piece_id=BBCWG6ULHGBJKI42DQUAYTAG63VOM2UFV2KHCKUZH45TWCCDKA2A, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.621137575 (42m27.052217706s) [noise=true , address=104.36.82.60:4345 , piece_id=TX4PHOR2JBPYTIPEGZ7AIYZPBKCSCY2J3GVSEADUCT53WZBFVDQQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.621411269 (42m27.0524914s) [noise=true , address=104.36.82.59:4327 , piece_id=LF3HMRWMP4I26KPCKXVZ7T72B2WQVGZY7HM35VINRLGSPVSOJDNA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.621701694 (42m27.052781825s) [noise=true , address=79.127.205.233:4648 , piece_id=33KAEXCMQFSYG25BFZIGFNH5HANBOOTGIKL5KFKE7QSSO44JKIMQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.621960069 (42m27.0530402s) [noise=true , address=104.36.82.15:4281 , piece_id=3SI2GJNEQ2PN5B76ZRNXAATOVLLRPETTQQXC53ZGPFDAIW7BO5XQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.622234775 (42m27.053314906s) [noise=true , address=104.36.82.61:4379 , piece_id=3GYYNOMAMRBWYWEN23XBFOG5IZEFVFUEJWGPSXT6G2UADKIWE6WA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.622468722 (42m27.053548853s) [noise=true , address=64.49.13.26:4948 , piece_id=LHQGTA554IREULAHP3Q3QSGY523MRWSGI45FPOBOW4PRGCJBPAMA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.623280185 (42m27.054360316s) [noise=true , address=104.36.82.11:4143 , piece_id=OIYZCCHPFACRG7BCSOP2USITVTN6ZTY6JA5GI2R2WCBBWKOIQXPQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.623774060 (42m27.054854181s) [noise=true , address=104.36.82.60:4341 , piece_id=WTK3IBRT23CBOPSXSYUKRHGQSG622T2AUES376DCIKO66DSAOCUQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.624530928 (42m27.055611059s) [noise=true , address=104.36.82.37:4654 , piece_id=MECYP7EZZFUPMAFEUFCVUE2WQTP5WRFOYTAKU6HUXHCX7IPNDMAQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.625404930 (42m27.056485061s) [noise=true , address=104.36.82.52:4103 , piece_id=P6QV3H5NKFRSXXQKKVW3V5E2W6CQ6PGWITESTGATQYTLRNUHJNCQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.626153493 (42m27.057233624s) [noise=true , address=104.36.82.35:4598 , piece_id=7JCMFN57EF2KRSJ4MGJOUILBK2DZABEVAHZMGDB2M6DKI3CHU7VQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.626989051 (42m27.058069182s) [noise=true , address=104.36.82.62:4416 , piece_id=UZECRJN7M6HC2Q5EOL5QEFBRHLVVTVS7NAU3E7HZSUEB434IXPKQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.627383686 (42m27.058463817s) [noise=true , address=104.36.82.5:4858 , piece_id=KR2DROY56ECMCJ55VPXQSOOPVXJP6ZZCSI4BVPXLITAXB6PPKJBA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:33.730137164 (42m28.161217295s) [upload=750]: Next returned nil segment Aug 8 18:08:33.730151332 (42m28.161231463s) [upload=750]: Waiting for error group managing segments... Aug 8 18:08:34.014807988 (42m28.445888119s) [noise=true , address=79.127.205.233:4648 , piece_id=33KAEXCMQFSYG25BFZIGFNH5HANBOOTGIKL5KFKE7QSSO44JKIMQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.082739832 (42m28.513819963s) [noise=true , address=64.49.13.26:4948 , piece_id=LHQGTA554IREULAHP3Q3QSGY523MRWSGI45FPOBOW4PRGCJBPAMA, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.104574428 (42m28.535654559s) [noise=true , address=64.49.13.154:4936 , piece_id=5JHATRFSB42SUVQG4LYG2UKJIVVZAPOYWRX2FAFEALXIWH4MWXDA, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.560367250 (42m28.991447381s) [noise=true , address=104.36.82.60:4345 , piece_id=TX4PHOR2JBPYTIPEGZ7AIYZPBKCSCY2J3GVSEADUCT53WZBFVDQQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.573255500 (42m29.004335621s) [noise=true , address=104.36.82.60:4341 , piece_id=WTK3IBRT23CBOPSXSYUKRHGQSG622T2AUES376DCIKO66DSAOCUQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.642428328 (42m29.073508449s) [noise=true , address=104.36.82.59:4327 , piece_id=LF3HMRWMP4I26KPCKXVZ7T72B2WQVGZY7HM35VINRLGSPVSOJDNA, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.649042744 (42m29.080122875s) [noise=true , address=104.36.82.35:4598 , piece_id=7JCMFN57EF2KRSJ4MGJOUILBK2DZABEVAHZMGDB2M6DKI3CHU7VQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.672062137 (42m29.103142268s) [noise=true , address=45.91.116.11:4129 , piece_id=BBCWG6ULHGBJKI42DQUAYTAG63VOM2UFV2KHCKUZH45TWCCDKA2A, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.683197252 (42m29.114277383s) [noise=true , address=104.36.82.46:4509 , piece_id=B46DOEJWSMG4M57P6VE3FT2EVG5G3VKJIC4YBGVVNBKMU3X2PGHQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.690802193 (42m29.121882314s) [noise=true , address=104.36.82.37:4654 , piece_id=MECYP7EZZFUPMAFEUFCVUE2WQTP5WRFOYTAKU6HUXHCX7IPNDMAQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.730638302 (42m29.161718433s) [noise=true , address=104.36.82.61:4379 , piece_id=3GYYNOMAMRBWYWEN23XBFOG5IZEFVFUEJWGPSXT6G2UADKIWE6WA, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.756068527 (42m29.187148648s) [noise=true , address=104.36.82.52:4103 , piece_id=P6QV3H5NKFRSXXQKKVW3V5E2W6CQ6PGWITESTGATQYTLRNUHJNCQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.760324190 (42m29.191404321s) [noise=true , address=104.36.82.5:4858 , piece_id=KR2DROY56ECMCJ55VPXQSOOPVXJP6ZZCSI4BVPXLITAXB6PPKJBA, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.770480252 (42m29.201560383s) [noise=true , address=104.36.82.15:4281 , piece_id=3SI2GJNEQ2PN5B76ZRNXAATOVLLRPETTQQXC53ZGPFDAIW7BO5XQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.770502485 (42m29.201582616s) [seg_pos={0 0}, upload=750]: Segment reached optimal threshold of 14 pieces. Aug 8 18:08:34.770595502 (42m29.201675623s) [noise=true , address=104.36.82.11:4143 , piece_id=OIYZCCHPFACRG7BCSOP2USITVTN6ZTY6JA5GI2R2WCBBWKOIQXPQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ipThd6PwZUpCXy3ML4qqMd9dmRLmxKjVNCNoT5wCg1szdWp8U): protocol: expected piece hash; context canceled; EOF Aug 8 18:08:34.770652110 (42m29.201732241s) [noise=true , address=104.36.82.44:4871 , piece_id=GQ57M3NGW7RHAEUVFICZJLXRY3D5LZOWSRZPUBE42RODCI565KXA, seg_pos={0 0}, upload=750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t3N84zSSMtzRBs1H47Szc2xAHwqmyr9szJahRkxMYDLto8DAx): protocol: expected piece hash; context canceled; EOF Aug 8 18:08:34.770818338 (42m29.201898469s) [noise=true , address=104.36.82.45:4929 , piece_id=ILJY377CZ5FBRVCFZCHZEMOLQZBM2LHQ67M7KOWHSXJQJOJTKKJQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VxQN6CV1ogwKcs27ho2ayknnPi7BDEcA9ZFbgsUacuQNFAdmm): protocol: expected piece hash; context canceled; EOF Aug 8 18:08:34.770822646 (42m29.201902778s) [noise=true , address=104.36.82.62:4416 , piece_id=UZECRJN7M6HC2Q5EOL5QEFBRHLVVTVS7NAU3E7HZSUEB434IXPKQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12syasUPsyYf4UstQ6cFAr6qamze3vCyAm9dnobk5e83w4bTz69): protocol: expected piece hash; context canceled; EOF Aug 8 18:08:34.770897630 (42m29.201977761s) [seg_pos={0 0}, upload=750]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 18:08:34.771018311 (42m29.202098442s) [upload=750]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 18:08:34.771025956 (42m29.202106127s) [upload=750]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 18:08:35.092714666 (42m29.523794797s) [upload=750]: Done uploading segments... Aug 8 18:08:35.092729535 (42m29.523809666s) [upload=750]: Upload finished. err: <nil> Duration: 5.96835926s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [....................................X..........X............] duration: 1.937099392s FAIL (2025-08-08 18:09:42 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 8 17:58:37.957200338 (32m32.388280469s) [upload=582]: Starting upload Aug 8 17:58:37.957297144 (32m32.388377275s) [upload=582]: Done starting upload Aug 8 17:58:37.957394770 (32m32.388474901s) [upload=582]: Uploading segments... Aug 8 17:58:37.957482327 (32m32.388562459s) [upload=582]: Got next segment. Inline: true Aug 8 17:58:37.957488490 (32m32.388568631s) [upload=582]: Waiting for error group managing segments... Aug 8 17:58:37.957554776 (32m32.388634907s) [upload=582]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 17:58:37.957561689 (32m32.38864182s) [upload=582]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 17:58:37.957565306 (32m32.388645427s) [upload=582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 17:58:38.276535375 (32m32.707615516s) [upload=582]: Done uploading segments... Aug 8 17:58:38.276578197 (32m32.707658339s) [upload=582]: Upload finished. err: <nil> Duration:* 1.937117606s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 6.095018528s FAIL (2025-08-08 18:09:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.095047474s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...........X................................X........X...X..] duration: 5.923074306s FAIL (2025-08-08 18:09:21 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 8 18:08:32.158878721 (42m26.589958852s) [upload=750]: Starting upload Aug 8 18:08:32.158934127 (42m26.590014258s) [upload=750]: Done starting upload Aug 8 18:08:32.159014300 (42m26.590094431s) [upload=750]: Uploading segments... Aug 8 18:08:32.159154128 (42m26.590234329s) [upload=750]: Got next segment. Inline: false Aug 8 18:08:32.159193062 (42m26.590273183s) [upload=750]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 18:08:32.159249370 (42m26.590329521s) [upload=750]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 18:08:32.619210358 (42m27.050290489s) [seg_pos={0 0}, upload=750]: Begin upload segment... Aug 8 18:08:32.619249643 (42m27.050329774s) [seg_pos={0 0}, upload=750]: Done begin upload segment. Aug 8 18:08:32.619270152 (42m27.050350273s) [noise=true , address=64.49.13.154:4936 , piece_id=5JHATRFSB42SUVQG4LYG2UKJIVVZAPOYWRX2FAFEALXIWH4MWXDA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.619823210 (42m27.050903341s) [noise=true , address=104.36.82.44:4871 , piece_id=GQ57M3NGW7RHAEUVFICZJLXRY3D5LZOWSRZPUBE42RODCI565KXA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.620150026 (42m27.051230147s) [noise=true , address=104.36.82.45:4929 , piece_id=ILJY377CZ5FBRVCFZCHZEMOLQZBM2LHQ67M7KOWHSXJQJOJTKKJQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.620523119 (42m27.05160325s) [noise=true , address=104.36.82.46:4509 , piece_id=B46DOEJWSMG4M57P6VE3FT2EVG5G3VKJIC4YBGVVNBKMU3X2PGHQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.620844254 (42m27.051924385s) [noise=true , address=45.91.116.11:4129 , piece_id=BBCWG6ULHGBJKI42DQUAYTAG63VOM2UFV2KHCKUZH45TWCCDKA2A, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.621137575 (42m27.052217706s) [noise=true , address=104.36.82.60:4345 , piece_id=TX4PHOR2JBPYTIPEGZ7AIYZPBKCSCY2J3GVSEADUCT53WZBFVDQQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.621411269 (42m27.0524914s) [noise=true , address=104.36.82.59:4327 , piece_id=LF3HMRWMP4I26KPCKXVZ7T72B2WQVGZY7HM35VINRLGSPVSOJDNA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.621701694 (42m27.052781825s) [noise=true , address=79.127.205.233:4648 , piece_id=33KAEXCMQFSYG25BFZIGFNH5HANBOOTGIKL5KFKE7QSSO44JKIMQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.621960069 (42m27.0530402s) [noise=true , address=104.36.82.15:4281 , piece_id=3SI2GJNEQ2PN5B76ZRNXAATOVLLRPETTQQXC53ZGPFDAIW7BO5XQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.622234775 (42m27.053314906s) [noise=true , address=104.36.82.61:4379 , piece_id=3GYYNOMAMRBWYWEN23XBFOG5IZEFVFUEJWGPSXT6G2UADKIWE6WA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.622468722 (42m27.053548853s) [noise=true , address=64.49.13.26:4948 , piece_id=LHQGTA554IREULAHP3Q3QSGY523MRWSGI45FPOBOW4PRGCJBPAMA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.623280185 (42m27.054360316s) [noise=true , address=104.36.82.11:4143 , piece_id=OIYZCCHPFACRG7BCSOP2USITVTN6ZTY6JA5GI2R2WCBBWKOIQXPQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.623774060 (42m27.054854181s) [noise=true , address=104.36.82.60:4341 , piece_id=WTK3IBRT23CBOPSXSYUKRHGQSG622T2AUES376DCIKO66DSAOCUQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.624530928 (42m27.055611059s) [noise=true , address=104.36.82.37:4654 , piece_id=MECYP7EZZFUPMAFEUFCVUE2WQTP5WRFOYTAKU6HUXHCX7IPNDMAQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.625404930 (42m27.056485061s) [noise=true , address=104.36.82.52:4103 , piece_id=P6QV3H5NKFRSXXQKKVW3V5E2W6CQ6PGWITESTGATQYTLRNUHJNCQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.626153493 (42m27.057233624s) [noise=true , address=104.36.82.35:4598 , piece_id=7JCMFN57EF2KRSJ4MGJOUILBK2DZABEVAHZMGDB2M6DKI3CHU7VQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.626989051 (42m27.058069182s) [noise=true , address=104.36.82.62:4416 , piece_id=UZECRJN7M6HC2Q5EOL5QEFBRHLVVTVS7NAU3E7HZSUEB434IXPKQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.627383686 (42m27.058463817s) [noise=true , address=104.36.82.5:4858 , piece_id=KR2DROY56ECMCJ55VPXQSOOPVXJP6ZZCSI4BVPXLITAXB6PPKJBA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:33.730137164 (42m28.161217295s) [upload=750]: Next returned nil segment Aug 8 18:08:33.730151332 (42m28.161231463s) [upload=750]: Waiting for error group managing segments... Aug 8 18:08:34.014807988 (42m28.445888119s) [noise=true , address=79.127.205.233:4648 , piece_id=33KAEXCMQFSYG25BFZIGFNH5HANBOOTGIKL5KFKE7QSSO44JKIMQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.082739832 (42m28.513819963s) [noise=true , address=64.49.13.26:4948 , piece_id=LHQGTA554IREULAHP3Q3QSGY523MRWSGI45FPOBOW4PRGCJBPAMA, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.104574428 (42m28.535654559s) [noise=true , address=64.49.13.154:4936 , piece_id=5JHATRFSB42SUVQG4LYG2UKJIVVZAPOYWRX2FAFEALXIWH4MWXDA, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.560367250 (42m28.991447381s) [noise=true , address=104.36.82.60:4345 , piece_id=TX4PHOR2JBPYTIPEGZ7AIYZPBKCSCY2J3GVSEADUCT53WZBFVDQQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.573255500 (42m29.004335621s) [noise=true , address=104.36.82.60:4341 , piece_id=WTK3IBRT23CBOPSXSYUKRHGQSG622T2AUES376DCIKO66DSAOCUQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.642428328 (42m29.073508449s) [noise=true , address=104.36.82.59:4327 , piece_id=LF3HMRWMP4I26KPCKXVZ7T72B2WQVGZY7HM35VINRLGSPVSOJDNA, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.649042744 (42m29.080122875s) [noise=true , address=104.36.82.35:4598 , piece_id=7JCMFN57EF2KRSJ4MGJOUILBK2DZABEVAHZMGDB2M6DKI3CHU7VQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.672062137 (42m29.103142268s) [noise=true , address=45.91.116.11:4129 , piece_id=BBCWG6ULHGBJKI42DQUAYTAG63VOM2UFV2KHCKUZH45TWCCDKA2A, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.683197252 (42m29.114277383s) [noise=true , address=104.36.82.46:4509 , piece_id=B46DOEJWSMG4M57P6VE3FT2EVG5G3VKJIC4YBGVVNBKMU3X2PGHQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.690802193 (42m29.121882314s) [noise=true , address=104.36.82.37:4654 , piece_id=MECYP7EZZFUPMAFEUFCVUE2WQTP5WRFOYTAKU6HUXHCX7IPNDMAQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.730638302 (42m29.161718433s) [noise=true , address=104.36.82.61:4379 , piece_id=3GYYNOMAMRBWYWEN23XBFOG5IZEFVFUEJWGPSXT6G2UADKIWE6WA, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.756068527 (42m29.187148648s) [noise=true , address=104.36.82.52:4103 , piece_id=P6QV3H5NKFRSXXQKKVW3V5E2W6CQ6PGWITESTGATQYTLRNUHJNCQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.760324190 (42m29.191404321s) [noise=true , address=104.36.82.5:4858 , piece_id=KR2DROY56ECMCJ55VPXQSOOPVXJP6ZZCSI4BVPXLITAXB6PPKJBA, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.770480252 (42m29.201560383s) [noise=true , address=104.36.82.15:4281 , piece_id=3SI2GJNEQ2PN5B76ZRNXAATOVLLRPETTQQXC53ZGPFDAIW7BO5XQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.770502485 (42m29.201582616s) [seg_pos={0 0}, upload=750]: Segment reached optimal threshold of 14 pieces. Aug 8 18:08:34.770595502 (42m29.201675623s) [noise=true , address=104.36.82.11:4143 , piece_id=OIYZCCHPFACRG7BCSOP2USITVTN6ZTY6JA5GI2R2WCBBWKOIQXPQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ipThd6PwZUpCXy3ML4qqMd9dmRLmxKjVNCNoT5wCg1szdWp8U): protocol: expected piece hash; context canceled; EOF Aug 8 18:08:34.770652110 (42m29.201732241s) [noise=true , address=104.36.82.44:4871 , piece_id=GQ57M3NGW7RHAEUVFICZJLXRY3D5LZOWSRZPUBE42RODCI565KXA, seg_pos={0 0}, upload=750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t3N84zSSMtzRBs1H47Szc2xAHwqmyr9szJahRkxMYDLto8DAx): protocol: expected piece hash; context canceled; EOF Aug 8 18:08:34.770818338 (42m29.201898469s) [noise=true , address=104.36.82.45:4929 , piece_id=ILJY377CZ5FBRVCFZCHZEMOLQZBM2LHQ67M7KOWHSXJQJOJTKKJQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VxQN6CV1ogwKcs27ho2ayknnPi7BDEcA9ZFbgsUacuQNFAdmm): protocol: expected piece hash; context canceled; EOF Aug 8 18:08:34.770822646 (42m29.201902778s) [noise=true , address=104.36.82.62:4416 , piece_id=UZECRJN7M6HC2Q5EOL5QEFBRHLVVTVS7NAU3E7HZSUEB434IXPKQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12syasUPsyYf4UstQ6cFAr6qamze3vCyAm9dnobk5e83w4bTz69): protocol: expected piece hash; context canceled; EOF Aug 8 18:08:34.770897630 (42m29.201977761s) [seg_pos={0 0}, upload=750]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 18:08:34.771018311 (42m29.202098442s) [upload=750]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 18:08:34.771025956 (42m29.202106127s) [upload=750]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 18:08:35.092714666 (42m29.523794797s) [upload=750]: Done uploading segments... Aug 8 18:08:35.092729535 (42m29.523809666s) [upload=750]: Upload finished. err: <nil> Duration: 5.923122437s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [............X................................X........X...X.] duration: 6.096610471s FAIL (2025-08-08 18:09:03 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 8 18:08:32.158878721 (42m26.589958852s) [upload=750]: Starting upload Aug 8 18:08:32.158934127 (42m26.590014258s) [upload=750]: Done starting upload Aug 8 18:08:32.159014300 (42m26.590094431s) [upload=750]: Uploading segments... Aug 8 18:08:32.159154128 (42m26.590234329s) [upload=750]: Got next segment. Inline: false Aug 8 18:08:32.159193062 (42m26.590273183s) [upload=750]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 18:08:32.159249370 (42m26.590329521s) [upload=750]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 18:08:32.619210358 (42m27.050290489s) [seg_pos={0 0}, upload=750]: Begin upload segment... Aug 8 18:08:32.619249643 (42m27.050329774s) [seg_pos={0 0}, upload=750]: Done begin upload segment. Aug 8 18:08:32.619270152 (42m27.050350273s) [noise=true , address=64.49.13.154:4936 , piece_id=5JHATRFSB42SUVQG4LYG2UKJIVVZAPOYWRX2FAFEALXIWH4MWXDA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.619823210 (42m27.050903341s) [noise=true , address=104.36.82.44:4871 , piece_id=GQ57M3NGW7RHAEUVFICZJLXRY3D5LZOWSRZPUBE42RODCI565KXA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.620150026 (42m27.051230147s) [noise=true , address=104.36.82.45:4929 , piece_id=ILJY377CZ5FBRVCFZCHZEMOLQZBM2LHQ67M7KOWHSXJQJOJTKKJQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.620523119 (42m27.05160325s) [noise=true , address=104.36.82.46:4509 , piece_id=B46DOEJWSMG4M57P6VE3FT2EVG5G3VKJIC4YBGVVNBKMU3X2PGHQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.620844254 (42m27.051924385s) [noise=true , address=45.91.116.11:4129 , piece_id=BBCWG6ULHGBJKI42DQUAYTAG63VOM2UFV2KHCKUZH45TWCCDKA2A, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.621137575 (42m27.052217706s) [noise=true , address=104.36.82.60:4345 , piece_id=TX4PHOR2JBPYTIPEGZ7AIYZPBKCSCY2J3GVSEADUCT53WZBFVDQQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.621411269 (42m27.0524914s) [noise=true , address=104.36.82.59:4327 , piece_id=LF3HMRWMP4I26KPCKXVZ7T72B2WQVGZY7HM35VINRLGSPVSOJDNA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.621701694 (42m27.052781825s) [noise=true , address=79.127.205.233:4648 , piece_id=33KAEXCMQFSYG25BFZIGFNH5HANBOOTGIKL5KFKE7QSSO44JKIMQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.621960069 (42m27.0530402s) [noise=true , address=104.36.82.15:4281 , piece_id=3SI2GJNEQ2PN5B76ZRNXAATOVLLRPETTQQXC53ZGPFDAIW7BO5XQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.622234775 (42m27.053314906s) [noise=true , address=104.36.82.61:4379 , piece_id=3GYYNOMAMRBWYWEN23XBFOG5IZEFVFUEJWGPSXT6G2UADKIWE6WA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.622468722 (42m27.053548853s) [noise=true , address=64.49.13.26:4948 , piece_id=LHQGTA554IREULAHP3Q3QSGY523MRWSGI45FPOBOW4PRGCJBPAMA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.623280185 (42m27.054360316s) [noise=true , address=104.36.82.11:4143 , piece_id=OIYZCCHPFACRG7BCSOP2USITVTN6ZTY6JA5GI2R2WCBBWKOIQXPQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.623774060 (42m27.054854181s) [noise=true , address=104.36.82.60:4341 , piece_id=WTK3IBRT23CBOPSXSYUKRHGQSG622T2AUES376DCIKO66DSAOCUQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.624530928 (42m27.055611059s) [noise=true , address=104.36.82.37:4654 , piece_id=MECYP7EZZFUPMAFEUFCVUE2WQTP5WRFOYTAKU6HUXHCX7IPNDMAQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.625404930 (42m27.056485061s) [noise=true , address=104.36.82.52:4103 , piece_id=P6QV3H5NKFRSXXQKKVW3V5E2W6CQ6PGWITESTGATQYTLRNUHJNCQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.626153493 (42m27.057233624s) [noise=true , address=104.36.82.35:4598 , piece_id=7JCMFN57EF2KRSJ4MGJOUILBK2DZABEVAHZMGDB2M6DKI3CHU7VQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.626989051 (42m27.058069182s) [noise=true , address=104.36.82.62:4416 , piece_id=UZECRJN7M6HC2Q5EOL5QEFBRHLVVTVS7NAU3E7HZSUEB434IXPKQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.627383686 (42m27.058463817s) [noise=true , address=104.36.82.5:4858 , piece_id=KR2DROY56ECMCJ55VPXQSOOPVXJP6ZZCSI4BVPXLITAXB6PPKJBA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:33.730137164 (42m28.161217295s) [upload=750]: Next returned nil segment Aug 8 18:08:33.730151332 (42m28.161231463s) [upload=750]: Waiting for error group managing segments... Aug 8 18:08:34.014807988 (42m28.445888119s) [noise=true , address=79.127.205.233:4648 , piece_id=33KAEXCMQFSYG25BFZIGFNH5HANBOOTGIKL5KFKE7QSSO44JKIMQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.082739832 (42m28.513819963s) [noise=true , address=64.49.13.26:4948 , piece_id=LHQGTA554IREULAHP3Q3QSGY523MRWSGI45FPOBOW4PRGCJBPAMA, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.104574428 (42m28.535654559s) [noise=true , address=64.49.13.154:4936 , piece_id=5JHATRFSB42SUVQG4LYG2UKJIVVZAPOYWRX2FAFEALXIWH4MWXDA, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.560367250 (42m28.991447381s) [noise=true , address=104.36.82.60:4345 , piece_id=TX4PHOR2JBPYTIPEGZ7AIYZPBKCSCY2J3GVSEADUCT53WZBFVDQQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.573255500 (42m29.004335621s) [noise=true , address=104.36.82.60:4341 , piece_id=WTK3IBRT23CBOPSXSYUKRHGQSG622T2AUES376DCIKO66DSAOCUQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.642428328 (42m29.073508449s) [noise=true , address=104.36.82.59:4327 , piece_id=LF3HMRWMP4I26KPCKXVZ7T72B2WQVGZY7HM35VINRLGSPVSOJDNA, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.649042744 (42m29.080122875s) [noise=true , address=104.36.82.35:4598 , piece_id=7JCMFN57EF2KRSJ4MGJOUILBK2DZABEVAHZMGDB2M6DKI3CHU7VQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.672062137 (42m29.103142268s) [noise=true , address=45.91.116.11:4129 , piece_id=BBCWG6ULHGBJKI42DQUAYTAG63VOM2UFV2KHCKUZH45TWCCDKA2A, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.683197252 (42m29.114277383s) [noise=true , address=104.36.82.46:4509 , piece_id=B46DOEJWSMG4M57P6VE3FT2EVG5G3VKJIC4YBGVVNBKMU3X2PGHQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.690802193 (42m29.121882314s) [noise=true , address=104.36.82.37:4654 , piece_id=MECYP7EZZFUPMAFEUFCVUE2WQTP5WRFOYTAKU6HUXHCX7IPNDMAQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.730638302 (42m29.161718433s) [noise=true , address=104.36.82.61:4379 , piece_id=3GYYNOMAMRBWYWEN23XBFOG5IZEFVFUEJWGPSXT6G2UADKIWE6WA, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.756068527 (42m29.187148648s) [noise=true , address=104.36.82.52:4103 , piece_id=P6QV3H5NKFRSXXQKKVW3V5E2W6CQ6PGWITESTGATQYTLRNUHJNCQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.760324190 (42m29.191404321s) [noise=true , address=104.36.82.5:4858 , piece_id=KR2DROY56ECMCJ55VPXQSOOPVXJP6ZZCSI4BVPXLITAXB6PPKJBA, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.770480252 (42m29.201560383s) [noise=true , address=104.36.82.15:4281 , piece_id=3SI2GJNEQ2PN5B76ZRNXAATOVLLRPETTQQXC53ZGPFDAIW7BO5XQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.770502485 (42m29.201582616s) [seg_pos={0 0}, upload=750]: Segment reached optimal threshold of 14 pieces. Aug 8 18:08:34.770595502 (42m29.201675623s) [noise=true , address=104.36.82.11:4143 , piece_id=OIYZCCHPFACRG7BCSOP2USITVTN6ZTY6JA5GI2R2WCBBWKOIQXPQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ipThd6PwZUpCXy3ML4qqMd9dmRLmxKjVNCNoT5wCg1szdWp8U): protocol: expected piece hash; context canceled; EOF Aug 8 18:08:34.770652110 (42m29.201732241s) [noise=true , address=104.36.82.44:4871 , piece_id=GQ57M3NGW7RHAEUVFICZJLXRY3D5LZOWSRZPUBE42RODCI565KXA, seg_pos={0 0}, upload=750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t3N84zSSMtzRBs1H47Szc2xAHwqmyr9szJahRkxMYDLto8DAx): protocol: expected piece hash; context canceled; EOF Aug 8 18:08:34.770818338 (42m29.201898469s) [noise=true , address=104.36.82.45:4929 , piece_id=ILJY377CZ5FBRVCFZCHZEMOLQZBM2LHQ67M7KOWHSXJQJOJTKKJQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VxQN6CV1ogwKcs27ho2ayknnPi7BDEcA9ZFbgsUacuQNFAdmm): protocol: expected piece hash; context canceled; EOF Aug 8 18:08:34.770822646 (42m29.201902778s) [noise=true , address=104.36.82.62:4416 , piece_id=UZECRJN7M6HC2Q5EOL5QEFBRHLVVTVS7NAU3E7HZSUEB434IXPKQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12syasUPsyYf4UstQ6cFAr6qamze3vCyAm9dnobk5e83w4bTz69): protocol: expected piece hash; context canceled; EOF Aug 8 18:08:34.770897630 (42m29.201977761s) [seg_pos={0 0}, upload=750]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 18:08:34.771018311 (42m29.202098442s) [upload=750]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 18:08:34.771025956 (42m29.202106127s) [upload=750]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 18:08:35.092714666 (42m29.523794797s) [upload=750]: Done uploading segments... Aug 8 18:08:35.092729535 (42m29.523809666s) [upload=750]: Upload finished. err: <nil> Duration: 6.096628474s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.............X................................X........X...X] duration: 4.051497061s FAIL (2025-08-08 18:08:35 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 8 18:08:32.158878721 (42m26.589958852s) [upload=750]: Starting upload Aug 8 18:08:32.158934127 (42m26.590014258s) [upload=750]: Done starting upload Aug 8 18:08:32.159014300 (42m26.590094431s) [upload=750]: Uploading segments... Aug 8 18:08:32.159154128 (42m26.590234329s) [upload=750]: Got next segment. Inline: false Aug 8 18:08:32.159193062 (42m26.590273183s) [upload=750]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 18:08:32.159249370 (42m26.590329521s) [upload=750]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 18:08:32.619210358 (42m27.050290489s) [seg_pos={0 0}, upload=750]: Begin upload segment... Aug 8 18:08:32.619249643 (42m27.050329774s) [seg_pos={0 0}, upload=750]: Done begin upload segment. Aug 8 18:08:32.619270152 (42m27.050350273s) [noise=true , address=64.49.13.154:4936 , piece_id=5JHATRFSB42SUVQG4LYG2UKJIVVZAPOYWRX2FAFEALXIWH4MWXDA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.619823210 (42m27.050903341s) [noise=true , address=104.36.82.44:4871 , piece_id=GQ57M3NGW7RHAEUVFICZJLXRY3D5LZOWSRZPUBE42RODCI565KXA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.620150026 (42m27.051230147s) [noise=true , address=104.36.82.45:4929 , piece_id=ILJY377CZ5FBRVCFZCHZEMOLQZBM2LHQ67M7KOWHSXJQJOJTKKJQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.620523119 (42m27.05160325s) [noise=true , address=104.36.82.46:4509 , piece_id=B46DOEJWSMG4M57P6VE3FT2EVG5G3VKJIC4YBGVVNBKMU3X2PGHQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.620844254 (42m27.051924385s) [noise=true , address=45.91.116.11:4129 , piece_id=BBCWG6ULHGBJKI42DQUAYTAG63VOM2UFV2KHCKUZH45TWCCDKA2A, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.621137575 (42m27.052217706s) [noise=true , address=104.36.82.60:4345 , piece_id=TX4PHOR2JBPYTIPEGZ7AIYZPBKCSCY2J3GVSEADUCT53WZBFVDQQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.621411269 (42m27.0524914s) [noise=true , address=104.36.82.59:4327 , piece_id=LF3HMRWMP4I26KPCKXVZ7T72B2WQVGZY7HM35VINRLGSPVSOJDNA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.621701694 (42m27.052781825s) [noise=true , address=79.127.205.233:4648 , piece_id=33KAEXCMQFSYG25BFZIGFNH5HANBOOTGIKL5KFKE7QSSO44JKIMQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.621960069 (42m27.0530402s) [noise=true , address=104.36.82.15:4281 , piece_id=3SI2GJNEQ2PN5B76ZRNXAATOVLLRPETTQQXC53ZGPFDAIW7BO5XQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.622234775 (42m27.053314906s) [noise=true , address=104.36.82.61:4379 , piece_id=3GYYNOMAMRBWYWEN23XBFOG5IZEFVFUEJWGPSXT6G2UADKIWE6WA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.622468722 (42m27.053548853s) [noise=true , address=64.49.13.26:4948 , piece_id=LHQGTA554IREULAHP3Q3QSGY523MRWSGI45FPOBOW4PRGCJBPAMA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.623280185 (42m27.054360316s) [noise=true , address=104.36.82.11:4143 , piece_id=OIYZCCHPFACRG7BCSOP2USITVTN6ZTY6JA5GI2R2WCBBWKOIQXPQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.623774060 (42m27.054854181s) [noise=true , address=104.36.82.60:4341 , piece_id=WTK3IBRT23CBOPSXSYUKRHGQSG622T2AUES376DCIKO66DSAOCUQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.624530928 (42m27.055611059s) [noise=true , address=104.36.82.37:4654 , piece_id=MECYP7EZZFUPMAFEUFCVUE2WQTP5WRFOYTAKU6HUXHCX7IPNDMAQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.625404930 (42m27.056485061s) [noise=true , address=104.36.82.52:4103 , piece_id=P6QV3H5NKFRSXXQKKVW3V5E2W6CQ6PGWITESTGATQYTLRNUHJNCQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.626153493 (42m27.057233624s) [noise=true , address=104.36.82.35:4598 , piece_id=7JCMFN57EF2KRSJ4MGJOUILBK2DZABEVAHZMGDB2M6DKI3CHU7VQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.626989051 (42m27.058069182s) [noise=true , address=104.36.82.62:4416 , piece_id=UZECRJN7M6HC2Q5EOL5QEFBRHLVVTVS7NAU3E7HZSUEB434IXPKQ, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:32.627383686 (42m27.058463817s) [noise=true , address=104.36.82.5:4858 , piece_id=KR2DROY56ECMCJ55VPXQSOOPVXJP6ZZCSI4BVPXLITAXB6PPKJBA, seg_pos={0 0}, upload=750]: Uploading piece... Aug 8 18:08:33.730137164 (42m28.161217295s) [upload=750]: Next returned nil segment Aug 8 18:08:33.730151332 (42m28.161231463s) [upload=750]: Waiting for error group managing segments... Aug 8 18:08:34.014807988 (42m28.445888119s) [noise=true , address=79.127.205.233:4648 , piece_id=33KAEXCMQFSYG25BFZIGFNH5HANBOOTGIKL5KFKE7QSSO44JKIMQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.082739832 (42m28.513819963s) [noise=true , address=64.49.13.26:4948 , piece_id=LHQGTA554IREULAHP3Q3QSGY523MRWSGI45FPOBOW4PRGCJBPAMA, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.104574428 (42m28.535654559s) [noise=true , address=64.49.13.154:4936 , piece_id=5JHATRFSB42SUVQG4LYG2UKJIVVZAPOYWRX2FAFEALXIWH4MWXDA, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.560367250 (42m28.991447381s) [noise=true , address=104.36.82.60:4345 , piece_id=TX4PHOR2JBPYTIPEGZ7AIYZPBKCSCY2J3GVSEADUCT53WZBFVDQQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.573255500 (42m29.004335621s) [noise=true , address=104.36.82.60:4341 , piece_id=WTK3IBRT23CBOPSXSYUKRHGQSG622T2AUES376DCIKO66DSAOCUQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.642428328 (42m29.073508449s) [noise=true , address=104.36.82.59:4327 , piece_id=LF3HMRWMP4I26KPCKXVZ7T72B2WQVGZY7HM35VINRLGSPVSOJDNA, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.649042744 (42m29.080122875s) [noise=true , address=104.36.82.35:4598 , piece_id=7JCMFN57EF2KRSJ4MGJOUILBK2DZABEVAHZMGDB2M6DKI3CHU7VQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.672062137 (42m29.103142268s) [noise=true , address=45.91.116.11:4129 , piece_id=BBCWG6ULHGBJKI42DQUAYTAG63VOM2UFV2KHCKUZH45TWCCDKA2A, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.683197252 (42m29.114277383s) [noise=true , address=104.36.82.46:4509 , piece_id=B46DOEJWSMG4M57P6VE3FT2EVG5G3VKJIC4YBGVVNBKMU3X2PGHQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.690802193 (42m29.121882314s) [noise=true , address=104.36.82.37:4654 , piece_id=MECYP7EZZFUPMAFEUFCVUE2WQTP5WRFOYTAKU6HUXHCX7IPNDMAQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.730638302 (42m29.161718433s) [noise=true , address=104.36.82.61:4379 , piece_id=3GYYNOMAMRBWYWEN23XBFOG5IZEFVFUEJWGPSXT6G2UADKIWE6WA, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.756068527 (42m29.187148648s) [noise=true , address=104.36.82.52:4103 , piece_id=P6QV3H5NKFRSXXQKKVW3V5E2W6CQ6PGWITESTGATQYTLRNUHJNCQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.760324190 (42m29.191404321s) [noise=true , address=104.36.82.5:4858 , piece_id=KR2DROY56ECMCJ55VPXQSOOPVXJP6ZZCSI4BVPXLITAXB6PPKJBA, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.770480252 (42m29.201560383s) [noise=true , address=104.36.82.15:4281 , piece_id=3SI2GJNEQ2PN5B76ZRNXAATOVLLRPETTQQXC53ZGPFDAIW7BO5XQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: <nil> Aug 8 18:08:34.770502485 (42m29.201582616s) [seg_pos={0 0}, upload=750]: Segment reached optimal threshold of 14 pieces. Aug 8 18:08:34.770595502 (42m29.201675623s) [noise=true , address=104.36.82.11:4143 , piece_id=OIYZCCHPFACRG7BCSOP2USITVTN6ZTY6JA5GI2R2WCBBWKOIQXPQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ipThd6PwZUpCXy3ML4qqMd9dmRLmxKjVNCNoT5wCg1szdWp8U): protocol: expected piece hash; context canceled; EOF Aug 8 18:08:34.770652110 (42m29.201732241s) [noise=true , address=104.36.82.44:4871 , piece_id=GQ57M3NGW7RHAEUVFICZJLXRY3D5LZOWSRZPUBE42RODCI565KXA, seg_pos={0 0}, upload=750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t3N84zSSMtzRBs1H47Szc2xAHwqmyr9szJahRkxMYDLto8DAx): protocol: expected piece hash; context canceled; EOF Aug 8 18:08:34.770818338 (42m29.201898469s) [noise=true , address=104.36.82.45:4929 , piece_id=ILJY377CZ5FBRVCFZCHZEMOLQZBM2LHQ67M7KOWHSXJQJOJTKKJQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VxQN6CV1ogwKcs27ho2ayknnPi7BDEcA9ZFbgsUacuQNFAdmm): protocol: expected piece hash; context canceled; EOF Aug 8 18:08:34.770822646 (42m29.201902778s) [noise=true , address=104.36.82.62:4416 , piece_id=UZECRJN7M6HC2Q5EOL5QEFBRHLVVTVS7NAU3E7HZSUEB434IXPKQ, seg_pos={0 0}, upload=750]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12syasUPsyYf4UstQ6cFAr6qamze3vCyAm9dnobk5e83w4bTz69): protocol: expected piece hash; context canceled; EOF Aug 8 18:08:34.770897630 (42m29.201977761s) [seg_pos={0 0}, upload=750]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 18:08:34.771018311 (42m29.202098442s) [upload=750]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 18:08:34.771025956 (42m29.202106127s) [upload=750]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 18:08:35.092714666 (42m29.523794797s) [upload=750]: Done uploading segments... Aug 8 18:08:35.092729535 (42m29.523809666s) [upload=750]: Upload finished. err: <nil> Duration: 4.051514875s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.....................................X..........X...........] duration: 1.942534389s FAIL (2025-08-08 18:08:35 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 8 17:58:37.957200338 (32m32.388280469s) [upload=582]: Starting upload Aug 8 17:58:37.957297144 (32m32.388377275s) [upload=582]: Done starting upload Aug 8 17:58:37.957394770 (32m32.388474901s) [upload=582]: Uploading segments... Aug 8 17:58:37.957482327 (32m32.388562459s) [upload=582]: Got next segment. Inline: true Aug 8 17:58:37.957488490 (32m32.388568631s) [upload=582]: Waiting for error group managing segments... Aug 8 17:58:37.957554776 (32m32.388634907s) [upload=582]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 17:58:37.957561689 (32m32.38864182s) [upload=582]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 17:58:37.957565306 (32m32.388645427s) [upload=582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 17:58:38.276535375 (32m32.707615516s) [upload=582]: Done uploading segments... Aug 8 17:58:38.276578197 (32m32.707658339s) [upload=582]: Upload finished. err: <nil> Duration:* 1.942565338s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 6.26851739s FAIL (2025-08-08 18:08:26 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.268530546s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [......................................X..........X..........] duration: 1.837400173s FAIL (2025-08-08 18:08:10 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 8 17:58:37.957200338 (32m32.388280469s) [upload=582]: Starting upload Aug 8 17:58:37.957297144 (32m32.388377275s) [upload=582]: Done starting upload Aug 8 17:58:37.957394770 (32m32.388474901s) [upload=582]: Uploading segments... Aug 8 17:58:37.957482327 (32m32.388562459s) [upload=582]: Got next segment. Inline: true Aug 8 17:58:37.957488490 (32m32.388568631s) [upload=582]: Waiting for error group managing segments... Aug 8 17:58:37.957554776 (32m32.388634907s) [upload=582]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 17:58:37.957561689 (32m32.38864182s) [upload=582]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 17:58:37.957565306 (32m32.388645427s) [upload=582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 17:58:38.276535375 (32m32.707615516s) [upload=582]: Done uploading segments... Aug 8 17:58:38.276578197 (32m32.707658339s) [upload=582]: Upload finished. err: <nil> Duration:* 1.837434748s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..............X................................X........X...] duration: 5.986045726s FAIL (2025-08-08 18:07:55 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 18:06:01.633600972 (39m56.064681113s) [upload=703]: Starting upload Aug 8 18:06:01.633670555 (39m56.064750696s) [upload=703]: Done starting upload Aug 8 18:06:01.633822637 (39m56.064902768s) [upload=703]: Uploading segments... Aug 8 18:06:01.633939139 (39m56.06501927s) [upload=703]: Got next segment. Inline: false Aug 8 18:06:01.633996729 (39m56.06507686s) [upload=703]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 18:06:01.634004454 (39m56.065084585s) [upload=703]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 18:06:01.849869572 (39m56.280949723s) [upload=703]: Next segment err: metaclient: Too Many Requests Aug 8 18:06:01.849933534 (39m56.281013685s) [upload=703]: Done uploading segments... Aug 8 18:06:01.849958051 (39m56.281038182s) [upload=703]: Upload finished. err: metaclient: Too Many Requests Duration: 5.986065966s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 5.999189867s FAIL (2025-08-08 18:07:50 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.99920704s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...............X................................X........X..] duration: 5.952195251s FAIL (2025-08-08 18:07:25 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 18:06:01.633600972 (39m56.064681113s) [upload=703]: Starting upload Aug 8 18:06:01.633670555 (39m56.064750696s) [upload=703]: Done starting upload Aug 8 18:06:01.633822637 (39m56.064902768s) [upload=703]: Uploading segments... Aug 8 18:06:01.633939139 (39m56.06501927s) [upload=703]: Got next segment. Inline: false Aug 8 18:06:01.633996729 (39m56.06507686s) [upload=703]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 18:06:01.634004454 (39m56.065084585s) [upload=703]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 18:06:01.849869572 (39m56.280949723s) [upload=703]: Next segment err: metaclient: Too Many Requests Aug 8 18:06:01.849933534 (39m56.281013685s) [upload=703]: Done uploading segments... Aug 8 18:06:01.849958051 (39m56.281038182s) [upload=703]: Upload finished. err: metaclient: Too Many Requests Duration: 5.952220371s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......................................X..........X.........] duration: 1.986867612s FAIL (2025-08-08 18:07:22 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 8 17:58:37.957200338 (32m32.388280469s) [upload=582]: Starting upload Aug 8 17:58:37.957297144 (32m32.388377275s) [upload=582]: Done starting upload Aug 8 17:58:37.957394770 (32m32.388474901s) [upload=582]: Uploading segments... Aug 8 17:58:37.957482327 (32m32.388562459s) [upload=582]: Got next segment. Inline: true Aug 8 17:58:37.957488490 (32m32.388568631s) [upload=582]: Waiting for error group managing segments... Aug 8 17:58:37.957554776 (32m32.388634907s) [upload=582]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 17:58:37.957561689 (32m32.38864182s) [upload=582]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 17:58:37.957565306 (32m32.388645427s) [upload=582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 17:58:38.276535375 (32m32.707615516s) [upload=582]: Done uploading segments... Aug 8 17:58:38.276578197 (32m32.707658339s) [upload=582]: Upload finished. err: <nil> Duration:* 1.986905645s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [................X................................X........X.] duration: 5.959580883s FAIL (2025-08-08 18:07:03 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 18:06:01.633600972 (39m56.064681113s) [upload=703]: Starting upload Aug 8 18:06:01.633670555 (39m56.064750696s) [upload=703]: Done starting upload Aug 8 18:06:01.633822637 (39m56.064902768s) [upload=703]: Uploading segments... Aug 8 18:06:01.633939139 (39m56.06501927s) [upload=703]: Got next segment. Inline: false Aug 8 18:06:01.633996729 (39m56.06507686s) [upload=703]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 18:06:01.634004454 (39m56.065084585s) [upload=703]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 18:06:01.849869572 (39m56.280949723s) [upload=703]: Next segment err: metaclient: Too Many Requests Aug 8 18:06:01.849933534 (39m56.281013685s) [upload=703]: Done uploading segments... Aug 8 18:06:01.849958051 (39m56.281038182s) [upload=703]: Upload finished. err: metaclient: Too Many Requests Duration: 5.959606834s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 6.854666612s FAIL (2025-08-08 18:06:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.85468083s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [........................................X..........X........] duration: 1.902617606s FAIL (2025-08-08 18:06:13 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 8 17:58:37.957200338 (32m32.388280469s) [upload=582]: Starting upload Aug 8 17:58:37.957297144 (32m32.388377275s) [upload=582]: Done starting upload Aug 8 17:58:37.957394770 (32m32.388474901s) [upload=582]: Uploading segments... Aug 8 17:58:37.957482327 (32m32.388562459s) [upload=582]: Got next segment. Inline: true Aug 8 17:58:37.957488490 (32m32.388568631s) [upload=582]: Waiting for error group managing segments... Aug 8 17:58:37.957554776 (32m32.388634907s) [upload=582]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 17:58:37.957561689 (32m32.38864182s) [upload=582]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 17:58:37.957565306 (32m32.388645427s) [upload=582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 17:58:38.276535375 (32m32.707615516s) [upload=582]: Done uploading segments... Aug 8 17:58:38.276578197 (32m32.707658339s) [upload=582]: Upload finished. err: <nil> Duration:* 1.902645209s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.................X................................X........X] duration: 868.920544ms FAIL (2025-08-08 18:06:01 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 18:06:01.633600972 (39m56.064681113s) [upload=703]: Starting upload Aug 8 18:06:01.633670555 (39m56.064750696s) [upload=703]: Done starting upload Aug 8 18:06:01.633822637 (39m56.064902768s) [upload=703]: Uploading segments... Aug 8 18:06:01.633939139 (39m56.06501927s) [upload=703]: Got next segment. Inline: false Aug 8 18:06:01.633996729 (39m56.06507686s) [upload=703]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 18:06:01.634004454 (39m56.065084585s) [upload=703]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 18:06:01.849869572 (39m56.280949723s) [upload=703]: Next segment err: metaclient: Too Many Requests Aug 8 18:06:01.849933534 (39m56.281013685s) [upload=703]: Done uploading segments... Aug 8 18:06:01.849958051 (39m56.281038182s) [upload=703]: Upload finished. err: metaclient: Too Many Requests Duration: 868.944209ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 6.479261762s FAIL (2025-08-08 18:05:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.479280749s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................X................................X........] duration: 6.012588482s FAIL (2025-08-08 18:05:33 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 8 17:58:57.687589430 (32m52.118669561s) [upload=588]: Starting upload Aug 8 17:58:57.687627203 (32m52.118707324s) [upload=588]: Done starting upload Aug 8 17:58:57.687821034 (32m52.118901165s) [upload=588]: Uploading segments... Aug 8 17:58:57.687860369 (32m52.1189405s) [upload=588]: Got next segment. Inline: false Aug 8 17:58:57.687886398 (32m52.11896653s) [upload=588]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 17:58:57.687890406 (32m52.118970537s) [upload=588]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 17:58:58.147562561 (32m52.578642682s) [seg_pos={0 0}, upload=588]: Begin upload segment... Aug 8 17:58:58.147605704 (32m52.578685825s) [seg_pos={0 0}, upload=588]: Done begin upload segment. Aug 8 17:58:58.147625301 (32m52.578705422s) [noise=true , address=79.127.219.51:4181 , piece_id=7GOUGLRJVZKW45LDJXAUJT5A5TQPPOTXXA3OW5BB2WZIAHIFFKKA, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.147979318 (32m52.579059449s) [noise=true , address=104.36.82.35:4594 , piece_id=6RX25NVO6OMF6N2G5DK5VAZSULO47IGQVUROL7367DZJXVM7JTUA, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.148253864 (32m52.579333995s) [noise=true , address=104.36.82.44:4877 , piece_id=Y4NTQVMER2Z4HFCFCPGFMLU3FNCVAHP6FBYZX22G6T6VBYMYFWXQ, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.148899449 (32m52.57997958s) [noise=true , address=104.36.82.2:4761 , piece_id=6SRL2DT565OCQ43KVC7AX6WC63HURQK226IYIS3HF545KHOZCNLQ, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.149130150 (32m52.580210271s) [noise=true , address=104.36.82.61:4373 , piece_id=ZXUOSUCOMB3CEJX5AHT5ZAOW2ZKOEWGN7JB3YF3NZQ3FGOE4BEAQ, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.149356184 (32m52.580436315s) [noise=true , address=104.36.82.6:4878 , piece_id=UXFCCM5YNLOHLETFQZLNJX3XRHUNMIF44EUGRKPOY4DO2VSPT4BA, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.149617223 (32m52.580697354s) [noise=true , address=104.36.82.16:4310 , piece_id=H23ERP7EDZQDABZXZ7L7MYJKVHPK4AU57VWUVNLSV6FHS36UUTXQ, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.149867892 (32m52.580948023s) [noise=true , address=104.36.82.47:4534 , piece_id=BJKFSI2OIJGZYMY76LGCNBQJGWNTVS7N6RVFMYIRDBMWIJCWTJJA, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.150167736 (32m52.581247857s) [noise=true , address=79.127.219.51:4198 , piece_id=MWXX3OLOMRZSCVUTBIAFIOJIVWTDHQC6UPQTJKDHTUA6RPVCCTEA, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.150400712 (32m52.581480843s) [noise=true , address=104.36.82.23:4458 , piece_id=CKKNPTVUHUB6X4INP33HBMPYDJ5GWI4OQRRRZCGMLILLROVLFRUA, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.150698872 (32m52.581779003s) [noise=true , address=104.36.82.43:4853 , piece_id=PDRJVWFVOEPJIBQBDU3HKIZIJBUHHHSDRANZI2HIBBFCPYFQLAIA, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.150942037 (32m52.582022168s) [noise=true , address=104.36.82.59:4327 , piece_id=JN2ISE4TGMJJV545UOACR55PPGJ37Q6BGKMTYJD7NJPIFXKWXTHA, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.151172879 (32m52.58225301s) [noise=true , address=104.36.82.36:4648 , piece_id=4ORRZDPRIDZHVOK6GFRRTNWIQ6KPRGOXVTTQCITETEMIWBXETMIA, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.151389795 (32m52.582469916s) [noise=true , address=104.36.82.19:4406 , piece_id=5Q37QRWCVPXARQFMWGXFEAAEESR2VZO6LW7QFXAHPJNM7BBUTMEA, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.151635233 (32m52.582715354s) [noise=true , address=104.36.82.34:4580 , piece_id=YR34U5ODNLREKEAB7FCHBJ2TSPCJEGQDMQBXKPL5CJUJC52ZI6QQ, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.151869893 (32m52.582950024s) [noise=true , address=45.91.116.9:4275 , piece_id=4VMJ753VDOF46C4O6PJJHGFDP5PDPN3ON457HPEL7AY3SENIBTRA, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.152072881 (32m52.583153012s) [noise=true , address=45.91.116.13:4185 , piece_id=JVNOONDOW3BGCNBFPM2553OTUSVVEWTPZVFTWFAOLJQOZBNDHJHA, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.152285267 (32m52.583365398s) [noise=true , address=104.36.82.12:4165 , piece_id=YENUQ3Z5EFXJ5RFHVSXK73OCGO4IUIVHWN4AZIDXL6L3D64R7GAQ, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:59.654634717 (32m54.085714858s) [upload=588]: Next returned nil segment Aug 8 17:58:59.654651438 (32m54.085731569s) [upload=588]: Waiting for error group managing segments... Aug 8 17:59:00.067695971 (32m54.498776102s) [noise=true , address=104.36.82.43:4853 , piece_id=PDRJVWFVOEPJIBQBDU3HKIZIJBUHHHSDRANZI2HIBBFCPYFQLAIA, seg_pos={0 0}, upload=588]: Done uploading piece. err: <nil> Aug 8 17:59:00.105330478 (32m54.536410609s) [noise=true , address=79.127.219.51:4198 , piece_id=MWXX3OLOMRZSCVUTBIAFIOJIVWTDHQC6UPQTJKDHTUA6RPVCCTEA, seg_pos={0 0}, upload=588]: Done uploading piece. err: <nil> Aug 8 17:59:00.146519144 (32m54.577599275s) [noise=true , address=104.36.82.23:4458 , piece_id=CKKNPTVUHUB6X4INP33HBMPYDJ5GWI4OQRRRZCGMLILLROVLFRUA, seg_pos={0 0}, upload=588]: Done uploading piece. err: <nil> Aug 8 17:59:00.149019347 (32m54.580099468s) [noise=true , address=104.36.82.2:4761 , piece_id=6SRL2DT565OCQ43KVC7AX6WC63HURQK226IYIS3HF545KHOZCNLQ, seg_pos={0 0}, upload=588]: Done uploading piece. err: <nil> Aug 8 17:59:00.154663226 (32m54.585743357s) [noise=true , address=104.36.82.6:4878 , piece_id=UXFCCM5YNLOHLETFQZLNJX3XRHUNMIF44EUGRKPOY4DO2VSPT4BA, seg_pos={0 0}, upload=588]: Done uploading piece. err: <nil> Aug 8 17:59:00.159408265 (32m54.590488386s) [noise=true , address=104.36.82.12:4165 , piece_id=YENUQ3Z5EFXJ5RFHVSXK73OCGO4IUIVHWN4AZIDXL6L3D64R7GAQ, seg_pos={0 0}, upload=588]: Done uploading piece. err: <nil> Aug 8 17:59:00.168359110 (32m54.599439241s) [noise=true , address=104.36.82.44:4877 , piece_id=Y4NTQVMER2Z4HFCFCPGFMLU3FNCVAHP6FBYZX22G6T6VBYMYFWXQ, seg_pos={0 0}, upload=588]: Done uploading piece. err: <nil> Aug 8 17:59:00.186862202 (32m54.617942323s) [noise=true , address=104.36.82.34:4580 , piece_id=YR34U5ODNLREKEAB7FCHBJ2TSPCJEGQDMQBXKPL5CJUJC52ZI6QQ, seg_pos={0 0}, upload=588]: Done uploading piece. err: <nil> Aug 8 17:59:00.206628962 (32m54.637709083s) [noise=true , address=104.36.82.16:4310 , piece_id=H23ERP7EDZQDABZXZ7L7MYJKVHPK4AU57VWUVNLSV6FHS36UUTXQ, seg_pos={0 0}, upload=588]: Done uploading piece. err: <nil> Aug 8 17:59:00.207036983 (32m54.638117194s) [noise=true , address=45.91.116.9:4275 , piece_id=4VMJ753VDOF46C4O6PJJHGFDP5PDPN3ON457HPEL7AY3SENIBTRA, seg_pos={0 0}, upload=588]: Done uploading piece. err: <nil> Aug 8 17:59:00.228579751 (32m54.659659882s) [noise=true , address=104.36.82.36:4648 , piece_id=4ORRZDPRIDZHVOK6GFRRTNWIQ6KPRGOXVTTQCITETEMIWBXETMIA, seg_pos={0 0}, upload=588]: Done uploading piece. err: <nil> Aug 8 17:59:00.229354534 (32m54.660434665s) [noise=true , address=104.36.82.19:4406 , piece_id=5Q37QRWCVPXARQFMWGXFEAAEESR2VZO6LW7QFXAHPJNM7BBUTMEA, seg_pos={0 0}, upload=588]: Done uploading piece. err: <nil> Aug 8 17:59:00.234562829 (32m54.66564296s) [noise=true , address=45.91.116.13:4185 , piece_id=JVNOONDOW3BGCNBFPM2553OTUSVVEWTPZVFTWFAOLJQOZBNDHJHA, seg_pos={0 0}, upload=588]: Done uploading piece. err: <nil> Aug 8 17:59:00.243158605 (32m54.674238736s) [noise=true , address=104.36.82.59:4327 , piece_id=JN2ISE4TGMJJV545UOACR55PPGJ37Q6BGKMTYJD7NJPIFXKWXTHA, seg_pos={0 0}, upload=588]: Done uploading piece. err: <nil> Aug 8 17:59:00.243184965 (32m54.674265096s) [seg_pos={0 0}, upload=588]: Segment reached optimal threshold of 14 pieces. Aug 8 17:59:00.243289776 (32m54.674369907s) [noise=true , address=104.36.82.47:4534 , piece_id=BJKFSI2OIJGZYMY76LGCNBQJGWNTVS7N6RVFMYIRDBMWIJCWTJJA, seg_pos={0 0}, upload=588]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VDrNGcCnaKEmG5NN4nex1JoZAgdCEfX5CdsKbxytfLfKzPbr): protocol: expected piece hash; context canceled; EOF Aug 8 17:59:00.243360421 (32m54.674440542s) [noise=true , address=79.127.219.51:4181 , piece_id=7GOUGLRJVZKW45LDJXAUJT5A5TQPPOTXXA3OW5BB2WZIAHIFFKKA, seg_pos={0 0}, upload=588]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KvEKktxRuXnEgc6rcJj8rotGamhqt3pcEHSiBkXMkyRC2uCRB): protocol: expected piece hash; context canceled; EOF Aug 8 17:59:00.243410096 (32m54.674490227s) [noise=true , address=104.36.82.35:4594 , piece_id=6RX25NVO6OMF6N2G5DK5VAZSULO47IGQVUROL7367DZJXVM7JTUA, seg_pos={0 0}, upload=588]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12D9nh4XFmsjjFcZEMjaL4uw4Whsa8nfMrAsYPu6NVpsxgb3jvf): protocol: expected piece hash; context canceled; EOF Aug 8 17:59:00.243438971 (32m54.674519092s) [noise=true , address=104.36.82.61:4373 , piece_id=ZXUOSUCOMB3CEJX5AHT5ZAOW2ZKOEWGN7JB3YF3NZQ3FGOE4BEAQ, seg_pos={0 0}, upload=588]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AQGSkJuNJDxoeqhChUenWxHwF5yK41UESCF63FQz3XvabXXfz): protocol: expected piece hash; context canceled; EOF Aug 8 17:59:00.243485631 (32m54.674565762s) [seg_pos={0 0}, upload=588]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 17:59:00.243578738 (32m54.674658869s) [upload=588]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 17:59:00.243582997 (32m54.674663128s) [upload=588]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 17:59:00.666727024 (32m55.097807165s) [upload=588]: Done uploading segments... Aug 8 17:59:00.666749676 (32m55.097829807s) [upload=588]: Upload finished. err: <nil> Duration: 6.012613421s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........................................X..........X.......] duration: 1.97096692s FAIL (2025-08-08 18:05:32 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 8 17:58:37.957200338 (32m32.388280469s) [upload=582]: Starting upload Aug 8 17:58:37.957297144 (32m32.388377275s) [upload=582]: Done starting upload Aug 8 17:58:37.957394770 (32m32.388474901s) [upload=582]: Uploading segments... Aug 8 17:58:37.957482327 (32m32.388562459s) [upload=582]: Got next segment. Inline: true Aug 8 17:58:37.957488490 (32m32.388568631s) [upload=582]: Waiting for error group managing segments... Aug 8 17:58:37.957554776 (32m32.388634907s) [upload=582]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 17:58:37.957561689 (32m32.38864182s) [upload=582]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 17:58:37.957565306 (32m32.388645427s) [upload=582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 17:58:38.276535375 (32m32.707615516s) [upload=582]: Done uploading segments... Aug 8 17:58:38.276578197 (32m32.707658339s) [upload=582]: Upload finished. err: <nil> Duration:* 1.970997529s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 8.52908341s FAIL (2025-08-08 18:05:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 8.529105542s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........................................X..........X......] duration: 1.864269343s FAIL (2025-08-08 18:04:45 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 8 17:58:37.957200338 (32m32.388280469s) [upload=582]: Starting upload Aug 8 17:58:37.957297144 (32m32.388377275s) [upload=582]: Done starting upload Aug 8 17:58:37.957394770 (32m32.388474901s) [upload=582]: Uploading segments... Aug 8 17:58:37.957482327 (32m32.388562459s) [upload=582]: Got next segment. Inline: true Aug 8 17:58:37.957488490 (32m32.388568631s) [upload=582]: Waiting for error group managing segments... Aug 8 17:58:37.957554776 (32m32.388634907s) [upload=582]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 17:58:37.957561689 (32m32.38864182s) [upload=582]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 17:58:37.957565306 (32m32.388645427s) [upload=582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 17:58:38.276535375 (32m32.707615516s) [upload=582]: Done uploading segments... Aug 8 17:58:38.276578197 (32m32.707658339s) [upload=582]: Upload finished. err: <nil> Duration:* 1.864294682s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................X................................X.......] duration: 6.05972007s FAIL (2025-08-08 18:04:40 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 8 17:58:57.687589430 (32m52.118669561s) [upload=588]: Starting upload Aug 8 17:58:57.687627203 (32m52.118707324s) [upload=588]: Done starting upload Aug 8 17:58:57.687821034 (32m52.118901165s) [upload=588]: Uploading segments... Aug 8 17:58:57.687860369 (32m52.1189405s) [upload=588]: Got next segment. Inline: false Aug 8 17:58:57.687886398 (32m52.11896653s) [upload=588]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 17:58:57.687890406 (32m52.118970537s) [upload=588]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 17:58:58.147562561 (32m52.578642682s) [seg_pos={0 0}, upload=588]: Begin upload segment... Aug 8 17:58:58.147605704 (32m52.578685825s) [seg_pos={0 0}, upload=588]: Done begin upload segment. Aug 8 17:58:58.147625301 (32m52.578705422s) [noise=true , address=79.127.219.51:4181 , piece_id=7GOUGLRJVZKW45LDJXAUJT5A5TQPPOTXXA3OW5BB2WZIAHIFFKKA, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.147979318 (32m52.579059449s) [noise=true , address=104.36.82.35:4594 , piece_id=6RX25NVO6OMF6N2G5DK5VAZSULO47IGQVUROL7367DZJXVM7JTUA, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.148253864 (32m52.579333995s) [noise=true , address=104.36.82.44:4877 , piece_id=Y4NTQVMER2Z4HFCFCPGFMLU3FNCVAHP6FBYZX22G6T6VBYMYFWXQ, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.148899449 (32m52.57997958s) [noise=true , address=104.36.82.2:4761 , piece_id=6SRL2DT565OCQ43KVC7AX6WC63HURQK226IYIS3HF545KHOZCNLQ, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.149130150 (32m52.580210271s) [noise=true , address=104.36.82.61:4373 , piece_id=ZXUOSUCOMB3CEJX5AHT5ZAOW2ZKOEWGN7JB3YF3NZQ3FGOE4BEAQ, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.149356184 (32m52.580436315s) [noise=true , address=104.36.82.6:4878 , piece_id=UXFCCM5YNLOHLETFQZLNJX3XRHUNMIF44EUGRKPOY4DO2VSPT4BA, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.149617223 (32m52.580697354s) [noise=true , address=104.36.82.16:4310 , piece_id=H23ERP7EDZQDABZXZ7L7MYJKVHPK4AU57VWUVNLSV6FHS36UUTXQ, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.149867892 (32m52.580948023s) [noise=true , address=104.36.82.47:4534 , piece_id=BJKFSI2OIJGZYMY76LGCNBQJGWNTVS7N6RVFMYIRDBMWIJCWTJJA, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.150167736 (32m52.581247857s) [noise=true , address=79.127.219.51:4198 , piece_id=MWXX3OLOMRZSCVUTBIAFIOJIVWTDHQC6UPQTJKDHTUA6RPVCCTEA, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.150400712 (32m52.581480843s) [noise=true , address=104.36.82.23:4458 , piece_id=CKKNPTVUHUB6X4INP33HBMPYDJ5GWI4OQRRRZCGMLILLROVLFRUA, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.150698872 (32m52.581779003s) [noise=true , address=104.36.82.43:4853 , piece_id=PDRJVWFVOEPJIBQBDU3HKIZIJBUHHHSDRANZI2HIBBFCPYFQLAIA, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.150942037 (32m52.582022168s) [noise=true , address=104.36.82.59:4327 , piece_id=JN2ISE4TGMJJV545UOACR55PPGJ37Q6BGKMTYJD7NJPIFXKWXTHA, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.151172879 (32m52.58225301s) [noise=true , address=104.36.82.36:4648 , piece_id=4ORRZDPRIDZHVOK6GFRRTNWIQ6KPRGOXVTTQCITETEMIWBXETMIA, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.151389795 (32m52.582469916s) [noise=true , address=104.36.82.19:4406 , piece_id=5Q37QRWCVPXARQFMWGXFEAAEESR2VZO6LW7QFXAHPJNM7BBUTMEA, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.151635233 (32m52.582715354s) [noise=true , address=104.36.82.34:4580 , piece_id=YR34U5ODNLREKEAB7FCHBJ2TSPCJEGQDMQBXKPL5CJUJC52ZI6QQ, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.151869893 (32m52.582950024s) [noise=true , address=45.91.116.9:4275 , piece_id=4VMJ753VDOF46C4O6PJJHGFDP5PDPN3ON457HPEL7AY3SENIBTRA, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.152072881 (32m52.583153012s) [noise=true , address=45.91.116.13:4185 , piece_id=JVNOONDOW3BGCNBFPM2553OTUSVVEWTPZVFTWFAOLJQOZBNDHJHA, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.152285267 (32m52.583365398s) [noise=true , address=104.36.82.12:4165 , piece_id=YENUQ3Z5EFXJ5RFHVSXK73OCGO4IUIVHWN4AZIDXL6L3D64R7GAQ, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:59.654634717 (32m54.085714858s) [upload=588]: Next returned nil segment Aug 8 17:58:59.654651438 (32m54.085731569s) [upload=588]: Waiting for error group managing segments... Aug 8 17:59:00.067695971 (32m54.498776102s) [noise=true , address=104.36.82.43:4853 , piece_id=PDRJVWFVOEPJIBQBDU3HKIZIJBUHHHSDRANZI2HIBBFCPYFQLAIA, seg_pos={0 0}, upload=588]: Done uploading piece. err: <nil> Aug 8 17:59:00.105330478 (32m54.536410609s) [noise=true , address=79.127.219.51:4198 , piece_id=MWXX3OLOMRZSCVUTBIAFIOJIVWTDHQC6UPQTJKDHTUA6RPVCCTEA, seg_pos={0 0}, upload=588]: Done uploading piece. err: <nil> Aug 8 17:59:00.146519144 (32m54.577599275s) [noise=true , address=104.36.82.23:4458 , piece_id=CKKNPTVUHUB6X4INP33HBMPYDJ5GWI4OQRRRZCGMLILLROVLFRUA, seg_pos={0 0}, upload=588]: Done uploading piece. err: <nil> Aug 8 17:59:00.149019347 (32m54.580099468s) [noise=true , address=104.36.82.2:4761 , piece_id=6SRL2DT565OCQ43KVC7AX6WC63HURQK226IYIS3HF545KHOZCNLQ, seg_pos={0 0}, upload=588]: Done uploading piece. err: <nil> Aug 8 17:59:00.154663226 (32m54.585743357s) [noise=true , address=104.36.82.6:4878 , piece_id=UXFCCM5YNLOHLETFQZLNJX3XRHUNMIF44EUGRKPOY4DO2VSPT4BA, seg_pos={0 0}, upload=588]: Done uploading piece. err: <nil> Aug 8 17:59:00.159408265 (32m54.590488386s) [noise=true , address=104.36.82.12:4165 , piece_id=YENUQ3Z5EFXJ5RFHVSXK73OCGO4IUIVHWN4AZIDXL6L3D64R7GAQ, seg_pos={0 0}, upload=588]: Done uploading piece. err: <nil> Aug 8 17:59:00.168359110 (32m54.599439241s) [noise=true , address=104.36.82.44:4877 , piece_id=Y4NTQVMER2Z4HFCFCPGFMLU3FNCVAHP6FBYZX22G6T6VBYMYFWXQ, seg_pos={0 0}, upload=588]: Done uploading piece. err: <nil> Aug 8 17:59:00.186862202 (32m54.617942323s) [noise=true , address=104.36.82.34:4580 , piece_id=YR34U5ODNLREKEAB7FCHBJ2TSPCJEGQDMQBXKPL5CJUJC52ZI6QQ, seg_pos={0 0}, upload=588]: Done uploading piece. err: <nil> Aug 8 17:59:00.206628962 (32m54.637709083s) [noise=true , address=104.36.82.16:4310 , piece_id=H23ERP7EDZQDABZXZ7L7MYJKVHPK4AU57VWUVNLSV6FHS36UUTXQ, seg_pos={0 0}, upload=588]: Done uploading piece. err: <nil> Aug 8 17:59:00.207036983 (32m54.638117194s) [noise=true , address=45.91.116.9:4275 , piece_id=4VMJ753VDOF46C4O6PJJHGFDP5PDPN3ON457HPEL7AY3SENIBTRA, seg_pos={0 0}, upload=588]: Done uploading piece. err: <nil> Aug 8 17:59:00.228579751 (32m54.659659882s) [noise=true , address=104.36.82.36:4648 , piece_id=4ORRZDPRIDZHVOK6GFRRTNWIQ6KPRGOXVTTQCITETEMIWBXETMIA, seg_pos={0 0}, upload=588]: Done uploading piece. err: <nil> Aug 8 17:59:00.229354534 (32m54.660434665s) [noise=true , address=104.36.82.19:4406 , piece_id=5Q37QRWCVPXARQFMWGXFEAAEESR2VZO6LW7QFXAHPJNM7BBUTMEA, seg_pos={0 0}, upload=588]: Done uploading piece. err: <nil> Aug 8 17:59:00.234562829 (32m54.66564296s) [noise=true , address=45.91.116.13:4185 , piece_id=JVNOONDOW3BGCNBFPM2553OTUSVVEWTPZVFTWFAOLJQOZBNDHJHA, seg_pos={0 0}, upload=588]: Done uploading piece. err: <nil> Aug 8 17:59:00.243158605 (32m54.674238736s) [noise=true , address=104.36.82.59:4327 , piece_id=JN2ISE4TGMJJV545UOACR55PPGJ37Q6BGKMTYJD7NJPIFXKWXTHA, seg_pos={0 0}, upload=588]: Done uploading piece. err: <nil> Aug 8 17:59:00.243184965 (32m54.674265096s) [seg_pos={0 0}, upload=588]: Segment reached optimal threshold of 14 pieces. Aug 8 17:59:00.243289776 (32m54.674369907s) [noise=true , address=104.36.82.47:4534 , piece_id=BJKFSI2OIJGZYMY76LGCNBQJGWNTVS7N6RVFMYIRDBMWIJCWTJJA, seg_pos={0 0}, upload=588]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VDrNGcCnaKEmG5NN4nex1JoZAgdCEfX5CdsKbxytfLfKzPbr): protocol: expected piece hash; context canceled; EOF Aug 8 17:59:00.243360421 (32m54.674440542s) [noise=true , address=79.127.219.51:4181 , piece_id=7GOUGLRJVZKW45LDJXAUJT5A5TQPPOTXXA3OW5BB2WZIAHIFFKKA, seg_pos={0 0}, upload=588]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KvEKktxRuXnEgc6rcJj8rotGamhqt3pcEHSiBkXMkyRC2uCRB): protocol: expected piece hash; context canceled; EOF Aug 8 17:59:00.243410096 (32m54.674490227s) [noise=true , address=104.36.82.35:4594 , piece_id=6RX25NVO6OMF6N2G5DK5VAZSULO47IGQVUROL7367DZJXVM7JTUA, seg_pos={0 0}, upload=588]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12D9nh4XFmsjjFcZEMjaL4uw4Whsa8nfMrAsYPu6NVpsxgb3jvf): protocol: expected piece hash; context canceled; EOF Aug 8 17:59:00.243438971 (32m54.674519092s) [noise=true , address=104.36.82.61:4373 , piece_id=ZXUOSUCOMB3CEJX5AHT5ZAOW2ZKOEWGN7JB3YF3NZQ3FGOE4BEAQ, seg_pos={0 0}, upload=588]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AQGSkJuNJDxoeqhChUenWxHwF5yK41UESCF63FQz3XvabXXfz): protocol: expected piece hash; context canceled; EOF Aug 8 17:59:00.243485631 (32m54.674565762s) [seg_pos={0 0}, upload=588]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 17:59:00.243578738 (32m54.674658869s) [upload=588]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 17:59:00.243582997 (32m54.674663128s) [upload=588]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 17:59:00.666727024 (32m55.097807165s) [upload=588]: Done uploading segments... Aug 8 17:59:00.666749676 (32m55.097829807s) [upload=588]: Upload finished. err: <nil> Duration: 6.059740297s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 6.356295491s FAIL (2025-08-08 18:04:28 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.356322523s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................X................................X......] duration: 5.959206588s FAIL (2025-08-08 18:03:56 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 8 17:58:57.687589430 (32m52.118669561s) [upload=588]: Starting upload Aug 8 17:58:57.687627203 (32m52.118707324s) [upload=588]: Done starting upload Aug 8 17:58:57.687821034 (32m52.118901165s) [upload=588]: Uploading segments... Aug 8 17:58:57.687860369 (32m52.1189405s) [upload=588]: Got next segment. Inline: false Aug 8 17:58:57.687886398 (32m52.11896653s) [upload=588]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 17:58:57.687890406 (32m52.118970537s) [upload=588]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 17:58:58.147562561 (32m52.578642682s) [seg_pos={0 0}, upload=588]: Begin upload segment... Aug 8 17:58:58.147605704 (32m52.578685825s) [seg_pos={0 0}, upload=588]: Done begin upload segment. Aug 8 17:58:58.147625301 (32m52.578705422s) [noise=true , address=79.127.219.51:4181 , piece_id=7GOUGLRJVZKW45LDJXAUJT5A5TQPPOTXXA3OW5BB2WZIAHIFFKKA, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.147979318 (32m52.579059449s) [noise=true , address=104.36.82.35:4594 , piece_id=6RX25NVO6OMF6N2G5DK5VAZSULO47IGQVUROL7367DZJXVM7JTUA, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.148253864 (32m52.579333995s) [noise=true , address=104.36.82.44:4877 , piece_id=Y4NTQVMER2Z4HFCFCPGFMLU3FNCVAHP6FBYZX22G6T6VBYMYFWXQ, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.148899449 (32m52.57997958s) [noise=true , address=104.36.82.2:4761 , piece_id=6SRL2DT565OCQ43KVC7AX6WC63HURQK226IYIS3HF545KHOZCNLQ, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.149130150 (32m52.580210271s) [noise=true , address=104.36.82.61:4373 , piece_id=ZXUOSUCOMB3CEJX5AHT5ZAOW2ZKOEWGN7JB3YF3NZQ3FGOE4BEAQ, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.149356184 (32m52.580436315s) [noise=true , address=104.36.82.6:4878 , piece_id=UXFCCM5YNLOHLETFQZLNJX3XRHUNMIF44EUGRKPOY4DO2VSPT4BA, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.149617223 (32m52.580697354s) [noise=true , address=104.36.82.16:4310 , piece_id=H23ERP7EDZQDABZXZ7L7MYJKVHPK4AU57VWUVNLSV6FHS36UUTXQ, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.149867892 (32m52.580948023s) [noise=true , address=104.36.82.47:4534 , piece_id=BJKFSI2OIJGZYMY76LGCNBQJGWNTVS7N6RVFMYIRDBMWIJCWTJJA, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.150167736 (32m52.581247857s) [noise=true , address=79.127.219.51:4198 , piece_id=MWXX3OLOMRZSCVUTBIAFIOJIVWTDHQC6UPQTJKDHTUA6RPVCCTEA, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.150400712 (32m52.581480843s) [noise=true , address=104.36.82.23:4458 , piece_id=CKKNPTVUHUB6X4INP33HBMPYDJ5GWI4OQRRRZCGMLILLROVLFRUA, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.150698872 (32m52.581779003s) [noise=true , address=104.36.82.43:4853 , piece_id=PDRJVWFVOEPJIBQBDU3HKIZIJBUHHHSDRANZI2HIBBFCPYFQLAIA, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.150942037 (32m52.582022168s) [noise=true , address=104.36.82.59:4327 , piece_id=JN2ISE4TGMJJV545UOACR55PPGJ37Q6BGKMTYJD7NJPIFXKWXTHA, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.151172879 (32m52.58225301s) [noise=true , address=104.36.82.36:4648 , piece_id=4ORRZDPRIDZHVOK6GFRRTNWIQ6KPRGOXVTTQCITETEMIWBXETMIA, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.151389795 (32m52.582469916s) [noise=true , address=104.36.82.19:4406 , piece_id=5Q37QRWCVPXARQFMWGXFEAAEESR2VZO6LW7QFXAHPJNM7BBUTMEA, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.151635233 (32m52.582715354s) [noise=true , address=104.36.82.34:4580 , piece_id=YR34U5ODNLREKEAB7FCHBJ2TSPCJEGQDMQBXKPL5CJUJC52ZI6QQ, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.151869893 (32m52.582950024s) [noise=true , address=45.91.116.9:4275 , piece_id=4VMJ753VDOF46C4O6PJJHGFDP5PDPN3ON457HPEL7AY3SENIBTRA, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.152072881 (32m52.583153012s) [noise=true , address=45.91.116.13:4185 , piece_id=JVNOONDOW3BGCNBFPM2553OTUSVVEWTPZVFTWFAOLJQOZBNDHJHA, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.152285267 (32m52.583365398s) [noise=true , address=104.36.82.12:4165 , piece_id=YENUQ3Z5EFXJ5RFHVSXK73OCGO4IUIVHWN4AZIDXL6L3D64R7GAQ, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:59.654634717 (32m54.085714858s) [upload=588]: Next returned nil segment Aug 8 17:58:59.654651438 (32m54.085731569s) [upload=588]: Waiting for error group managing segments... Aug 8 17:59:00.067695971 (32m54.498776102s) [noise=true , address=104.36.82.43:4853 , piece_id=PDRJVWFVOEPJIBQBDU3HKIZIJBUHHHSDRANZI2HIBBFCPYFQLAIA, seg_pos={0 0}, upload=588]: Done uploading piece. err: <nil> Aug 8 17:59:00.105330478 (32m54.536410609s) [noise=true , address=79.127.219.51:4198 , piece_id=MWXX3OLOMRZSCVUTBIAFIOJIVWTDHQC6UPQTJKDHTUA6RPVCCTEA, seg_pos={0 0}, upload=588]: Done uploading piece. err: <nil> Aug 8 17:59:00.146519144 (32m54.577599275s) [noise=true , address=104.36.82.23:4458 , piece_id=CKKNPTVUHUB6X4INP33HBMPYDJ5GWI4OQRRRZCGMLILLROVLFRUA, seg_pos={0 0}, upload=588]: Done uploading piece. err: <nil> Aug 8 17:59:00.149019347 (32m54.580099468s) [noise=true , address=104.36.82.2:4761 , piece_id=6SRL2DT565OCQ43KVC7AX6WC63HURQK226IYIS3HF545KHOZCNLQ, seg_pos={0 0}, upload=588]: Done uploading piece. err: <nil> Aug 8 17:59:00.154663226 (32m54.585743357s) [noise=true , address=104.36.82.6:4878 , piece_id=UXFCCM5YNLOHLETFQZLNJX3XRHUNMIF44EUGRKPOY4DO2VSPT4BA, seg_pos={0 0}, upload=588]: Done uploading piece. err: <nil> Aug 8 17:59:00.159408265 (32m54.590488386s) [noise=true , address=104.36.82.12:4165 , piece_id=YENUQ3Z5EFXJ5RFHVSXK73OCGO4IUIVHWN4AZIDXL6L3D64R7GAQ, seg_pos={0 0}, upload=588]: Done uploading piece. err: <nil> Aug 8 17:59:00.168359110 (32m54.599439241s) [noise=true , address=104.36.82.44:4877 , piece_id=Y4NTQVMER2Z4HFCFCPGFMLU3FNCVAHP6FBYZX22G6T6VBYMYFWXQ, seg_pos={0 0}, upload=588]: Done uploading piece. err: <nil> Aug 8 17:59:00.186862202 (32m54.617942323s) [noise=true , address=104.36.82.34:4580 , piece_id=YR34U5ODNLREKEAB7FCHBJ2TSPCJEGQDMQBXKPL5CJUJC52ZI6QQ, seg_pos={0 0}, upload=588]: Done uploading piece. err: <nil> Aug 8 17:59:00.206628962 (32m54.637709083s) [noise=true , address=104.36.82.16:4310 , piece_id=H23ERP7EDZQDABZXZ7L7MYJKVHPK4AU57VWUVNLSV6FHS36UUTXQ, seg_pos={0 0}, upload=588]: Done uploading piece. err: <nil> Aug 8 17:59:00.207036983 (32m54.638117194s) [noise=true , address=45.91.116.9:4275 , piece_id=4VMJ753VDOF46C4O6PJJHGFDP5PDPN3ON457HPEL7AY3SENIBTRA, seg_pos={0 0}, upload=588]: Done uploading piece. err: <nil> Aug 8 17:59:00.228579751 (32m54.659659882s) [noise=true , address=104.36.82.36:4648 , piece_id=4ORRZDPRIDZHVOK6GFRRTNWIQ6KPRGOXVTTQCITETEMIWBXETMIA, seg_pos={0 0}, upload=588]: Done uploading piece. err: <nil> Aug 8 17:59:00.229354534 (32m54.660434665s) [noise=true , address=104.36.82.19:4406 , piece_id=5Q37QRWCVPXARQFMWGXFEAAEESR2VZO6LW7QFXAHPJNM7BBUTMEA, seg_pos={0 0}, upload=588]: Done uploading piece. err: <nil> Aug 8 17:59:00.234562829 (32m54.66564296s) [noise=true , address=45.91.116.13:4185 , piece_id=JVNOONDOW3BGCNBFPM2553OTUSVVEWTPZVFTWFAOLJQOZBNDHJHA, seg_pos={0 0}, upload=588]: Done uploading piece. err: <nil> Aug 8 17:59:00.243158605 (32m54.674238736s) [noise=true , address=104.36.82.59:4327 , piece_id=JN2ISE4TGMJJV545UOACR55PPGJ37Q6BGKMTYJD7NJPIFXKWXTHA, seg_pos={0 0}, upload=588]: Done uploading piece. err: <nil> Aug 8 17:59:00.243184965 (32m54.674265096s) [seg_pos={0 0}, upload=588]: Segment reached optimal threshold of 14 pieces. Aug 8 17:59:00.243289776 (32m54.674369907s) [noise=true , address=104.36.82.47:4534 , piece_id=BJKFSI2OIJGZYMY76LGCNBQJGWNTVS7N6RVFMYIRDBMWIJCWTJJA, seg_pos={0 0}, upload=588]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VDrNGcCnaKEmG5NN4nex1JoZAgdCEfX5CdsKbxytfLfKzPbr): protocol: expected piece hash; context canceled; EOF Aug 8 17:59:00.243360421 (32m54.674440542s) [noise=true , address=79.127.219.51:4181 , piece_id=7GOUGLRJVZKW45LDJXAUJT5A5TQPPOTXXA3OW5BB2WZIAHIFFKKA, seg_pos={0 0}, upload=588]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KvEKktxRuXnEgc6rcJj8rotGamhqt3pcEHSiBkXMkyRC2uCRB): protocol: expected piece hash; context canceled; EOF Aug 8 17:59:00.243410096 (32m54.674490227s) [noise=true , address=104.36.82.35:4594 , piece_id=6RX25NVO6OMF6N2G5DK5VAZSULO47IGQVUROL7367DZJXVM7JTUA, seg_pos={0 0}, upload=588]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12D9nh4XFmsjjFcZEMjaL4uw4Whsa8nfMrAsYPu6NVpsxgb3jvf): protocol: expected piece hash; context canceled; EOF Aug 8 17:59:00.243438971 (32m54.674519092s) [noise=true , address=104.36.82.61:4373 , piece_id=ZXUOSUCOMB3CEJX5AHT5ZAOW2ZKOEWGN7JB3YF3NZQ3FGOE4BEAQ, seg_pos={0 0}, upload=588]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AQGSkJuNJDxoeqhChUenWxHwF5yK41UESCF63FQz3XvabXXfz): protocol: expected piece hash; context canceled; EOF Aug 8 17:59:00.243485631 (32m54.674565762s) [seg_pos={0 0}, upload=588]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 17:59:00.243578738 (32m54.674658869s) [upload=588]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 17:59:00.243582997 (32m54.674663128s) [upload=588]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 17:59:00.666727024 (32m55.097807165s) [upload=588]: Done uploading segments... Aug 8 17:59:00.666749676 (32m55.097829807s) [upload=588]: Upload finished. err: <nil> Duration: 5.959229872s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 6.259481926s FAIL (2025-08-08 18:03:45 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.259501273s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...........................................X..........X.....] duration: 1.886242826s FAIL (2025-08-08 18:03:41 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 8 17:58:37.957200338 (32m32.388280469s) [upload=582]: Starting upload Aug 8 17:58:37.957297144 (32m32.388377275s) [upload=582]: Done starting upload Aug 8 17:58:37.957394770 (32m32.388474901s) [upload=582]: Uploading segments... Aug 8 17:58:37.957482327 (32m32.388562459s) [upload=582]: Got next segment. Inline: true Aug 8 17:58:37.957488490 (32m32.388568631s) [upload=582]: Waiting for error group managing segments... Aug 8 17:58:37.957554776 (32m32.388634907s) [upload=582]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 17:58:37.957561689 (32m32.38864182s) [upload=582]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 17:58:37.957565306 (32m32.388645427s) [upload=582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 17:58:38.276535375 (32m32.707615516s) [upload=582]: Done uploading segments... Aug 8 17:58:38.276578197 (32m32.707658339s) [upload=582]: Upload finished. err: <nil> Duration:* 1.886295687s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................X................................X.....] duration: 6.068830663s FAIL (2025-08-08 18:03:24 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 8 17:58:57.687589430 (32m52.118669561s) [upload=588]: Starting upload Aug 8 17:58:57.687627203 (32m52.118707324s) [upload=588]: Done starting upload Aug 8 17:58:57.687821034 (32m52.118901165s) [upload=588]: Uploading segments... Aug 8 17:58:57.687860369 (32m52.1189405s) [upload=588]: Got next segment. Inline: false Aug 8 17:58:57.687886398 (32m52.11896653s) [upload=588]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 17:58:57.687890406 (32m52.118970537s) [upload=588]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 17:58:58.147562561 (32m52.578642682s) [seg_pos={0 0}, upload=588]: Begin upload segment... Aug 8 17:58:58.147605704 (32m52.578685825s) [seg_pos={0 0}, upload=588]: Done begin upload segment. Aug 8 17:58:58.147625301 (32m52.578705422s) [noise=true , address=79.127.219.51:4181 , piece_id=7GOUGLRJVZKW45LDJXAUJT5A5TQPPOTXXA3OW5BB2WZIAHIFFKKA, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.147979318 (32m52.579059449s) [noise=true , address=104.36.82.35:4594 , piece_id=6RX25NVO6OMF6N2G5DK5VAZSULO47IGQVUROL7367DZJXVM7JTUA, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.148253864 (32m52.579333995s) [noise=true , address=104.36.82.44:4877 , piece_id=Y4NTQVMER2Z4HFCFCPGFMLU3FNCVAHP6FBYZX22G6T6VBYMYFWXQ, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.148899449 (32m52.57997958s) [noise=true , address=104.36.82.2:4761 , piece_id=6SRL2DT565OCQ43KVC7AX6WC63HURQK226IYIS3HF545KHOZCNLQ, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.149130150 (32m52.580210271s) [noise=true , address=104.36.82.61:4373 , piece_id=ZXUOSUCOMB3CEJX5AHT5ZAOW2ZKOEWGN7JB3YF3NZQ3FGOE4BEAQ, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.149356184 (32m52.580436315s) [noise=true , address=104.36.82.6:4878 , piece_id=UXFCCM5YNLOHLETFQZLNJX3XRHUNMIF44EUGRKPOY4DO2VSPT4BA, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.149617223 (32m52.580697354s) [noise=true , address=104.36.82.16:4310 , piece_id=H23ERP7EDZQDABZXZ7L7MYJKVHPK4AU57VWUVNLSV6FHS36UUTXQ, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.149867892 (32m52.580948023s) [noise=true , address=104.36.82.47:4534 , piece_id=BJKFSI2OIJGZYMY76LGCNBQJGWNTVS7N6RVFMYIRDBMWIJCWTJJA, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.150167736 (32m52.581247857s) [noise=true , address=79.127.219.51:4198 , piece_id=MWXX3OLOMRZSCVUTBIAFIOJIVWTDHQC6UPQTJKDHTUA6RPVCCTEA, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.150400712 (32m52.581480843s) [noise=true , address=104.36.82.23:4458 , piece_id=CKKNPTVUHUB6X4INP33HBMPYDJ5GWI4OQRRRZCGMLILLROVLFRUA, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.150698872 (32m52.581779003s) [noise=true , address=104.36.82.43:4853 , piece_id=PDRJVWFVOEPJIBQBDU3HKIZIJBUHHHSDRANZI2HIBBFCPYFQLAIA, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.150942037 (32m52.582022168s) [noise=true , address=104.36.82.59:4327 , piece_id=JN2ISE4TGMJJV545UOACR55PPGJ37Q6BGKMTYJD7NJPIFXKWXTHA, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.151172879 (32m52.58225301s) [noise=true , address=104.36.82.36:4648 , piece_id=4ORRZDPRIDZHVOK6GFRRTNWIQ6KPRGOXVTTQCITETEMIWBXETMIA, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.151389795 (32m52.582469916s) [noise=true , address=104.36.82.19:4406 , piece_id=5Q37QRWCVPXARQFMWGXFEAAEESR2VZO6LW7QFXAHPJNM7BBUTMEA, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.151635233 (32m52.582715354s) [noise=true , address=104.36.82.34:4580 , piece_id=YR34U5ODNLREKEAB7FCHBJ2TSPCJEGQDMQBXKPL5CJUJC52ZI6QQ, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.151869893 (32m52.582950024s) [noise=true , address=45.91.116.9:4275 , piece_id=4VMJ753VDOF46C4O6PJJHGFDP5PDPN3ON457HPEL7AY3SENIBTRA, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.152072881 (32m52.583153012s) [noise=true , address=45.91.116.13:4185 , piece_id=JVNOONDOW3BGCNBFPM2553OTUSVVEWTPZVFTWFAOLJQOZBNDHJHA, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:58.152285267 (32m52.583365398s) [noise=true , address=104.36.82.12:4165 , piece_id=YENUQ3Z5EFXJ5RFHVSXK73OCGO4IUIVHWN4AZIDXL6L3D64R7GAQ, seg_pos={0 0}, upload=588]: Uploading piece... Aug 8 17:58:59.654634717 (32m54.085714858s) [upload=588]: Next returned nil segment Aug 8 17:58:59.654651438 (32m54.085731569s) [upload=588]: Waiting for error group managing segments... Aug 8 17:59:00.067695971 (32m54.498776102s) [noise=true , address=104.36.82.43:4853 , piece_id=PDRJVWFVOEPJIBQBDU3HKIZIJBUHHHSDRANZI2HIBBFCPYFQLAIA, seg_pos={0 0}, upload=588]: Done uploading piece. err: <nil> Aug 8 17:59:00.105330478 (32m54.536410609s) [noise=true , address=79.127.219.51:4198 , piece_id=MWXX3OLOMRZSCVUTBIAFIOJIVWTDHQC6UPQTJKDHTUA6RPVCCTEA, seg_pos={0 0}, upload=588]: Done uploading piece. err: <nil> Aug 8 17:59:00.146519144 (32m54.577599275s) [noise=true , address=104.36.82.23:4458 , piece_id=CKKNPTVUHUB6X4INP33HBMPYDJ5GWI4OQRRRZCGMLILLROVLFRUA, seg_pos={0 0}, upload=588]: Done uploading piece. err: <nil> Aug 8 17:59:00.149019347 (32m54.580099468s) [noise=true , address=104.36.82.2:4761 , piece_id=6SRL2DT565OCQ43KVC7AX6WC63HURQK226IYIS3HF545KHOZCNLQ, seg_pos={0 0}, upload=588]: Done uploading piece. err: <nil> Aug 8 17:59:00.154663226 (32m54.585743357s) [noise=true , address=104.36.82.6:4878 , piece_id=UXFCCM5YNLOHLETFQZLNJX3XRHUNMIF44EUGRKPOY4DO2VSPT4BA, seg_pos={0 0}, upload=588]: Done uploading piece. err: <nil> Aug 8 17:59:00.159408265 (32m54.590488386s) [noise=true , address=104.36.82.12:4165 , piece_id=YENUQ3Z5EFXJ5RFHVSXK73OCGO4IUIVHWN4AZIDXL6L3D64R7GAQ, seg_pos={0 0}, upload=588]: Done uploading piece. err: <nil> Aug 8 17:59:00.168359110 (32m54.599439241s) [noise=true , address=104.36.82.44:4877 , piece_id=Y4NTQVMER2Z4HFCFCPGFMLU3FNCVAHP6FBYZX22G6T6VBYMYFWXQ, seg_pos={0 0}, upload=588]: Done uploading piece. err: <nil> Aug 8 17:59:00.186862202 (32m54.617942323s) [noise=true , address=104.36.82.34:4580 , piece_id=YR34U5ODNLREKEAB7FCHBJ2TSPCJEGQDMQBXKPL5CJUJC52ZI6QQ, seg_pos={0 0}, upload=588]: Done uploading piece. err: <nil> Aug 8 17:59:00.206628962 (32m54.637709083s) [noise=true , address=104.36.82.16:4310 , piece_id=H23ERP7EDZQDABZXZ7L7MYJKVHPK4AU57VWUVNLSV6FHS36UUTXQ, seg_pos={0 0}, upload=588]: Done uploading piece. err: <nil> Aug 8 17:59:00.207036983 (32m54.638117194s) [noise=true , address=45.91.116.9:4275 , piece_id=4VMJ753VDOF46C4O6PJJHGFDP5PDPN3ON457HPEL7AY3SENIBTRA, seg_pos={0 0}, upload=588]: Done uploading piece. err: <nil> Aug 8 17:59:00.228579751 (32m54.659659882s) [noise=true , address=104.36.82.36:4648 , piece_id=4ORRZDPRIDZHVOK6GFRRTNWIQ6KPRGOXVTTQCITETEMIWBXETMIA, seg_pos={0 0}, upload=588]: Done uploading piece. err: <nil> Aug 8 17:59:00.229354534 (32m54.660434665s) [noise=true , address=104.36.82.19:4406 , piece_id=5Q37QRWCVPXARQFMWGXFEAAEESR2VZO6LW7QFXAHPJNM7BBUTMEA, seg_pos={0 0}, upload=588]: Done uploading piece. err: <nil> Aug 8 17:59:00.234562829 (32m54.66564296s) [noise=true , address=45.91.116.13:4185 , piece_id=JVNOONDOW3BGCNBFPM2553OTUSVVEWTPZVFTWFAOLJQOZBNDHJHA, seg_pos={0 0}, upload=588]: Done uploading piece. err: <nil> Aug 8 17:59:00.243158605 (32m54.674238736s) [noise=true , address=104.36.82.59:4327 , piece_id=JN2ISE4TGMJJV545UOACR55PPGJ37Q6BGKMTYJD7NJPIFXKWXTHA, seg_pos={0 0}, upload=588]: Done uploading piece. err: <nil> Aug 8 17:59:00.243184965 (32m54.674265096s) [seg_pos={0 0}, upload=588]: Segment reached optimal threshold of 14 pieces. Aug 8 17:59:00.243289776 (32m54.674369907s) [noise=true , address=104.36.82.47:4534 , piece_id=BJKFSI2OIJGZYMY76LGCNBQJGWNTVS7N6RVFMYIRDBMWIJCWTJJA, seg_pos={0 0}, upload=588]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VDrNGcCnaKEmG5NN4nex1JoZAgdCEfX5CdsKbxytfLfKzPbr): protocol: expected piece hash; context canceled; EOF Aug 8 17:59:00.243360421 (32m54.674440542s) [noise=true , address=79.127.219.51:4181 , piece_id=7GOUGLRJVZKW45LDJXAUJT5A5TQPPOTXXA3OW5BB2WZIAHIFFKKA, seg_pos={0 0}, upload=588]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KvEKktxRuXnEgc6rcJj8rotGamhqt3pcEHSiBkXMkyRC2uCRB): protocol: expected piece hash; context canceled; EOF Aug 8 17:59:00.243410096 (32m54.674490227s) [noise=true , address=104.36.82.35:4594 , piece_id=6RX25NVO6OMF6N2G5DK5VAZSULO47IGQVUROL7367DZJXVM7JTUA, seg_pos={0 0}, upload=588]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12D9nh4XFmsjjFcZEMjaL4uw4Whsa8nfMrAsYPu6NVpsxgb3jvf): protocol: expected piece hash; context canceled; EOF Aug 8 17:59:00.243438971 (32m54.674519092s) [noise=true , address=104.36.82.61:4373 , piece_id=ZXUOSUCOMB3CEJX5AHT5ZAOW2ZKOEWGN7JB3YF3NZQ3FGOE4BEAQ, seg_pos={0 0}, upload=588]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AQGSkJuNJDxoeqhChUenWxHwF5yK41UESCF63FQz3XvabXXfz): protocol: expected piece hash; context canceled; EOF Aug 8 17:59:00.243485631 (32m54.674565762s) [seg_pos={0 0}, upload=588]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 17:59:00.243578738 (32m54.674658869s) [upload=588]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 17:59:00.243582997 (32m54.674663128s) [upload=588]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 17:59:00.666727024 (32m55.097807165s) [upload=588]: Done uploading segments... Aug 8 17:59:00.666749676 (32m55.097829807s) [upload=588]: Upload finished. err: <nil> Duration: 6.068856181s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 6.146571503s FAIL (2025-08-08 18:03:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.146595688s edge gateway us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)