Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 5.655049495s FAIL (2025-08-07 05:39:41 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA): protocol: expected piece hash; context canceled; EOF Aug 7 04:54:42.476517671 (14h45m50.41493352s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFD6NPNAAUVIRZ5YGTKCBJPLQXPFJMN25HQT7FUNU26DPTS2F7UQ, seg_pos={0 0}, upload=14153]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Aug 7 04:54:42.476561945 (14h45m50.414977794s) [seg_pos={0 0}, upload=14153]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 04:54:42.476635777 (14h45m50.415051626s) [upload=14153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 04:54:42.476640095 (14h45m50.415055944s) [upload=14153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 04:54:42.859043030 (14h45m50.797458879s) [upload=14153]: Done uploading segments... Aug 7 04:54:42.859063249 (14h45m50.797479098s) [upload=14153]: Upload finished. err: <nil> Aug 7 04:55:05.836870332 (14h46m13.775286181s) [upload=14159]: Starting upload Aug 7 04:55:05.836926720 (14h46m13.775342569s) [upload=14159]: Done starting upload Aug 7 04:55:05.837015199 (14h46m13.775431048s) [upload=14159]: Uploading segments... Aug 7 04:55:05.837116423 (14h46m13.775532272s) [upload=14159]: Got next segment. Inline: false Aug 7 04:55:05.837155838 (14h46m13.775571687s) [upload=14159]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 04:55:05.837160236 (14h46m13.775576086s) [upload=14159]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 04:55:06.073286783 (14h46m14.011702622s) [seg_pos={0 0}, upload=14159]: Begin upload segment... Aug 7 04:55:06.073338001 (14h46m14.01175389s) [seg_pos={0 0}, upload=14159]: Done begin upload segment. Aug 7 04:55:06.073380742 (14h46m14.011796651s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073390892 (14h46m14.011806741s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073867794 (14h46m14.012283643s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073885418 (14h46m14.012301267s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074211331 (14h46m14.01262718s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074520083 (14h46m14.012935922s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074805158 (14h46m14.013221017s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075051048 (14h46m14.013466897s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075279705 (14h46m14.013695554s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075364017 (14h46m14.013779866s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075645796 (14h46m14.014061645s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075834126 (14h46m14.014249975s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076062343 (14h46m14.014478192s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076228621 (14h46m14.01464447s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076500751 (14h46m14.0149166s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076692338 (14h46m14.015108187s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:07.706338803 (14h46m15.644754653s) [upload=14159]: Next returned nil segment Aug 7 04:55:07.706356186 (14h46m15.644772035s) [upload=14159]: Waiting for error group managing segments... Aug 7 04:55:08.079467986 (14h46m16.017883835s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.083077803 (14h46m16.021493662s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.086948248 (14h46m16.025364097s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.096855863 (14h46m16.035271702s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.099582620 (14h46m16.037998469s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.103264886 (14h46m16.041680735s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.112037449 (14h46m16.050453298s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.112072888 (14h46m16.050488727s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.140507229 (14h46m16.078923078s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.178535946 (14h46m16.116951795s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.181286579 (14h46m16.119702428s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.186892866 (14h46m16.125308715s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.193444219 (14h46m16.131860078s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.193468486 (14h46m16.131884335s) [seg_pos={0 0}, upload=14159]: Segment reached optimal threshold of 13 pieces. Aug 7 04:55:08.193605848 (14h46m16.132021697s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193660403 (14h46m16.132076252s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193695380 (14h46m16.132111229s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193712683 (14h46m16.132128532s) [seg_pos={0 0}, upload=14159]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 04:55:08.193822934 (14h46m16.132238783s) [upload=14159]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 04:55:08.193827452 (14h46m16.132243301s) [upload=14159]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 04:55:08.487892748 (14h46m16.426308607s) [upload=14159]: Done uploading segments... Aug 7 04:55:08.487913047 (14h46m16.426328896s) [upload=14159]: Upload finished. err: <nil> Duration: 5.655077167s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 5.59534303s FAIL (2025-08-07 05:39:02 UTC) orbiter warning: operation: sync2.Copy digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2a1b3ec28e7199156a3f4d4616d0d5eed5ab214532aeb49ecb9757cbb62da413 != before 57bd9df9aae0e0164ea9509dedb90a3f1d2caf9fb2f66475a29f29b5ff5ef938 Duration: 5.595375583s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 5.90757235s FAIL (2025-08-07 05:38:48 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA): protocol: expected piece hash; context canceled; EOF Aug 7 04:54:42.476517671 (14h45m50.41493352s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFD6NPNAAUVIRZ5YGTKCBJPLQXPFJMN25HQT7FUNU26DPTS2F7UQ, seg_pos={0 0}, upload=14153]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Aug 7 04:54:42.476561945 (14h45m50.414977794s) [seg_pos={0 0}, upload=14153]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 04:54:42.476635777 (14h45m50.415051626s) [upload=14153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 04:54:42.476640095 (14h45m50.415055944s) [upload=14153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 04:54:42.859043030 (14h45m50.797458879s) [upload=14153]: Done uploading segments... Aug 7 04:54:42.859063249 (14h45m50.797479098s) [upload=14153]: Upload finished. err: <nil> Aug 7 04:55:05.836870332 (14h46m13.775286181s) [upload=14159]: Starting upload Aug 7 04:55:05.836926720 (14h46m13.775342569s) [upload=14159]: Done starting upload Aug 7 04:55:05.837015199 (14h46m13.775431048s) [upload=14159]: Uploading segments... Aug 7 04:55:05.837116423 (14h46m13.775532272s) [upload=14159]: Got next segment. Inline: false Aug 7 04:55:05.837155838 (14h46m13.775571687s) [upload=14159]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 04:55:05.837160236 (14h46m13.775576086s) [upload=14159]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 04:55:06.073286783 (14h46m14.011702622s) [seg_pos={0 0}, upload=14159]: Begin upload segment... Aug 7 04:55:06.073338001 (14h46m14.01175389s) [seg_pos={0 0}, upload=14159]: Done begin upload segment. Aug 7 04:55:06.073380742 (14h46m14.011796651s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073390892 (14h46m14.011806741s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073867794 (14h46m14.012283643s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073885418 (14h46m14.012301267s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074211331 (14h46m14.01262718s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074520083 (14h46m14.012935922s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074805158 (14h46m14.013221017s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075051048 (14h46m14.013466897s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075279705 (14h46m14.013695554s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075364017 (14h46m14.013779866s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075645796 (14h46m14.014061645s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075834126 (14h46m14.014249975s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076062343 (14h46m14.014478192s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076228621 (14h46m14.01464447s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076500751 (14h46m14.0149166s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076692338 (14h46m14.015108187s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:07.706338803 (14h46m15.644754653s) [upload=14159]: Next returned nil segment Aug 7 04:55:07.706356186 (14h46m15.644772035s) [upload=14159]: Waiting for error group managing segments... Aug 7 04:55:08.079467986 (14h46m16.017883835s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.083077803 (14h46m16.021493662s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.086948248 (14h46m16.025364097s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.096855863 (14h46m16.035271702s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.099582620 (14h46m16.037998469s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.103264886 (14h46m16.041680735s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.112037449 (14h46m16.050453298s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.112072888 (14h46m16.050488727s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.140507229 (14h46m16.078923078s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.178535946 (14h46m16.116951795s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.181286579 (14h46m16.119702428s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.186892866 (14h46m16.125308715s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.193444219 (14h46m16.131860078s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.193468486 (14h46m16.131884335s) [seg_pos={0 0}, upload=14159]: Segment reached optimal threshold of 13 pieces. Aug 7 04:55:08.193605848 (14h46m16.132021697s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193660403 (14h46m16.132076252s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193695380 (14h46m16.132111229s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193712683 (14h46m16.132128532s) [seg_pos={0 0}, upload=14159]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 04:55:08.193822934 (14h46m16.132238783s) [upload=14159]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 04:55:08.193827452 (14h46m16.132243301s) [upload=14159]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 04:55:08.487892748 (14h46m16.426308607s) [upload=14159]: Done uploading segments... Aug 7 04:55:08.487913047 (14h46m16.426328896s) [upload=14159]: Upload finished. err: <nil> Duration: 5.907600324s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 5.817237888s FAIL (2025-08-07 05:38:31 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA): protocol: expected piece hash; context canceled; EOF Aug 7 04:54:42.476517671 (14h45m50.41493352s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFD6NPNAAUVIRZ5YGTKCBJPLQXPFJMN25HQT7FUNU26DPTS2F7UQ, seg_pos={0 0}, upload=14153]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Aug 7 04:54:42.476561945 (14h45m50.414977794s) [seg_pos={0 0}, upload=14153]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 04:54:42.476635777 (14h45m50.415051626s) [upload=14153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 04:54:42.476640095 (14h45m50.415055944s) [upload=14153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 04:54:42.859043030 (14h45m50.797458879s) [upload=14153]: Done uploading segments... Aug 7 04:54:42.859063249 (14h45m50.797479098s) [upload=14153]: Upload finished. err: <nil> Aug 7 04:55:05.836870332 (14h46m13.775286181s) [upload=14159]: Starting upload Aug 7 04:55:05.836926720 (14h46m13.775342569s) [upload=14159]: Done starting upload Aug 7 04:55:05.837015199 (14h46m13.775431048s) [upload=14159]: Uploading segments... Aug 7 04:55:05.837116423 (14h46m13.775532272s) [upload=14159]: Got next segment. Inline: false Aug 7 04:55:05.837155838 (14h46m13.775571687s) [upload=14159]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 04:55:05.837160236 (14h46m13.775576086s) [upload=14159]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 04:55:06.073286783 (14h46m14.011702622s) [seg_pos={0 0}, upload=14159]: Begin upload segment... Aug 7 04:55:06.073338001 (14h46m14.01175389s) [seg_pos={0 0}, upload=14159]: Done begin upload segment. Aug 7 04:55:06.073380742 (14h46m14.011796651s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073390892 (14h46m14.011806741s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073867794 (14h46m14.012283643s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073885418 (14h46m14.012301267s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074211331 (14h46m14.01262718s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074520083 (14h46m14.012935922s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074805158 (14h46m14.013221017s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075051048 (14h46m14.013466897s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075279705 (14h46m14.013695554s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075364017 (14h46m14.013779866s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075645796 (14h46m14.014061645s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075834126 (14h46m14.014249975s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076062343 (14h46m14.014478192s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076228621 (14h46m14.01464447s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076500751 (14h46m14.0149166s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076692338 (14h46m14.015108187s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:07.706338803 (14h46m15.644754653s) [upload=14159]: Next returned nil segment Aug 7 04:55:07.706356186 (14h46m15.644772035s) [upload=14159]: Waiting for error group managing segments... Aug 7 04:55:08.079467986 (14h46m16.017883835s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.083077803 (14h46m16.021493662s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.086948248 (14h46m16.025364097s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.096855863 (14h46m16.035271702s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.099582620 (14h46m16.037998469s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.103264886 (14h46m16.041680735s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.112037449 (14h46m16.050453298s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.112072888 (14h46m16.050488727s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.140507229 (14h46m16.078923078s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.178535946 (14h46m16.116951795s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.181286579 (14h46m16.119702428s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.186892866 (14h46m16.125308715s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.193444219 (14h46m16.131860078s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.193468486 (14h46m16.131884335s) [seg_pos={0 0}, upload=14159]: Segment reached optimal threshold of 13 pieces. Aug 7 04:55:08.193605848 (14h46m16.132021697s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193660403 (14h46m16.132076252s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193695380 (14h46m16.132111229s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193712683 (14h46m16.132128532s) [seg_pos={0 0}, upload=14159]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 04:55:08.193822934 (14h46m16.132238783s) [upload=14159]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 04:55:08.193827452 (14h46m16.132243301s) [upload=14159]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 04:55:08.487892748 (14h46m16.426308607s) [upload=14159]: Done uploading segments... Aug 7 04:55:08.487913047 (14h46m16.426328896s) [upload=14159]: Upload finished. err: <nil> Duration: 5.817266662s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 5.862295424s FAIL (2025-08-07 05:38:21 UTC) orbiter warning: operation: sync2.Copy digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2a1b3ec28e7199156a3f4d4616d0d5eed5ab214532aeb49ecb9757cbb62da413 != before 57bd9df9aae0e0164ea9509dedb90a3f1d2caf9fb2f66475a29f29b5ff5ef938 Duration: 5.862317756s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 5.650897291s FAIL (2025-08-07 05:37:58 UTC) orbiter warning: operation: sync2.Copy digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2a1b3ec28e7199156a3f4d4616d0d5eed5ab214532aeb49ecb9757cbb62da413 != before 57bd9df9aae0e0164ea9509dedb90a3f1d2caf9fb2f66475a29f29b5ff5ef938 Duration: 5.650921709s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 5.797076231s FAIL (2025-08-07 05:37:22 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA): protocol: expected piece hash; context canceled; EOF Aug 7 04:54:42.476517671 (14h45m50.41493352s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFD6NPNAAUVIRZ5YGTKCBJPLQXPFJMN25HQT7FUNU26DPTS2F7UQ, seg_pos={0 0}, upload=14153]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Aug 7 04:54:42.476561945 (14h45m50.414977794s) [seg_pos={0 0}, upload=14153]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 04:54:42.476635777 (14h45m50.415051626s) [upload=14153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 04:54:42.476640095 (14h45m50.415055944s) [upload=14153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 04:54:42.859043030 (14h45m50.797458879s) [upload=14153]: Done uploading segments... Aug 7 04:54:42.859063249 (14h45m50.797479098s) [upload=14153]: Upload finished. err: <nil> Aug 7 04:55:05.836870332 (14h46m13.775286181s) [upload=14159]: Starting upload Aug 7 04:55:05.836926720 (14h46m13.775342569s) [upload=14159]: Done starting upload Aug 7 04:55:05.837015199 (14h46m13.775431048s) [upload=14159]: Uploading segments... Aug 7 04:55:05.837116423 (14h46m13.775532272s) [upload=14159]: Got next segment. Inline: false Aug 7 04:55:05.837155838 (14h46m13.775571687s) [upload=14159]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 04:55:05.837160236 (14h46m13.775576086s) [upload=14159]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 04:55:06.073286783 (14h46m14.011702622s) [seg_pos={0 0}, upload=14159]: Begin upload segment... Aug 7 04:55:06.073338001 (14h46m14.01175389s) [seg_pos={0 0}, upload=14159]: Done begin upload segment. Aug 7 04:55:06.073380742 (14h46m14.011796651s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073390892 (14h46m14.011806741s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073867794 (14h46m14.012283643s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073885418 (14h46m14.012301267s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074211331 (14h46m14.01262718s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074520083 (14h46m14.012935922s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074805158 (14h46m14.013221017s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075051048 (14h46m14.013466897s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075279705 (14h46m14.013695554s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075364017 (14h46m14.013779866s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075645796 (14h46m14.014061645s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075834126 (14h46m14.014249975s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076062343 (14h46m14.014478192s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076228621 (14h46m14.01464447s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076500751 (14h46m14.0149166s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076692338 (14h46m14.015108187s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:07.706338803 (14h46m15.644754653s) [upload=14159]: Next returned nil segment Aug 7 04:55:07.706356186 (14h46m15.644772035s) [upload=14159]: Waiting for error group managing segments... Aug 7 04:55:08.079467986 (14h46m16.017883835s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.083077803 (14h46m16.021493662s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.086948248 (14h46m16.025364097s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.096855863 (14h46m16.035271702s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.099582620 (14h46m16.037998469s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.103264886 (14h46m16.041680735s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.112037449 (14h46m16.050453298s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.112072888 (14h46m16.050488727s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.140507229 (14h46m16.078923078s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.178535946 (14h46m16.116951795s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.181286579 (14h46m16.119702428s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.186892866 (14h46m16.125308715s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.193444219 (14h46m16.131860078s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.193468486 (14h46m16.131884335s) [seg_pos={0 0}, upload=14159]: Segment reached optimal threshold of 13 pieces. Aug 7 04:55:08.193605848 (14h46m16.132021697s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193660403 (14h46m16.132076252s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193695380 (14h46m16.132111229s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193712683 (14h46m16.132128532s) [seg_pos={0 0}, upload=14159]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 04:55:08.193822934 (14h46m16.132238783s) [upload=14159]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 04:55:08.193827452 (14h46m16.132243301s) [upload=14159]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 04:55:08.487892748 (14h46m16.426308607s) [upload=14159]: Done uploading segments... Aug 7 04:55:08.487913047 (14h46m16.426328896s) [upload=14159]: Upload finished. err: <nil> Duration: 5.797102371s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 5.573844267s FAIL (2025-08-07 05:36:53 UTC) orbiter warning: operation: sync2.Copy digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2a1b3ec28e7199156a3f4d4616d0d5eed5ab214532aeb49ecb9757cbb62da413 != before 57bd9df9aae0e0164ea9509dedb90a3f1d2caf9fb2f66475a29f29b5ff5ef938 Duration: 5.573869977s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 5.793643735s FAIL (2025-08-07 05:36:24 UTC) orbiter warning: operation: sync2.Copy digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2a1b3ec28e7199156a3f4d4616d0d5eed5ab214532aeb49ecb9757cbb62da413 != before 57bd9df9aae0e0164ea9509dedb90a3f1d2caf9fb2f66475a29f29b5ff5ef938 Duration: 5.793669724s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 5.749469015s FAIL (2025-08-07 05:36:08 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA): protocol: expected piece hash; context canceled; EOF Aug 7 04:54:42.476517671 (14h45m50.41493352s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFD6NPNAAUVIRZ5YGTKCBJPLQXPFJMN25HQT7FUNU26DPTS2F7UQ, seg_pos={0 0}, upload=14153]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Aug 7 04:54:42.476561945 (14h45m50.414977794s) [seg_pos={0 0}, upload=14153]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 04:54:42.476635777 (14h45m50.415051626s) [upload=14153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 04:54:42.476640095 (14h45m50.415055944s) [upload=14153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 04:54:42.859043030 (14h45m50.797458879s) [upload=14153]: Done uploading segments... Aug 7 04:54:42.859063249 (14h45m50.797479098s) [upload=14153]: Upload finished. err: <nil> Aug 7 04:55:05.836870332 (14h46m13.775286181s) [upload=14159]: Starting upload Aug 7 04:55:05.836926720 (14h46m13.775342569s) [upload=14159]: Done starting upload Aug 7 04:55:05.837015199 (14h46m13.775431048s) [upload=14159]: Uploading segments... Aug 7 04:55:05.837116423 (14h46m13.775532272s) [upload=14159]: Got next segment. Inline: false Aug 7 04:55:05.837155838 (14h46m13.775571687s) [upload=14159]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 04:55:05.837160236 (14h46m13.775576086s) [upload=14159]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 04:55:06.073286783 (14h46m14.011702622s) [seg_pos={0 0}, upload=14159]: Begin upload segment... Aug 7 04:55:06.073338001 (14h46m14.01175389s) [seg_pos={0 0}, upload=14159]: Done begin upload segment. Aug 7 04:55:06.073380742 (14h46m14.011796651s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073390892 (14h46m14.011806741s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073867794 (14h46m14.012283643s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073885418 (14h46m14.012301267s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074211331 (14h46m14.01262718s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074520083 (14h46m14.012935922s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074805158 (14h46m14.013221017s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075051048 (14h46m14.013466897s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075279705 (14h46m14.013695554s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075364017 (14h46m14.013779866s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075645796 (14h46m14.014061645s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075834126 (14h46m14.014249975s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076062343 (14h46m14.014478192s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076228621 (14h46m14.01464447s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076500751 (14h46m14.0149166s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076692338 (14h46m14.015108187s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:07.706338803 (14h46m15.644754653s) [upload=14159]: Next returned nil segment Aug 7 04:55:07.706356186 (14h46m15.644772035s) [upload=14159]: Waiting for error group managing segments... Aug 7 04:55:08.079467986 (14h46m16.017883835s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.083077803 (14h46m16.021493662s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.086948248 (14h46m16.025364097s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.096855863 (14h46m16.035271702s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.099582620 (14h46m16.037998469s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.103264886 (14h46m16.041680735s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.112037449 (14h46m16.050453298s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.112072888 (14h46m16.050488727s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.140507229 (14h46m16.078923078s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.178535946 (14h46m16.116951795s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.181286579 (14h46m16.119702428s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.186892866 (14h46m16.125308715s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.193444219 (14h46m16.131860078s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.193468486 (14h46m16.131884335s) [seg_pos={0 0}, upload=14159]: Segment reached optimal threshold of 13 pieces. Aug 7 04:55:08.193605848 (14h46m16.132021697s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193660403 (14h46m16.132076252s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193695380 (14h46m16.132111229s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193712683 (14h46m16.132128532s) [seg_pos={0 0}, upload=14159]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 04:55:08.193822934 (14h46m16.132238783s) [upload=14159]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 04:55:08.193827452 (14h46m16.132243301s) [upload=14159]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 04:55:08.487892748 (14h46m16.426308607s) [upload=14159]: Done uploading segments... Aug 7 04:55:08.487913047 (14h46m16.426328896s) [upload=14159]: Upload finished. err: <nil> Duration: 5.749498501s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 5.800212022s FAIL (2025-08-07 05:35:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA): protocol: expected piece hash; context canceled; EOF Aug 7 04:54:42.476517671 (14h45m50.41493352s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFD6NPNAAUVIRZ5YGTKCBJPLQXPFJMN25HQT7FUNU26DPTS2F7UQ, seg_pos={0 0}, upload=14153]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Aug 7 04:54:42.476561945 (14h45m50.414977794s) [seg_pos={0 0}, upload=14153]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 04:54:42.476635777 (14h45m50.415051626s) [upload=14153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 04:54:42.476640095 (14h45m50.415055944s) [upload=14153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 04:54:42.859043030 (14h45m50.797458879s) [upload=14153]: Done uploading segments... Aug 7 04:54:42.859063249 (14h45m50.797479098s) [upload=14153]: Upload finished. err: <nil> Aug 7 04:55:05.836870332 (14h46m13.775286181s) [upload=14159]: Starting upload Aug 7 04:55:05.836926720 (14h46m13.775342569s) [upload=14159]: Done starting upload Aug 7 04:55:05.837015199 (14h46m13.775431048s) [upload=14159]: Uploading segments... Aug 7 04:55:05.837116423 (14h46m13.775532272s) [upload=14159]: Got next segment. Inline: false Aug 7 04:55:05.837155838 (14h46m13.775571687s) [upload=14159]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 04:55:05.837160236 (14h46m13.775576086s) [upload=14159]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 04:55:06.073286783 (14h46m14.011702622s) [seg_pos={0 0}, upload=14159]: Begin upload segment... Aug 7 04:55:06.073338001 (14h46m14.01175389s) [seg_pos={0 0}, upload=14159]: Done begin upload segment. Aug 7 04:55:06.073380742 (14h46m14.011796651s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073390892 (14h46m14.011806741s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073867794 (14h46m14.012283643s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073885418 (14h46m14.012301267s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074211331 (14h46m14.01262718s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074520083 (14h46m14.012935922s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074805158 (14h46m14.013221017s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075051048 (14h46m14.013466897s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075279705 (14h46m14.013695554s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075364017 (14h46m14.013779866s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075645796 (14h46m14.014061645s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075834126 (14h46m14.014249975s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076062343 (14h46m14.014478192s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076228621 (14h46m14.01464447s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076500751 (14h46m14.0149166s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076692338 (14h46m14.015108187s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:07.706338803 (14h46m15.644754653s) [upload=14159]: Next returned nil segment Aug 7 04:55:07.706356186 (14h46m15.644772035s) [upload=14159]: Waiting for error group managing segments... Aug 7 04:55:08.079467986 (14h46m16.017883835s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.083077803 (14h46m16.021493662s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.086948248 (14h46m16.025364097s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.096855863 (14h46m16.035271702s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.099582620 (14h46m16.037998469s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.103264886 (14h46m16.041680735s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.112037449 (14h46m16.050453298s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.112072888 (14h46m16.050488727s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.140507229 (14h46m16.078923078s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.178535946 (14h46m16.116951795s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.181286579 (14h46m16.119702428s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.186892866 (14h46m16.125308715s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.193444219 (14h46m16.131860078s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.193468486 (14h46m16.131884335s) [seg_pos={0 0}, upload=14159]: Segment reached optimal threshold of 13 pieces. Aug 7 04:55:08.193605848 (14h46m16.132021697s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193660403 (14h46m16.132076252s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193695380 (14h46m16.132111229s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193712683 (14h46m16.132128532s) [seg_pos={0 0}, upload=14159]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 04:55:08.193822934 (14h46m16.132238783s) [upload=14159]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 04:55:08.193827452 (14h46m16.132243301s) [upload=14159]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 04:55:08.487892748 (14h46m16.426308607s) [upload=14159]: Done uploading segments... Aug 7 04:55:08.487913047 (14h46m16.426328896s) [upload=14159]: Upload finished. err: <nil> Duration: 5.800243952s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [X.....................X.....................................] duration: 5.732222999s FAIL (2025-08-07 05:35:22 UTC) orbiter warning: operation: sync2.Copy digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2a1b3ec28e7199156a3f4d4616d0d5eed5ab214532aeb49ecb9757cbb62da413 != before 57bd9df9aae0e0164ea9509dedb90a3f1d2caf9fb2f66475a29f29b5ff5ef938 Duration: 5.732247987s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 5.802493687s FAIL (2025-08-07 05:34:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA): protocol: expected piece hash; context canceled; EOF Aug 7 04:54:42.476517671 (14h45m50.41493352s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFD6NPNAAUVIRZ5YGTKCBJPLQXPFJMN25HQT7FUNU26DPTS2F7UQ, seg_pos={0 0}, upload=14153]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Aug 7 04:54:42.476561945 (14h45m50.414977794s) [seg_pos={0 0}, upload=14153]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 04:54:42.476635777 (14h45m50.415051626s) [upload=14153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 04:54:42.476640095 (14h45m50.415055944s) [upload=14153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 04:54:42.859043030 (14h45m50.797458879s) [upload=14153]: Done uploading segments... Aug 7 04:54:42.859063249 (14h45m50.797479098s) [upload=14153]: Upload finished. err: <nil> Aug 7 04:55:05.836870332 (14h46m13.775286181s) [upload=14159]: Starting upload Aug 7 04:55:05.836926720 (14h46m13.775342569s) [upload=14159]: Done starting upload Aug 7 04:55:05.837015199 (14h46m13.775431048s) [upload=14159]: Uploading segments... Aug 7 04:55:05.837116423 (14h46m13.775532272s) [upload=14159]: Got next segment. Inline: false Aug 7 04:55:05.837155838 (14h46m13.775571687s) [upload=14159]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 04:55:05.837160236 (14h46m13.775576086s) [upload=14159]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 04:55:06.073286783 (14h46m14.011702622s) [seg_pos={0 0}, upload=14159]: Begin upload segment... Aug 7 04:55:06.073338001 (14h46m14.01175389s) [seg_pos={0 0}, upload=14159]: Done begin upload segment. Aug 7 04:55:06.073380742 (14h46m14.011796651s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073390892 (14h46m14.011806741s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073867794 (14h46m14.012283643s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073885418 (14h46m14.012301267s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074211331 (14h46m14.01262718s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074520083 (14h46m14.012935922s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074805158 (14h46m14.013221017s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075051048 (14h46m14.013466897s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075279705 (14h46m14.013695554s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075364017 (14h46m14.013779866s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075645796 (14h46m14.014061645s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075834126 (14h46m14.014249975s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076062343 (14h46m14.014478192s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076228621 (14h46m14.01464447s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076500751 (14h46m14.0149166s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076692338 (14h46m14.015108187s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:07.706338803 (14h46m15.644754653s) [upload=14159]: Next returned nil segment Aug 7 04:55:07.706356186 (14h46m15.644772035s) [upload=14159]: Waiting for error group managing segments... Aug 7 04:55:08.079467986 (14h46m16.017883835s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.083077803 (14h46m16.021493662s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.086948248 (14h46m16.025364097s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.096855863 (14h46m16.035271702s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.099582620 (14h46m16.037998469s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.103264886 (14h46m16.041680735s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.112037449 (14h46m16.050453298s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.112072888 (14h46m16.050488727s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.140507229 (14h46m16.078923078s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.178535946 (14h46m16.116951795s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.181286579 (14h46m16.119702428s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.186892866 (14h46m16.125308715s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.193444219 (14h46m16.131860078s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.193468486 (14h46m16.131884335s) [seg_pos={0 0}, upload=14159]: Segment reached optimal threshold of 13 pieces. Aug 7 04:55:08.193605848 (14h46m16.132021697s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193660403 (14h46m16.132076252s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193695380 (14h46m16.132111229s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193712683 (14h46m16.132128532s) [seg_pos={0 0}, upload=14159]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 04:55:08.193822934 (14h46m16.132238783s) [upload=14159]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 04:55:08.193827452 (14h46m16.132243301s) [upload=14159]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 04:55:08.487892748 (14h46m16.426308607s) [upload=14159]: Done uploading segments... Aug 7 04:55:08.487913047 (14h46m16.426328896s) [upload=14159]: Upload finished. err: <nil> Duration: 5.802518564s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.X.....................X....................................] duration: 5.595138119s FAIL (2025-08-07 05:34:40 UTC) orbiter warning: operation: sync2.Copy digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2a1b3ec28e7199156a3f4d4616d0d5eed5ab214532aeb49ecb9757cbb62da413 != before 57bd9df9aae0e0164ea9509dedb90a3f1d2caf9fb2f66475a29f29b5ff5ef938 Duration: 5.595166573s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 5.82690952s FAIL (2025-08-07 05:34:36 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA): protocol: expected piece hash; context canceled; EOF Aug 7 04:54:42.476517671 (14h45m50.41493352s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFD6NPNAAUVIRZ5YGTKCBJPLQXPFJMN25HQT7FUNU26DPTS2F7UQ, seg_pos={0 0}, upload=14153]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Aug 7 04:54:42.476561945 (14h45m50.414977794s) [seg_pos={0 0}, upload=14153]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 04:54:42.476635777 (14h45m50.415051626s) [upload=14153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 04:54:42.476640095 (14h45m50.415055944s) [upload=14153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 04:54:42.859043030 (14h45m50.797458879s) [upload=14153]: Done uploading segments... Aug 7 04:54:42.859063249 (14h45m50.797479098s) [upload=14153]: Upload finished. err: <nil> Aug 7 04:55:05.836870332 (14h46m13.775286181s) [upload=14159]: Starting upload Aug 7 04:55:05.836926720 (14h46m13.775342569s) [upload=14159]: Done starting upload Aug 7 04:55:05.837015199 (14h46m13.775431048s) [upload=14159]: Uploading segments... Aug 7 04:55:05.837116423 (14h46m13.775532272s) [upload=14159]: Got next segment. Inline: false Aug 7 04:55:05.837155838 (14h46m13.775571687s) [upload=14159]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 04:55:05.837160236 (14h46m13.775576086s) [upload=14159]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 04:55:06.073286783 (14h46m14.011702622s) [seg_pos={0 0}, upload=14159]: Begin upload segment... Aug 7 04:55:06.073338001 (14h46m14.01175389s) [seg_pos={0 0}, upload=14159]: Done begin upload segment. Aug 7 04:55:06.073380742 (14h46m14.011796651s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073390892 (14h46m14.011806741s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073867794 (14h46m14.012283643s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073885418 (14h46m14.012301267s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074211331 (14h46m14.01262718s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074520083 (14h46m14.012935922s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074805158 (14h46m14.013221017s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075051048 (14h46m14.013466897s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075279705 (14h46m14.013695554s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075364017 (14h46m14.013779866s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075645796 (14h46m14.014061645s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075834126 (14h46m14.014249975s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076062343 (14h46m14.014478192s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076228621 (14h46m14.01464447s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076500751 (14h46m14.0149166s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076692338 (14h46m14.015108187s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:07.706338803 (14h46m15.644754653s) [upload=14159]: Next returned nil segment Aug 7 04:55:07.706356186 (14h46m15.644772035s) [upload=14159]: Waiting for error group managing segments... Aug 7 04:55:08.079467986 (14h46m16.017883835s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.083077803 (14h46m16.021493662s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.086948248 (14h46m16.025364097s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.096855863 (14h46m16.035271702s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.099582620 (14h46m16.037998469s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.103264886 (14h46m16.041680735s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.112037449 (14h46m16.050453298s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.112072888 (14h46m16.050488727s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.140507229 (14h46m16.078923078s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.178535946 (14h46m16.116951795s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.181286579 (14h46m16.119702428s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.186892866 (14h46m16.125308715s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.193444219 (14h46m16.131860078s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.193468486 (14h46m16.131884335s) [seg_pos={0 0}, upload=14159]: Segment reached optimal threshold of 13 pieces. Aug 7 04:55:08.193605848 (14h46m16.132021697s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193660403 (14h46m16.132076252s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193695380 (14h46m16.132111229s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193712683 (14h46m16.132128532s) [seg_pos={0 0}, upload=14159]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 04:55:08.193822934 (14h46m16.132238783s) [upload=14159]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 04:55:08.193827452 (14h46m16.132243301s) [upload=14159]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 04:55:08.487892748 (14h46m16.426308607s) [upload=14159]: Done uploading segments... Aug 7 04:55:08.487913047 (14h46m16.426328896s) [upload=14159]: Upload finished. err: <nil> Duration: 5.826960398s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 5.766501876s FAIL (2025-08-07 05:33:35 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA): protocol: expected piece hash; context canceled; EOF Aug 7 04:54:42.476517671 (14h45m50.41493352s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFD6NPNAAUVIRZ5YGTKCBJPLQXPFJMN25HQT7FUNU26DPTS2F7UQ, seg_pos={0 0}, upload=14153]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Aug 7 04:54:42.476561945 (14h45m50.414977794s) [seg_pos={0 0}, upload=14153]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 04:54:42.476635777 (14h45m50.415051626s) [upload=14153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 04:54:42.476640095 (14h45m50.415055944s) [upload=14153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 04:54:42.859043030 (14h45m50.797458879s) [upload=14153]: Done uploading segments... Aug 7 04:54:42.859063249 (14h45m50.797479098s) [upload=14153]: Upload finished. err: <nil> Aug 7 04:55:05.836870332 (14h46m13.775286181s) [upload=14159]: Starting upload Aug 7 04:55:05.836926720 (14h46m13.775342569s) [upload=14159]: Done starting upload Aug 7 04:55:05.837015199 (14h46m13.775431048s) [upload=14159]: Uploading segments... Aug 7 04:55:05.837116423 (14h46m13.775532272s) [upload=14159]: Got next segment. Inline: false Aug 7 04:55:05.837155838 (14h46m13.775571687s) [upload=14159]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 04:55:05.837160236 (14h46m13.775576086s) [upload=14159]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 04:55:06.073286783 (14h46m14.011702622s) [seg_pos={0 0}, upload=14159]: Begin upload segment... Aug 7 04:55:06.073338001 (14h46m14.01175389s) [seg_pos={0 0}, upload=14159]: Done begin upload segment. Aug 7 04:55:06.073380742 (14h46m14.011796651s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073390892 (14h46m14.011806741s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073867794 (14h46m14.012283643s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073885418 (14h46m14.012301267s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074211331 (14h46m14.01262718s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074520083 (14h46m14.012935922s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074805158 (14h46m14.013221017s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075051048 (14h46m14.013466897s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075279705 (14h46m14.013695554s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075364017 (14h46m14.013779866s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075645796 (14h46m14.014061645s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075834126 (14h46m14.014249975s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076062343 (14h46m14.014478192s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076228621 (14h46m14.01464447s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076500751 (14h46m14.0149166s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076692338 (14h46m14.015108187s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:07.706338803 (14h46m15.644754653s) [upload=14159]: Next returned nil segment Aug 7 04:55:07.706356186 (14h46m15.644772035s) [upload=14159]: Waiting for error group managing segments... Aug 7 04:55:08.079467986 (14h46m16.017883835s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.083077803 (14h46m16.021493662s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.086948248 (14h46m16.025364097s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.096855863 (14h46m16.035271702s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.099582620 (14h46m16.037998469s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.103264886 (14h46m16.041680735s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.112037449 (14h46m16.050453298s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.112072888 (14h46m16.050488727s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.140507229 (14h46m16.078923078s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.178535946 (14h46m16.116951795s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.181286579 (14h46m16.119702428s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.186892866 (14h46m16.125308715s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.193444219 (14h46m16.131860078s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.193468486 (14h46m16.131884335s) [seg_pos={0 0}, upload=14159]: Segment reached optimal threshold of 13 pieces. Aug 7 04:55:08.193605848 (14h46m16.132021697s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193660403 (14h46m16.132076252s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193695380 (14h46m16.132111229s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193712683 (14h46m16.132128532s) [seg_pos={0 0}, upload=14159]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 04:55:08.193822934 (14h46m16.132238783s) [upload=14159]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 04:55:08.193827452 (14h46m16.132243301s) [upload=14159]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 04:55:08.487892748 (14h46m16.426308607s) [upload=14159]: Done uploading segments... Aug 7 04:55:08.487913047 (14h46m16.426328896s) [upload=14159]: Upload finished. err: <nil> Duration: 5.766537594s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..X.....................X...................................] duration: 5.643406409s FAIL (2025-08-07 05:33:33 UTC) orbiter warning: operation: sync2.Copy digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2a1b3ec28e7199156a3f4d4616d0d5eed5ab214532aeb49ecb9757cbb62da413 != before 57bd9df9aae0e0164ea9509dedb90a3f1d2caf9fb2f66475a29f29b5ff5ef938 Duration: 5.643437369s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...X.....................X..................................] duration: 6.019421569s FAIL (2025-08-07 05:33:04 UTC) orbiter warning: operation: sync2.Copy digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2a1b3ec28e7199156a3f4d4616d0d5eed5ab214532aeb49ecb9757cbb62da413 != before 57bd9df9aae0e0164ea9509dedb90a3f1d2caf9fb2f66475a29f29b5ff5ef938 Duration: 6.019445634s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 5.822542346s FAIL (2025-08-07 05:32:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA): protocol: expected piece hash; context canceled; EOF Aug 7 04:54:42.476517671 (14h45m50.41493352s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFD6NPNAAUVIRZ5YGTKCBJPLQXPFJMN25HQT7FUNU26DPTS2F7UQ, seg_pos={0 0}, upload=14153]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Aug 7 04:54:42.476561945 (14h45m50.414977794s) [seg_pos={0 0}, upload=14153]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 04:54:42.476635777 (14h45m50.415051626s) [upload=14153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 04:54:42.476640095 (14h45m50.415055944s) [upload=14153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 04:54:42.859043030 (14h45m50.797458879s) [upload=14153]: Done uploading segments... Aug 7 04:54:42.859063249 (14h45m50.797479098s) [upload=14153]: Upload finished. err: <nil> Aug 7 04:55:05.836870332 (14h46m13.775286181s) [upload=14159]: Starting upload Aug 7 04:55:05.836926720 (14h46m13.775342569s) [upload=14159]: Done starting upload Aug 7 04:55:05.837015199 (14h46m13.775431048s) [upload=14159]: Uploading segments... Aug 7 04:55:05.837116423 (14h46m13.775532272s) [upload=14159]: Got next segment. Inline: false Aug 7 04:55:05.837155838 (14h46m13.775571687s) [upload=14159]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 04:55:05.837160236 (14h46m13.775576086s) [upload=14159]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 04:55:06.073286783 (14h46m14.011702622s) [seg_pos={0 0}, upload=14159]: Begin upload segment... Aug 7 04:55:06.073338001 (14h46m14.01175389s) [seg_pos={0 0}, upload=14159]: Done begin upload segment. Aug 7 04:55:06.073380742 (14h46m14.011796651s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073390892 (14h46m14.011806741s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073867794 (14h46m14.012283643s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073885418 (14h46m14.012301267s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074211331 (14h46m14.01262718s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074520083 (14h46m14.012935922s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074805158 (14h46m14.013221017s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075051048 (14h46m14.013466897s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075279705 (14h46m14.013695554s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075364017 (14h46m14.013779866s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075645796 (14h46m14.014061645s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075834126 (14h46m14.014249975s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076062343 (14h46m14.014478192s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076228621 (14h46m14.01464447s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076500751 (14h46m14.0149166s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076692338 (14h46m14.015108187s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:07.706338803 (14h46m15.644754653s) [upload=14159]: Next returned nil segment Aug 7 04:55:07.706356186 (14h46m15.644772035s) [upload=14159]: Waiting for error group managing segments... Aug 7 04:55:08.079467986 (14h46m16.017883835s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.083077803 (14h46m16.021493662s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.086948248 (14h46m16.025364097s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.096855863 (14h46m16.035271702s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.099582620 (14h46m16.037998469s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.103264886 (14h46m16.041680735s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.112037449 (14h46m16.050453298s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.112072888 (14h46m16.050488727s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.140507229 (14h46m16.078923078s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.178535946 (14h46m16.116951795s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.181286579 (14h46m16.119702428s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.186892866 (14h46m16.125308715s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.193444219 (14h46m16.131860078s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.193468486 (14h46m16.131884335s) [seg_pos={0 0}, upload=14159]: Segment reached optimal threshold of 13 pieces. Aug 7 04:55:08.193605848 (14h46m16.132021697s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193660403 (14h46m16.132076252s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193695380 (14h46m16.132111229s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193712683 (14h46m16.132128532s) [seg_pos={0 0}, upload=14159]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 04:55:08.193822934 (14h46m16.132238783s) [upload=14159]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 04:55:08.193827452 (14h46m16.132243301s) [upload=14159]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 04:55:08.487892748 (14h46m16.426308607s) [upload=14159]: Done uploading segments... Aug 7 04:55:08.487913047 (14h46m16.426328896s) [upload=14159]: Upload finished. err: <nil> Duration: 5.822570009s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [X...X.....................X.................................] duration: 5.70842664s FAIL (2025-08-07 05:32:28 UTC) orbiter warning: operation: sync2.Copy digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2a1b3ec28e7199156a3f4d4616d0d5eed5ab214532aeb49ecb9757cbb62da413 != before 57bd9df9aae0e0164ea9509dedb90a3f1d2caf9fb2f66475a29f29b5ff5ef938 Duration: 5.708443212s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [X..........X................................................] duration: 5.959013107s FAIL (2025-08-07 05:32:10 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA): protocol: expected piece hash; context canceled; EOF Aug 7 04:54:42.476517671 (14h45m50.41493352s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFD6NPNAAUVIRZ5YGTKCBJPLQXPFJMN25HQT7FUNU26DPTS2F7UQ, seg_pos={0 0}, upload=14153]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Aug 7 04:54:42.476561945 (14h45m50.414977794s) [seg_pos={0 0}, upload=14153]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 04:54:42.476635777 (14h45m50.415051626s) [upload=14153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 04:54:42.476640095 (14h45m50.415055944s) [upload=14153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 04:54:42.859043030 (14h45m50.797458879s) [upload=14153]: Done uploading segments... Aug 7 04:54:42.859063249 (14h45m50.797479098s) [upload=14153]: Upload finished. err: <nil> Aug 7 04:55:05.836870332 (14h46m13.775286181s) [upload=14159]: Starting upload Aug 7 04:55:05.836926720 (14h46m13.775342569s) [upload=14159]: Done starting upload Aug 7 04:55:05.837015199 (14h46m13.775431048s) [upload=14159]: Uploading segments... Aug 7 04:55:05.837116423 (14h46m13.775532272s) [upload=14159]: Got next segment. Inline: false Aug 7 04:55:05.837155838 (14h46m13.775571687s) [upload=14159]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 04:55:05.837160236 (14h46m13.775576086s) [upload=14159]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 04:55:06.073286783 (14h46m14.011702622s) [seg_pos={0 0}, upload=14159]: Begin upload segment... Aug 7 04:55:06.073338001 (14h46m14.01175389s) [seg_pos={0 0}, upload=14159]: Done begin upload segment. Aug 7 04:55:06.073380742 (14h46m14.011796651s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073390892 (14h46m14.011806741s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073867794 (14h46m14.012283643s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073885418 (14h46m14.012301267s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074211331 (14h46m14.01262718s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074520083 (14h46m14.012935922s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074805158 (14h46m14.013221017s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075051048 (14h46m14.013466897s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075279705 (14h46m14.013695554s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075364017 (14h46m14.013779866s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075645796 (14h46m14.014061645s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075834126 (14h46m14.014249975s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076062343 (14h46m14.014478192s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076228621 (14h46m14.01464447s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076500751 (14h46m14.0149166s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076692338 (14h46m14.015108187s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:07.706338803 (14h46m15.644754653s) [upload=14159]: Next returned nil segment Aug 7 04:55:07.706356186 (14h46m15.644772035s) [upload=14159]: Waiting for error group managing segments... Aug 7 04:55:08.079467986 (14h46m16.017883835s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.083077803 (14h46m16.021493662s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.086948248 (14h46m16.025364097s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.096855863 (14h46m16.035271702s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.099582620 (14h46m16.037998469s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.103264886 (14h46m16.041680735s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.112037449 (14h46m16.050453298s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.112072888 (14h46m16.050488727s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.140507229 (14h46m16.078923078s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.178535946 (14h46m16.116951795s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.181286579 (14h46m16.119702428s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.186892866 (14h46m16.125308715s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.193444219 (14h46m16.131860078s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.193468486 (14h46m16.131884335s) [seg_pos={0 0}, upload=14159]: Segment reached optimal threshold of 13 pieces. Aug 7 04:55:08.193605848 (14h46m16.132021697s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193660403 (14h46m16.132076252s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193695380 (14h46m16.132111229s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193712683 (14h46m16.132128532s) [seg_pos={0 0}, upload=14159]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 04:55:08.193822934 (14h46m16.132238783s) [upload=14159]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 04:55:08.193827452 (14h46m16.132243301s) [upload=14159]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 04:55:08.487892748 (14h46m16.426308607s) [upload=14159]: Done uploading segments... Aug 7 04:55:08.487913047 (14h46m16.426328896s) [upload=14159]: Upload finished. err: <nil> Duration: 5.959052643s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.X...X.....................X................................] duration: 5.676881327s FAIL (2025-08-07 05:31:16 UTC) orbiter warning: operation: sync2.Copy digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2a1b3ec28e7199156a3f4d4616d0d5eed5ab214532aeb49ecb9757cbb62da413 != before 57bd9df9aae0e0164ea9509dedb90a3f1d2caf9fb2f66475a29f29b5ff5ef938 Duration: 5.676910043s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.X..........X...............................................] duration: 5.817209202s FAIL (2025-08-07 05:31:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA): protocol: expected piece hash; context canceled; EOF Aug 7 04:54:42.476517671 (14h45m50.41493352s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFD6NPNAAUVIRZ5YGTKCBJPLQXPFJMN25HQT7FUNU26DPTS2F7UQ, seg_pos={0 0}, upload=14153]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Aug 7 04:54:42.476561945 (14h45m50.414977794s) [seg_pos={0 0}, upload=14153]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 04:54:42.476635777 (14h45m50.415051626s) [upload=14153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 04:54:42.476640095 (14h45m50.415055944s) [upload=14153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 04:54:42.859043030 (14h45m50.797458879s) [upload=14153]: Done uploading segments... Aug 7 04:54:42.859063249 (14h45m50.797479098s) [upload=14153]: Upload finished. err: <nil> Aug 7 04:55:05.836870332 (14h46m13.775286181s) [upload=14159]: Starting upload Aug 7 04:55:05.836926720 (14h46m13.775342569s) [upload=14159]: Done starting upload Aug 7 04:55:05.837015199 (14h46m13.775431048s) [upload=14159]: Uploading segments... Aug 7 04:55:05.837116423 (14h46m13.775532272s) [upload=14159]: Got next segment. Inline: false Aug 7 04:55:05.837155838 (14h46m13.775571687s) [upload=14159]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 04:55:05.837160236 (14h46m13.775576086s) [upload=14159]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 04:55:06.073286783 (14h46m14.011702622s) [seg_pos={0 0}, upload=14159]: Begin upload segment... Aug 7 04:55:06.073338001 (14h46m14.01175389s) [seg_pos={0 0}, upload=14159]: Done begin upload segment. Aug 7 04:55:06.073380742 (14h46m14.011796651s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073390892 (14h46m14.011806741s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073867794 (14h46m14.012283643s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073885418 (14h46m14.012301267s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074211331 (14h46m14.01262718s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074520083 (14h46m14.012935922s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074805158 (14h46m14.013221017s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075051048 (14h46m14.013466897s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075279705 (14h46m14.013695554s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075364017 (14h46m14.013779866s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075645796 (14h46m14.014061645s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075834126 (14h46m14.014249975s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076062343 (14h46m14.014478192s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076228621 (14h46m14.01464447s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076500751 (14h46m14.0149166s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076692338 (14h46m14.015108187s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:07.706338803 (14h46m15.644754653s) [upload=14159]: Next returned nil segment Aug 7 04:55:07.706356186 (14h46m15.644772035s) [upload=14159]: Waiting for error group managing segments... Aug 7 04:55:08.079467986 (14h46m16.017883835s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.083077803 (14h46m16.021493662s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.086948248 (14h46m16.025364097s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.096855863 (14h46m16.035271702s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.099582620 (14h46m16.037998469s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.103264886 (14h46m16.041680735s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.112037449 (14h46m16.050453298s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.112072888 (14h46m16.050488727s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.140507229 (14h46m16.078923078s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.178535946 (14h46m16.116951795s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.181286579 (14h46m16.119702428s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.186892866 (14h46m16.125308715s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.193444219 (14h46m16.131860078s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.193468486 (14h46m16.131884335s) [seg_pos={0 0}, upload=14159]: Segment reached optimal threshold of 13 pieces. Aug 7 04:55:08.193605848 (14h46m16.132021697s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193660403 (14h46m16.132076252s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193695380 (14h46m16.132111229s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193712683 (14h46m16.132128532s) [seg_pos={0 0}, upload=14159]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 04:55:08.193822934 (14h46m16.132238783s) [upload=14159]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 04:55:08.193827452 (14h46m16.132243301s) [upload=14159]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 04:55:08.487892748 (14h46m16.426308607s) [upload=14159]: Done uploading segments... Aug 7 04:55:08.487913047 (14h46m16.426328896s) [upload=14159]: Upload finished. err: <nil> Duration: 5.817236303s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..X...X.....................X...............................] duration: 5.572189158s FAIL (2025-08-07 05:30:35 UTC) orbiter warning: operation: sync2.Copy digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2a1b3ec28e7199156a3f4d4616d0d5eed5ab214532aeb49ecb9757cbb62da413 != before 57bd9df9aae0e0164ea9509dedb90a3f1d2caf9fb2f66475a29f29b5ff5ef938 Duration: 5.572216552s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..X..........X..............................................] duration: 5.713514583s FAIL (2025-08-07 05:30:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA): protocol: expected piece hash; context canceled; EOF Aug 7 04:54:42.476517671 (14h45m50.41493352s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFD6NPNAAUVIRZ5YGTKCBJPLQXPFJMN25HQT7FUNU26DPTS2F7UQ, seg_pos={0 0}, upload=14153]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Aug 7 04:54:42.476561945 (14h45m50.414977794s) [seg_pos={0 0}, upload=14153]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 04:54:42.476635777 (14h45m50.415051626s) [upload=14153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 04:54:42.476640095 (14h45m50.415055944s) [upload=14153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 04:54:42.859043030 (14h45m50.797458879s) [upload=14153]: Done uploading segments... Aug 7 04:54:42.859063249 (14h45m50.797479098s) [upload=14153]: Upload finished. err: <nil> Aug 7 04:55:05.836870332 (14h46m13.775286181s) [upload=14159]: Starting upload Aug 7 04:55:05.836926720 (14h46m13.775342569s) [upload=14159]: Done starting upload Aug 7 04:55:05.837015199 (14h46m13.775431048s) [upload=14159]: Uploading segments... Aug 7 04:55:05.837116423 (14h46m13.775532272s) [upload=14159]: Got next segment. Inline: false Aug 7 04:55:05.837155838 (14h46m13.775571687s) [upload=14159]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 04:55:05.837160236 (14h46m13.775576086s) [upload=14159]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 04:55:06.073286783 (14h46m14.011702622s) [seg_pos={0 0}, upload=14159]: Begin upload segment... Aug 7 04:55:06.073338001 (14h46m14.01175389s) [seg_pos={0 0}, upload=14159]: Done begin upload segment. Aug 7 04:55:06.073380742 (14h46m14.011796651s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073390892 (14h46m14.011806741s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073867794 (14h46m14.012283643s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073885418 (14h46m14.012301267s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074211331 (14h46m14.01262718s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074520083 (14h46m14.012935922s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074805158 (14h46m14.013221017s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075051048 (14h46m14.013466897s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075279705 (14h46m14.013695554s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075364017 (14h46m14.013779866s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075645796 (14h46m14.014061645s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075834126 (14h46m14.014249975s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076062343 (14h46m14.014478192s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076228621 (14h46m14.01464447s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076500751 (14h46m14.0149166s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076692338 (14h46m14.015108187s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:07.706338803 (14h46m15.644754653s) [upload=14159]: Next returned nil segment Aug 7 04:55:07.706356186 (14h46m15.644772035s) [upload=14159]: Waiting for error group managing segments... Aug 7 04:55:08.079467986 (14h46m16.017883835s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.083077803 (14h46m16.021493662s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.086948248 (14h46m16.025364097s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.096855863 (14h46m16.035271702s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.099582620 (14h46m16.037998469s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.103264886 (14h46m16.041680735s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.112037449 (14h46m16.050453298s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.112072888 (14h46m16.050488727s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.140507229 (14h46m16.078923078s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.178535946 (14h46m16.116951795s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.181286579 (14h46m16.119702428s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.186892866 (14h46m16.125308715s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.193444219 (14h46m16.131860078s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.193468486 (14h46m16.131884335s) [seg_pos={0 0}, upload=14159]: Segment reached optimal threshold of 13 pieces. Aug 7 04:55:08.193605848 (14h46m16.132021697s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193660403 (14h46m16.132076252s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193695380 (14h46m16.132111229s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193712683 (14h46m16.132128532s) [seg_pos={0 0}, upload=14159]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 04:55:08.193822934 (14h46m16.132238783s) [upload=14159]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 04:55:08.193827452 (14h46m16.132243301s) [upload=14159]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 04:55:08.487892748 (14h46m16.426308607s) [upload=14159]: Done uploading segments... Aug 7 04:55:08.487913047 (14h46m16.426328896s) [upload=14159]: Upload finished. err: <nil> Duration: 5.713541835s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...X...X.....................X..............................] duration: 5.597031157s FAIL (2025-08-07 05:30:05 UTC) orbiter warning: operation: sync2.Copy digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2a1b3ec28e7199156a3f4d4616d0d5eed5ab214532aeb49ecb9757cbb62da413 != before 57bd9df9aae0e0164ea9509dedb90a3f1d2caf9fb2f66475a29f29b5ff5ef938 Duration: 5.5970599s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [....X...X.....................X.............................] duration: 5.539124534s FAIL (2025-08-07 05:29:41 UTC) orbiter warning: operation: sync2.Copy digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2a1b3ec28e7199156a3f4d4616d0d5eed5ab214532aeb49ecb9757cbb62da413 != before 57bd9df9aae0e0164ea9509dedb90a3f1d2caf9fb2f66475a29f29b5ff5ef938 Duration: 5.539149461s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...X..........X.............................................] duration: 6.10939883s FAIL (2025-08-07 05:29:34 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA): protocol: expected piece hash; context canceled; EOF Aug 7 04:54:42.476517671 (14h45m50.41493352s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFD6NPNAAUVIRZ5YGTKCBJPLQXPFJMN25HQT7FUNU26DPTS2F7UQ, seg_pos={0 0}, upload=14153]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Aug 7 04:54:42.476561945 (14h45m50.414977794s) [seg_pos={0 0}, upload=14153]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 04:54:42.476635777 (14h45m50.415051626s) [upload=14153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 04:54:42.476640095 (14h45m50.415055944s) [upload=14153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 04:54:42.859043030 (14h45m50.797458879s) [upload=14153]: Done uploading segments... Aug 7 04:54:42.859063249 (14h45m50.797479098s) [upload=14153]: Upload finished. err: <nil> Aug 7 04:55:05.836870332 (14h46m13.775286181s) [upload=14159]: Starting upload Aug 7 04:55:05.836926720 (14h46m13.775342569s) [upload=14159]: Done starting upload Aug 7 04:55:05.837015199 (14h46m13.775431048s) [upload=14159]: Uploading segments... Aug 7 04:55:05.837116423 (14h46m13.775532272s) [upload=14159]: Got next segment. Inline: false Aug 7 04:55:05.837155838 (14h46m13.775571687s) [upload=14159]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 04:55:05.837160236 (14h46m13.775576086s) [upload=14159]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 04:55:06.073286783 (14h46m14.011702622s) [seg_pos={0 0}, upload=14159]: Begin upload segment... Aug 7 04:55:06.073338001 (14h46m14.01175389s) [seg_pos={0 0}, upload=14159]: Done begin upload segment. Aug 7 04:55:06.073380742 (14h46m14.011796651s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073390892 (14h46m14.011806741s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073867794 (14h46m14.012283643s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073885418 (14h46m14.012301267s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074211331 (14h46m14.01262718s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074520083 (14h46m14.012935922s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074805158 (14h46m14.013221017s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075051048 (14h46m14.013466897s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075279705 (14h46m14.013695554s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075364017 (14h46m14.013779866s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075645796 (14h46m14.014061645s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075834126 (14h46m14.014249975s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076062343 (14h46m14.014478192s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076228621 (14h46m14.01464447s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076500751 (14h46m14.0149166s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076692338 (14h46m14.015108187s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:07.706338803 (14h46m15.644754653s) [upload=14159]: Next returned nil segment Aug 7 04:55:07.706356186 (14h46m15.644772035s) [upload=14159]: Waiting for error group managing segments... Aug 7 04:55:08.079467986 (14h46m16.017883835s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.083077803 (14h46m16.021493662s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.086948248 (14h46m16.025364097s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.096855863 (14h46m16.035271702s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.099582620 (14h46m16.037998469s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.103264886 (14h46m16.041680735s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.112037449 (14h46m16.050453298s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.112072888 (14h46m16.050488727s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.140507229 (14h46m16.078923078s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.178535946 (14h46m16.116951795s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.181286579 (14h46m16.119702428s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.186892866 (14h46m16.125308715s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.193444219 (14h46m16.131860078s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.193468486 (14h46m16.131884335s) [seg_pos={0 0}, upload=14159]: Segment reached optimal threshold of 13 pieces. Aug 7 04:55:08.193605848 (14h46m16.132021697s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193660403 (14h46m16.132076252s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193695380 (14h46m16.132111229s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193712683 (14h46m16.132128532s) [seg_pos={0 0}, upload=14159]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 04:55:08.193822934 (14h46m16.132238783s) [upload=14159]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 04:55:08.193827452 (14h46m16.132243301s) [upload=14159]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 04:55:08.487892748 (14h46m16.426308607s) [upload=14159]: Done uploading segments... Aug 7 04:55:08.487913047 (14h46m16.426328896s) [upload=14159]: Upload finished. err: <nil> Duration: 6.109423506s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....X...X.....................X............................] duration: 5.635961273s FAIL (2025-08-07 05:29:21 UTC) orbiter warning: operation: sync2.Copy digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2a1b3ec28e7199156a3f4d4616d0d5eed5ab214532aeb49ecb9757cbb62da413 != before 57bd9df9aae0e0164ea9509dedb90a3f1d2caf9fb2f66475a29f29b5ff5ef938 Duration: 5.63598619s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....X..........X............................................] duration: 5.937108177s FAIL (2025-08-07 05:28:31 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA): protocol: expected piece hash; context canceled; EOF Aug 7 04:54:42.476517671 (14h45m50.41493352s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFD6NPNAAUVIRZ5YGTKCBJPLQXPFJMN25HQT7FUNU26DPTS2F7UQ, seg_pos={0 0}, upload=14153]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Aug 7 04:54:42.476561945 (14h45m50.414977794s) [seg_pos={0 0}, upload=14153]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 04:54:42.476635777 (14h45m50.415051626s) [upload=14153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 04:54:42.476640095 (14h45m50.415055944s) [upload=14153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 04:54:42.859043030 (14h45m50.797458879s) [upload=14153]: Done uploading segments... Aug 7 04:54:42.859063249 (14h45m50.797479098s) [upload=14153]: Upload finished. err: <nil> Aug 7 04:55:05.836870332 (14h46m13.775286181s) [upload=14159]: Starting upload Aug 7 04:55:05.836926720 (14h46m13.775342569s) [upload=14159]: Done starting upload Aug 7 04:55:05.837015199 (14h46m13.775431048s) [upload=14159]: Uploading segments... Aug 7 04:55:05.837116423 (14h46m13.775532272s) [upload=14159]: Got next segment. Inline: false Aug 7 04:55:05.837155838 (14h46m13.775571687s) [upload=14159]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 04:55:05.837160236 (14h46m13.775576086s) [upload=14159]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 04:55:06.073286783 (14h46m14.011702622s) [seg_pos={0 0}, upload=14159]: Begin upload segment... Aug 7 04:55:06.073338001 (14h46m14.01175389s) [seg_pos={0 0}, upload=14159]: Done begin upload segment. Aug 7 04:55:06.073380742 (14h46m14.011796651s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073390892 (14h46m14.011806741s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073867794 (14h46m14.012283643s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073885418 (14h46m14.012301267s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074211331 (14h46m14.01262718s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074520083 (14h46m14.012935922s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074805158 (14h46m14.013221017s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075051048 (14h46m14.013466897s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075279705 (14h46m14.013695554s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075364017 (14h46m14.013779866s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075645796 (14h46m14.014061645s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075834126 (14h46m14.014249975s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076062343 (14h46m14.014478192s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076228621 (14h46m14.01464447s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076500751 (14h46m14.0149166s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076692338 (14h46m14.015108187s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:07.706338803 (14h46m15.644754653s) [upload=14159]: Next returned nil segment Aug 7 04:55:07.706356186 (14h46m15.644772035s) [upload=14159]: Waiting for error group managing segments... Aug 7 04:55:08.079467986 (14h46m16.017883835s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.083077803 (14h46m16.021493662s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.086948248 (14h46m16.025364097s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.096855863 (14h46m16.035271702s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.099582620 (14h46m16.037998469s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.103264886 (14h46m16.041680735s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.112037449 (14h46m16.050453298s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.112072888 (14h46m16.050488727s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.140507229 (14h46m16.078923078s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.178535946 (14h46m16.116951795s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.181286579 (14h46m16.119702428s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.186892866 (14h46m16.125308715s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.193444219 (14h46m16.131860078s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.193468486 (14h46m16.131884335s) [seg_pos={0 0}, upload=14159]: Segment reached optimal threshold of 13 pieces. Aug 7 04:55:08.193605848 (14h46m16.132021697s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193660403 (14h46m16.132076252s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193695380 (14h46m16.132111229s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193712683 (14h46m16.132128532s) [seg_pos={0 0}, upload=14159]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 04:55:08.193822934 (14h46m16.132238783s) [upload=14159]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 04:55:08.193827452 (14h46m16.132243301s) [upload=14159]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 04:55:08.487892748 (14h46m16.426308607s) [upload=14159]: Done uploading segments... Aug 7 04:55:08.487913047 (14h46m16.426328896s) [upload=14159]: Upload finished. err: <nil> Duration: 5.93713634s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [......X...X.....................X...........................] duration: 5.530448331s FAIL (2025-08-07 05:28:20 UTC) orbiter warning: operation: sync2.Copy digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2a1b3ec28e7199156a3f4d4616d0d5eed5ab214532aeb49ecb9757cbb62da413 != before 57bd9df9aae0e0164ea9509dedb90a3f1d2caf9fb2f66475a29f29b5ff5ef938 Duration: 5.5304742s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......X...X.....................X..........................] duration: 5.584834212s FAIL (2025-08-07 05:27:36 UTC) orbiter warning: operation: sync2.Copy digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2a1b3ec28e7199156a3f4d4616d0d5eed5ab214532aeb49ecb9757cbb62da413 != before 57bd9df9aae0e0164ea9509dedb90a3f1d2caf9fb2f66475a29f29b5ff5ef938 Duration: 5.584885349s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....X..........X...........................................] duration: 5.74082881s FAIL (2025-08-07 05:27:20 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA): protocol: expected piece hash; context canceled; EOF Aug 7 04:54:42.476517671 (14h45m50.41493352s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFD6NPNAAUVIRZ5YGTKCBJPLQXPFJMN25HQT7FUNU26DPTS2F7UQ, seg_pos={0 0}, upload=14153]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Aug 7 04:54:42.476561945 (14h45m50.414977794s) [seg_pos={0 0}, upload=14153]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 04:54:42.476635777 (14h45m50.415051626s) [upload=14153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 04:54:42.476640095 (14h45m50.415055944s) [upload=14153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 04:54:42.859043030 (14h45m50.797458879s) [upload=14153]: Done uploading segments... Aug 7 04:54:42.859063249 (14h45m50.797479098s) [upload=14153]: Upload finished. err: <nil> Aug 7 04:55:05.836870332 (14h46m13.775286181s) [upload=14159]: Starting upload Aug 7 04:55:05.836926720 (14h46m13.775342569s) [upload=14159]: Done starting upload Aug 7 04:55:05.837015199 (14h46m13.775431048s) [upload=14159]: Uploading segments... Aug 7 04:55:05.837116423 (14h46m13.775532272s) [upload=14159]: Got next segment. Inline: false Aug 7 04:55:05.837155838 (14h46m13.775571687s) [upload=14159]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 04:55:05.837160236 (14h46m13.775576086s) [upload=14159]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 04:55:06.073286783 (14h46m14.011702622s) [seg_pos={0 0}, upload=14159]: Begin upload segment... Aug 7 04:55:06.073338001 (14h46m14.01175389s) [seg_pos={0 0}, upload=14159]: Done begin upload segment. Aug 7 04:55:06.073380742 (14h46m14.011796651s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073390892 (14h46m14.011806741s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073867794 (14h46m14.012283643s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073885418 (14h46m14.012301267s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074211331 (14h46m14.01262718s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074520083 (14h46m14.012935922s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074805158 (14h46m14.013221017s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075051048 (14h46m14.013466897s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075279705 (14h46m14.013695554s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075364017 (14h46m14.013779866s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075645796 (14h46m14.014061645s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075834126 (14h46m14.014249975s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076062343 (14h46m14.014478192s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076228621 (14h46m14.01464447s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076500751 (14h46m14.0149166s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076692338 (14h46m14.015108187s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:07.706338803 (14h46m15.644754653s) [upload=14159]: Next returned nil segment Aug 7 04:55:07.706356186 (14h46m15.644772035s) [upload=14159]: Waiting for error group managing segments... Aug 7 04:55:08.079467986 (14h46m16.017883835s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.083077803 (14h46m16.021493662s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.086948248 (14h46m16.025364097s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.096855863 (14h46m16.035271702s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.099582620 (14h46m16.037998469s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.103264886 (14h46m16.041680735s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.112037449 (14h46m16.050453298s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.112072888 (14h46m16.050488727s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.140507229 (14h46m16.078923078s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.178535946 (14h46m16.116951795s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.181286579 (14h46m16.119702428s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.186892866 (14h46m16.125308715s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.193444219 (14h46m16.131860078s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.193468486 (14h46m16.131884335s) [seg_pos={0 0}, upload=14159]: Segment reached optimal threshold of 13 pieces. Aug 7 04:55:08.193605848 (14h46m16.132021697s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193660403 (14h46m16.132076252s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193695380 (14h46m16.132111229s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193712683 (14h46m16.132128532s) [seg_pos={0 0}, upload=14159]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 04:55:08.193822934 (14h46m16.132238783s) [upload=14159]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 04:55:08.193827452 (14h46m16.132243301s) [upload=14159]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 04:55:08.487892748 (14h46m16.426308607s) [upload=14159]: Done uploading segments... Aug 7 04:55:08.487913047 (14h46m16.426328896s) [upload=14159]: Upload finished. err: <nil> Duration: 5.740857065s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [......X..........X..........................................] duration: 5.916011544s FAIL (2025-08-07 05:26:28 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA): protocol: expected piece hash; context canceled; EOF Aug 7 04:54:42.476517671 (14h45m50.41493352s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFD6NPNAAUVIRZ5YGTKCBJPLQXPFJMN25HQT7FUNU26DPTS2F7UQ, seg_pos={0 0}, upload=14153]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Aug 7 04:54:42.476561945 (14h45m50.414977794s) [seg_pos={0 0}, upload=14153]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 04:54:42.476635777 (14h45m50.415051626s) [upload=14153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 04:54:42.476640095 (14h45m50.415055944s) [upload=14153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 04:54:42.859043030 (14h45m50.797458879s) [upload=14153]: Done uploading segments... Aug 7 04:54:42.859063249 (14h45m50.797479098s) [upload=14153]: Upload finished. err: <nil> Aug 7 04:55:05.836870332 (14h46m13.775286181s) [upload=14159]: Starting upload Aug 7 04:55:05.836926720 (14h46m13.775342569s) [upload=14159]: Done starting upload Aug 7 04:55:05.837015199 (14h46m13.775431048s) [upload=14159]: Uploading segments... Aug 7 04:55:05.837116423 (14h46m13.775532272s) [upload=14159]: Got next segment. Inline: false Aug 7 04:55:05.837155838 (14h46m13.775571687s) [upload=14159]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 04:55:05.837160236 (14h46m13.775576086s) [upload=14159]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 04:55:06.073286783 (14h46m14.011702622s) [seg_pos={0 0}, upload=14159]: Begin upload segment... Aug 7 04:55:06.073338001 (14h46m14.01175389s) [seg_pos={0 0}, upload=14159]: Done begin upload segment. Aug 7 04:55:06.073380742 (14h46m14.011796651s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073390892 (14h46m14.011806741s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073867794 (14h46m14.012283643s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073885418 (14h46m14.012301267s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074211331 (14h46m14.01262718s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074520083 (14h46m14.012935922s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074805158 (14h46m14.013221017s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075051048 (14h46m14.013466897s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075279705 (14h46m14.013695554s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075364017 (14h46m14.013779866s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075645796 (14h46m14.014061645s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075834126 (14h46m14.014249975s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076062343 (14h46m14.014478192s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076228621 (14h46m14.01464447s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076500751 (14h46m14.0149166s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076692338 (14h46m14.015108187s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:07.706338803 (14h46m15.644754653s) [upload=14159]: Next returned nil segment Aug 7 04:55:07.706356186 (14h46m15.644772035s) [upload=14159]: Waiting for error group managing segments... Aug 7 04:55:08.079467986 (14h46m16.017883835s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.083077803 (14h46m16.021493662s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.086948248 (14h46m16.025364097s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.096855863 (14h46m16.035271702s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.099582620 (14h46m16.037998469s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.103264886 (14h46m16.041680735s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.112037449 (14h46m16.050453298s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.112072888 (14h46m16.050488727s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.140507229 (14h46m16.078923078s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.178535946 (14h46m16.116951795s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.181286579 (14h46m16.119702428s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.186892866 (14h46m16.125308715s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.193444219 (14h46m16.131860078s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.193468486 (14h46m16.131884335s) [seg_pos={0 0}, upload=14159]: Segment reached optimal threshold of 13 pieces. Aug 7 04:55:08.193605848 (14h46m16.132021697s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193660403 (14h46m16.132076252s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193695380 (14h46m16.132111229s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193712683 (14h46m16.132128532s) [seg_pos={0 0}, upload=14159]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 04:55:08.193822934 (14h46m16.132238783s) [upload=14159]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 04:55:08.193827452 (14h46m16.132243301s) [upload=14159]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 04:55:08.487892748 (14h46m16.426308607s) [upload=14159]: Done uploading segments... Aug 7 04:55:08.487913047 (14h46m16.426328896s) [upload=14159]: Upload finished. err: <nil> Duration: 5.916041291s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [........X...X.....................X.........................] duration: 5.687590593s FAIL (2025-08-07 05:26:23 UTC) orbiter warning: operation: sync2.Copy digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2a1b3ec28e7199156a3f4d4616d0d5eed5ab214532aeb49ecb9757cbb62da413 != before 57bd9df9aae0e0164ea9509dedb90a3f1d2caf9fb2f66475a29f29b5ff5ef938 Duration: 5.687617434s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........X...X.....................X........................] duration: 5.798182894s FAIL (2025-08-07 05:26:07 UTC) orbiter warning: operation: sync2.Copy digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2a1b3ec28e7199156a3f4d4616d0d5eed5ab214532aeb49ecb9757cbb62da413 != before 57bd9df9aae0e0164ea9509dedb90a3f1d2caf9fb2f66475a29f29b5ff5ef938 Duration: 5.798210738s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......X..........X.........................................] duration: 6.105785074s FAIL (2025-08-07 05:25:38 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA): protocol: expected piece hash; context canceled; EOF Aug 7 04:54:42.476517671 (14h45m50.41493352s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFD6NPNAAUVIRZ5YGTKCBJPLQXPFJMN25HQT7FUNU26DPTS2F7UQ, seg_pos={0 0}, upload=14153]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Aug 7 04:54:42.476561945 (14h45m50.414977794s) [seg_pos={0 0}, upload=14153]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 04:54:42.476635777 (14h45m50.415051626s) [upload=14153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 04:54:42.476640095 (14h45m50.415055944s) [upload=14153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 04:54:42.859043030 (14h45m50.797458879s) [upload=14153]: Done uploading segments... Aug 7 04:54:42.859063249 (14h45m50.797479098s) [upload=14153]: Upload finished. err: <nil> Aug 7 04:55:05.836870332 (14h46m13.775286181s) [upload=14159]: Starting upload Aug 7 04:55:05.836926720 (14h46m13.775342569s) [upload=14159]: Done starting upload Aug 7 04:55:05.837015199 (14h46m13.775431048s) [upload=14159]: Uploading segments... Aug 7 04:55:05.837116423 (14h46m13.775532272s) [upload=14159]: Got next segment. Inline: false Aug 7 04:55:05.837155838 (14h46m13.775571687s) [upload=14159]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 04:55:05.837160236 (14h46m13.775576086s) [upload=14159]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 04:55:06.073286783 (14h46m14.011702622s) [seg_pos={0 0}, upload=14159]: Begin upload segment... Aug 7 04:55:06.073338001 (14h46m14.01175389s) [seg_pos={0 0}, upload=14159]: Done begin upload segment. Aug 7 04:55:06.073380742 (14h46m14.011796651s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073390892 (14h46m14.011806741s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073867794 (14h46m14.012283643s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073885418 (14h46m14.012301267s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074211331 (14h46m14.01262718s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074520083 (14h46m14.012935922s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074805158 (14h46m14.013221017s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075051048 (14h46m14.013466897s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075279705 (14h46m14.013695554s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075364017 (14h46m14.013779866s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075645796 (14h46m14.014061645s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075834126 (14h46m14.014249975s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076062343 (14h46m14.014478192s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076228621 (14h46m14.01464447s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076500751 (14h46m14.0149166s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076692338 (14h46m14.015108187s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:07.706338803 (14h46m15.644754653s) [upload=14159]: Next returned nil segment Aug 7 04:55:07.706356186 (14h46m15.644772035s) [upload=14159]: Waiting for error group managing segments... Aug 7 04:55:08.079467986 (14h46m16.017883835s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.083077803 (14h46m16.021493662s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.086948248 (14h46m16.025364097s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.096855863 (14h46m16.035271702s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.099582620 (14h46m16.037998469s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.103264886 (14h46m16.041680735s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.112037449 (14h46m16.050453298s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.112072888 (14h46m16.050488727s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.140507229 (14h46m16.078923078s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.178535946 (14h46m16.116951795s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.181286579 (14h46m16.119702428s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.186892866 (14h46m16.125308715s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.193444219 (14h46m16.131860078s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.193468486 (14h46m16.131884335s) [seg_pos={0 0}, upload=14159]: Segment reached optimal threshold of 13 pieces. Aug 7 04:55:08.193605848 (14h46m16.132021697s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193660403 (14h46m16.132076252s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193695380 (14h46m16.132111229s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193712683 (14h46m16.132128532s) [seg_pos={0 0}, upload=14159]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 04:55:08.193822934 (14h46m16.132238783s) [upload=14159]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 04:55:08.193827452 (14h46m16.132243301s) [upload=14159]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 04:55:08.487892748 (14h46m16.426308607s) [upload=14159]: Done uploading segments... Aug 7 04:55:08.487913047 (14h46m16.426328896s) [upload=14159]: Upload finished. err: <nil> Duration: 6.105807949s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..........X...X.....................X.......................] duration: 5.940486481s FAIL (2025-08-07 05:25:26 UTC) orbiter warning: operation: sync2.Copy digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2a1b3ec28e7199156a3f4d4616d0d5eed5ab214532aeb49ecb9757cbb62da413 != before 57bd9df9aae0e0164ea9509dedb90a3f1d2caf9fb2f66475a29f29b5ff5ef938 Duration: 5.94052795s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [........X..........X........................................] duration: 5.910378998s FAIL (2025-08-07 05:24:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA): protocol: expected piece hash; context canceled; EOF Aug 7 04:54:42.476517671 (14h45m50.41493352s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFD6NPNAAUVIRZ5YGTKCBJPLQXPFJMN25HQT7FUNU26DPTS2F7UQ, seg_pos={0 0}, upload=14153]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Aug 7 04:54:42.476561945 (14h45m50.414977794s) [seg_pos={0 0}, upload=14153]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 04:54:42.476635777 (14h45m50.415051626s) [upload=14153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 04:54:42.476640095 (14h45m50.415055944s) [upload=14153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 04:54:42.859043030 (14h45m50.797458879s) [upload=14153]: Done uploading segments... Aug 7 04:54:42.859063249 (14h45m50.797479098s) [upload=14153]: Upload finished. err: <nil> Aug 7 04:55:05.836870332 (14h46m13.775286181s) [upload=14159]: Starting upload Aug 7 04:55:05.836926720 (14h46m13.775342569s) [upload=14159]: Done starting upload Aug 7 04:55:05.837015199 (14h46m13.775431048s) [upload=14159]: Uploading segments... Aug 7 04:55:05.837116423 (14h46m13.775532272s) [upload=14159]: Got next segment. Inline: false Aug 7 04:55:05.837155838 (14h46m13.775571687s) [upload=14159]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 04:55:05.837160236 (14h46m13.775576086s) [upload=14159]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 04:55:06.073286783 (14h46m14.011702622s) [seg_pos={0 0}, upload=14159]: Begin upload segment... Aug 7 04:55:06.073338001 (14h46m14.01175389s) [seg_pos={0 0}, upload=14159]: Done begin upload segment. Aug 7 04:55:06.073380742 (14h46m14.011796651s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073390892 (14h46m14.011806741s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073867794 (14h46m14.012283643s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073885418 (14h46m14.012301267s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074211331 (14h46m14.01262718s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074520083 (14h46m14.012935922s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074805158 (14h46m14.013221017s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075051048 (14h46m14.013466897s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075279705 (14h46m14.013695554s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075364017 (14h46m14.013779866s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075645796 (14h46m14.014061645s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075834126 (14h46m14.014249975s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076062343 (14h46m14.014478192s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076228621 (14h46m14.01464447s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076500751 (14h46m14.0149166s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076692338 (14h46m14.015108187s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:07.706338803 (14h46m15.644754653s) [upload=14159]: Next returned nil segment Aug 7 04:55:07.706356186 (14h46m15.644772035s) [upload=14159]: Waiting for error group managing segments... Aug 7 04:55:08.079467986 (14h46m16.017883835s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.083077803 (14h46m16.021493662s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.086948248 (14h46m16.025364097s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.096855863 (14h46m16.035271702s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.099582620 (14h46m16.037998469s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.103264886 (14h46m16.041680735s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.112037449 (14h46m16.050453298s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.112072888 (14h46m16.050488727s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.140507229 (14h46m16.078923078s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.178535946 (14h46m16.116951795s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.181286579 (14h46m16.119702428s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.186892866 (14h46m16.125308715s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.193444219 (14h46m16.131860078s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.193468486 (14h46m16.131884335s) [seg_pos={0 0}, upload=14159]: Segment reached optimal threshold of 13 pieces. Aug 7 04:55:08.193605848 (14h46m16.132021697s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193660403 (14h46m16.132076252s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193695380 (14h46m16.132111229s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193712683 (14h46m16.132128532s) [seg_pos={0 0}, upload=14159]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 04:55:08.193822934 (14h46m16.132238783s) [upload=14159]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 04:55:08.193827452 (14h46m16.132243301s) [upload=14159]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 04:55:08.487892748 (14h46m16.426308607s) [upload=14159]: Done uploading segments... Aug 7 04:55:08.487913047 (14h46m16.426328896s) [upload=14159]: Upload finished. err: <nil> Duration: 5.910405378s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...........X...X.....................X......................] duration: 5.70960417s FAIL (2025-08-07 05:24:31 UTC) orbiter warning: operation: sync2.Copy digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2a1b3ec28e7199156a3f4d4616d0d5eed5ab214532aeb49ecb9757cbb62da413 != before 57bd9df9aae0e0164ea9509dedb90a3f1d2caf9fb2f66475a29f29b5ff5ef938 Duration: 5.70963556s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........X..........X.......................................] duration: 5.773207524s FAIL (2025-08-07 05:23:55 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA): protocol: expected piece hash; context canceled; EOF Aug 7 04:54:42.476517671 (14h45m50.41493352s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFD6NPNAAUVIRZ5YGTKCBJPLQXPFJMN25HQT7FUNU26DPTS2F7UQ, seg_pos={0 0}, upload=14153]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Aug 7 04:54:42.476561945 (14h45m50.414977794s) [seg_pos={0 0}, upload=14153]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 04:54:42.476635777 (14h45m50.415051626s) [upload=14153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 04:54:42.476640095 (14h45m50.415055944s) [upload=14153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 04:54:42.859043030 (14h45m50.797458879s) [upload=14153]: Done uploading segments... Aug 7 04:54:42.859063249 (14h45m50.797479098s) [upload=14153]: Upload finished. err: <nil> Aug 7 04:55:05.836870332 (14h46m13.775286181s) [upload=14159]: Starting upload Aug 7 04:55:05.836926720 (14h46m13.775342569s) [upload=14159]: Done starting upload Aug 7 04:55:05.837015199 (14h46m13.775431048s) [upload=14159]: Uploading segments... Aug 7 04:55:05.837116423 (14h46m13.775532272s) [upload=14159]: Got next segment. Inline: false Aug 7 04:55:05.837155838 (14h46m13.775571687s) [upload=14159]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 04:55:05.837160236 (14h46m13.775576086s) [upload=14159]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 04:55:06.073286783 (14h46m14.011702622s) [seg_pos={0 0}, upload=14159]: Begin upload segment... Aug 7 04:55:06.073338001 (14h46m14.01175389s) [seg_pos={0 0}, upload=14159]: Done begin upload segment. Aug 7 04:55:06.073380742 (14h46m14.011796651s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073390892 (14h46m14.011806741s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073867794 (14h46m14.012283643s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073885418 (14h46m14.012301267s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074211331 (14h46m14.01262718s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074520083 (14h46m14.012935922s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074805158 (14h46m14.013221017s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075051048 (14h46m14.013466897s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075279705 (14h46m14.013695554s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075364017 (14h46m14.013779866s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075645796 (14h46m14.014061645s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075834126 (14h46m14.014249975s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076062343 (14h46m14.014478192s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076228621 (14h46m14.01464447s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076500751 (14h46m14.0149166s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076692338 (14h46m14.015108187s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:07.706338803 (14h46m15.644754653s) [upload=14159]: Next returned nil segment Aug 7 04:55:07.706356186 (14h46m15.644772035s) [upload=14159]: Waiting for error group managing segments... Aug 7 04:55:08.079467986 (14h46m16.017883835s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.083077803 (14h46m16.021493662s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.086948248 (14h46m16.025364097s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.096855863 (14h46m16.035271702s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.099582620 (14h46m16.037998469s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.103264886 (14h46m16.041680735s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.112037449 (14h46m16.050453298s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.112072888 (14h46m16.050488727s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.140507229 (14h46m16.078923078s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.178535946 (14h46m16.116951795s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.181286579 (14h46m16.119702428s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.186892866 (14h46m16.125308715s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.193444219 (14h46m16.131860078s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.193468486 (14h46m16.131884335s) [seg_pos={0 0}, upload=14159]: Segment reached optimal threshold of 13 pieces. Aug 7 04:55:08.193605848 (14h46m16.132021697s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193660403 (14h46m16.132076252s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193695380 (14h46m16.132111229s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193712683 (14h46m16.132128532s) [seg_pos={0 0}, upload=14159]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 04:55:08.193822934 (14h46m16.132238783s) [upload=14159]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 04:55:08.193827452 (14h46m16.132243301s) [upload=14159]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 04:55:08.487892748 (14h46m16.426308607s) [upload=14159]: Done uploading segments... Aug 7 04:55:08.487913047 (14h46m16.426328896s) [upload=14159]: Upload finished. err: <nil> Duration: 5.773242499s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........X..........X......................................] duration: 5.897068997s FAIL (2025-08-07 05:23:36 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA): protocol: expected piece hash; context canceled; EOF Aug 7 04:54:42.476517671 (14h45m50.41493352s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFD6NPNAAUVIRZ5YGTKCBJPLQXPFJMN25HQT7FUNU26DPTS2F7UQ, seg_pos={0 0}, upload=14153]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Aug 7 04:54:42.476561945 (14h45m50.414977794s) [seg_pos={0 0}, upload=14153]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 04:54:42.476635777 (14h45m50.415051626s) [upload=14153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 04:54:42.476640095 (14h45m50.415055944s) [upload=14153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 04:54:42.859043030 (14h45m50.797458879s) [upload=14153]: Done uploading segments... Aug 7 04:54:42.859063249 (14h45m50.797479098s) [upload=14153]: Upload finished. err: <nil> Aug 7 04:55:05.836870332 (14h46m13.775286181s) [upload=14159]: Starting upload Aug 7 04:55:05.836926720 (14h46m13.775342569s) [upload=14159]: Done starting upload Aug 7 04:55:05.837015199 (14h46m13.775431048s) [upload=14159]: Uploading segments... Aug 7 04:55:05.837116423 (14h46m13.775532272s) [upload=14159]: Got next segment. Inline: false Aug 7 04:55:05.837155838 (14h46m13.775571687s) [upload=14159]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 04:55:05.837160236 (14h46m13.775576086s) [upload=14159]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 04:55:06.073286783 (14h46m14.011702622s) [seg_pos={0 0}, upload=14159]: Begin upload segment... Aug 7 04:55:06.073338001 (14h46m14.01175389s) [seg_pos={0 0}, upload=14159]: Done begin upload segment. Aug 7 04:55:06.073380742 (14h46m14.011796651s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073390892 (14h46m14.011806741s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073867794 (14h46m14.012283643s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073885418 (14h46m14.012301267s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074211331 (14h46m14.01262718s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074520083 (14h46m14.012935922s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074805158 (14h46m14.013221017s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075051048 (14h46m14.013466897s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075279705 (14h46m14.013695554s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075364017 (14h46m14.013779866s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075645796 (14h46m14.014061645s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075834126 (14h46m14.014249975s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076062343 (14h46m14.014478192s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076228621 (14h46m14.01464447s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076500751 (14h46m14.0149166s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076692338 (14h46m14.015108187s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:07.706338803 (14h46m15.644754653s) [upload=14159]: Next returned nil segment Aug 7 04:55:07.706356186 (14h46m15.644772035s) [upload=14159]: Waiting for error group managing segments... Aug 7 04:55:08.079467986 (14h46m16.017883835s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.083077803 (14h46m16.021493662s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.086948248 (14h46m16.025364097s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.096855863 (14h46m16.035271702s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.099582620 (14h46m16.037998469s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.103264886 (14h46m16.041680735s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.112037449 (14h46m16.050453298s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.112072888 (14h46m16.050488727s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.140507229 (14h46m16.078923078s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.178535946 (14h46m16.116951795s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.181286579 (14h46m16.119702428s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.186892866 (14h46m16.125308715s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.193444219 (14h46m16.131860078s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.193468486 (14h46m16.131884335s) [seg_pos={0 0}, upload=14159]: Segment reached optimal threshold of 13 pieces. Aug 7 04:55:08.193605848 (14h46m16.132021697s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193660403 (14h46m16.132076252s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193695380 (14h46m16.132111229s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193712683 (14h46m16.132128532s) [seg_pos={0 0}, upload=14159]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 04:55:08.193822934 (14h46m16.132238783s) [upload=14159]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 04:55:08.193827452 (14h46m16.132243301s) [upload=14159]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 04:55:08.487892748 (14h46m16.426308607s) [upload=14159]: Done uploading segments... Aug 7 04:55:08.487913047 (14h46m16.426328896s) [upload=14159]: Upload finished. err: <nil> Duration: 5.897096079s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [............X...X.....................X.....................] duration: 5.77191116s FAIL (2025-08-07 05:23:19 UTC) orbiter warning: operation: sync2.Copy digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2a1b3ec28e7199156a3f4d4616d0d5eed5ab214532aeb49ecb9757cbb62da413 != before 57bd9df9aae0e0164ea9509dedb90a3f1d2caf9fb2f66475a29f29b5ff5ef938 Duration: 5.771940886s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.............X...X.....................X....................] duration: 5.83924281s FAIL (2025-08-07 05:23:03 UTC) orbiter warning: operation: sync2.Copy digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2a1b3ec28e7199156a3f4d4616d0d5eed5ab214532aeb49ecb9757cbb62da413 != before 57bd9df9aae0e0164ea9509dedb90a3f1d2caf9fb2f66475a29f29b5ff5ef938 Duration: 5.839271735s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 5.98761938s FAIL (2025-08-07 05:22:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.987644348s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [X..........X..........X.....................................] duration: 5.807177294s FAIL (2025-08-07 05:22:37 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA): protocol: expected piece hash; context canceled; EOF Aug 7 04:54:42.476517671 (14h45m50.41493352s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFD6NPNAAUVIRZ5YGTKCBJPLQXPFJMN25HQT7FUNU26DPTS2F7UQ, seg_pos={0 0}, upload=14153]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Aug 7 04:54:42.476561945 (14h45m50.414977794s) [seg_pos={0 0}, upload=14153]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 04:54:42.476635777 (14h45m50.415051626s) [upload=14153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 04:54:42.476640095 (14h45m50.415055944s) [upload=14153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 04:54:42.859043030 (14h45m50.797458879s) [upload=14153]: Done uploading segments... Aug 7 04:54:42.859063249 (14h45m50.797479098s) [upload=14153]: Upload finished. err: <nil> Aug 7 04:55:05.836870332 (14h46m13.775286181s) [upload=14159]: Starting upload Aug 7 04:55:05.836926720 (14h46m13.775342569s) [upload=14159]: Done starting upload Aug 7 04:55:05.837015199 (14h46m13.775431048s) [upload=14159]: Uploading segments... Aug 7 04:55:05.837116423 (14h46m13.775532272s) [upload=14159]: Got next segment. Inline: false Aug 7 04:55:05.837155838 (14h46m13.775571687s) [upload=14159]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 04:55:05.837160236 (14h46m13.775576086s) [upload=14159]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 04:55:06.073286783 (14h46m14.011702622s) [seg_pos={0 0}, upload=14159]: Begin upload segment... Aug 7 04:55:06.073338001 (14h46m14.01175389s) [seg_pos={0 0}, upload=14159]: Done begin upload segment. Aug 7 04:55:06.073380742 (14h46m14.011796651s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073390892 (14h46m14.011806741s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073867794 (14h46m14.012283643s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073885418 (14h46m14.012301267s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074211331 (14h46m14.01262718s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074520083 (14h46m14.012935922s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074805158 (14h46m14.013221017s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075051048 (14h46m14.013466897s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075279705 (14h46m14.013695554s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075364017 (14h46m14.013779866s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075645796 (14h46m14.014061645s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075834126 (14h46m14.014249975s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076062343 (14h46m14.014478192s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076228621 (14h46m14.01464447s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076500751 (14h46m14.0149166s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076692338 (14h46m14.015108187s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:07.706338803 (14h46m15.644754653s) [upload=14159]: Next returned nil segment Aug 7 04:55:07.706356186 (14h46m15.644772035s) [upload=14159]: Waiting for error group managing segments... Aug 7 04:55:08.079467986 (14h46m16.017883835s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.083077803 (14h46m16.021493662s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.086948248 (14h46m16.025364097s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.096855863 (14h46m16.035271702s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.099582620 (14h46m16.037998469s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.103264886 (14h46m16.041680735s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.112037449 (14h46m16.050453298s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.112072888 (14h46m16.050488727s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.140507229 (14h46m16.078923078s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.178535946 (14h46m16.116951795s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.181286579 (14h46m16.119702428s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.186892866 (14h46m16.125308715s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.193444219 (14h46m16.131860078s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.193468486 (14h46m16.131884335s) [seg_pos={0 0}, upload=14159]: Segment reached optimal threshold of 13 pieces. Aug 7 04:55:08.193605848 (14h46m16.132021697s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193660403 (14h46m16.132076252s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193695380 (14h46m16.132111229s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193712683 (14h46m16.132128532s) [seg_pos={0 0}, upload=14159]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 04:55:08.193822934 (14h46m16.132238783s) [upload=14159]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 04:55:08.193827452 (14h46m16.132243301s) [upload=14159]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 04:55:08.487892748 (14h46m16.426308607s) [upload=14159]: Done uploading segments... Aug 7 04:55:08.487913047 (14h46m16.426328896s) [upload=14159]: Upload finished. err: <nil> Duration: 5.807202544s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..............X...X.....................X...................] duration: 5.699387645s FAIL (2025-08-07 05:22:23 UTC) orbiter warning: operation: sync2.Copy digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2a1b3ec28e7199156a3f4d4616d0d5eed5ab214532aeb49ecb9757cbb62da413 != before 57bd9df9aae0e0164ea9509dedb90a3f1d2caf9fb2f66475a29f29b5ff5ef938 Duration: 5.699412984s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.X..........X..........X....................................] duration: 5.769954657s FAIL (2025-08-07 05:22:00 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA): protocol: expected piece hash; context canceled; EOF Aug 7 04:54:42.476517671 (14h45m50.41493352s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFD6NPNAAUVIRZ5YGTKCBJPLQXPFJMN25HQT7FUNU26DPTS2F7UQ, seg_pos={0 0}, upload=14153]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Aug 7 04:54:42.476561945 (14h45m50.414977794s) [seg_pos={0 0}, upload=14153]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 04:54:42.476635777 (14h45m50.415051626s) [upload=14153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 04:54:42.476640095 (14h45m50.415055944s) [upload=14153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 04:54:42.859043030 (14h45m50.797458879s) [upload=14153]: Done uploading segments... Aug 7 04:54:42.859063249 (14h45m50.797479098s) [upload=14153]: Upload finished. err: <nil> Aug 7 04:55:05.836870332 (14h46m13.775286181s) [upload=14159]: Starting upload Aug 7 04:55:05.836926720 (14h46m13.775342569s) [upload=14159]: Done starting upload Aug 7 04:55:05.837015199 (14h46m13.775431048s) [upload=14159]: Uploading segments... Aug 7 04:55:05.837116423 (14h46m13.775532272s) [upload=14159]: Got next segment. Inline: false Aug 7 04:55:05.837155838 (14h46m13.775571687s) [upload=14159]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 04:55:05.837160236 (14h46m13.775576086s) [upload=14159]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 04:55:06.073286783 (14h46m14.011702622s) [seg_pos={0 0}, upload=14159]: Begin upload segment... Aug 7 04:55:06.073338001 (14h46m14.01175389s) [seg_pos={0 0}, upload=14159]: Done begin upload segment. Aug 7 04:55:06.073380742 (14h46m14.011796651s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073390892 (14h46m14.011806741s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073867794 (14h46m14.012283643s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073885418 (14h46m14.012301267s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074211331 (14h46m14.01262718s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074520083 (14h46m14.012935922s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074805158 (14h46m14.013221017s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075051048 (14h46m14.013466897s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075279705 (14h46m14.013695554s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075364017 (14h46m14.013779866s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075645796 (14h46m14.014061645s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075834126 (14h46m14.014249975s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076062343 (14h46m14.014478192s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076228621 (14h46m14.01464447s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076500751 (14h46m14.0149166s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076692338 (14h46m14.015108187s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:07.706338803 (14h46m15.644754653s) [upload=14159]: Next returned nil segment Aug 7 04:55:07.706356186 (14h46m15.644772035s) [upload=14159]: Waiting for error group managing segments... Aug 7 04:55:08.079467986 (14h46m16.017883835s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.083077803 (14h46m16.021493662s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.086948248 (14h46m16.025364097s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.096855863 (14h46m16.035271702s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.099582620 (14h46m16.037998469s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.103264886 (14h46m16.041680735s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.112037449 (14h46m16.050453298s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.112072888 (14h46m16.050488727s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.140507229 (14h46m16.078923078s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.178535946 (14h46m16.116951795s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.181286579 (14h46m16.119702428s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.186892866 (14h46m16.125308715s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.193444219 (14h46m16.131860078s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.193468486 (14h46m16.131884335s) [seg_pos={0 0}, upload=14159]: Segment reached optimal threshold of 13 pieces. Aug 7 04:55:08.193605848 (14h46m16.132021697s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193660403 (14h46m16.132076252s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193695380 (14h46m16.132111229s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193712683 (14h46m16.132128532s) [seg_pos={0 0}, upload=14159]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 04:55:08.193822934 (14h46m16.132238783s) [upload=14159]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 04:55:08.193827452 (14h46m16.132243301s) [upload=14159]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 04:55:08.487892748 (14h46m16.426308607s) [upload=14159]: Done uploading segments... Aug 7 04:55:08.487913047 (14h46m16.426328896s) [upload=14159]: Upload finished. err: <nil> Duration: 5.769990083s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 6.383233307s FAIL (2025-08-07 05:21:50 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.38325515s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [..X..........X..........X...................................] duration: 5.76806469s FAIL (2025-08-07 05:21:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA): protocol: expected piece hash; context canceled; EOF Aug 7 04:54:42.476517671 (14h45m50.41493352s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFD6NPNAAUVIRZ5YGTKCBJPLQXPFJMN25HQT7FUNU26DPTS2F7UQ, seg_pos={0 0}, upload=14153]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Aug 7 04:54:42.476561945 (14h45m50.414977794s) [seg_pos={0 0}, upload=14153]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 04:54:42.476635777 (14h45m50.415051626s) [upload=14153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 04:54:42.476640095 (14h45m50.415055944s) [upload=14153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 04:54:42.859043030 (14h45m50.797458879s) [upload=14153]: Done uploading segments... Aug 7 04:54:42.859063249 (14h45m50.797479098s) [upload=14153]: Upload finished. err: <nil> Aug 7 04:55:05.836870332 (14h46m13.775286181s) [upload=14159]: Starting upload Aug 7 04:55:05.836926720 (14h46m13.775342569s) [upload=14159]: Done starting upload Aug 7 04:55:05.837015199 (14h46m13.775431048s) [upload=14159]: Uploading segments... Aug 7 04:55:05.837116423 (14h46m13.775532272s) [upload=14159]: Got next segment. Inline: false Aug 7 04:55:05.837155838 (14h46m13.775571687s) [upload=14159]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 04:55:05.837160236 (14h46m13.775576086s) [upload=14159]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 04:55:06.073286783 (14h46m14.011702622s) [seg_pos={0 0}, upload=14159]: Begin upload segment... Aug 7 04:55:06.073338001 (14h46m14.01175389s) [seg_pos={0 0}, upload=14159]: Done begin upload segment. Aug 7 04:55:06.073380742 (14h46m14.011796651s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073390892 (14h46m14.011806741s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073867794 (14h46m14.012283643s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.073885418 (14h46m14.012301267s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074211331 (14h46m14.01262718s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074520083 (14h46m14.012935922s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.074805158 (14h46m14.013221017s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075051048 (14h46m14.013466897s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075279705 (14h46m14.013695554s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075364017 (14h46m14.013779866s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075645796 (14h46m14.014061645s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.075834126 (14h46m14.014249975s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076062343 (14h46m14.014478192s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076228621 (14h46m14.01464447s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076500751 (14h46m14.0149166s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:06.076692338 (14h46m14.015108187s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Uploading piece... Aug 7 04:55:07.706338803 (14h46m15.644754653s) [upload=14159]: Next returned nil segment Aug 7 04:55:07.706356186 (14h46m15.644772035s) [upload=14159]: Waiting for error group managing segments... Aug 7 04:55:08.079467986 (14h46m16.017883835s) [noise=true , address=45.91.116.7:4009 , piece_id=C2MHRJ4CI4AYL74TJ4KOBIQC3FAXGG742O62MSRSMFEKGJ2JS3HA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.083077803 (14h46m16.021493662s) [noise=true , address=45.91.116.8:4045 , piece_id=ZVGXB673GLM2FMZFVJXUCTQL2S7INOLAIUBRFSEAX4ZBBWUN7H3Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.086948248 (14h46m16.025364097s) [noise=true , address=77.90.31.15:4697 , piece_id=J2KPIRWKL7B4SOZNCH2EOD5FQCR3C5JQBIIVVYWAEKRNDAE3AX4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.096855863 (14h46m16.035271702s) [noise=true , address=77.90.31.12:4592 , piece_id=C5KKUD24FGEDIJO3RTD5PAEF5GETZR2BYTDZ66ZSPZRCRLY34UCA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.099582620 (14h46m16.037998469s) [noise=true , address=45.91.116.8:4047 , piece_id=WEFN62SUQLYB7AFZSZQ66RDHX2MSEPUSKY33YPOPLQAXRZU7SHWA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.103264886 (14h46m16.041680735s) [noise=true , address=77.90.31.14:4662 , piece_id=OI2J6BBDKFJ7G2UYY3QQ74IXBPQUDBG5RYWX3ZVGMRNXBGXAY5LQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.112037449 (14h46m16.050453298s) [noise=true , address=104.36.82.13:4187 , piece_id=DEIA5S3YXGTHCCD7P2BC6KXNXZ6SALAC4NUVRNQF7RYKY3GWTZ3A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.112072888 (14h46m16.050488727s) [noise=true , address=45.91.116.10:4081 , piece_id=55YNSM2WVZBI3VO45RS6PKHH57UTGM32SSO2QNL5N2MBTV3OTJZQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.140507229 (14h46m16.078923078s) [noise=true , address=104.36.82.16:4295 , piece_id=ZPEDB2LZA6M7TXOZFLZ2MCRBHVDUZ4FMTSJVOCYSJVC7CIIJB57Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.178535946 (14h46m16.116951795s) [noise=true , address=45.91.116.11:4118 , piece_id=JCSO3RMSRG6JYFN63ZAWFKQ6GBG25QHCACMED6GF5KF2YSIPAB4Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.181286579 (14h46m16.119702428s) [noise=true , address=45.91.116.12:4225 , piece_id=A4KTBBXML6OW66FAQLEJ3PDFZHWOEY2KCJQBT6WLVOZDDWHKQCGA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.186892866 (14h46m16.125308715s) [noise=true , address=45.91.116.13:4155 , piece_id=TTIPSV6C43LMKAJVFGESR55JRF5T5HDKO4VQLQJJ7G3ENPVQMMPA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.193444219 (14h46m16.131860078s) [noise=true , address=104.36.82.12:4151 , piece_id=XPOKTPIDNSTZL2KJRMMEDFNUHNDYGXUGRRWFDJDYVMX3CLIU4EXQ, seg_pos={0 0}, upload=14159]: Done uploading piece. err: <nil> Aug 7 04:55:08.193468486 (14h46m16.131884335s) [seg_pos={0 0}, upload=14159]: Segment reached optimal threshold of 13 pieces. Aug 7 04:55:08.193605848 (14h46m16.132021697s) [noise=true , address=104.36.82.2:4732 , piece_id=D6TWGHGA5Q2VZJUWHR2JH7LKM6NJ6CCAPBI2YUJWDJJ5LTGTGX7Q, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193660403 (14h46m16.132076252s) [noise=true , address=77.90.31.14:4663 , piece_id=JMUAHCSTIKPLBNU6GBBKH5K75OSDCUJTZAXK4RBL6SGDFTSSDNMA, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193695380 (14h46m16.132111229s) [noise=true , address=104.36.82.11:4114 , piece_id=XGLX4HD6BRRZUJOJUZZE7XF32NENFHT4HMBQAIXCNTPQMKFNDZ2A, seg_pos={0 0}, upload=14159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: expected piece hash; context canceled; EOF Aug 7 04:55:08.193712683 (14h46m16.132128532s) [seg_pos={0 0}, upload=14159]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 04:55:08.193822934 (14h46m16.132238783s) [upload=14159]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 04:55:08.193827452 (14h46m16.132243301s) [upload=14159]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 04:55:08.487892748 (14h46m16.426308607s) [upload=14159]: Done uploading segments... Aug 7 04:55:08.487913047 (14h46m16.426328896s) [upload=14159]: Upload finished. err: <nil> Duration: 5.768091792s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)