Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [....X....X..................................................] duration: 1.841786767s FAIL (2025-08-07 03:40:41 UTC) orbiter warning: operation: DownloadObject uplink: object not found ("orbiter_us_0/1K") Duration: 1.841812896s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [........................X..........X........................] duration: 5.633160988s FAIL (2025-08-07 03:40:13 UTC) orbiter warning: operation: DownloadObject uplink: object not found ("orbiter_us_0/4M") Duration: 5.633184163s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 5.902744587s FAIL (2025-08-07 03:39:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== DkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:09.452864198 (13h19m17.391280047s) [noise=true , address=45.91.116.11:4118 , piece_id=ZVKDKMJL3MRTSJNHCK6KVVCBYXEFGY4QNSCAMCJFYHAYNMGVFPRQ, seg_pos={0 0}, upload=12758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:09.452874778 (13h19m17.391290627s) [seg_pos={0 0}, upload=12758]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 03:28:09.452958438 (13h19m17.391374287s) [upload=12758]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 03:28:09.452962817 (13h19m17.391378666s) [upload=12758]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 03:28:09.747228138 (13h19m17.685644027s) [upload=12758]: Done uploading segments... Aug 7 03:28:09.747250910 (13h19m17.685666779s) [upload=12758]: Upload finished. err: <nil> Aug 7 03:28:44.605684325 (13h19m52.544100174s) [upload=12768]: Starting upload Aug 7 03:28:44.605739741 (13h19m52.54415559s) [upload=12768]: Done starting upload Aug 7 03:28:44.605848990 (13h19m52.54426484s) [upload=12768]: Uploading segments... Aug 7 03:28:44.605951336 (13h19m52.544367185s) [upload=12768]: Got next segment. Inline: false Aug 7 03:28:44.605995300 (13h19m52.544411149s) [upload=12768]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 03:28:44.606000089 (13h19m52.544415938s) [upload=12768]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 03:28:44.861620101 (13h19m52.80003594s) [seg_pos={0 0}, upload=12768]: Begin upload segment... Aug 7 03:28:44.861673774 (13h19m52.800089613s) [seg_pos={0 0}, upload=12768]: Done begin upload segment. Aug 7 03:28:44.861696257 (13h19m52.800112106s) [noise=true , address=104.36.82.7:4911 , piece_id=MQEV5OGZMVK2NDQUJRRM5LBL57H7PV4NQBBFC7ENA6K3QV4G2ZFA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.861789946 (13h19m52.800205825s) [noise=true , address=45.91.116.13:4154 , piece_id=ZPGJKCFH6DY3H7PMDZP6RIUD4756OI72YR6AWXX3BDT2B5VT7WBA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862065032 (13h19m52.800480881s) [noise=true , address=45.91.116.10:4081 , piece_id=HNR4SQQNQ5NXURX5UHPBOXU4GA3JXEGYNB47TTDPJONSFT6S6QXQ, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862279713 (13h19m52.800695562s) [noise=true , address=104.36.82.8:4971 , piece_id=TITIMRNQC6XGL7V5D2FFLUKZMH7WS7ZKHQRXQO7UVPP4XZ3H7TJA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862316884 (13h19m52.800732733s) [noise=true , address=45.91.116.4:4940 , piece_id=T53PUFTY6HYKFKE2IWTFEXOEE2WB5NMSKLOY4AHPNGWEMDUANJRA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862559979 (13h19m52.800975828s) [noise=true , address=77.90.31.15:4698 , piece_id=4DVMT6PTWCEZ4ICGDCJ7ZAHP3GSEBCC3WGS3OTR2AYD2XAQAA6UQ, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862586841 (13h19m52.80100269s) [noise=true , address=77.90.31.18:4806 , piece_id=WG3WEWCPUTC3ZPCR6BRN3SKDGZZVVXYY52H2J6OF7UXDBO6HAK5A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862803405 (13h19m52.801219254s) [noise=true , address=45.91.116.9:4263 , piece_id=DTT26U5JI4EUIJZOVVVFDCPVXSLAWFCT6BFVVWFGTN63YZ3FRXLA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862906553 (13h19m52.801322402s) [noise=true , address=104.36.82.9:4006 , piece_id=PSF3N3N7RPXDCDZVLRXYFYCVOT7WXMEVHYT7JJUZUDUJDDNWJZLA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863050348 (13h19m52.801466197s) [noise=true , address=77.90.31.18:4805 , piece_id=IJA4KGDBD6KJD6NXVNI6HEXYY6MPRDZZTWUJX2CNPKBU3T75YNLA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863162232 (13h19m52.801578081s) [noise=true , address=77.90.31.10:4517 , piece_id=JROHDGYTTG57KVZ62P6PM7QXHWOS2T55BXDCMHB7C2S4YGF2E73A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863263736 (13h19m52.801679585s) [noise=true , address=45.91.116.6:4973 , piece_id=AZIPOBQLKMOYFYYNBSCYVWTXBFTO23D5M3GCR6AAO7B4JQM7ZEVA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863407952 (13h19m52.801823801s) [noise=true , address=77.90.31.18:4807 , piece_id=JBDXLQBPQHGWXGJ2Q6MGMG7MRTN3FCV2QHFTKS5XE2ONFSW7VZ6A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863462657 (13h19m52.801878506s) [noise=true , address=77.90.31.11:4555 , piece_id=7LMIE2NKIXDHXK6PSJBOOXDDMV6EDC2B6DKTT54KC2EQTOP6QRRA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863671396 (13h19m52.802087235s) [noise=true , address=104.36.82.12:4150 , piece_id=R5KDMNNWKKXP5VH4NZDDBOBLEI6QDIISOCGIZWQC3XGWZJ54HM7A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.866072811 (13h19m52.80448866s) [noise=true , address=45.91.116.14:4189 , piece_id=SV7CXDGZSOLJRNF66GMH4FAWRO6VUOUVW4GKMCN7RRSZYRPCP34A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:46.602566612 (13h19m54.540982461s) [upload=12768]: Next returned nil segment Aug 7 03:28:46.602584987 (13h19m54.541000836s) [upload=12768]: Waiting for error group managing segments... Aug 7 03:28:46.879071462 (13h19m54.817487301s) [noise=true , address=77.90.31.10:4517 , piece_id=JROHDGYTTG57KVZ62P6PM7QXHWOS2T55BXDCMHB7C2S4YGF2E73A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.892476459 (13h19m54.830892298s) [noise=true , address=45.91.116.9:4263 , piece_id=DTT26U5JI4EUIJZOVVVFDCPVXSLAWFCT6BFVVWFGTN63YZ3FRXLA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.922922511 (13h19m54.86133836s) [noise=true , address=104.36.82.12:4150 , piece_id=R5KDMNNWKKXP5VH4NZDDBOBLEI6QDIISOCGIZWQC3XGWZJ54HM7A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.941555732 (13h19m54.879971581s) [noise=true , address=45.91.116.10:4081 , piece_id=HNR4SQQNQ5NXURX5UHPBOXU4GA3JXEGYNB47TTDPJONSFT6S6QXQ, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.949205798 (13h19m54.887621647s) [noise=true , address=45.91.116.6:4973 , piece_id=AZIPOBQLKMOYFYYNBSCYVWTXBFTO23D5M3GCR6AAO7B4JQM7ZEVA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.950523069 (13h19m54.888938918s) [noise=true , address=77.90.31.18:4805 , piece_id=IJA4KGDBD6KJD6NXVNI6HEXYY6MPRDZZTWUJX2CNPKBU3T75YNLA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.979618908 (13h19m54.918034757s) [noise=true , address=45.91.116.13:4154 , piece_id=ZPGJKCFH6DY3H7PMDZP6RIUD4756OI72YR6AWXX3BDT2B5VT7WBA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.982696867 (13h19m54.921112716s) [noise=true , address=77.90.31.18:4806 , piece_id=WG3WEWCPUTC3ZPCR6BRN3SKDGZZVVXYY52H2J6OF7UXDBO6HAK5A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.996455200 (13h19m54.934871049s) [noise=true , address=104.36.82.8:4971 , piece_id=TITIMRNQC6XGL7V5D2FFLUKZMH7WS7ZKHQRXQO7UVPP4XZ3H7TJA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.998128342 (13h19m54.936544181s) [noise=true , address=45.91.116.14:4189 , piece_id=SV7CXDGZSOLJRNF66GMH4FAWRO6VUOUVW4GKMCN7RRSZYRPCP34A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.004708831 (13h19m54.94312468s) [noise=true , address=104.36.82.9:4006 , piece_id=PSF3N3N7RPXDCDZVLRXYFYCVOT7WXMEVHYT7JJUZUDUJDDNWJZLA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.007888294 (13h19m54.946304143s) [noise=true , address=104.36.82.7:4911 , piece_id=MQEV5OGZMVK2NDQUJRRM5LBL57H7PV4NQBBFC7ENA6K3QV4G2ZFA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.066682153 (13h19m55.005098002s) [noise=true , address=77.90.31.18:4807 , piece_id=JBDXLQBPQHGWXGJ2Q6MGMG7MRTN3FCV2QHFTKS5XE2ONFSW7VZ6A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.066705959 (13h19m55.005121808s) [seg_pos={0 0}, upload=12768]: Segment reached optimal threshold of 13 pieces. Aug 7 03:28:47.066812673 (13h19m55.005228522s) [noise=true , address=45.91.116.4:4940 , piece_id=T53PUFTY6HYKFKE2IWTFEXOEE2WB5NMSKLOY4AHPNGWEMDUANJRA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:47.066870153 (13h19m55.005285992s) [noise=true , address=77.90.31.11:4555 , piece_id=7LMIE2NKIXDHXK6PSJBOOXDDMV6EDC2B6DKTT54KC2EQTOP6QRRA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:47.066882947 (13h19m55.005298796s) [noise=true , address=77.90.31.15:4698 , piece_id=4DVMT6PTWCEZ4ICGDCJ7ZAHP3GSEBCC3WGS3OTR2AYD2XAQAA6UQ, seg_pos={0 0}, upload=12768]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:47.066892867 (13h19m55.005308716s) [seg_pos={0 0}, upload=12768]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 03:28:47.066966377 (13h19m55.005382226s) [upload=12768]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 03:28:47.066970666 (13h19m55.005386515s) [upload=12768]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 03:28:47.369311744 (13h19m55.307727593s) [upload=12768]: Done uploading segments... Aug 7 03:28:47.369329037 (13h19m55.307744886s) [upload=12768]: Upload finished. err: <nil> Duration: 5.902770616s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........................X..........X.......................] duration: 5.51336155s FAIL (2025-08-07 03:39:37 UTC) orbiter warning: operation: DownloadObject uplink: object not found ("orbiter_us_0/4M") Duration: 5.513387339s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [X....X....X.................................................] duration: 1.852946567s FAIL (2025-08-07 03:39:36 UTC) orbiter warning: operation: DownloadObject uplink: object not found ("orbiter_us_0/1K") Duration: 1.852973619s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 5.951208731s FAIL (2025-08-07 03:39:23 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== DkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:09.452864198 (13h19m17.391280047s) [noise=true , address=45.91.116.11:4118 , piece_id=ZVKDKMJL3MRTSJNHCK6KVVCBYXEFGY4QNSCAMCJFYHAYNMGVFPRQ, seg_pos={0 0}, upload=12758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:09.452874778 (13h19m17.391290627s) [seg_pos={0 0}, upload=12758]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 03:28:09.452958438 (13h19m17.391374287s) [upload=12758]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 03:28:09.452962817 (13h19m17.391378666s) [upload=12758]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 03:28:09.747228138 (13h19m17.685644027s) [upload=12758]: Done uploading segments... Aug 7 03:28:09.747250910 (13h19m17.685666779s) [upload=12758]: Upload finished. err: <nil> Aug 7 03:28:44.605684325 (13h19m52.544100174s) [upload=12768]: Starting upload Aug 7 03:28:44.605739741 (13h19m52.54415559s) [upload=12768]: Done starting upload Aug 7 03:28:44.605848990 (13h19m52.54426484s) [upload=12768]: Uploading segments... Aug 7 03:28:44.605951336 (13h19m52.544367185s) [upload=12768]: Got next segment. Inline: false Aug 7 03:28:44.605995300 (13h19m52.544411149s) [upload=12768]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 03:28:44.606000089 (13h19m52.544415938s) [upload=12768]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 03:28:44.861620101 (13h19m52.80003594s) [seg_pos={0 0}, upload=12768]: Begin upload segment... Aug 7 03:28:44.861673774 (13h19m52.800089613s) [seg_pos={0 0}, upload=12768]: Done begin upload segment. Aug 7 03:28:44.861696257 (13h19m52.800112106s) [noise=true , address=104.36.82.7:4911 , piece_id=MQEV5OGZMVK2NDQUJRRM5LBL57H7PV4NQBBFC7ENA6K3QV4G2ZFA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.861789946 (13h19m52.800205825s) [noise=true , address=45.91.116.13:4154 , piece_id=ZPGJKCFH6DY3H7PMDZP6RIUD4756OI72YR6AWXX3BDT2B5VT7WBA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862065032 (13h19m52.800480881s) [noise=true , address=45.91.116.10:4081 , piece_id=HNR4SQQNQ5NXURX5UHPBOXU4GA3JXEGYNB47TTDPJONSFT6S6QXQ, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862279713 (13h19m52.800695562s) [noise=true , address=104.36.82.8:4971 , piece_id=TITIMRNQC6XGL7V5D2FFLUKZMH7WS7ZKHQRXQO7UVPP4XZ3H7TJA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862316884 (13h19m52.800732733s) [noise=true , address=45.91.116.4:4940 , piece_id=T53PUFTY6HYKFKE2IWTFEXOEE2WB5NMSKLOY4AHPNGWEMDUANJRA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862559979 (13h19m52.800975828s) [noise=true , address=77.90.31.15:4698 , piece_id=4DVMT6PTWCEZ4ICGDCJ7ZAHP3GSEBCC3WGS3OTR2AYD2XAQAA6UQ, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862586841 (13h19m52.80100269s) [noise=true , address=77.90.31.18:4806 , piece_id=WG3WEWCPUTC3ZPCR6BRN3SKDGZZVVXYY52H2J6OF7UXDBO6HAK5A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862803405 (13h19m52.801219254s) [noise=true , address=45.91.116.9:4263 , piece_id=DTT26U5JI4EUIJZOVVVFDCPVXSLAWFCT6BFVVWFGTN63YZ3FRXLA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862906553 (13h19m52.801322402s) [noise=true , address=104.36.82.9:4006 , piece_id=PSF3N3N7RPXDCDZVLRXYFYCVOT7WXMEVHYT7JJUZUDUJDDNWJZLA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863050348 (13h19m52.801466197s) [noise=true , address=77.90.31.18:4805 , piece_id=IJA4KGDBD6KJD6NXVNI6HEXYY6MPRDZZTWUJX2CNPKBU3T75YNLA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863162232 (13h19m52.801578081s) [noise=true , address=77.90.31.10:4517 , piece_id=JROHDGYTTG57KVZ62P6PM7QXHWOS2T55BXDCMHB7C2S4YGF2E73A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863263736 (13h19m52.801679585s) [noise=true , address=45.91.116.6:4973 , piece_id=AZIPOBQLKMOYFYYNBSCYVWTXBFTO23D5M3GCR6AAO7B4JQM7ZEVA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863407952 (13h19m52.801823801s) [noise=true , address=77.90.31.18:4807 , piece_id=JBDXLQBPQHGWXGJ2Q6MGMG7MRTN3FCV2QHFTKS5XE2ONFSW7VZ6A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863462657 (13h19m52.801878506s) [noise=true , address=77.90.31.11:4555 , piece_id=7LMIE2NKIXDHXK6PSJBOOXDDMV6EDC2B6DKTT54KC2EQTOP6QRRA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863671396 (13h19m52.802087235s) [noise=true , address=104.36.82.12:4150 , piece_id=R5KDMNNWKKXP5VH4NZDDBOBLEI6QDIISOCGIZWQC3XGWZJ54HM7A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.866072811 (13h19m52.80448866s) [noise=true , address=45.91.116.14:4189 , piece_id=SV7CXDGZSOLJRNF66GMH4FAWRO6VUOUVW4GKMCN7RRSZYRPCP34A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:46.602566612 (13h19m54.540982461s) [upload=12768]: Next returned nil segment Aug 7 03:28:46.602584987 (13h19m54.541000836s) [upload=12768]: Waiting for error group managing segments... Aug 7 03:28:46.879071462 (13h19m54.817487301s) [noise=true , address=77.90.31.10:4517 , piece_id=JROHDGYTTG57KVZ62P6PM7QXHWOS2T55BXDCMHB7C2S4YGF2E73A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.892476459 (13h19m54.830892298s) [noise=true , address=45.91.116.9:4263 , piece_id=DTT26U5JI4EUIJZOVVVFDCPVXSLAWFCT6BFVVWFGTN63YZ3FRXLA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.922922511 (13h19m54.86133836s) [noise=true , address=104.36.82.12:4150 , piece_id=R5KDMNNWKKXP5VH4NZDDBOBLEI6QDIISOCGIZWQC3XGWZJ54HM7A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.941555732 (13h19m54.879971581s) [noise=true , address=45.91.116.10:4081 , piece_id=HNR4SQQNQ5NXURX5UHPBOXU4GA3JXEGYNB47TTDPJONSFT6S6QXQ, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.949205798 (13h19m54.887621647s) [noise=true , address=45.91.116.6:4973 , piece_id=AZIPOBQLKMOYFYYNBSCYVWTXBFTO23D5M3GCR6AAO7B4JQM7ZEVA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.950523069 (13h19m54.888938918s) [noise=true , address=77.90.31.18:4805 , piece_id=IJA4KGDBD6KJD6NXVNI6HEXYY6MPRDZZTWUJX2CNPKBU3T75YNLA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.979618908 (13h19m54.918034757s) [noise=true , address=45.91.116.13:4154 , piece_id=ZPGJKCFH6DY3H7PMDZP6RIUD4756OI72YR6AWXX3BDT2B5VT7WBA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.982696867 (13h19m54.921112716s) [noise=true , address=77.90.31.18:4806 , piece_id=WG3WEWCPUTC3ZPCR6BRN3SKDGZZVVXYY52H2J6OF7UXDBO6HAK5A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.996455200 (13h19m54.934871049s) [noise=true , address=104.36.82.8:4971 , piece_id=TITIMRNQC6XGL7V5D2FFLUKZMH7WS7ZKHQRXQO7UVPP4XZ3H7TJA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.998128342 (13h19m54.936544181s) [noise=true , address=45.91.116.14:4189 , piece_id=SV7CXDGZSOLJRNF66GMH4FAWRO6VUOUVW4GKMCN7RRSZYRPCP34A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.004708831 (13h19m54.94312468s) [noise=true , address=104.36.82.9:4006 , piece_id=PSF3N3N7RPXDCDZVLRXYFYCVOT7WXMEVHYT7JJUZUDUJDDNWJZLA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.007888294 (13h19m54.946304143s) [noise=true , address=104.36.82.7:4911 , piece_id=MQEV5OGZMVK2NDQUJRRM5LBL57H7PV4NQBBFC7ENA6K3QV4G2ZFA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.066682153 (13h19m55.005098002s) [noise=true , address=77.90.31.18:4807 , piece_id=JBDXLQBPQHGWXGJ2Q6MGMG7MRTN3FCV2QHFTKS5XE2ONFSW7VZ6A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.066705959 (13h19m55.005121808s) [seg_pos={0 0}, upload=12768]: Segment reached optimal threshold of 13 pieces. Aug 7 03:28:47.066812673 (13h19m55.005228522s) [noise=true , address=45.91.116.4:4940 , piece_id=T53PUFTY6HYKFKE2IWTFEXOEE2WB5NMSKLOY4AHPNGWEMDUANJRA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:47.066870153 (13h19m55.005285992s) [noise=true , address=77.90.31.11:4555 , piece_id=7LMIE2NKIXDHXK6PSJBOOXDDMV6EDC2B6DKTT54KC2EQTOP6QRRA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:47.066882947 (13h19m55.005298796s) [noise=true , address=77.90.31.15:4698 , piece_id=4DVMT6PTWCEZ4ICGDCJ7ZAHP3GSEBCC3WGS3OTR2AYD2XAQAA6UQ, seg_pos={0 0}, upload=12768]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:47.066892867 (13h19m55.005308716s) [seg_pos={0 0}, upload=12768]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 03:28:47.066966377 (13h19m55.005382226s) [upload=12768]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 03:28:47.066970666 (13h19m55.005386515s) [upload=12768]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 03:28:47.369311744 (13h19m55.307727593s) [upload=12768]: Done uploading segments... Aug 7 03:28:47.369329037 (13h19m55.307744886s) [upload=12768]: Upload finished. err: <nil> Duration: 5.951234031s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................X..........X......................] duration: 5.580346239s FAIL (2025-08-07 03:39:17 UTC) orbiter warning: operation: DownloadObject uplink: object not found ("orbiter_us_0/4M") Duration: 5.580375906s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 5.840338842s FAIL (2025-08-07 03:39:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== DkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:09.452864198 (13h19m17.391280047s) [noise=true , address=45.91.116.11:4118 , piece_id=ZVKDKMJL3MRTSJNHCK6KVVCBYXEFGY4QNSCAMCJFYHAYNMGVFPRQ, seg_pos={0 0}, upload=12758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:09.452874778 (13h19m17.391290627s) [seg_pos={0 0}, upload=12758]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 03:28:09.452958438 (13h19m17.391374287s) [upload=12758]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 03:28:09.452962817 (13h19m17.391378666s) [upload=12758]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 03:28:09.747228138 (13h19m17.685644027s) [upload=12758]: Done uploading segments... Aug 7 03:28:09.747250910 (13h19m17.685666779s) [upload=12758]: Upload finished. err: <nil> Aug 7 03:28:44.605684325 (13h19m52.544100174s) [upload=12768]: Starting upload Aug 7 03:28:44.605739741 (13h19m52.54415559s) [upload=12768]: Done starting upload Aug 7 03:28:44.605848990 (13h19m52.54426484s) [upload=12768]: Uploading segments... Aug 7 03:28:44.605951336 (13h19m52.544367185s) [upload=12768]: Got next segment. Inline: false Aug 7 03:28:44.605995300 (13h19m52.544411149s) [upload=12768]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 03:28:44.606000089 (13h19m52.544415938s) [upload=12768]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 03:28:44.861620101 (13h19m52.80003594s) [seg_pos={0 0}, upload=12768]: Begin upload segment... Aug 7 03:28:44.861673774 (13h19m52.800089613s) [seg_pos={0 0}, upload=12768]: Done begin upload segment. Aug 7 03:28:44.861696257 (13h19m52.800112106s) [noise=true , address=104.36.82.7:4911 , piece_id=MQEV5OGZMVK2NDQUJRRM5LBL57H7PV4NQBBFC7ENA6K3QV4G2ZFA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.861789946 (13h19m52.800205825s) [noise=true , address=45.91.116.13:4154 , piece_id=ZPGJKCFH6DY3H7PMDZP6RIUD4756OI72YR6AWXX3BDT2B5VT7WBA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862065032 (13h19m52.800480881s) [noise=true , address=45.91.116.10:4081 , piece_id=HNR4SQQNQ5NXURX5UHPBOXU4GA3JXEGYNB47TTDPJONSFT6S6QXQ, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862279713 (13h19m52.800695562s) [noise=true , address=104.36.82.8:4971 , piece_id=TITIMRNQC6XGL7V5D2FFLUKZMH7WS7ZKHQRXQO7UVPP4XZ3H7TJA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862316884 (13h19m52.800732733s) [noise=true , address=45.91.116.4:4940 , piece_id=T53PUFTY6HYKFKE2IWTFEXOEE2WB5NMSKLOY4AHPNGWEMDUANJRA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862559979 (13h19m52.800975828s) [noise=true , address=77.90.31.15:4698 , piece_id=4DVMT6PTWCEZ4ICGDCJ7ZAHP3GSEBCC3WGS3OTR2AYD2XAQAA6UQ, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862586841 (13h19m52.80100269s) [noise=true , address=77.90.31.18:4806 , piece_id=WG3WEWCPUTC3ZPCR6BRN3SKDGZZVVXYY52H2J6OF7UXDBO6HAK5A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862803405 (13h19m52.801219254s) [noise=true , address=45.91.116.9:4263 , piece_id=DTT26U5JI4EUIJZOVVVFDCPVXSLAWFCT6BFVVWFGTN63YZ3FRXLA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862906553 (13h19m52.801322402s) [noise=true , address=104.36.82.9:4006 , piece_id=PSF3N3N7RPXDCDZVLRXYFYCVOT7WXMEVHYT7JJUZUDUJDDNWJZLA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863050348 (13h19m52.801466197s) [noise=true , address=77.90.31.18:4805 , piece_id=IJA4KGDBD6KJD6NXVNI6HEXYY6MPRDZZTWUJX2CNPKBU3T75YNLA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863162232 (13h19m52.801578081s) [noise=true , address=77.90.31.10:4517 , piece_id=JROHDGYTTG57KVZ62P6PM7QXHWOS2T55BXDCMHB7C2S4YGF2E73A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863263736 (13h19m52.801679585s) [noise=true , address=45.91.116.6:4973 , piece_id=AZIPOBQLKMOYFYYNBSCYVWTXBFTO23D5M3GCR6AAO7B4JQM7ZEVA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863407952 (13h19m52.801823801s) [noise=true , address=77.90.31.18:4807 , piece_id=JBDXLQBPQHGWXGJ2Q6MGMG7MRTN3FCV2QHFTKS5XE2ONFSW7VZ6A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863462657 (13h19m52.801878506s) [noise=true , address=77.90.31.11:4555 , piece_id=7LMIE2NKIXDHXK6PSJBOOXDDMV6EDC2B6DKTT54KC2EQTOP6QRRA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863671396 (13h19m52.802087235s) [noise=true , address=104.36.82.12:4150 , piece_id=R5KDMNNWKKXP5VH4NZDDBOBLEI6QDIISOCGIZWQC3XGWZJ54HM7A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.866072811 (13h19m52.80448866s) [noise=true , address=45.91.116.14:4189 , piece_id=SV7CXDGZSOLJRNF66GMH4FAWRO6VUOUVW4GKMCN7RRSZYRPCP34A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:46.602566612 (13h19m54.540982461s) [upload=12768]: Next returned nil segment Aug 7 03:28:46.602584987 (13h19m54.541000836s) [upload=12768]: Waiting for error group managing segments... Aug 7 03:28:46.879071462 (13h19m54.817487301s) [noise=true , address=77.90.31.10:4517 , piece_id=JROHDGYTTG57KVZ62P6PM7QXHWOS2T55BXDCMHB7C2S4YGF2E73A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.892476459 (13h19m54.830892298s) [noise=true , address=45.91.116.9:4263 , piece_id=DTT26U5JI4EUIJZOVVVFDCPVXSLAWFCT6BFVVWFGTN63YZ3FRXLA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.922922511 (13h19m54.86133836s) [noise=true , address=104.36.82.12:4150 , piece_id=R5KDMNNWKKXP5VH4NZDDBOBLEI6QDIISOCGIZWQC3XGWZJ54HM7A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.941555732 (13h19m54.879971581s) [noise=true , address=45.91.116.10:4081 , piece_id=HNR4SQQNQ5NXURX5UHPBOXU4GA3JXEGYNB47TTDPJONSFT6S6QXQ, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.949205798 (13h19m54.887621647s) [noise=true , address=45.91.116.6:4973 , piece_id=AZIPOBQLKMOYFYYNBSCYVWTXBFTO23D5M3GCR6AAO7B4JQM7ZEVA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.950523069 (13h19m54.888938918s) [noise=true , address=77.90.31.18:4805 , piece_id=IJA4KGDBD6KJD6NXVNI6HEXYY6MPRDZZTWUJX2CNPKBU3T75YNLA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.979618908 (13h19m54.918034757s) [noise=true , address=45.91.116.13:4154 , piece_id=ZPGJKCFH6DY3H7PMDZP6RIUD4756OI72YR6AWXX3BDT2B5VT7WBA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.982696867 (13h19m54.921112716s) [noise=true , address=77.90.31.18:4806 , piece_id=WG3WEWCPUTC3ZPCR6BRN3SKDGZZVVXYY52H2J6OF7UXDBO6HAK5A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.996455200 (13h19m54.934871049s) [noise=true , address=104.36.82.8:4971 , piece_id=TITIMRNQC6XGL7V5D2FFLUKZMH7WS7ZKHQRXQO7UVPP4XZ3H7TJA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.998128342 (13h19m54.936544181s) [noise=true , address=45.91.116.14:4189 , piece_id=SV7CXDGZSOLJRNF66GMH4FAWRO6VUOUVW4GKMCN7RRSZYRPCP34A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.004708831 (13h19m54.94312468s) [noise=true , address=104.36.82.9:4006 , piece_id=PSF3N3N7RPXDCDZVLRXYFYCVOT7WXMEVHYT7JJUZUDUJDDNWJZLA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.007888294 (13h19m54.946304143s) [noise=true , address=104.36.82.7:4911 , piece_id=MQEV5OGZMVK2NDQUJRRM5LBL57H7PV4NQBBFC7ENA6K3QV4G2ZFA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.066682153 (13h19m55.005098002s) [noise=true , address=77.90.31.18:4807 , piece_id=JBDXLQBPQHGWXGJ2Q6MGMG7MRTN3FCV2QHFTKS5XE2ONFSW7VZ6A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.066705959 (13h19m55.005121808s) [seg_pos={0 0}, upload=12768]: Segment reached optimal threshold of 13 pieces. Aug 7 03:28:47.066812673 (13h19m55.005228522s) [noise=true , address=45.91.116.4:4940 , piece_id=T53PUFTY6HYKFKE2IWTFEXOEE2WB5NMSKLOY4AHPNGWEMDUANJRA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:47.066870153 (13h19m55.005285992s) [noise=true , address=77.90.31.11:4555 , piece_id=7LMIE2NKIXDHXK6PSJBOOXDDMV6EDC2B6DKTT54KC2EQTOP6QRRA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:47.066882947 (13h19m55.005298796s) [noise=true , address=77.90.31.15:4698 , piece_id=4DVMT6PTWCEZ4ICGDCJ7ZAHP3GSEBCC3WGS3OTR2AYD2XAQAA6UQ, seg_pos={0 0}, upload=12768]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:47.066892867 (13h19m55.005308716s) [seg_pos={0 0}, upload=12768]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 03:28:47.066966377 (13h19m55.005382226s) [upload=12768]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 03:28:47.066970666 (13h19m55.005386515s) [upload=12768]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 03:28:47.369311744 (13h19m55.307727593s) [upload=12768]: Done uploading segments... Aug 7 03:28:47.369329037 (13h19m55.307744886s) [upload=12768]: Upload finished. err: <nil> Duration: 5.840368618s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.X....X....X................................................] duration: 1.817749576s FAIL (2025-08-07 03:38:53 UTC) orbiter warning: operation: DownloadObject uplink: object not found ("orbiter_us_0/1K") Duration: 1.817780415s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........................X..........X.....................] duration: 5.752970556s FAIL (2025-08-07 03:38:13 UTC) orbiter warning: operation: DownloadObject uplink: object not found ("orbiter_us_0/4M") Duration: 5.752996335s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 14.362726384s FAIL (2025-08-07 03:38:07 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== DkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:09.452864198 (13h19m17.391280047s) [noise=true , address=45.91.116.11:4118 , piece_id=ZVKDKMJL3MRTSJNHCK6KVVCBYXEFGY4QNSCAMCJFYHAYNMGVFPRQ, seg_pos={0 0}, upload=12758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:09.452874778 (13h19m17.391290627s) [seg_pos={0 0}, upload=12758]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 03:28:09.452958438 (13h19m17.391374287s) [upload=12758]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 03:28:09.452962817 (13h19m17.391378666s) [upload=12758]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 03:28:09.747228138 (13h19m17.685644027s) [upload=12758]: Done uploading segments... Aug 7 03:28:09.747250910 (13h19m17.685666779s) [upload=12758]: Upload finished. err: <nil> Aug 7 03:28:44.605684325 (13h19m52.544100174s) [upload=12768]: Starting upload Aug 7 03:28:44.605739741 (13h19m52.54415559s) [upload=12768]: Done starting upload Aug 7 03:28:44.605848990 (13h19m52.54426484s) [upload=12768]: Uploading segments... Aug 7 03:28:44.605951336 (13h19m52.544367185s) [upload=12768]: Got next segment. Inline: false Aug 7 03:28:44.605995300 (13h19m52.544411149s) [upload=12768]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 03:28:44.606000089 (13h19m52.544415938s) [upload=12768]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 03:28:44.861620101 (13h19m52.80003594s) [seg_pos={0 0}, upload=12768]: Begin upload segment... Aug 7 03:28:44.861673774 (13h19m52.800089613s) [seg_pos={0 0}, upload=12768]: Done begin upload segment. Aug 7 03:28:44.861696257 (13h19m52.800112106s) [noise=true , address=104.36.82.7:4911 , piece_id=MQEV5OGZMVK2NDQUJRRM5LBL57H7PV4NQBBFC7ENA6K3QV4G2ZFA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.861789946 (13h19m52.800205825s) [noise=true , address=45.91.116.13:4154 , piece_id=ZPGJKCFH6DY3H7PMDZP6RIUD4756OI72YR6AWXX3BDT2B5VT7WBA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862065032 (13h19m52.800480881s) [noise=true , address=45.91.116.10:4081 , piece_id=HNR4SQQNQ5NXURX5UHPBOXU4GA3JXEGYNB47TTDPJONSFT6S6QXQ, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862279713 (13h19m52.800695562s) [noise=true , address=104.36.82.8:4971 , piece_id=TITIMRNQC6XGL7V5D2FFLUKZMH7WS7ZKHQRXQO7UVPP4XZ3H7TJA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862316884 (13h19m52.800732733s) [noise=true , address=45.91.116.4:4940 , piece_id=T53PUFTY6HYKFKE2IWTFEXOEE2WB5NMSKLOY4AHPNGWEMDUANJRA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862559979 (13h19m52.800975828s) [noise=true , address=77.90.31.15:4698 , piece_id=4DVMT6PTWCEZ4ICGDCJ7ZAHP3GSEBCC3WGS3OTR2AYD2XAQAA6UQ, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862586841 (13h19m52.80100269s) [noise=true , address=77.90.31.18:4806 , piece_id=WG3WEWCPUTC3ZPCR6BRN3SKDGZZVVXYY52H2J6OF7UXDBO6HAK5A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862803405 (13h19m52.801219254s) [noise=true , address=45.91.116.9:4263 , piece_id=DTT26U5JI4EUIJZOVVVFDCPVXSLAWFCT6BFVVWFGTN63YZ3FRXLA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862906553 (13h19m52.801322402s) [noise=true , address=104.36.82.9:4006 , piece_id=PSF3N3N7RPXDCDZVLRXYFYCVOT7WXMEVHYT7JJUZUDUJDDNWJZLA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863050348 (13h19m52.801466197s) [noise=true , address=77.90.31.18:4805 , piece_id=IJA4KGDBD6KJD6NXVNI6HEXYY6MPRDZZTWUJX2CNPKBU3T75YNLA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863162232 (13h19m52.801578081s) [noise=true , address=77.90.31.10:4517 , piece_id=JROHDGYTTG57KVZ62P6PM7QXHWOS2T55BXDCMHB7C2S4YGF2E73A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863263736 (13h19m52.801679585s) [noise=true , address=45.91.116.6:4973 , piece_id=AZIPOBQLKMOYFYYNBSCYVWTXBFTO23D5M3GCR6AAO7B4JQM7ZEVA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863407952 (13h19m52.801823801s) [noise=true , address=77.90.31.18:4807 , piece_id=JBDXLQBPQHGWXGJ2Q6MGMG7MRTN3FCV2QHFTKS5XE2ONFSW7VZ6A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863462657 (13h19m52.801878506s) [noise=true , address=77.90.31.11:4555 , piece_id=7LMIE2NKIXDHXK6PSJBOOXDDMV6EDC2B6DKTT54KC2EQTOP6QRRA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863671396 (13h19m52.802087235s) [noise=true , address=104.36.82.12:4150 , piece_id=R5KDMNNWKKXP5VH4NZDDBOBLEI6QDIISOCGIZWQC3XGWZJ54HM7A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.866072811 (13h19m52.80448866s) [noise=true , address=45.91.116.14:4189 , piece_id=SV7CXDGZSOLJRNF66GMH4FAWRO6VUOUVW4GKMCN7RRSZYRPCP34A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:46.602566612 (13h19m54.540982461s) [upload=12768]: Next returned nil segment Aug 7 03:28:46.602584987 (13h19m54.541000836s) [upload=12768]: Waiting for error group managing segments... Aug 7 03:28:46.879071462 (13h19m54.817487301s) [noise=true , address=77.90.31.10:4517 , piece_id=JROHDGYTTG57KVZ62P6PM7QXHWOS2T55BXDCMHB7C2S4YGF2E73A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.892476459 (13h19m54.830892298s) [noise=true , address=45.91.116.9:4263 , piece_id=DTT26U5JI4EUIJZOVVVFDCPVXSLAWFCT6BFVVWFGTN63YZ3FRXLA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.922922511 (13h19m54.86133836s) [noise=true , address=104.36.82.12:4150 , piece_id=R5KDMNNWKKXP5VH4NZDDBOBLEI6QDIISOCGIZWQC3XGWZJ54HM7A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.941555732 (13h19m54.879971581s) [noise=true , address=45.91.116.10:4081 , piece_id=HNR4SQQNQ5NXURX5UHPBOXU4GA3JXEGYNB47TTDPJONSFT6S6QXQ, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.949205798 (13h19m54.887621647s) [noise=true , address=45.91.116.6:4973 , piece_id=AZIPOBQLKMOYFYYNBSCYVWTXBFTO23D5M3GCR6AAO7B4JQM7ZEVA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.950523069 (13h19m54.888938918s) [noise=true , address=77.90.31.18:4805 , piece_id=IJA4KGDBD6KJD6NXVNI6HEXYY6MPRDZZTWUJX2CNPKBU3T75YNLA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.979618908 (13h19m54.918034757s) [noise=true , address=45.91.116.13:4154 , piece_id=ZPGJKCFH6DY3H7PMDZP6RIUD4756OI72YR6AWXX3BDT2B5VT7WBA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.982696867 (13h19m54.921112716s) [noise=true , address=77.90.31.18:4806 , piece_id=WG3WEWCPUTC3ZPCR6BRN3SKDGZZVVXYY52H2J6OF7UXDBO6HAK5A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.996455200 (13h19m54.934871049s) [noise=true , address=104.36.82.8:4971 , piece_id=TITIMRNQC6XGL7V5D2FFLUKZMH7WS7ZKHQRXQO7UVPP4XZ3H7TJA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.998128342 (13h19m54.936544181s) [noise=true , address=45.91.116.14:4189 , piece_id=SV7CXDGZSOLJRNF66GMH4FAWRO6VUOUVW4GKMCN7RRSZYRPCP34A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.004708831 (13h19m54.94312468s) [noise=true , address=104.36.82.9:4006 , piece_id=PSF3N3N7RPXDCDZVLRXYFYCVOT7WXMEVHYT7JJUZUDUJDDNWJZLA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.007888294 (13h19m54.946304143s) [noise=true , address=104.36.82.7:4911 , piece_id=MQEV5OGZMVK2NDQUJRRM5LBL57H7PV4NQBBFC7ENA6K3QV4G2ZFA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.066682153 (13h19m55.005098002s) [noise=true , address=77.90.31.18:4807 , piece_id=JBDXLQBPQHGWXGJ2Q6MGMG7MRTN3FCV2QHFTKS5XE2ONFSW7VZ6A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.066705959 (13h19m55.005121808s) [seg_pos={0 0}, upload=12768]: Segment reached optimal threshold of 13 pieces. Aug 7 03:28:47.066812673 (13h19m55.005228522s) [noise=true , address=45.91.116.4:4940 , piece_id=T53PUFTY6HYKFKE2IWTFEXOEE2WB5NMSKLOY4AHPNGWEMDUANJRA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:47.066870153 (13h19m55.005285992s) [noise=true , address=77.90.31.11:4555 , piece_id=7LMIE2NKIXDHXK6PSJBOOXDDMV6EDC2B6DKTT54KC2EQTOP6QRRA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:47.066882947 (13h19m55.005298796s) [noise=true , address=77.90.31.15:4698 , piece_id=4DVMT6PTWCEZ4ICGDCJ7ZAHP3GSEBCC3WGS3OTR2AYD2XAQAA6UQ, seg_pos={0 0}, upload=12768]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:47.066892867 (13h19m55.005308716s) [seg_pos={0 0}, upload=12768]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 03:28:47.066966377 (13h19m55.005382226s) [upload=12768]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 03:28:47.066970666 (13h19m55.005386515s) [upload=12768]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 03:28:47.369311744 (13h19m55.307727593s) [upload=12768]: Done uploading segments... Aug 7 03:28:47.369329037 (13h19m55.307744886s) [upload=12768]: Upload finished. err: <nil> Duration: 14.36275027s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..X....X....X...............................................] duration: 2.044758106s FAIL (2025-08-07 03:37:53 UTC) orbiter warning: operation: DownloadObject uplink: object not found ("orbiter_us_0/1K") Duration: 2.044782113s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 5.782841056s FAIL (2025-08-07 03:37:32 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== DkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:09.452864198 (13h19m17.391280047s) [noise=true , address=45.91.116.11:4118 , piece_id=ZVKDKMJL3MRTSJNHCK6KVVCBYXEFGY4QNSCAMCJFYHAYNMGVFPRQ, seg_pos={0 0}, upload=12758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:09.452874778 (13h19m17.391290627s) [seg_pos={0 0}, upload=12758]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 03:28:09.452958438 (13h19m17.391374287s) [upload=12758]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 03:28:09.452962817 (13h19m17.391378666s) [upload=12758]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 03:28:09.747228138 (13h19m17.685644027s) [upload=12758]: Done uploading segments... Aug 7 03:28:09.747250910 (13h19m17.685666779s) [upload=12758]: Upload finished. err: <nil> Aug 7 03:28:44.605684325 (13h19m52.544100174s) [upload=12768]: Starting upload Aug 7 03:28:44.605739741 (13h19m52.54415559s) [upload=12768]: Done starting upload Aug 7 03:28:44.605848990 (13h19m52.54426484s) [upload=12768]: Uploading segments... Aug 7 03:28:44.605951336 (13h19m52.544367185s) [upload=12768]: Got next segment. Inline: false Aug 7 03:28:44.605995300 (13h19m52.544411149s) [upload=12768]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 03:28:44.606000089 (13h19m52.544415938s) [upload=12768]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 03:28:44.861620101 (13h19m52.80003594s) [seg_pos={0 0}, upload=12768]: Begin upload segment... Aug 7 03:28:44.861673774 (13h19m52.800089613s) [seg_pos={0 0}, upload=12768]: Done begin upload segment. Aug 7 03:28:44.861696257 (13h19m52.800112106s) [noise=true , address=104.36.82.7:4911 , piece_id=MQEV5OGZMVK2NDQUJRRM5LBL57H7PV4NQBBFC7ENA6K3QV4G2ZFA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.861789946 (13h19m52.800205825s) [noise=true , address=45.91.116.13:4154 , piece_id=ZPGJKCFH6DY3H7PMDZP6RIUD4756OI72YR6AWXX3BDT2B5VT7WBA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862065032 (13h19m52.800480881s) [noise=true , address=45.91.116.10:4081 , piece_id=HNR4SQQNQ5NXURX5UHPBOXU4GA3JXEGYNB47TTDPJONSFT6S6QXQ, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862279713 (13h19m52.800695562s) [noise=true , address=104.36.82.8:4971 , piece_id=TITIMRNQC6XGL7V5D2FFLUKZMH7WS7ZKHQRXQO7UVPP4XZ3H7TJA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862316884 (13h19m52.800732733s) [noise=true , address=45.91.116.4:4940 , piece_id=T53PUFTY6HYKFKE2IWTFEXOEE2WB5NMSKLOY4AHPNGWEMDUANJRA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862559979 (13h19m52.800975828s) [noise=true , address=77.90.31.15:4698 , piece_id=4DVMT6PTWCEZ4ICGDCJ7ZAHP3GSEBCC3WGS3OTR2AYD2XAQAA6UQ, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862586841 (13h19m52.80100269s) [noise=true , address=77.90.31.18:4806 , piece_id=WG3WEWCPUTC3ZPCR6BRN3SKDGZZVVXYY52H2J6OF7UXDBO6HAK5A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862803405 (13h19m52.801219254s) [noise=true , address=45.91.116.9:4263 , piece_id=DTT26U5JI4EUIJZOVVVFDCPVXSLAWFCT6BFVVWFGTN63YZ3FRXLA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862906553 (13h19m52.801322402s) [noise=true , address=104.36.82.9:4006 , piece_id=PSF3N3N7RPXDCDZVLRXYFYCVOT7WXMEVHYT7JJUZUDUJDDNWJZLA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863050348 (13h19m52.801466197s) [noise=true , address=77.90.31.18:4805 , piece_id=IJA4KGDBD6KJD6NXVNI6HEXYY6MPRDZZTWUJX2CNPKBU3T75YNLA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863162232 (13h19m52.801578081s) [noise=true , address=77.90.31.10:4517 , piece_id=JROHDGYTTG57KVZ62P6PM7QXHWOS2T55BXDCMHB7C2S4YGF2E73A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863263736 (13h19m52.801679585s) [noise=true , address=45.91.116.6:4973 , piece_id=AZIPOBQLKMOYFYYNBSCYVWTXBFTO23D5M3GCR6AAO7B4JQM7ZEVA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863407952 (13h19m52.801823801s) [noise=true , address=77.90.31.18:4807 , piece_id=JBDXLQBPQHGWXGJ2Q6MGMG7MRTN3FCV2QHFTKS5XE2ONFSW7VZ6A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863462657 (13h19m52.801878506s) [noise=true , address=77.90.31.11:4555 , piece_id=7LMIE2NKIXDHXK6PSJBOOXDDMV6EDC2B6DKTT54KC2EQTOP6QRRA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863671396 (13h19m52.802087235s) [noise=true , address=104.36.82.12:4150 , piece_id=R5KDMNNWKKXP5VH4NZDDBOBLEI6QDIISOCGIZWQC3XGWZJ54HM7A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.866072811 (13h19m52.80448866s) [noise=true , address=45.91.116.14:4189 , piece_id=SV7CXDGZSOLJRNF66GMH4FAWRO6VUOUVW4GKMCN7RRSZYRPCP34A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:46.602566612 (13h19m54.540982461s) [upload=12768]: Next returned nil segment Aug 7 03:28:46.602584987 (13h19m54.541000836s) [upload=12768]: Waiting for error group managing segments... Aug 7 03:28:46.879071462 (13h19m54.817487301s) [noise=true , address=77.90.31.10:4517 , piece_id=JROHDGYTTG57KVZ62P6PM7QXHWOS2T55BXDCMHB7C2S4YGF2E73A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.892476459 (13h19m54.830892298s) [noise=true , address=45.91.116.9:4263 , piece_id=DTT26U5JI4EUIJZOVVVFDCPVXSLAWFCT6BFVVWFGTN63YZ3FRXLA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.922922511 (13h19m54.86133836s) [noise=true , address=104.36.82.12:4150 , piece_id=R5KDMNNWKKXP5VH4NZDDBOBLEI6QDIISOCGIZWQC3XGWZJ54HM7A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.941555732 (13h19m54.879971581s) [noise=true , address=45.91.116.10:4081 , piece_id=HNR4SQQNQ5NXURX5UHPBOXU4GA3JXEGYNB47TTDPJONSFT6S6QXQ, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.949205798 (13h19m54.887621647s) [noise=true , address=45.91.116.6:4973 , piece_id=AZIPOBQLKMOYFYYNBSCYVWTXBFTO23D5M3GCR6AAO7B4JQM7ZEVA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.950523069 (13h19m54.888938918s) [noise=true , address=77.90.31.18:4805 , piece_id=IJA4KGDBD6KJD6NXVNI6HEXYY6MPRDZZTWUJX2CNPKBU3T75YNLA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.979618908 (13h19m54.918034757s) [noise=true , address=45.91.116.13:4154 , piece_id=ZPGJKCFH6DY3H7PMDZP6RIUD4756OI72YR6AWXX3BDT2B5VT7WBA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.982696867 (13h19m54.921112716s) [noise=true , address=77.90.31.18:4806 , piece_id=WG3WEWCPUTC3ZPCR6BRN3SKDGZZVVXYY52H2J6OF7UXDBO6HAK5A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.996455200 (13h19m54.934871049s) [noise=true , address=104.36.82.8:4971 , piece_id=TITIMRNQC6XGL7V5D2FFLUKZMH7WS7ZKHQRXQO7UVPP4XZ3H7TJA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.998128342 (13h19m54.936544181s) [noise=true , address=45.91.116.14:4189 , piece_id=SV7CXDGZSOLJRNF66GMH4FAWRO6VUOUVW4GKMCN7RRSZYRPCP34A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.004708831 (13h19m54.94312468s) [noise=true , address=104.36.82.9:4006 , piece_id=PSF3N3N7RPXDCDZVLRXYFYCVOT7WXMEVHYT7JJUZUDUJDDNWJZLA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.007888294 (13h19m54.946304143s) [noise=true , address=104.36.82.7:4911 , piece_id=MQEV5OGZMVK2NDQUJRRM5LBL57H7PV4NQBBFC7ENA6K3QV4G2ZFA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.066682153 (13h19m55.005098002s) [noise=true , address=77.90.31.18:4807 , piece_id=JBDXLQBPQHGWXGJ2Q6MGMG7MRTN3FCV2QHFTKS5XE2ONFSW7VZ6A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.066705959 (13h19m55.005121808s) [seg_pos={0 0}, upload=12768]: Segment reached optimal threshold of 13 pieces. Aug 7 03:28:47.066812673 (13h19m55.005228522s) [noise=true , address=45.91.116.4:4940 , piece_id=T53PUFTY6HYKFKE2IWTFEXOEE2WB5NMSKLOY4AHPNGWEMDUANJRA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:47.066870153 (13h19m55.005285992s) [noise=true , address=77.90.31.11:4555 , piece_id=7LMIE2NKIXDHXK6PSJBOOXDDMV6EDC2B6DKTT54KC2EQTOP6QRRA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:47.066882947 (13h19m55.005298796s) [noise=true , address=77.90.31.15:4698 , piece_id=4DVMT6PTWCEZ4ICGDCJ7ZAHP3GSEBCC3WGS3OTR2AYD2XAQAA6UQ, seg_pos={0 0}, upload=12768]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:47.066892867 (13h19m55.005308716s) [seg_pos={0 0}, upload=12768]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 03:28:47.066966377 (13h19m55.005382226s) [upload=12768]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 03:28:47.066970666 (13h19m55.005386515s) [upload=12768]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 03:28:47.369311744 (13h19m55.307727593s) [upload=12768]: Done uploading segments... Aug 7 03:28:47.369329037 (13h19m55.307744886s) [upload=12768]: Upload finished. err: <nil> Duration: 5.782870844s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [............................X..........X....................] duration: 5.562211033s FAIL (2025-08-07 03:37:06 UTC) orbiter warning: operation: DownloadObject uplink: object not found ("orbiter_us_0/4M") Duration: 5.562234678s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...X....X....X..............................................] duration: 1.849327864s FAIL (2025-08-07 03:36:48 UTC) orbiter warning: operation: DownloadObject uplink: object not found ("orbiter_us_0/1K") Duration: 1.849354987s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............................X..........X...................] duration: 5.631939109s FAIL (2025-08-07 03:36:45 UTC) orbiter warning: operation: DownloadObject uplink: object not found ("orbiter_us_0/4M") Duration: 5.631961152s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 6.191079638s FAIL (2025-08-07 03:36:25 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== DkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:09.452864198 (13h19m17.391280047s) [noise=true , address=45.91.116.11:4118 , piece_id=ZVKDKMJL3MRTSJNHCK6KVVCBYXEFGY4QNSCAMCJFYHAYNMGVFPRQ, seg_pos={0 0}, upload=12758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:09.452874778 (13h19m17.391290627s) [seg_pos={0 0}, upload=12758]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 03:28:09.452958438 (13h19m17.391374287s) [upload=12758]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 03:28:09.452962817 (13h19m17.391378666s) [upload=12758]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 03:28:09.747228138 (13h19m17.685644027s) [upload=12758]: Done uploading segments... Aug 7 03:28:09.747250910 (13h19m17.685666779s) [upload=12758]: Upload finished. err: <nil> Aug 7 03:28:44.605684325 (13h19m52.544100174s) [upload=12768]: Starting upload Aug 7 03:28:44.605739741 (13h19m52.54415559s) [upload=12768]: Done starting upload Aug 7 03:28:44.605848990 (13h19m52.54426484s) [upload=12768]: Uploading segments... Aug 7 03:28:44.605951336 (13h19m52.544367185s) [upload=12768]: Got next segment. Inline: false Aug 7 03:28:44.605995300 (13h19m52.544411149s) [upload=12768]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 03:28:44.606000089 (13h19m52.544415938s) [upload=12768]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 03:28:44.861620101 (13h19m52.80003594s) [seg_pos={0 0}, upload=12768]: Begin upload segment... Aug 7 03:28:44.861673774 (13h19m52.800089613s) [seg_pos={0 0}, upload=12768]: Done begin upload segment. Aug 7 03:28:44.861696257 (13h19m52.800112106s) [noise=true , address=104.36.82.7:4911 , piece_id=MQEV5OGZMVK2NDQUJRRM5LBL57H7PV4NQBBFC7ENA6K3QV4G2ZFA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.861789946 (13h19m52.800205825s) [noise=true , address=45.91.116.13:4154 , piece_id=ZPGJKCFH6DY3H7PMDZP6RIUD4756OI72YR6AWXX3BDT2B5VT7WBA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862065032 (13h19m52.800480881s) [noise=true , address=45.91.116.10:4081 , piece_id=HNR4SQQNQ5NXURX5UHPBOXU4GA3JXEGYNB47TTDPJONSFT6S6QXQ, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862279713 (13h19m52.800695562s) [noise=true , address=104.36.82.8:4971 , piece_id=TITIMRNQC6XGL7V5D2FFLUKZMH7WS7ZKHQRXQO7UVPP4XZ3H7TJA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862316884 (13h19m52.800732733s) [noise=true , address=45.91.116.4:4940 , piece_id=T53PUFTY6HYKFKE2IWTFEXOEE2WB5NMSKLOY4AHPNGWEMDUANJRA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862559979 (13h19m52.800975828s) [noise=true , address=77.90.31.15:4698 , piece_id=4DVMT6PTWCEZ4ICGDCJ7ZAHP3GSEBCC3WGS3OTR2AYD2XAQAA6UQ, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862586841 (13h19m52.80100269s) [noise=true , address=77.90.31.18:4806 , piece_id=WG3WEWCPUTC3ZPCR6BRN3SKDGZZVVXYY52H2J6OF7UXDBO6HAK5A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862803405 (13h19m52.801219254s) [noise=true , address=45.91.116.9:4263 , piece_id=DTT26U5JI4EUIJZOVVVFDCPVXSLAWFCT6BFVVWFGTN63YZ3FRXLA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862906553 (13h19m52.801322402s) [noise=true , address=104.36.82.9:4006 , piece_id=PSF3N3N7RPXDCDZVLRXYFYCVOT7WXMEVHYT7JJUZUDUJDDNWJZLA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863050348 (13h19m52.801466197s) [noise=true , address=77.90.31.18:4805 , piece_id=IJA4KGDBD6KJD6NXVNI6HEXYY6MPRDZZTWUJX2CNPKBU3T75YNLA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863162232 (13h19m52.801578081s) [noise=true , address=77.90.31.10:4517 , piece_id=JROHDGYTTG57KVZ62P6PM7QXHWOS2T55BXDCMHB7C2S4YGF2E73A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863263736 (13h19m52.801679585s) [noise=true , address=45.91.116.6:4973 , piece_id=AZIPOBQLKMOYFYYNBSCYVWTXBFTO23D5M3GCR6AAO7B4JQM7ZEVA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863407952 (13h19m52.801823801s) [noise=true , address=77.90.31.18:4807 , piece_id=JBDXLQBPQHGWXGJ2Q6MGMG7MRTN3FCV2QHFTKS5XE2ONFSW7VZ6A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863462657 (13h19m52.801878506s) [noise=true , address=77.90.31.11:4555 , piece_id=7LMIE2NKIXDHXK6PSJBOOXDDMV6EDC2B6DKTT54KC2EQTOP6QRRA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863671396 (13h19m52.802087235s) [noise=true , address=104.36.82.12:4150 , piece_id=R5KDMNNWKKXP5VH4NZDDBOBLEI6QDIISOCGIZWQC3XGWZJ54HM7A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.866072811 (13h19m52.80448866s) [noise=true , address=45.91.116.14:4189 , piece_id=SV7CXDGZSOLJRNF66GMH4FAWRO6VUOUVW4GKMCN7RRSZYRPCP34A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:46.602566612 (13h19m54.540982461s) [upload=12768]: Next returned nil segment Aug 7 03:28:46.602584987 (13h19m54.541000836s) [upload=12768]: Waiting for error group managing segments... Aug 7 03:28:46.879071462 (13h19m54.817487301s) [noise=true , address=77.90.31.10:4517 , piece_id=JROHDGYTTG57KVZ62P6PM7QXHWOS2T55BXDCMHB7C2S4YGF2E73A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.892476459 (13h19m54.830892298s) [noise=true , address=45.91.116.9:4263 , piece_id=DTT26U5JI4EUIJZOVVVFDCPVXSLAWFCT6BFVVWFGTN63YZ3FRXLA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.922922511 (13h19m54.86133836s) [noise=true , address=104.36.82.12:4150 , piece_id=R5KDMNNWKKXP5VH4NZDDBOBLEI6QDIISOCGIZWQC3XGWZJ54HM7A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.941555732 (13h19m54.879971581s) [noise=true , address=45.91.116.10:4081 , piece_id=HNR4SQQNQ5NXURX5UHPBOXU4GA3JXEGYNB47TTDPJONSFT6S6QXQ, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.949205798 (13h19m54.887621647s) [noise=true , address=45.91.116.6:4973 , piece_id=AZIPOBQLKMOYFYYNBSCYVWTXBFTO23D5M3GCR6AAO7B4JQM7ZEVA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.950523069 (13h19m54.888938918s) [noise=true , address=77.90.31.18:4805 , piece_id=IJA4KGDBD6KJD6NXVNI6HEXYY6MPRDZZTWUJX2CNPKBU3T75YNLA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.979618908 (13h19m54.918034757s) [noise=true , address=45.91.116.13:4154 , piece_id=ZPGJKCFH6DY3H7PMDZP6RIUD4756OI72YR6AWXX3BDT2B5VT7WBA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.982696867 (13h19m54.921112716s) [noise=true , address=77.90.31.18:4806 , piece_id=WG3WEWCPUTC3ZPCR6BRN3SKDGZZVVXYY52H2J6OF7UXDBO6HAK5A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.996455200 (13h19m54.934871049s) [noise=true , address=104.36.82.8:4971 , piece_id=TITIMRNQC6XGL7V5D2FFLUKZMH7WS7ZKHQRXQO7UVPP4XZ3H7TJA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.998128342 (13h19m54.936544181s) [noise=true , address=45.91.116.14:4189 , piece_id=SV7CXDGZSOLJRNF66GMH4FAWRO6VUOUVW4GKMCN7RRSZYRPCP34A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.004708831 (13h19m54.94312468s) [noise=true , address=104.36.82.9:4006 , piece_id=PSF3N3N7RPXDCDZVLRXYFYCVOT7WXMEVHYT7JJUZUDUJDDNWJZLA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.007888294 (13h19m54.946304143s) [noise=true , address=104.36.82.7:4911 , piece_id=MQEV5OGZMVK2NDQUJRRM5LBL57H7PV4NQBBFC7ENA6K3QV4G2ZFA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.066682153 (13h19m55.005098002s) [noise=true , address=77.90.31.18:4807 , piece_id=JBDXLQBPQHGWXGJ2Q6MGMG7MRTN3FCV2QHFTKS5XE2ONFSW7VZ6A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.066705959 (13h19m55.005121808s) [seg_pos={0 0}, upload=12768]: Segment reached optimal threshold of 13 pieces. Aug 7 03:28:47.066812673 (13h19m55.005228522s) [noise=true , address=45.91.116.4:4940 , piece_id=T53PUFTY6HYKFKE2IWTFEXOEE2WB5NMSKLOY4AHPNGWEMDUANJRA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:47.066870153 (13h19m55.005285992s) [noise=true , address=77.90.31.11:4555 , piece_id=7LMIE2NKIXDHXK6PSJBOOXDDMV6EDC2B6DKTT54KC2EQTOP6QRRA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:47.066882947 (13h19m55.005298796s) [noise=true , address=77.90.31.15:4698 , piece_id=4DVMT6PTWCEZ4ICGDCJ7ZAHP3GSEBCC3WGS3OTR2AYD2XAQAA6UQ, seg_pos={0 0}, upload=12768]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:47.066892867 (13h19m55.005308716s) [seg_pos={0 0}, upload=12768]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 03:28:47.066966377 (13h19m55.005382226s) [upload=12768]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 03:28:47.066970666 (13h19m55.005386515s) [upload=12768]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 03:28:47.369311744 (13h19m55.307727593s) [upload=12768]: Done uploading segments... Aug 7 03:28:47.369329037 (13h19m55.307744886s) [upload=12768]: Upload finished. err: <nil> Duration: 6.19110107s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [....X....X....X.............................................] duration: 1.867093997s FAIL (2025-08-07 03:36:20 UTC) orbiter warning: operation: DownloadObject uplink: object not found ("orbiter_us_0/1K") Duration: 1.867130267s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.....X....X....X............................................] duration: 1.825877195s FAIL (2025-08-07 03:36:00 UTC) orbiter warning: operation: DownloadObject uplink: object not found ("orbiter_us_0/1K") Duration: 1.825930556s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [......X....X....X...........................................] duration: 1.922437953s FAIL (2025-08-07 03:35:37 UTC) orbiter warning: operation: DownloadObject uplink: object not found ("orbiter_us_0/1K") Duration: 1.922461488s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............................X..........X..................] duration: 5.844820872s FAIL (2025-08-07 03:35:34 UTC) orbiter warning: operation: DownloadObject uplink: object not found ("orbiter_us_0/4M") Duration: 5.844838525s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 5.841435042s FAIL (2025-08-07 03:35:28 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== DkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:09.452864198 (13h19m17.391280047s) [noise=true , address=45.91.116.11:4118 , piece_id=ZVKDKMJL3MRTSJNHCK6KVVCBYXEFGY4QNSCAMCJFYHAYNMGVFPRQ, seg_pos={0 0}, upload=12758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:09.452874778 (13h19m17.391290627s) [seg_pos={0 0}, upload=12758]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 03:28:09.452958438 (13h19m17.391374287s) [upload=12758]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 03:28:09.452962817 (13h19m17.391378666s) [upload=12758]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 03:28:09.747228138 (13h19m17.685644027s) [upload=12758]: Done uploading segments... Aug 7 03:28:09.747250910 (13h19m17.685666779s) [upload=12758]: Upload finished. err: <nil> Aug 7 03:28:44.605684325 (13h19m52.544100174s) [upload=12768]: Starting upload Aug 7 03:28:44.605739741 (13h19m52.54415559s) [upload=12768]: Done starting upload Aug 7 03:28:44.605848990 (13h19m52.54426484s) [upload=12768]: Uploading segments... Aug 7 03:28:44.605951336 (13h19m52.544367185s) [upload=12768]: Got next segment. Inline: false Aug 7 03:28:44.605995300 (13h19m52.544411149s) [upload=12768]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 03:28:44.606000089 (13h19m52.544415938s) [upload=12768]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 03:28:44.861620101 (13h19m52.80003594s) [seg_pos={0 0}, upload=12768]: Begin upload segment... Aug 7 03:28:44.861673774 (13h19m52.800089613s) [seg_pos={0 0}, upload=12768]: Done begin upload segment. Aug 7 03:28:44.861696257 (13h19m52.800112106s) [noise=true , address=104.36.82.7:4911 , piece_id=MQEV5OGZMVK2NDQUJRRM5LBL57H7PV4NQBBFC7ENA6K3QV4G2ZFA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.861789946 (13h19m52.800205825s) [noise=true , address=45.91.116.13:4154 , piece_id=ZPGJKCFH6DY3H7PMDZP6RIUD4756OI72YR6AWXX3BDT2B5VT7WBA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862065032 (13h19m52.800480881s) [noise=true , address=45.91.116.10:4081 , piece_id=HNR4SQQNQ5NXURX5UHPBOXU4GA3JXEGYNB47TTDPJONSFT6S6QXQ, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862279713 (13h19m52.800695562s) [noise=true , address=104.36.82.8:4971 , piece_id=TITIMRNQC6XGL7V5D2FFLUKZMH7WS7ZKHQRXQO7UVPP4XZ3H7TJA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862316884 (13h19m52.800732733s) [noise=true , address=45.91.116.4:4940 , piece_id=T53PUFTY6HYKFKE2IWTFEXOEE2WB5NMSKLOY4AHPNGWEMDUANJRA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862559979 (13h19m52.800975828s) [noise=true , address=77.90.31.15:4698 , piece_id=4DVMT6PTWCEZ4ICGDCJ7ZAHP3GSEBCC3WGS3OTR2AYD2XAQAA6UQ, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862586841 (13h19m52.80100269s) [noise=true , address=77.90.31.18:4806 , piece_id=WG3WEWCPUTC3ZPCR6BRN3SKDGZZVVXYY52H2J6OF7UXDBO6HAK5A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862803405 (13h19m52.801219254s) [noise=true , address=45.91.116.9:4263 , piece_id=DTT26U5JI4EUIJZOVVVFDCPVXSLAWFCT6BFVVWFGTN63YZ3FRXLA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862906553 (13h19m52.801322402s) [noise=true , address=104.36.82.9:4006 , piece_id=PSF3N3N7RPXDCDZVLRXYFYCVOT7WXMEVHYT7JJUZUDUJDDNWJZLA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863050348 (13h19m52.801466197s) [noise=true , address=77.90.31.18:4805 , piece_id=IJA4KGDBD6KJD6NXVNI6HEXYY6MPRDZZTWUJX2CNPKBU3T75YNLA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863162232 (13h19m52.801578081s) [noise=true , address=77.90.31.10:4517 , piece_id=JROHDGYTTG57KVZ62P6PM7QXHWOS2T55BXDCMHB7C2S4YGF2E73A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863263736 (13h19m52.801679585s) [noise=true , address=45.91.116.6:4973 , piece_id=AZIPOBQLKMOYFYYNBSCYVWTXBFTO23D5M3GCR6AAO7B4JQM7ZEVA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863407952 (13h19m52.801823801s) [noise=true , address=77.90.31.18:4807 , piece_id=JBDXLQBPQHGWXGJ2Q6MGMG7MRTN3FCV2QHFTKS5XE2ONFSW7VZ6A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863462657 (13h19m52.801878506s) [noise=true , address=77.90.31.11:4555 , piece_id=7LMIE2NKIXDHXK6PSJBOOXDDMV6EDC2B6DKTT54KC2EQTOP6QRRA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863671396 (13h19m52.802087235s) [noise=true , address=104.36.82.12:4150 , piece_id=R5KDMNNWKKXP5VH4NZDDBOBLEI6QDIISOCGIZWQC3XGWZJ54HM7A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.866072811 (13h19m52.80448866s) [noise=true , address=45.91.116.14:4189 , piece_id=SV7CXDGZSOLJRNF66GMH4FAWRO6VUOUVW4GKMCN7RRSZYRPCP34A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:46.602566612 (13h19m54.540982461s) [upload=12768]: Next returned nil segment Aug 7 03:28:46.602584987 (13h19m54.541000836s) [upload=12768]: Waiting for error group managing segments... Aug 7 03:28:46.879071462 (13h19m54.817487301s) [noise=true , address=77.90.31.10:4517 , piece_id=JROHDGYTTG57KVZ62P6PM7QXHWOS2T55BXDCMHB7C2S4YGF2E73A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.892476459 (13h19m54.830892298s) [noise=true , address=45.91.116.9:4263 , piece_id=DTT26U5JI4EUIJZOVVVFDCPVXSLAWFCT6BFVVWFGTN63YZ3FRXLA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.922922511 (13h19m54.86133836s) [noise=true , address=104.36.82.12:4150 , piece_id=R5KDMNNWKKXP5VH4NZDDBOBLEI6QDIISOCGIZWQC3XGWZJ54HM7A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.941555732 (13h19m54.879971581s) [noise=true , address=45.91.116.10:4081 , piece_id=HNR4SQQNQ5NXURX5UHPBOXU4GA3JXEGYNB47TTDPJONSFT6S6QXQ, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.949205798 (13h19m54.887621647s) [noise=true , address=45.91.116.6:4973 , piece_id=AZIPOBQLKMOYFYYNBSCYVWTXBFTO23D5M3GCR6AAO7B4JQM7ZEVA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.950523069 (13h19m54.888938918s) [noise=true , address=77.90.31.18:4805 , piece_id=IJA4KGDBD6KJD6NXVNI6HEXYY6MPRDZZTWUJX2CNPKBU3T75YNLA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.979618908 (13h19m54.918034757s) [noise=true , address=45.91.116.13:4154 , piece_id=ZPGJKCFH6DY3H7PMDZP6RIUD4756OI72YR6AWXX3BDT2B5VT7WBA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.982696867 (13h19m54.921112716s) [noise=true , address=77.90.31.18:4806 , piece_id=WG3WEWCPUTC3ZPCR6BRN3SKDGZZVVXYY52H2J6OF7UXDBO6HAK5A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.996455200 (13h19m54.934871049s) [noise=true , address=104.36.82.8:4971 , piece_id=TITIMRNQC6XGL7V5D2FFLUKZMH7WS7ZKHQRXQO7UVPP4XZ3H7TJA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.998128342 (13h19m54.936544181s) [noise=true , address=45.91.116.14:4189 , piece_id=SV7CXDGZSOLJRNF66GMH4FAWRO6VUOUVW4GKMCN7RRSZYRPCP34A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.004708831 (13h19m54.94312468s) [noise=true , address=104.36.82.9:4006 , piece_id=PSF3N3N7RPXDCDZVLRXYFYCVOT7WXMEVHYT7JJUZUDUJDDNWJZLA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.007888294 (13h19m54.946304143s) [noise=true , address=104.36.82.7:4911 , piece_id=MQEV5OGZMVK2NDQUJRRM5LBL57H7PV4NQBBFC7ENA6K3QV4G2ZFA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.066682153 (13h19m55.005098002s) [noise=true , address=77.90.31.18:4807 , piece_id=JBDXLQBPQHGWXGJ2Q6MGMG7MRTN3FCV2QHFTKS5XE2ONFSW7VZ6A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.066705959 (13h19m55.005121808s) [seg_pos={0 0}, upload=12768]: Segment reached optimal threshold of 13 pieces. Aug 7 03:28:47.066812673 (13h19m55.005228522s) [noise=true , address=45.91.116.4:4940 , piece_id=T53PUFTY6HYKFKE2IWTFEXOEE2WB5NMSKLOY4AHPNGWEMDUANJRA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:47.066870153 (13h19m55.005285992s) [noise=true , address=77.90.31.11:4555 , piece_id=7LMIE2NKIXDHXK6PSJBOOXDDMV6EDC2B6DKTT54KC2EQTOP6QRRA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:47.066882947 (13h19m55.005298796s) [noise=true , address=77.90.31.15:4698 , piece_id=4DVMT6PTWCEZ4ICGDCJ7ZAHP3GSEBCC3WGS3OTR2AYD2XAQAA6UQ, seg_pos={0 0}, upload=12768]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:47.066892867 (13h19m55.005308716s) [seg_pos={0 0}, upload=12768]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 03:28:47.066966377 (13h19m55.005382226s) [upload=12768]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 03:28:47.066970666 (13h19m55.005386515s) [upload=12768]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 03:28:47.369311744 (13h19m55.307727593s) [upload=12768]: Done uploading segments... Aug 7 03:28:47.369329037 (13h19m55.307744886s) [upload=12768]: Upload finished. err: <nil> Duration: 5.841471832s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............................X..........X.................] duration: 6.014198245s FAIL (2025-08-07 03:35:04 UTC) orbiter warning: operation: DownloadObject uplink: object not found ("orbiter_us_0/4M") Duration: 6.014235708s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 5.953215761s FAIL (2025-08-07 03:35:01 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== DkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:09.452864198 (13h19m17.391280047s) [noise=true , address=45.91.116.11:4118 , piece_id=ZVKDKMJL3MRTSJNHCK6KVVCBYXEFGY4QNSCAMCJFYHAYNMGVFPRQ, seg_pos={0 0}, upload=12758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:09.452874778 (13h19m17.391290627s) [seg_pos={0 0}, upload=12758]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 03:28:09.452958438 (13h19m17.391374287s) [upload=12758]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 03:28:09.452962817 (13h19m17.391378666s) [upload=12758]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 03:28:09.747228138 (13h19m17.685644027s) [upload=12758]: Done uploading segments... Aug 7 03:28:09.747250910 (13h19m17.685666779s) [upload=12758]: Upload finished. err: <nil> Aug 7 03:28:44.605684325 (13h19m52.544100174s) [upload=12768]: Starting upload Aug 7 03:28:44.605739741 (13h19m52.54415559s) [upload=12768]: Done starting upload Aug 7 03:28:44.605848990 (13h19m52.54426484s) [upload=12768]: Uploading segments... Aug 7 03:28:44.605951336 (13h19m52.544367185s) [upload=12768]: Got next segment. Inline: false Aug 7 03:28:44.605995300 (13h19m52.544411149s) [upload=12768]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 03:28:44.606000089 (13h19m52.544415938s) [upload=12768]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 03:28:44.861620101 (13h19m52.80003594s) [seg_pos={0 0}, upload=12768]: Begin upload segment... Aug 7 03:28:44.861673774 (13h19m52.800089613s) [seg_pos={0 0}, upload=12768]: Done begin upload segment. Aug 7 03:28:44.861696257 (13h19m52.800112106s) [noise=true , address=104.36.82.7:4911 , piece_id=MQEV5OGZMVK2NDQUJRRM5LBL57H7PV4NQBBFC7ENA6K3QV4G2ZFA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.861789946 (13h19m52.800205825s) [noise=true , address=45.91.116.13:4154 , piece_id=ZPGJKCFH6DY3H7PMDZP6RIUD4756OI72YR6AWXX3BDT2B5VT7WBA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862065032 (13h19m52.800480881s) [noise=true , address=45.91.116.10:4081 , piece_id=HNR4SQQNQ5NXURX5UHPBOXU4GA3JXEGYNB47TTDPJONSFT6S6QXQ, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862279713 (13h19m52.800695562s) [noise=true , address=104.36.82.8:4971 , piece_id=TITIMRNQC6XGL7V5D2FFLUKZMH7WS7ZKHQRXQO7UVPP4XZ3H7TJA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862316884 (13h19m52.800732733s) [noise=true , address=45.91.116.4:4940 , piece_id=T53PUFTY6HYKFKE2IWTFEXOEE2WB5NMSKLOY4AHPNGWEMDUANJRA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862559979 (13h19m52.800975828s) [noise=true , address=77.90.31.15:4698 , piece_id=4DVMT6PTWCEZ4ICGDCJ7ZAHP3GSEBCC3WGS3OTR2AYD2XAQAA6UQ, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862586841 (13h19m52.80100269s) [noise=true , address=77.90.31.18:4806 , piece_id=WG3WEWCPUTC3ZPCR6BRN3SKDGZZVVXYY52H2J6OF7UXDBO6HAK5A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862803405 (13h19m52.801219254s) [noise=true , address=45.91.116.9:4263 , piece_id=DTT26U5JI4EUIJZOVVVFDCPVXSLAWFCT6BFVVWFGTN63YZ3FRXLA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862906553 (13h19m52.801322402s) [noise=true , address=104.36.82.9:4006 , piece_id=PSF3N3N7RPXDCDZVLRXYFYCVOT7WXMEVHYT7JJUZUDUJDDNWJZLA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863050348 (13h19m52.801466197s) [noise=true , address=77.90.31.18:4805 , piece_id=IJA4KGDBD6KJD6NXVNI6HEXYY6MPRDZZTWUJX2CNPKBU3T75YNLA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863162232 (13h19m52.801578081s) [noise=true , address=77.90.31.10:4517 , piece_id=JROHDGYTTG57KVZ62P6PM7QXHWOS2T55BXDCMHB7C2S4YGF2E73A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863263736 (13h19m52.801679585s) [noise=true , address=45.91.116.6:4973 , piece_id=AZIPOBQLKMOYFYYNBSCYVWTXBFTO23D5M3GCR6AAO7B4JQM7ZEVA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863407952 (13h19m52.801823801s) [noise=true , address=77.90.31.18:4807 , piece_id=JBDXLQBPQHGWXGJ2Q6MGMG7MRTN3FCV2QHFTKS5XE2ONFSW7VZ6A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863462657 (13h19m52.801878506s) [noise=true , address=77.90.31.11:4555 , piece_id=7LMIE2NKIXDHXK6PSJBOOXDDMV6EDC2B6DKTT54KC2EQTOP6QRRA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863671396 (13h19m52.802087235s) [noise=true , address=104.36.82.12:4150 , piece_id=R5KDMNNWKKXP5VH4NZDDBOBLEI6QDIISOCGIZWQC3XGWZJ54HM7A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.866072811 (13h19m52.80448866s) [noise=true , address=45.91.116.14:4189 , piece_id=SV7CXDGZSOLJRNF66GMH4FAWRO6VUOUVW4GKMCN7RRSZYRPCP34A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:46.602566612 (13h19m54.540982461s) [upload=12768]: Next returned nil segment Aug 7 03:28:46.602584987 (13h19m54.541000836s) [upload=12768]: Waiting for error group managing segments... Aug 7 03:28:46.879071462 (13h19m54.817487301s) [noise=true , address=77.90.31.10:4517 , piece_id=JROHDGYTTG57KVZ62P6PM7QXHWOS2T55BXDCMHB7C2S4YGF2E73A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.892476459 (13h19m54.830892298s) [noise=true , address=45.91.116.9:4263 , piece_id=DTT26U5JI4EUIJZOVVVFDCPVXSLAWFCT6BFVVWFGTN63YZ3FRXLA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.922922511 (13h19m54.86133836s) [noise=true , address=104.36.82.12:4150 , piece_id=R5KDMNNWKKXP5VH4NZDDBOBLEI6QDIISOCGIZWQC3XGWZJ54HM7A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.941555732 (13h19m54.879971581s) [noise=true , address=45.91.116.10:4081 , piece_id=HNR4SQQNQ5NXURX5UHPBOXU4GA3JXEGYNB47TTDPJONSFT6S6QXQ, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.949205798 (13h19m54.887621647s) [noise=true , address=45.91.116.6:4973 , piece_id=AZIPOBQLKMOYFYYNBSCYVWTXBFTO23D5M3GCR6AAO7B4JQM7ZEVA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.950523069 (13h19m54.888938918s) [noise=true , address=77.90.31.18:4805 , piece_id=IJA4KGDBD6KJD6NXVNI6HEXYY6MPRDZZTWUJX2CNPKBU3T75YNLA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.979618908 (13h19m54.918034757s) [noise=true , address=45.91.116.13:4154 , piece_id=ZPGJKCFH6DY3H7PMDZP6RIUD4756OI72YR6AWXX3BDT2B5VT7WBA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.982696867 (13h19m54.921112716s) [noise=true , address=77.90.31.18:4806 , piece_id=WG3WEWCPUTC3ZPCR6BRN3SKDGZZVVXYY52H2J6OF7UXDBO6HAK5A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.996455200 (13h19m54.934871049s) [noise=true , address=104.36.82.8:4971 , piece_id=TITIMRNQC6XGL7V5D2FFLUKZMH7WS7ZKHQRXQO7UVPP4XZ3H7TJA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.998128342 (13h19m54.936544181s) [noise=true , address=45.91.116.14:4189 , piece_id=SV7CXDGZSOLJRNF66GMH4FAWRO6VUOUVW4GKMCN7RRSZYRPCP34A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.004708831 (13h19m54.94312468s) [noise=true , address=104.36.82.9:4006 , piece_id=PSF3N3N7RPXDCDZVLRXYFYCVOT7WXMEVHYT7JJUZUDUJDDNWJZLA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.007888294 (13h19m54.946304143s) [noise=true , address=104.36.82.7:4911 , piece_id=MQEV5OGZMVK2NDQUJRRM5LBL57H7PV4NQBBFC7ENA6K3QV4G2ZFA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.066682153 (13h19m55.005098002s) [noise=true , address=77.90.31.18:4807 , piece_id=JBDXLQBPQHGWXGJ2Q6MGMG7MRTN3FCV2QHFTKS5XE2ONFSW7VZ6A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.066705959 (13h19m55.005121808s) [seg_pos={0 0}, upload=12768]: Segment reached optimal threshold of 13 pieces. Aug 7 03:28:47.066812673 (13h19m55.005228522s) [noise=true , address=45.91.116.4:4940 , piece_id=T53PUFTY6HYKFKE2IWTFEXOEE2WB5NMSKLOY4AHPNGWEMDUANJRA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:47.066870153 (13h19m55.005285992s) [noise=true , address=77.90.31.11:4555 , piece_id=7LMIE2NKIXDHXK6PSJBOOXDDMV6EDC2B6DKTT54KC2EQTOP6QRRA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:47.066882947 (13h19m55.005298796s) [noise=true , address=77.90.31.15:4698 , piece_id=4DVMT6PTWCEZ4ICGDCJ7ZAHP3GSEBCC3WGS3OTR2AYD2XAQAA6UQ, seg_pos={0 0}, upload=12768]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:47.066892867 (13h19m55.005308716s) [seg_pos={0 0}, upload=12768]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 03:28:47.066966377 (13h19m55.005382226s) [upload=12768]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 03:28:47.066970666 (13h19m55.005386515s) [upload=12768]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 03:28:47.369311744 (13h19m55.307727593s) [upload=12768]: Done uploading segments... Aug 7 03:28:47.369329037 (13h19m55.307744886s) [upload=12768]: Upload finished. err: <nil> Duration: 5.953245929s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.......X....X....X..........................................] duration: 1.914257203s FAIL (2025-08-07 03:35:01 UTC) orbiter warning: operation: DownloadObject uplink: object not found ("orbiter_us_0/1K") Duration: 1.914289853s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [........X....X....X.........................................] duration: 2.129366074s FAIL (2025-08-07 03:34:43 UTC) orbiter warning: operation: DownloadObject uplink: object not found ("orbiter_us_0/1K") Duration: 2.129390971s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [................................X..........X................] duration: 6.122543665s FAIL (2025-08-07 03:34:25 UTC) orbiter warning: operation: DownloadObject uplink: object not found ("orbiter_us_0/4M") Duration: 6.122569554s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.........X....X....X........................................] duration: 2.032986043s FAIL (2025-08-07 03:34:17 UTC) orbiter warning: operation: DownloadObject uplink: object not found ("orbiter_us_0/1K") Duration: 2.033004527s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 5.771327491s FAIL (2025-08-07 03:34:02 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== DkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:09.452864198 (13h19m17.391280047s) [noise=true , address=45.91.116.11:4118 , piece_id=ZVKDKMJL3MRTSJNHCK6KVVCBYXEFGY4QNSCAMCJFYHAYNMGVFPRQ, seg_pos={0 0}, upload=12758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:09.452874778 (13h19m17.391290627s) [seg_pos={0 0}, upload=12758]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 03:28:09.452958438 (13h19m17.391374287s) [upload=12758]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 03:28:09.452962817 (13h19m17.391378666s) [upload=12758]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 03:28:09.747228138 (13h19m17.685644027s) [upload=12758]: Done uploading segments... Aug 7 03:28:09.747250910 (13h19m17.685666779s) [upload=12758]: Upload finished. err: <nil> Aug 7 03:28:44.605684325 (13h19m52.544100174s) [upload=12768]: Starting upload Aug 7 03:28:44.605739741 (13h19m52.54415559s) [upload=12768]: Done starting upload Aug 7 03:28:44.605848990 (13h19m52.54426484s) [upload=12768]: Uploading segments... Aug 7 03:28:44.605951336 (13h19m52.544367185s) [upload=12768]: Got next segment. Inline: false Aug 7 03:28:44.605995300 (13h19m52.544411149s) [upload=12768]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 03:28:44.606000089 (13h19m52.544415938s) [upload=12768]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 03:28:44.861620101 (13h19m52.80003594s) [seg_pos={0 0}, upload=12768]: Begin upload segment... Aug 7 03:28:44.861673774 (13h19m52.800089613s) [seg_pos={0 0}, upload=12768]: Done begin upload segment. Aug 7 03:28:44.861696257 (13h19m52.800112106s) [noise=true , address=104.36.82.7:4911 , piece_id=MQEV5OGZMVK2NDQUJRRM5LBL57H7PV4NQBBFC7ENA6K3QV4G2ZFA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.861789946 (13h19m52.800205825s) [noise=true , address=45.91.116.13:4154 , piece_id=ZPGJKCFH6DY3H7PMDZP6RIUD4756OI72YR6AWXX3BDT2B5VT7WBA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862065032 (13h19m52.800480881s) [noise=true , address=45.91.116.10:4081 , piece_id=HNR4SQQNQ5NXURX5UHPBOXU4GA3JXEGYNB47TTDPJONSFT6S6QXQ, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862279713 (13h19m52.800695562s) [noise=true , address=104.36.82.8:4971 , piece_id=TITIMRNQC6XGL7V5D2FFLUKZMH7WS7ZKHQRXQO7UVPP4XZ3H7TJA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862316884 (13h19m52.800732733s) [noise=true , address=45.91.116.4:4940 , piece_id=T53PUFTY6HYKFKE2IWTFEXOEE2WB5NMSKLOY4AHPNGWEMDUANJRA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862559979 (13h19m52.800975828s) [noise=true , address=77.90.31.15:4698 , piece_id=4DVMT6PTWCEZ4ICGDCJ7ZAHP3GSEBCC3WGS3OTR2AYD2XAQAA6UQ, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862586841 (13h19m52.80100269s) [noise=true , address=77.90.31.18:4806 , piece_id=WG3WEWCPUTC3ZPCR6BRN3SKDGZZVVXYY52H2J6OF7UXDBO6HAK5A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862803405 (13h19m52.801219254s) [noise=true , address=45.91.116.9:4263 , piece_id=DTT26U5JI4EUIJZOVVVFDCPVXSLAWFCT6BFVVWFGTN63YZ3FRXLA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862906553 (13h19m52.801322402s) [noise=true , address=104.36.82.9:4006 , piece_id=PSF3N3N7RPXDCDZVLRXYFYCVOT7WXMEVHYT7JJUZUDUJDDNWJZLA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863050348 (13h19m52.801466197s) [noise=true , address=77.90.31.18:4805 , piece_id=IJA4KGDBD6KJD6NXVNI6HEXYY6MPRDZZTWUJX2CNPKBU3T75YNLA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863162232 (13h19m52.801578081s) [noise=true , address=77.90.31.10:4517 , piece_id=JROHDGYTTG57KVZ62P6PM7QXHWOS2T55BXDCMHB7C2S4YGF2E73A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863263736 (13h19m52.801679585s) [noise=true , address=45.91.116.6:4973 , piece_id=AZIPOBQLKMOYFYYNBSCYVWTXBFTO23D5M3GCR6AAO7B4JQM7ZEVA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863407952 (13h19m52.801823801s) [noise=true , address=77.90.31.18:4807 , piece_id=JBDXLQBPQHGWXGJ2Q6MGMG7MRTN3FCV2QHFTKS5XE2ONFSW7VZ6A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863462657 (13h19m52.801878506s) [noise=true , address=77.90.31.11:4555 , piece_id=7LMIE2NKIXDHXK6PSJBOOXDDMV6EDC2B6DKTT54KC2EQTOP6QRRA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863671396 (13h19m52.802087235s) [noise=true , address=104.36.82.12:4150 , piece_id=R5KDMNNWKKXP5VH4NZDDBOBLEI6QDIISOCGIZWQC3XGWZJ54HM7A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.866072811 (13h19m52.80448866s) [noise=true , address=45.91.116.14:4189 , piece_id=SV7CXDGZSOLJRNF66GMH4FAWRO6VUOUVW4GKMCN7RRSZYRPCP34A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:46.602566612 (13h19m54.540982461s) [upload=12768]: Next returned nil segment Aug 7 03:28:46.602584987 (13h19m54.541000836s) [upload=12768]: Waiting for error group managing segments... Aug 7 03:28:46.879071462 (13h19m54.817487301s) [noise=true , address=77.90.31.10:4517 , piece_id=JROHDGYTTG57KVZ62P6PM7QXHWOS2T55BXDCMHB7C2S4YGF2E73A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.892476459 (13h19m54.830892298s) [noise=true , address=45.91.116.9:4263 , piece_id=DTT26U5JI4EUIJZOVVVFDCPVXSLAWFCT6BFVVWFGTN63YZ3FRXLA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.922922511 (13h19m54.86133836s) [noise=true , address=104.36.82.12:4150 , piece_id=R5KDMNNWKKXP5VH4NZDDBOBLEI6QDIISOCGIZWQC3XGWZJ54HM7A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.941555732 (13h19m54.879971581s) [noise=true , address=45.91.116.10:4081 , piece_id=HNR4SQQNQ5NXURX5UHPBOXU4GA3JXEGYNB47TTDPJONSFT6S6QXQ, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.949205798 (13h19m54.887621647s) [noise=true , address=45.91.116.6:4973 , piece_id=AZIPOBQLKMOYFYYNBSCYVWTXBFTO23D5M3GCR6AAO7B4JQM7ZEVA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.950523069 (13h19m54.888938918s) [noise=true , address=77.90.31.18:4805 , piece_id=IJA4KGDBD6KJD6NXVNI6HEXYY6MPRDZZTWUJX2CNPKBU3T75YNLA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.979618908 (13h19m54.918034757s) [noise=true , address=45.91.116.13:4154 , piece_id=ZPGJKCFH6DY3H7PMDZP6RIUD4756OI72YR6AWXX3BDT2B5VT7WBA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.982696867 (13h19m54.921112716s) [noise=true , address=77.90.31.18:4806 , piece_id=WG3WEWCPUTC3ZPCR6BRN3SKDGZZVVXYY52H2J6OF7UXDBO6HAK5A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.996455200 (13h19m54.934871049s) [noise=true , address=104.36.82.8:4971 , piece_id=TITIMRNQC6XGL7V5D2FFLUKZMH7WS7ZKHQRXQO7UVPP4XZ3H7TJA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.998128342 (13h19m54.936544181s) [noise=true , address=45.91.116.14:4189 , piece_id=SV7CXDGZSOLJRNF66GMH4FAWRO6VUOUVW4GKMCN7RRSZYRPCP34A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.004708831 (13h19m54.94312468s) [noise=true , address=104.36.82.9:4006 , piece_id=PSF3N3N7RPXDCDZVLRXYFYCVOT7WXMEVHYT7JJUZUDUJDDNWJZLA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.007888294 (13h19m54.946304143s) [noise=true , address=104.36.82.7:4911 , piece_id=MQEV5OGZMVK2NDQUJRRM5LBL57H7PV4NQBBFC7ENA6K3QV4G2ZFA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.066682153 (13h19m55.005098002s) [noise=true , address=77.90.31.18:4807 , piece_id=JBDXLQBPQHGWXGJ2Q6MGMG7MRTN3FCV2QHFTKS5XE2ONFSW7VZ6A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.066705959 (13h19m55.005121808s) [seg_pos={0 0}, upload=12768]: Segment reached optimal threshold of 13 pieces. Aug 7 03:28:47.066812673 (13h19m55.005228522s) [noise=true , address=45.91.116.4:4940 , piece_id=T53PUFTY6HYKFKE2IWTFEXOEE2WB5NMSKLOY4AHPNGWEMDUANJRA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:47.066870153 (13h19m55.005285992s) [noise=true , address=77.90.31.11:4555 , piece_id=7LMIE2NKIXDHXK6PSJBOOXDDMV6EDC2B6DKTT54KC2EQTOP6QRRA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:47.066882947 (13h19m55.005298796s) [noise=true , address=77.90.31.15:4698 , piece_id=4DVMT6PTWCEZ4ICGDCJ7ZAHP3GSEBCC3WGS3OTR2AYD2XAQAA6UQ, seg_pos={0 0}, upload=12768]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:47.066892867 (13h19m55.005308716s) [seg_pos={0 0}, upload=12768]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 03:28:47.066966377 (13h19m55.005382226s) [upload=12768]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 03:28:47.066970666 (13h19m55.005386515s) [upload=12768]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 03:28:47.369311744 (13h19m55.307727593s) [upload=12768]: Done uploading segments... Aug 7 03:28:47.369329037 (13h19m55.307744886s) [upload=12768]: Upload finished. err: <nil> Duration: 5.771356124s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..........X....X....X.......................................] duration: 1.890468698s FAIL (2025-08-07 03:33:41 UTC) orbiter warning: operation: DownloadObject uplink: object not found ("orbiter_us_0/1K") Duration: 1.890497121s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................................X..........X...............] duration: 5.750142608s FAIL (2025-08-07 03:33:32 UTC) orbiter warning: operation: DownloadObject uplink: object not found ("orbiter_us_0/4M") Duration: 5.750171022s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 5.978416437s FAIL (2025-08-07 03:33:26 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== DkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:09.452864198 (13h19m17.391280047s) [noise=true , address=45.91.116.11:4118 , piece_id=ZVKDKMJL3MRTSJNHCK6KVVCBYXEFGY4QNSCAMCJFYHAYNMGVFPRQ, seg_pos={0 0}, upload=12758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:09.452874778 (13h19m17.391290627s) [seg_pos={0 0}, upload=12758]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 03:28:09.452958438 (13h19m17.391374287s) [upload=12758]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 03:28:09.452962817 (13h19m17.391378666s) [upload=12758]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 03:28:09.747228138 (13h19m17.685644027s) [upload=12758]: Done uploading segments... Aug 7 03:28:09.747250910 (13h19m17.685666779s) [upload=12758]: Upload finished. err: <nil> Aug 7 03:28:44.605684325 (13h19m52.544100174s) [upload=12768]: Starting upload Aug 7 03:28:44.605739741 (13h19m52.54415559s) [upload=12768]: Done starting upload Aug 7 03:28:44.605848990 (13h19m52.54426484s) [upload=12768]: Uploading segments... Aug 7 03:28:44.605951336 (13h19m52.544367185s) [upload=12768]: Got next segment. Inline: false Aug 7 03:28:44.605995300 (13h19m52.544411149s) [upload=12768]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 03:28:44.606000089 (13h19m52.544415938s) [upload=12768]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 03:28:44.861620101 (13h19m52.80003594s) [seg_pos={0 0}, upload=12768]: Begin upload segment... Aug 7 03:28:44.861673774 (13h19m52.800089613s) [seg_pos={0 0}, upload=12768]: Done begin upload segment. Aug 7 03:28:44.861696257 (13h19m52.800112106s) [noise=true , address=104.36.82.7:4911 , piece_id=MQEV5OGZMVK2NDQUJRRM5LBL57H7PV4NQBBFC7ENA6K3QV4G2ZFA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.861789946 (13h19m52.800205825s) [noise=true , address=45.91.116.13:4154 , piece_id=ZPGJKCFH6DY3H7PMDZP6RIUD4756OI72YR6AWXX3BDT2B5VT7WBA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862065032 (13h19m52.800480881s) [noise=true , address=45.91.116.10:4081 , piece_id=HNR4SQQNQ5NXURX5UHPBOXU4GA3JXEGYNB47TTDPJONSFT6S6QXQ, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862279713 (13h19m52.800695562s) [noise=true , address=104.36.82.8:4971 , piece_id=TITIMRNQC6XGL7V5D2FFLUKZMH7WS7ZKHQRXQO7UVPP4XZ3H7TJA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862316884 (13h19m52.800732733s) [noise=true , address=45.91.116.4:4940 , piece_id=T53PUFTY6HYKFKE2IWTFEXOEE2WB5NMSKLOY4AHPNGWEMDUANJRA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862559979 (13h19m52.800975828s) [noise=true , address=77.90.31.15:4698 , piece_id=4DVMT6PTWCEZ4ICGDCJ7ZAHP3GSEBCC3WGS3OTR2AYD2XAQAA6UQ, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862586841 (13h19m52.80100269s) [noise=true , address=77.90.31.18:4806 , piece_id=WG3WEWCPUTC3ZPCR6BRN3SKDGZZVVXYY52H2J6OF7UXDBO6HAK5A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862803405 (13h19m52.801219254s) [noise=true , address=45.91.116.9:4263 , piece_id=DTT26U5JI4EUIJZOVVVFDCPVXSLAWFCT6BFVVWFGTN63YZ3FRXLA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862906553 (13h19m52.801322402s) [noise=true , address=104.36.82.9:4006 , piece_id=PSF3N3N7RPXDCDZVLRXYFYCVOT7WXMEVHYT7JJUZUDUJDDNWJZLA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863050348 (13h19m52.801466197s) [noise=true , address=77.90.31.18:4805 , piece_id=IJA4KGDBD6KJD6NXVNI6HEXYY6MPRDZZTWUJX2CNPKBU3T75YNLA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863162232 (13h19m52.801578081s) [noise=true , address=77.90.31.10:4517 , piece_id=JROHDGYTTG57KVZ62P6PM7QXHWOS2T55BXDCMHB7C2S4YGF2E73A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863263736 (13h19m52.801679585s) [noise=true , address=45.91.116.6:4973 , piece_id=AZIPOBQLKMOYFYYNBSCYVWTXBFTO23D5M3GCR6AAO7B4JQM7ZEVA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863407952 (13h19m52.801823801s) [noise=true , address=77.90.31.18:4807 , piece_id=JBDXLQBPQHGWXGJ2Q6MGMG7MRTN3FCV2QHFTKS5XE2ONFSW7VZ6A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863462657 (13h19m52.801878506s) [noise=true , address=77.90.31.11:4555 , piece_id=7LMIE2NKIXDHXK6PSJBOOXDDMV6EDC2B6DKTT54KC2EQTOP6QRRA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863671396 (13h19m52.802087235s) [noise=true , address=104.36.82.12:4150 , piece_id=R5KDMNNWKKXP5VH4NZDDBOBLEI6QDIISOCGIZWQC3XGWZJ54HM7A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.866072811 (13h19m52.80448866s) [noise=true , address=45.91.116.14:4189 , piece_id=SV7CXDGZSOLJRNF66GMH4FAWRO6VUOUVW4GKMCN7RRSZYRPCP34A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:46.602566612 (13h19m54.540982461s) [upload=12768]: Next returned nil segment Aug 7 03:28:46.602584987 (13h19m54.541000836s) [upload=12768]: Waiting for error group managing segments... Aug 7 03:28:46.879071462 (13h19m54.817487301s) [noise=true , address=77.90.31.10:4517 , piece_id=JROHDGYTTG57KVZ62P6PM7QXHWOS2T55BXDCMHB7C2S4YGF2E73A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.892476459 (13h19m54.830892298s) [noise=true , address=45.91.116.9:4263 , piece_id=DTT26U5JI4EUIJZOVVVFDCPVXSLAWFCT6BFVVWFGTN63YZ3FRXLA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.922922511 (13h19m54.86133836s) [noise=true , address=104.36.82.12:4150 , piece_id=R5KDMNNWKKXP5VH4NZDDBOBLEI6QDIISOCGIZWQC3XGWZJ54HM7A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.941555732 (13h19m54.879971581s) [noise=true , address=45.91.116.10:4081 , piece_id=HNR4SQQNQ5NXURX5UHPBOXU4GA3JXEGYNB47TTDPJONSFT6S6QXQ, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.949205798 (13h19m54.887621647s) [noise=true , address=45.91.116.6:4973 , piece_id=AZIPOBQLKMOYFYYNBSCYVWTXBFTO23D5M3GCR6AAO7B4JQM7ZEVA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.950523069 (13h19m54.888938918s) [noise=true , address=77.90.31.18:4805 , piece_id=IJA4KGDBD6KJD6NXVNI6HEXYY6MPRDZZTWUJX2CNPKBU3T75YNLA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.979618908 (13h19m54.918034757s) [noise=true , address=45.91.116.13:4154 , piece_id=ZPGJKCFH6DY3H7PMDZP6RIUD4756OI72YR6AWXX3BDT2B5VT7WBA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.982696867 (13h19m54.921112716s) [noise=true , address=77.90.31.18:4806 , piece_id=WG3WEWCPUTC3ZPCR6BRN3SKDGZZVVXYY52H2J6OF7UXDBO6HAK5A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.996455200 (13h19m54.934871049s) [noise=true , address=104.36.82.8:4971 , piece_id=TITIMRNQC6XGL7V5D2FFLUKZMH7WS7ZKHQRXQO7UVPP4XZ3H7TJA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.998128342 (13h19m54.936544181s) [noise=true , address=45.91.116.14:4189 , piece_id=SV7CXDGZSOLJRNF66GMH4FAWRO6VUOUVW4GKMCN7RRSZYRPCP34A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.004708831 (13h19m54.94312468s) [noise=true , address=104.36.82.9:4006 , piece_id=PSF3N3N7RPXDCDZVLRXYFYCVOT7WXMEVHYT7JJUZUDUJDDNWJZLA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.007888294 (13h19m54.946304143s) [noise=true , address=104.36.82.7:4911 , piece_id=MQEV5OGZMVK2NDQUJRRM5LBL57H7PV4NQBBFC7ENA6K3QV4G2ZFA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.066682153 (13h19m55.005098002s) [noise=true , address=77.90.31.18:4807 , piece_id=JBDXLQBPQHGWXGJ2Q6MGMG7MRTN3FCV2QHFTKS5XE2ONFSW7VZ6A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.066705959 (13h19m55.005121808s) [seg_pos={0 0}, upload=12768]: Segment reached optimal threshold of 13 pieces. Aug 7 03:28:47.066812673 (13h19m55.005228522s) [noise=true , address=45.91.116.4:4940 , piece_id=T53PUFTY6HYKFKE2IWTFEXOEE2WB5NMSKLOY4AHPNGWEMDUANJRA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:47.066870153 (13h19m55.005285992s) [noise=true , address=77.90.31.11:4555 , piece_id=7LMIE2NKIXDHXK6PSJBOOXDDMV6EDC2B6DKTT54KC2EQTOP6QRRA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:47.066882947 (13h19m55.005298796s) [noise=true , address=77.90.31.15:4698 , piece_id=4DVMT6PTWCEZ4ICGDCJ7ZAHP3GSEBCC3WGS3OTR2AYD2XAQAA6UQ, seg_pos={0 0}, upload=12768]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:47.066892867 (13h19m55.005308716s) [seg_pos={0 0}, upload=12768]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 03:28:47.066966377 (13h19m55.005382226s) [upload=12768]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 03:28:47.066970666 (13h19m55.005386515s) [upload=12768]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 03:28:47.369311744 (13h19m55.307727593s) [upload=12768]: Done uploading segments... Aug 7 03:28:47.369329037 (13h19m55.307744886s) [upload=12768]: Upload finished. err: <nil> Duration: 5.978441235s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................................X..........X..............] duration: 5.850317908s FAIL (2025-08-07 03:32:49 UTC) orbiter warning: operation: DownloadObject uplink: object not found ("orbiter_us_0/4M") Duration: 5.850350911s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 5.943203227s FAIL (2025-08-07 03:32:37 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== DkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:09.452864198 (13h19m17.391280047s) [noise=true , address=45.91.116.11:4118 , piece_id=ZVKDKMJL3MRTSJNHCK6KVVCBYXEFGY4QNSCAMCJFYHAYNMGVFPRQ, seg_pos={0 0}, upload=12758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:09.452874778 (13h19m17.391290627s) [seg_pos={0 0}, upload=12758]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 03:28:09.452958438 (13h19m17.391374287s) [upload=12758]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 03:28:09.452962817 (13h19m17.391378666s) [upload=12758]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 03:28:09.747228138 (13h19m17.685644027s) [upload=12758]: Done uploading segments... Aug 7 03:28:09.747250910 (13h19m17.685666779s) [upload=12758]: Upload finished. err: <nil> Aug 7 03:28:44.605684325 (13h19m52.544100174s) [upload=12768]: Starting upload Aug 7 03:28:44.605739741 (13h19m52.54415559s) [upload=12768]: Done starting upload Aug 7 03:28:44.605848990 (13h19m52.54426484s) [upload=12768]: Uploading segments... Aug 7 03:28:44.605951336 (13h19m52.544367185s) [upload=12768]: Got next segment. Inline: false Aug 7 03:28:44.605995300 (13h19m52.544411149s) [upload=12768]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 03:28:44.606000089 (13h19m52.544415938s) [upload=12768]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 03:28:44.861620101 (13h19m52.80003594s) [seg_pos={0 0}, upload=12768]: Begin upload segment... Aug 7 03:28:44.861673774 (13h19m52.800089613s) [seg_pos={0 0}, upload=12768]: Done begin upload segment. Aug 7 03:28:44.861696257 (13h19m52.800112106s) [noise=true , address=104.36.82.7:4911 , piece_id=MQEV5OGZMVK2NDQUJRRM5LBL57H7PV4NQBBFC7ENA6K3QV4G2ZFA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.861789946 (13h19m52.800205825s) [noise=true , address=45.91.116.13:4154 , piece_id=ZPGJKCFH6DY3H7PMDZP6RIUD4756OI72YR6AWXX3BDT2B5VT7WBA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862065032 (13h19m52.800480881s) [noise=true , address=45.91.116.10:4081 , piece_id=HNR4SQQNQ5NXURX5UHPBOXU4GA3JXEGYNB47TTDPJONSFT6S6QXQ, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862279713 (13h19m52.800695562s) [noise=true , address=104.36.82.8:4971 , piece_id=TITIMRNQC6XGL7V5D2FFLUKZMH7WS7ZKHQRXQO7UVPP4XZ3H7TJA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862316884 (13h19m52.800732733s) [noise=true , address=45.91.116.4:4940 , piece_id=T53PUFTY6HYKFKE2IWTFEXOEE2WB5NMSKLOY4AHPNGWEMDUANJRA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862559979 (13h19m52.800975828s) [noise=true , address=77.90.31.15:4698 , piece_id=4DVMT6PTWCEZ4ICGDCJ7ZAHP3GSEBCC3WGS3OTR2AYD2XAQAA6UQ, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862586841 (13h19m52.80100269s) [noise=true , address=77.90.31.18:4806 , piece_id=WG3WEWCPUTC3ZPCR6BRN3SKDGZZVVXYY52H2J6OF7UXDBO6HAK5A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862803405 (13h19m52.801219254s) [noise=true , address=45.91.116.9:4263 , piece_id=DTT26U5JI4EUIJZOVVVFDCPVXSLAWFCT6BFVVWFGTN63YZ3FRXLA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862906553 (13h19m52.801322402s) [noise=true , address=104.36.82.9:4006 , piece_id=PSF3N3N7RPXDCDZVLRXYFYCVOT7WXMEVHYT7JJUZUDUJDDNWJZLA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863050348 (13h19m52.801466197s) [noise=true , address=77.90.31.18:4805 , piece_id=IJA4KGDBD6KJD6NXVNI6HEXYY6MPRDZZTWUJX2CNPKBU3T75YNLA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863162232 (13h19m52.801578081s) [noise=true , address=77.90.31.10:4517 , piece_id=JROHDGYTTG57KVZ62P6PM7QXHWOS2T55BXDCMHB7C2S4YGF2E73A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863263736 (13h19m52.801679585s) [noise=true , address=45.91.116.6:4973 , piece_id=AZIPOBQLKMOYFYYNBSCYVWTXBFTO23D5M3GCR6AAO7B4JQM7ZEVA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863407952 (13h19m52.801823801s) [noise=true , address=77.90.31.18:4807 , piece_id=JBDXLQBPQHGWXGJ2Q6MGMG7MRTN3FCV2QHFTKS5XE2ONFSW7VZ6A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863462657 (13h19m52.801878506s) [noise=true , address=77.90.31.11:4555 , piece_id=7LMIE2NKIXDHXK6PSJBOOXDDMV6EDC2B6DKTT54KC2EQTOP6QRRA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863671396 (13h19m52.802087235s) [noise=true , address=104.36.82.12:4150 , piece_id=R5KDMNNWKKXP5VH4NZDDBOBLEI6QDIISOCGIZWQC3XGWZJ54HM7A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.866072811 (13h19m52.80448866s) [noise=true , address=45.91.116.14:4189 , piece_id=SV7CXDGZSOLJRNF66GMH4FAWRO6VUOUVW4GKMCN7RRSZYRPCP34A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:46.602566612 (13h19m54.540982461s) [upload=12768]: Next returned nil segment Aug 7 03:28:46.602584987 (13h19m54.541000836s) [upload=12768]: Waiting for error group managing segments... Aug 7 03:28:46.879071462 (13h19m54.817487301s) [noise=true , address=77.90.31.10:4517 , piece_id=JROHDGYTTG57KVZ62P6PM7QXHWOS2T55BXDCMHB7C2S4YGF2E73A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.892476459 (13h19m54.830892298s) [noise=true , address=45.91.116.9:4263 , piece_id=DTT26U5JI4EUIJZOVVVFDCPVXSLAWFCT6BFVVWFGTN63YZ3FRXLA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.922922511 (13h19m54.86133836s) [noise=true , address=104.36.82.12:4150 , piece_id=R5KDMNNWKKXP5VH4NZDDBOBLEI6QDIISOCGIZWQC3XGWZJ54HM7A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.941555732 (13h19m54.879971581s) [noise=true , address=45.91.116.10:4081 , piece_id=HNR4SQQNQ5NXURX5UHPBOXU4GA3JXEGYNB47TTDPJONSFT6S6QXQ, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.949205798 (13h19m54.887621647s) [noise=true , address=45.91.116.6:4973 , piece_id=AZIPOBQLKMOYFYYNBSCYVWTXBFTO23D5M3GCR6AAO7B4JQM7ZEVA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.950523069 (13h19m54.888938918s) [noise=true , address=77.90.31.18:4805 , piece_id=IJA4KGDBD6KJD6NXVNI6HEXYY6MPRDZZTWUJX2CNPKBU3T75YNLA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.979618908 (13h19m54.918034757s) [noise=true , address=45.91.116.13:4154 , piece_id=ZPGJKCFH6DY3H7PMDZP6RIUD4756OI72YR6AWXX3BDT2B5VT7WBA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.982696867 (13h19m54.921112716s) [noise=true , address=77.90.31.18:4806 , piece_id=WG3WEWCPUTC3ZPCR6BRN3SKDGZZVVXYY52H2J6OF7UXDBO6HAK5A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.996455200 (13h19m54.934871049s) [noise=true , address=104.36.82.8:4971 , piece_id=TITIMRNQC6XGL7V5D2FFLUKZMH7WS7ZKHQRXQO7UVPP4XZ3H7TJA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.998128342 (13h19m54.936544181s) [noise=true , address=45.91.116.14:4189 , piece_id=SV7CXDGZSOLJRNF66GMH4FAWRO6VUOUVW4GKMCN7RRSZYRPCP34A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.004708831 (13h19m54.94312468s) [noise=true , address=104.36.82.9:4006 , piece_id=PSF3N3N7RPXDCDZVLRXYFYCVOT7WXMEVHYT7JJUZUDUJDDNWJZLA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.007888294 (13h19m54.946304143s) [noise=true , address=104.36.82.7:4911 , piece_id=MQEV5OGZMVK2NDQUJRRM5LBL57H7PV4NQBBFC7ENA6K3QV4G2ZFA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.066682153 (13h19m55.005098002s) [noise=true , address=77.90.31.18:4807 , piece_id=JBDXLQBPQHGWXGJ2Q6MGMG7MRTN3FCV2QHFTKS5XE2ONFSW7VZ6A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.066705959 (13h19m55.005121808s) [seg_pos={0 0}, upload=12768]: Segment reached optimal threshold of 13 pieces. Aug 7 03:28:47.066812673 (13h19m55.005228522s) [noise=true , address=45.91.116.4:4940 , piece_id=T53PUFTY6HYKFKE2IWTFEXOEE2WB5NMSKLOY4AHPNGWEMDUANJRA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:47.066870153 (13h19m55.005285992s) [noise=true , address=77.90.31.11:4555 , piece_id=7LMIE2NKIXDHXK6PSJBOOXDDMV6EDC2B6DKTT54KC2EQTOP6QRRA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:47.066882947 (13h19m55.005298796s) [noise=true , address=77.90.31.15:4698 , piece_id=4DVMT6PTWCEZ4ICGDCJ7ZAHP3GSEBCC3WGS3OTR2AYD2XAQAA6UQ, seg_pos={0 0}, upload=12768]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:47.066892867 (13h19m55.005308716s) [seg_pos={0 0}, upload=12768]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 03:28:47.066966377 (13h19m55.005382226s) [upload=12768]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 03:28:47.066970666 (13h19m55.005386515s) [upload=12768]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 03:28:47.369311744 (13h19m55.307727593s) [upload=12768]: Done uploading segments... Aug 7 03:28:47.369329037 (13h19m55.307744886s) [upload=12768]: Upload finished. err: <nil> Duration: 5.943239075s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...........X....X....X......................................] duration: 1.968141826s FAIL (2025-08-07 03:32:28 UTC) orbiter warning: operation: DownloadObject uplink: object not found ("orbiter_us_0/1K") Duration: 1.968161855s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................................X..........X.............] duration: 5.678201764s FAIL (2025-08-07 03:31:56 UTC) orbiter warning: operation: DownloadObject uplink: object not found ("orbiter_us_0/4M") Duration: 5.678224376s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 23.60645712s FAIL (2025-08-07 03:31:42 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== DkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:09.452864198 (13h19m17.391280047s) [noise=true , address=45.91.116.11:4118 , piece_id=ZVKDKMJL3MRTSJNHCK6KVVCBYXEFGY4QNSCAMCJFYHAYNMGVFPRQ, seg_pos={0 0}, upload=12758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:09.452874778 (13h19m17.391290627s) [seg_pos={0 0}, upload=12758]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 03:28:09.452958438 (13h19m17.391374287s) [upload=12758]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 03:28:09.452962817 (13h19m17.391378666s) [upload=12758]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 03:28:09.747228138 (13h19m17.685644027s) [upload=12758]: Done uploading segments... Aug 7 03:28:09.747250910 (13h19m17.685666779s) [upload=12758]: Upload finished. err: <nil> Aug 7 03:28:44.605684325 (13h19m52.544100174s) [upload=12768]: Starting upload Aug 7 03:28:44.605739741 (13h19m52.54415559s) [upload=12768]: Done starting upload Aug 7 03:28:44.605848990 (13h19m52.54426484s) [upload=12768]: Uploading segments... Aug 7 03:28:44.605951336 (13h19m52.544367185s) [upload=12768]: Got next segment. Inline: false Aug 7 03:28:44.605995300 (13h19m52.544411149s) [upload=12768]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 03:28:44.606000089 (13h19m52.544415938s) [upload=12768]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 03:28:44.861620101 (13h19m52.80003594s) [seg_pos={0 0}, upload=12768]: Begin upload segment... Aug 7 03:28:44.861673774 (13h19m52.800089613s) [seg_pos={0 0}, upload=12768]: Done begin upload segment. Aug 7 03:28:44.861696257 (13h19m52.800112106s) [noise=true , address=104.36.82.7:4911 , piece_id=MQEV5OGZMVK2NDQUJRRM5LBL57H7PV4NQBBFC7ENA6K3QV4G2ZFA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.861789946 (13h19m52.800205825s) [noise=true , address=45.91.116.13:4154 , piece_id=ZPGJKCFH6DY3H7PMDZP6RIUD4756OI72YR6AWXX3BDT2B5VT7WBA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862065032 (13h19m52.800480881s) [noise=true , address=45.91.116.10:4081 , piece_id=HNR4SQQNQ5NXURX5UHPBOXU4GA3JXEGYNB47TTDPJONSFT6S6QXQ, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862279713 (13h19m52.800695562s) [noise=true , address=104.36.82.8:4971 , piece_id=TITIMRNQC6XGL7V5D2FFLUKZMH7WS7ZKHQRXQO7UVPP4XZ3H7TJA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862316884 (13h19m52.800732733s) [noise=true , address=45.91.116.4:4940 , piece_id=T53PUFTY6HYKFKE2IWTFEXOEE2WB5NMSKLOY4AHPNGWEMDUANJRA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862559979 (13h19m52.800975828s) [noise=true , address=77.90.31.15:4698 , piece_id=4DVMT6PTWCEZ4ICGDCJ7ZAHP3GSEBCC3WGS3OTR2AYD2XAQAA6UQ, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862586841 (13h19m52.80100269s) [noise=true , address=77.90.31.18:4806 , piece_id=WG3WEWCPUTC3ZPCR6BRN3SKDGZZVVXYY52H2J6OF7UXDBO6HAK5A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862803405 (13h19m52.801219254s) [noise=true , address=45.91.116.9:4263 , piece_id=DTT26U5JI4EUIJZOVVVFDCPVXSLAWFCT6BFVVWFGTN63YZ3FRXLA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862906553 (13h19m52.801322402s) [noise=true , address=104.36.82.9:4006 , piece_id=PSF3N3N7RPXDCDZVLRXYFYCVOT7WXMEVHYT7JJUZUDUJDDNWJZLA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863050348 (13h19m52.801466197s) [noise=true , address=77.90.31.18:4805 , piece_id=IJA4KGDBD6KJD6NXVNI6HEXYY6MPRDZZTWUJX2CNPKBU3T75YNLA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863162232 (13h19m52.801578081s) [noise=true , address=77.90.31.10:4517 , piece_id=JROHDGYTTG57KVZ62P6PM7QXHWOS2T55BXDCMHB7C2S4YGF2E73A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863263736 (13h19m52.801679585s) [noise=true , address=45.91.116.6:4973 , piece_id=AZIPOBQLKMOYFYYNBSCYVWTXBFTO23D5M3GCR6AAO7B4JQM7ZEVA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863407952 (13h19m52.801823801s) [noise=true , address=77.90.31.18:4807 , piece_id=JBDXLQBPQHGWXGJ2Q6MGMG7MRTN3FCV2QHFTKS5XE2ONFSW7VZ6A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863462657 (13h19m52.801878506s) [noise=true , address=77.90.31.11:4555 , piece_id=7LMIE2NKIXDHXK6PSJBOOXDDMV6EDC2B6DKTT54KC2EQTOP6QRRA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863671396 (13h19m52.802087235s) [noise=true , address=104.36.82.12:4150 , piece_id=R5KDMNNWKKXP5VH4NZDDBOBLEI6QDIISOCGIZWQC3XGWZJ54HM7A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.866072811 (13h19m52.80448866s) [noise=true , address=45.91.116.14:4189 , piece_id=SV7CXDGZSOLJRNF66GMH4FAWRO6VUOUVW4GKMCN7RRSZYRPCP34A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:46.602566612 (13h19m54.540982461s) [upload=12768]: Next returned nil segment Aug 7 03:28:46.602584987 (13h19m54.541000836s) [upload=12768]: Waiting for error group managing segments... Aug 7 03:28:46.879071462 (13h19m54.817487301s) [noise=true , address=77.90.31.10:4517 , piece_id=JROHDGYTTG57KVZ62P6PM7QXHWOS2T55BXDCMHB7C2S4YGF2E73A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.892476459 (13h19m54.830892298s) [noise=true , address=45.91.116.9:4263 , piece_id=DTT26U5JI4EUIJZOVVVFDCPVXSLAWFCT6BFVVWFGTN63YZ3FRXLA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.922922511 (13h19m54.86133836s) [noise=true , address=104.36.82.12:4150 , piece_id=R5KDMNNWKKXP5VH4NZDDBOBLEI6QDIISOCGIZWQC3XGWZJ54HM7A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.941555732 (13h19m54.879971581s) [noise=true , address=45.91.116.10:4081 , piece_id=HNR4SQQNQ5NXURX5UHPBOXU4GA3JXEGYNB47TTDPJONSFT6S6QXQ, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.949205798 (13h19m54.887621647s) [noise=true , address=45.91.116.6:4973 , piece_id=AZIPOBQLKMOYFYYNBSCYVWTXBFTO23D5M3GCR6AAO7B4JQM7ZEVA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.950523069 (13h19m54.888938918s) [noise=true , address=77.90.31.18:4805 , piece_id=IJA4KGDBD6KJD6NXVNI6HEXYY6MPRDZZTWUJX2CNPKBU3T75YNLA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.979618908 (13h19m54.918034757s) [noise=true , address=45.91.116.13:4154 , piece_id=ZPGJKCFH6DY3H7PMDZP6RIUD4756OI72YR6AWXX3BDT2B5VT7WBA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.982696867 (13h19m54.921112716s) [noise=true , address=77.90.31.18:4806 , piece_id=WG3WEWCPUTC3ZPCR6BRN3SKDGZZVVXYY52H2J6OF7UXDBO6HAK5A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.996455200 (13h19m54.934871049s) [noise=true , address=104.36.82.8:4971 , piece_id=TITIMRNQC6XGL7V5D2FFLUKZMH7WS7ZKHQRXQO7UVPP4XZ3H7TJA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.998128342 (13h19m54.936544181s) [noise=true , address=45.91.116.14:4189 , piece_id=SV7CXDGZSOLJRNF66GMH4FAWRO6VUOUVW4GKMCN7RRSZYRPCP34A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.004708831 (13h19m54.94312468s) [noise=true , address=104.36.82.9:4006 , piece_id=PSF3N3N7RPXDCDZVLRXYFYCVOT7WXMEVHYT7JJUZUDUJDDNWJZLA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.007888294 (13h19m54.946304143s) [noise=true , address=104.36.82.7:4911 , piece_id=MQEV5OGZMVK2NDQUJRRM5LBL57H7PV4NQBBFC7ENA6K3QV4G2ZFA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.066682153 (13h19m55.005098002s) [noise=true , address=77.90.31.18:4807 , piece_id=JBDXLQBPQHGWXGJ2Q6MGMG7MRTN3FCV2QHFTKS5XE2ONFSW7VZ6A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.066705959 (13h19m55.005121808s) [seg_pos={0 0}, upload=12768]: Segment reached optimal threshold of 13 pieces. Aug 7 03:28:47.066812673 (13h19m55.005228522s) [noise=true , address=45.91.116.4:4940 , piece_id=T53PUFTY6HYKFKE2IWTFEXOEE2WB5NMSKLOY4AHPNGWEMDUANJRA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:47.066870153 (13h19m55.005285992s) [noise=true , address=77.90.31.11:4555 , piece_id=7LMIE2NKIXDHXK6PSJBOOXDDMV6EDC2B6DKTT54KC2EQTOP6QRRA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:47.066882947 (13h19m55.005298796s) [noise=true , address=77.90.31.15:4698 , piece_id=4DVMT6PTWCEZ4ICGDCJ7ZAHP3GSEBCC3WGS3OTR2AYD2XAQAA6UQ, seg_pos={0 0}, upload=12768]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:47.066892867 (13h19m55.005308716s) [seg_pos={0 0}, upload=12768]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 03:28:47.066966377 (13h19m55.005382226s) [upload=12768]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 03:28:47.066970666 (13h19m55.005386515s) [upload=12768]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 03:28:47.369311744 (13h19m55.307727593s) [upload=12768]: Done uploading segments... Aug 7 03:28:47.369329037 (13h19m55.307744886s) [upload=12768]: Upload finished. err: <nil> Duration: 23.6064776s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [............X....X....X.....................................] duration: 1.888617754s FAIL (2025-08-07 03:31:37 UTC) orbiter warning: operation: DownloadObject uplink: object not found ("orbiter_us_0/1K") Duration: 1.888644827s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 14.527605281s FAIL (2025-08-07 03:31:07 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== DkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:09.452864198 (13h19m17.391280047s) [noise=true , address=45.91.116.11:4118 , piece_id=ZVKDKMJL3MRTSJNHCK6KVVCBYXEFGY4QNSCAMCJFYHAYNMGVFPRQ, seg_pos={0 0}, upload=12758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:09.452874778 (13h19m17.391290627s) [seg_pos={0 0}, upload=12758]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 03:28:09.452958438 (13h19m17.391374287s) [upload=12758]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 03:28:09.452962817 (13h19m17.391378666s) [upload=12758]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 03:28:09.747228138 (13h19m17.685644027s) [upload=12758]: Done uploading segments... Aug 7 03:28:09.747250910 (13h19m17.685666779s) [upload=12758]: Upload finished. err: <nil> Aug 7 03:28:44.605684325 (13h19m52.544100174s) [upload=12768]: Starting upload Aug 7 03:28:44.605739741 (13h19m52.54415559s) [upload=12768]: Done starting upload Aug 7 03:28:44.605848990 (13h19m52.54426484s) [upload=12768]: Uploading segments... Aug 7 03:28:44.605951336 (13h19m52.544367185s) [upload=12768]: Got next segment. Inline: false Aug 7 03:28:44.605995300 (13h19m52.544411149s) [upload=12768]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 03:28:44.606000089 (13h19m52.544415938s) [upload=12768]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 03:28:44.861620101 (13h19m52.80003594s) [seg_pos={0 0}, upload=12768]: Begin upload segment... Aug 7 03:28:44.861673774 (13h19m52.800089613s) [seg_pos={0 0}, upload=12768]: Done begin upload segment. Aug 7 03:28:44.861696257 (13h19m52.800112106s) [noise=true , address=104.36.82.7:4911 , piece_id=MQEV5OGZMVK2NDQUJRRM5LBL57H7PV4NQBBFC7ENA6K3QV4G2ZFA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.861789946 (13h19m52.800205825s) [noise=true , address=45.91.116.13:4154 , piece_id=ZPGJKCFH6DY3H7PMDZP6RIUD4756OI72YR6AWXX3BDT2B5VT7WBA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862065032 (13h19m52.800480881s) [noise=true , address=45.91.116.10:4081 , piece_id=HNR4SQQNQ5NXURX5UHPBOXU4GA3JXEGYNB47TTDPJONSFT6S6QXQ, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862279713 (13h19m52.800695562s) [noise=true , address=104.36.82.8:4971 , piece_id=TITIMRNQC6XGL7V5D2FFLUKZMH7WS7ZKHQRXQO7UVPP4XZ3H7TJA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862316884 (13h19m52.800732733s) [noise=true , address=45.91.116.4:4940 , piece_id=T53PUFTY6HYKFKE2IWTFEXOEE2WB5NMSKLOY4AHPNGWEMDUANJRA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862559979 (13h19m52.800975828s) [noise=true , address=77.90.31.15:4698 , piece_id=4DVMT6PTWCEZ4ICGDCJ7ZAHP3GSEBCC3WGS3OTR2AYD2XAQAA6UQ, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862586841 (13h19m52.80100269s) [noise=true , address=77.90.31.18:4806 , piece_id=WG3WEWCPUTC3ZPCR6BRN3SKDGZZVVXYY52H2J6OF7UXDBO6HAK5A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862803405 (13h19m52.801219254s) [noise=true , address=45.91.116.9:4263 , piece_id=DTT26U5JI4EUIJZOVVVFDCPVXSLAWFCT6BFVVWFGTN63YZ3FRXLA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862906553 (13h19m52.801322402s) [noise=true , address=104.36.82.9:4006 , piece_id=PSF3N3N7RPXDCDZVLRXYFYCVOT7WXMEVHYT7JJUZUDUJDDNWJZLA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863050348 (13h19m52.801466197s) [noise=true , address=77.90.31.18:4805 , piece_id=IJA4KGDBD6KJD6NXVNI6HEXYY6MPRDZZTWUJX2CNPKBU3T75YNLA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863162232 (13h19m52.801578081s) [noise=true , address=77.90.31.10:4517 , piece_id=JROHDGYTTG57KVZ62P6PM7QXHWOS2T55BXDCMHB7C2S4YGF2E73A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863263736 (13h19m52.801679585s) [noise=true , address=45.91.116.6:4973 , piece_id=AZIPOBQLKMOYFYYNBSCYVWTXBFTO23D5M3GCR6AAO7B4JQM7ZEVA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863407952 (13h19m52.801823801s) [noise=true , address=77.90.31.18:4807 , piece_id=JBDXLQBPQHGWXGJ2Q6MGMG7MRTN3FCV2QHFTKS5XE2ONFSW7VZ6A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863462657 (13h19m52.801878506s) [noise=true , address=77.90.31.11:4555 , piece_id=7LMIE2NKIXDHXK6PSJBOOXDDMV6EDC2B6DKTT54KC2EQTOP6QRRA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863671396 (13h19m52.802087235s) [noise=true , address=104.36.82.12:4150 , piece_id=R5KDMNNWKKXP5VH4NZDDBOBLEI6QDIISOCGIZWQC3XGWZJ54HM7A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.866072811 (13h19m52.80448866s) [noise=true , address=45.91.116.14:4189 , piece_id=SV7CXDGZSOLJRNF66GMH4FAWRO6VUOUVW4GKMCN7RRSZYRPCP34A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:46.602566612 (13h19m54.540982461s) [upload=12768]: Next returned nil segment Aug 7 03:28:46.602584987 (13h19m54.541000836s) [upload=12768]: Waiting for error group managing segments... Aug 7 03:28:46.879071462 (13h19m54.817487301s) [noise=true , address=77.90.31.10:4517 , piece_id=JROHDGYTTG57KVZ62P6PM7QXHWOS2T55BXDCMHB7C2S4YGF2E73A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.892476459 (13h19m54.830892298s) [noise=true , address=45.91.116.9:4263 , piece_id=DTT26U5JI4EUIJZOVVVFDCPVXSLAWFCT6BFVVWFGTN63YZ3FRXLA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.922922511 (13h19m54.86133836s) [noise=true , address=104.36.82.12:4150 , piece_id=R5KDMNNWKKXP5VH4NZDDBOBLEI6QDIISOCGIZWQC3XGWZJ54HM7A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.941555732 (13h19m54.879971581s) [noise=true , address=45.91.116.10:4081 , piece_id=HNR4SQQNQ5NXURX5UHPBOXU4GA3JXEGYNB47TTDPJONSFT6S6QXQ, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.949205798 (13h19m54.887621647s) [noise=true , address=45.91.116.6:4973 , piece_id=AZIPOBQLKMOYFYYNBSCYVWTXBFTO23D5M3GCR6AAO7B4JQM7ZEVA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.950523069 (13h19m54.888938918s) [noise=true , address=77.90.31.18:4805 , piece_id=IJA4KGDBD6KJD6NXVNI6HEXYY6MPRDZZTWUJX2CNPKBU3T75YNLA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.979618908 (13h19m54.918034757s) [noise=true , address=45.91.116.13:4154 , piece_id=ZPGJKCFH6DY3H7PMDZP6RIUD4756OI72YR6AWXX3BDT2B5VT7WBA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.982696867 (13h19m54.921112716s) [noise=true , address=77.90.31.18:4806 , piece_id=WG3WEWCPUTC3ZPCR6BRN3SKDGZZVVXYY52H2J6OF7UXDBO6HAK5A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.996455200 (13h19m54.934871049s) [noise=true , address=104.36.82.8:4971 , piece_id=TITIMRNQC6XGL7V5D2FFLUKZMH7WS7ZKHQRXQO7UVPP4XZ3H7TJA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.998128342 (13h19m54.936544181s) [noise=true , address=45.91.116.14:4189 , piece_id=SV7CXDGZSOLJRNF66GMH4FAWRO6VUOUVW4GKMCN7RRSZYRPCP34A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.004708831 (13h19m54.94312468s) [noise=true , address=104.36.82.9:4006 , piece_id=PSF3N3N7RPXDCDZVLRXYFYCVOT7WXMEVHYT7JJUZUDUJDDNWJZLA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.007888294 (13h19m54.946304143s) [noise=true , address=104.36.82.7:4911 , piece_id=MQEV5OGZMVK2NDQUJRRM5LBL57H7PV4NQBBFC7ENA6K3QV4G2ZFA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.066682153 (13h19m55.005098002s) [noise=true , address=77.90.31.18:4807 , piece_id=JBDXLQBPQHGWXGJ2Q6MGMG7MRTN3FCV2QHFTKS5XE2ONFSW7VZ6A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.066705959 (13h19m55.005121808s) [seg_pos={0 0}, upload=12768]: Segment reached optimal threshold of 13 pieces. Aug 7 03:28:47.066812673 (13h19m55.005228522s) [noise=true , address=45.91.116.4:4940 , piece_id=T53PUFTY6HYKFKE2IWTFEXOEE2WB5NMSKLOY4AHPNGWEMDUANJRA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:47.066870153 (13h19m55.005285992s) [noise=true , address=77.90.31.11:4555 , piece_id=7LMIE2NKIXDHXK6PSJBOOXDDMV6EDC2B6DKTT54KC2EQTOP6QRRA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:47.066882947 (13h19m55.005298796s) [noise=true , address=77.90.31.15:4698 , piece_id=4DVMT6PTWCEZ4ICGDCJ7ZAHP3GSEBCC3WGS3OTR2AYD2XAQAA6UQ, seg_pos={0 0}, upload=12768]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:47.066892867 (13h19m55.005308716s) [seg_pos={0 0}, upload=12768]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 03:28:47.066966377 (13h19m55.005382226s) [upload=12768]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 03:28:47.066970666 (13h19m55.005386515s) [upload=12768]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 03:28:47.369311744 (13h19m55.307727593s) [upload=12768]: Done uploading segments... Aug 7 03:28:47.369329037 (13h19m55.307744886s) [upload=12768]: Upload finished. err: <nil> Duration: 14.527634126s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................................X..........X............] duration: 5.725937026s FAIL (2025-08-07 03:30:53 UTC) orbiter warning: operation: DownloadObject uplink: object not found ("orbiter_us_0/4M") Duration: 5.725969379s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................................X..........X...........] duration: 5.966300217s FAIL (2025-08-07 03:30:34 UTC) orbiter warning: operation: DownloadObject uplink: object not found ("orbiter_us_0/4M") Duration: 5.966325153s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.............X....X....X....................................] duration: 1.861163379s FAIL (2025-08-07 03:30:24 UTC) orbiter warning: operation: DownloadObject uplink: object not found ("orbiter_us_0/1K") Duration: 1.861194938s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 5.88935573s FAIL (2025-08-07 03:30:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== DkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:09.452864198 (13h19m17.391280047s) [noise=true , address=45.91.116.11:4118 , piece_id=ZVKDKMJL3MRTSJNHCK6KVVCBYXEFGY4QNSCAMCJFYHAYNMGVFPRQ, seg_pos={0 0}, upload=12758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:09.452874778 (13h19m17.391290627s) [seg_pos={0 0}, upload=12758]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 03:28:09.452958438 (13h19m17.391374287s) [upload=12758]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 03:28:09.452962817 (13h19m17.391378666s) [upload=12758]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 03:28:09.747228138 (13h19m17.685644027s) [upload=12758]: Done uploading segments... Aug 7 03:28:09.747250910 (13h19m17.685666779s) [upload=12758]: Upload finished. err: <nil> Aug 7 03:28:44.605684325 (13h19m52.544100174s) [upload=12768]: Starting upload Aug 7 03:28:44.605739741 (13h19m52.54415559s) [upload=12768]: Done starting upload Aug 7 03:28:44.605848990 (13h19m52.54426484s) [upload=12768]: Uploading segments... Aug 7 03:28:44.605951336 (13h19m52.544367185s) [upload=12768]: Got next segment. Inline: false Aug 7 03:28:44.605995300 (13h19m52.544411149s) [upload=12768]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 03:28:44.606000089 (13h19m52.544415938s) [upload=12768]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 03:28:44.861620101 (13h19m52.80003594s) [seg_pos={0 0}, upload=12768]: Begin upload segment... Aug 7 03:28:44.861673774 (13h19m52.800089613s) [seg_pos={0 0}, upload=12768]: Done begin upload segment. Aug 7 03:28:44.861696257 (13h19m52.800112106s) [noise=true , address=104.36.82.7:4911 , piece_id=MQEV5OGZMVK2NDQUJRRM5LBL57H7PV4NQBBFC7ENA6K3QV4G2ZFA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.861789946 (13h19m52.800205825s) [noise=true , address=45.91.116.13:4154 , piece_id=ZPGJKCFH6DY3H7PMDZP6RIUD4756OI72YR6AWXX3BDT2B5VT7WBA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862065032 (13h19m52.800480881s) [noise=true , address=45.91.116.10:4081 , piece_id=HNR4SQQNQ5NXURX5UHPBOXU4GA3JXEGYNB47TTDPJONSFT6S6QXQ, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862279713 (13h19m52.800695562s) [noise=true , address=104.36.82.8:4971 , piece_id=TITIMRNQC6XGL7V5D2FFLUKZMH7WS7ZKHQRXQO7UVPP4XZ3H7TJA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862316884 (13h19m52.800732733s) [noise=true , address=45.91.116.4:4940 , piece_id=T53PUFTY6HYKFKE2IWTFEXOEE2WB5NMSKLOY4AHPNGWEMDUANJRA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862559979 (13h19m52.800975828s) [noise=true , address=77.90.31.15:4698 , piece_id=4DVMT6PTWCEZ4ICGDCJ7ZAHP3GSEBCC3WGS3OTR2AYD2XAQAA6UQ, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862586841 (13h19m52.80100269s) [noise=true , address=77.90.31.18:4806 , piece_id=WG3WEWCPUTC3ZPCR6BRN3SKDGZZVVXYY52H2J6OF7UXDBO6HAK5A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862803405 (13h19m52.801219254s) [noise=true , address=45.91.116.9:4263 , piece_id=DTT26U5JI4EUIJZOVVVFDCPVXSLAWFCT6BFVVWFGTN63YZ3FRXLA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862906553 (13h19m52.801322402s) [noise=true , address=104.36.82.9:4006 , piece_id=PSF3N3N7RPXDCDZVLRXYFYCVOT7WXMEVHYT7JJUZUDUJDDNWJZLA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863050348 (13h19m52.801466197s) [noise=true , address=77.90.31.18:4805 , piece_id=IJA4KGDBD6KJD6NXVNI6HEXYY6MPRDZZTWUJX2CNPKBU3T75YNLA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863162232 (13h19m52.801578081s) [noise=true , address=77.90.31.10:4517 , piece_id=JROHDGYTTG57KVZ62P6PM7QXHWOS2T55BXDCMHB7C2S4YGF2E73A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863263736 (13h19m52.801679585s) [noise=true , address=45.91.116.6:4973 , piece_id=AZIPOBQLKMOYFYYNBSCYVWTXBFTO23D5M3GCR6AAO7B4JQM7ZEVA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863407952 (13h19m52.801823801s) [noise=true , address=77.90.31.18:4807 , piece_id=JBDXLQBPQHGWXGJ2Q6MGMG7MRTN3FCV2QHFTKS5XE2ONFSW7VZ6A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863462657 (13h19m52.801878506s) [noise=true , address=77.90.31.11:4555 , piece_id=7LMIE2NKIXDHXK6PSJBOOXDDMV6EDC2B6DKTT54KC2EQTOP6QRRA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863671396 (13h19m52.802087235s) [noise=true , address=104.36.82.12:4150 , piece_id=R5KDMNNWKKXP5VH4NZDDBOBLEI6QDIISOCGIZWQC3XGWZJ54HM7A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.866072811 (13h19m52.80448866s) [noise=true , address=45.91.116.14:4189 , piece_id=SV7CXDGZSOLJRNF66GMH4FAWRO6VUOUVW4GKMCN7RRSZYRPCP34A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:46.602566612 (13h19m54.540982461s) [upload=12768]: Next returned nil segment Aug 7 03:28:46.602584987 (13h19m54.541000836s) [upload=12768]: Waiting for error group managing segments... Aug 7 03:28:46.879071462 (13h19m54.817487301s) [noise=true , address=77.90.31.10:4517 , piece_id=JROHDGYTTG57KVZ62P6PM7QXHWOS2T55BXDCMHB7C2S4YGF2E73A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.892476459 (13h19m54.830892298s) [noise=true , address=45.91.116.9:4263 , piece_id=DTT26U5JI4EUIJZOVVVFDCPVXSLAWFCT6BFVVWFGTN63YZ3FRXLA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.922922511 (13h19m54.86133836s) [noise=true , address=104.36.82.12:4150 , piece_id=R5KDMNNWKKXP5VH4NZDDBOBLEI6QDIISOCGIZWQC3XGWZJ54HM7A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.941555732 (13h19m54.879971581s) [noise=true , address=45.91.116.10:4081 , piece_id=HNR4SQQNQ5NXURX5UHPBOXU4GA3JXEGYNB47TTDPJONSFT6S6QXQ, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.949205798 (13h19m54.887621647s) [noise=true , address=45.91.116.6:4973 , piece_id=AZIPOBQLKMOYFYYNBSCYVWTXBFTO23D5M3GCR6AAO7B4JQM7ZEVA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.950523069 (13h19m54.888938918s) [noise=true , address=77.90.31.18:4805 , piece_id=IJA4KGDBD6KJD6NXVNI6HEXYY6MPRDZZTWUJX2CNPKBU3T75YNLA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.979618908 (13h19m54.918034757s) [noise=true , address=45.91.116.13:4154 , piece_id=ZPGJKCFH6DY3H7PMDZP6RIUD4756OI72YR6AWXX3BDT2B5VT7WBA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.982696867 (13h19m54.921112716s) [noise=true , address=77.90.31.18:4806 , piece_id=WG3WEWCPUTC3ZPCR6BRN3SKDGZZVVXYY52H2J6OF7UXDBO6HAK5A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.996455200 (13h19m54.934871049s) [noise=true , address=104.36.82.8:4971 , piece_id=TITIMRNQC6XGL7V5D2FFLUKZMH7WS7ZKHQRXQO7UVPP4XZ3H7TJA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.998128342 (13h19m54.936544181s) [noise=true , address=45.91.116.14:4189 , piece_id=SV7CXDGZSOLJRNF66GMH4FAWRO6VUOUVW4GKMCN7RRSZYRPCP34A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.004708831 (13h19m54.94312468s) [noise=true , address=104.36.82.9:4006 , piece_id=PSF3N3N7RPXDCDZVLRXYFYCVOT7WXMEVHYT7JJUZUDUJDDNWJZLA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.007888294 (13h19m54.946304143s) [noise=true , address=104.36.82.7:4911 , piece_id=MQEV5OGZMVK2NDQUJRRM5LBL57H7PV4NQBBFC7ENA6K3QV4G2ZFA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.066682153 (13h19m55.005098002s) [noise=true , address=77.90.31.18:4807 , piece_id=JBDXLQBPQHGWXGJ2Q6MGMG7MRTN3FCV2QHFTKS5XE2ONFSW7VZ6A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.066705959 (13h19m55.005121808s) [seg_pos={0 0}, upload=12768]: Segment reached optimal threshold of 13 pieces. Aug 7 03:28:47.066812673 (13h19m55.005228522s) [noise=true , address=45.91.116.4:4940 , piece_id=T53PUFTY6HYKFKE2IWTFEXOEE2WB5NMSKLOY4AHPNGWEMDUANJRA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:47.066870153 (13h19m55.005285992s) [noise=true , address=77.90.31.11:4555 , piece_id=7LMIE2NKIXDHXK6PSJBOOXDDMV6EDC2B6DKTT54KC2EQTOP6QRRA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:47.066882947 (13h19m55.005298796s) [noise=true , address=77.90.31.15:4698 , piece_id=4DVMT6PTWCEZ4ICGDCJ7ZAHP3GSEBCC3WGS3OTR2AYD2XAQAA6UQ, seg_pos={0 0}, upload=12768]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:47.066892867 (13h19m55.005308716s) [seg_pos={0 0}, upload=12768]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 03:28:47.066966377 (13h19m55.005382226s) [upload=12768]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 03:28:47.066970666 (13h19m55.005386515s) [upload=12768]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 03:28:47.369311744 (13h19m55.307727593s) [upload=12768]: Done uploading segments... Aug 7 03:28:47.369329037 (13h19m55.307744886s) [upload=12768]: Upload finished. err: <nil> Duration: 5.88938714s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..............X....X....X...................................] duration: 1.841728543s FAIL (2025-08-07 03:29:59 UTC) orbiter warning: operation: DownloadObject uplink: object not found ("orbiter_us_0/1K") Duration: 1.841751706s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 19.688858218s FAIL (2025-08-07 03:29:55 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== DkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:09.452864198 (13h19m17.391280047s) [noise=true , address=45.91.116.11:4118 , piece_id=ZVKDKMJL3MRTSJNHCK6KVVCBYXEFGY4QNSCAMCJFYHAYNMGVFPRQ, seg_pos={0 0}, upload=12758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:09.452874778 (13h19m17.391290627s) [seg_pos={0 0}, upload=12758]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 03:28:09.452958438 (13h19m17.391374287s) [upload=12758]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 03:28:09.452962817 (13h19m17.391378666s) [upload=12758]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 03:28:09.747228138 (13h19m17.685644027s) [upload=12758]: Done uploading segments... Aug 7 03:28:09.747250910 (13h19m17.685666779s) [upload=12758]: Upload finished. err: <nil> Aug 7 03:28:44.605684325 (13h19m52.544100174s) [upload=12768]: Starting upload Aug 7 03:28:44.605739741 (13h19m52.54415559s) [upload=12768]: Done starting upload Aug 7 03:28:44.605848990 (13h19m52.54426484s) [upload=12768]: Uploading segments... Aug 7 03:28:44.605951336 (13h19m52.544367185s) [upload=12768]: Got next segment. Inline: false Aug 7 03:28:44.605995300 (13h19m52.544411149s) [upload=12768]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 03:28:44.606000089 (13h19m52.544415938s) [upload=12768]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 03:28:44.861620101 (13h19m52.80003594s) [seg_pos={0 0}, upload=12768]: Begin upload segment... Aug 7 03:28:44.861673774 (13h19m52.800089613s) [seg_pos={0 0}, upload=12768]: Done begin upload segment. Aug 7 03:28:44.861696257 (13h19m52.800112106s) [noise=true , address=104.36.82.7:4911 , piece_id=MQEV5OGZMVK2NDQUJRRM5LBL57H7PV4NQBBFC7ENA6K3QV4G2ZFA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.861789946 (13h19m52.800205825s) [noise=true , address=45.91.116.13:4154 , piece_id=ZPGJKCFH6DY3H7PMDZP6RIUD4756OI72YR6AWXX3BDT2B5VT7WBA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862065032 (13h19m52.800480881s) [noise=true , address=45.91.116.10:4081 , piece_id=HNR4SQQNQ5NXURX5UHPBOXU4GA3JXEGYNB47TTDPJONSFT6S6QXQ, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862279713 (13h19m52.800695562s) [noise=true , address=104.36.82.8:4971 , piece_id=TITIMRNQC6XGL7V5D2FFLUKZMH7WS7ZKHQRXQO7UVPP4XZ3H7TJA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862316884 (13h19m52.800732733s) [noise=true , address=45.91.116.4:4940 , piece_id=T53PUFTY6HYKFKE2IWTFEXOEE2WB5NMSKLOY4AHPNGWEMDUANJRA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862559979 (13h19m52.800975828s) [noise=true , address=77.90.31.15:4698 , piece_id=4DVMT6PTWCEZ4ICGDCJ7ZAHP3GSEBCC3WGS3OTR2AYD2XAQAA6UQ, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862586841 (13h19m52.80100269s) [noise=true , address=77.90.31.18:4806 , piece_id=WG3WEWCPUTC3ZPCR6BRN3SKDGZZVVXYY52H2J6OF7UXDBO6HAK5A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862803405 (13h19m52.801219254s) [noise=true , address=45.91.116.9:4263 , piece_id=DTT26U5JI4EUIJZOVVVFDCPVXSLAWFCT6BFVVWFGTN63YZ3FRXLA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862906553 (13h19m52.801322402s) [noise=true , address=104.36.82.9:4006 , piece_id=PSF3N3N7RPXDCDZVLRXYFYCVOT7WXMEVHYT7JJUZUDUJDDNWJZLA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863050348 (13h19m52.801466197s) [noise=true , address=77.90.31.18:4805 , piece_id=IJA4KGDBD6KJD6NXVNI6HEXYY6MPRDZZTWUJX2CNPKBU3T75YNLA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863162232 (13h19m52.801578081s) [noise=true , address=77.90.31.10:4517 , piece_id=JROHDGYTTG57KVZ62P6PM7QXHWOS2T55BXDCMHB7C2S4YGF2E73A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863263736 (13h19m52.801679585s) [noise=true , address=45.91.116.6:4973 , piece_id=AZIPOBQLKMOYFYYNBSCYVWTXBFTO23D5M3GCR6AAO7B4JQM7ZEVA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863407952 (13h19m52.801823801s) [noise=true , address=77.90.31.18:4807 , piece_id=JBDXLQBPQHGWXGJ2Q6MGMG7MRTN3FCV2QHFTKS5XE2ONFSW7VZ6A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863462657 (13h19m52.801878506s) [noise=true , address=77.90.31.11:4555 , piece_id=7LMIE2NKIXDHXK6PSJBOOXDDMV6EDC2B6DKTT54KC2EQTOP6QRRA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863671396 (13h19m52.802087235s) [noise=true , address=104.36.82.12:4150 , piece_id=R5KDMNNWKKXP5VH4NZDDBOBLEI6QDIISOCGIZWQC3XGWZJ54HM7A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.866072811 (13h19m52.80448866s) [noise=true , address=45.91.116.14:4189 , piece_id=SV7CXDGZSOLJRNF66GMH4FAWRO6VUOUVW4GKMCN7RRSZYRPCP34A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:46.602566612 (13h19m54.540982461s) [upload=12768]: Next returned nil segment Aug 7 03:28:46.602584987 (13h19m54.541000836s) [upload=12768]: Waiting for error group managing segments... Aug 7 03:28:46.879071462 (13h19m54.817487301s) [noise=true , address=77.90.31.10:4517 , piece_id=JROHDGYTTG57KVZ62P6PM7QXHWOS2T55BXDCMHB7C2S4YGF2E73A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.892476459 (13h19m54.830892298s) [noise=true , address=45.91.116.9:4263 , piece_id=DTT26U5JI4EUIJZOVVVFDCPVXSLAWFCT6BFVVWFGTN63YZ3FRXLA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.922922511 (13h19m54.86133836s) [noise=true , address=104.36.82.12:4150 , piece_id=R5KDMNNWKKXP5VH4NZDDBOBLEI6QDIISOCGIZWQC3XGWZJ54HM7A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.941555732 (13h19m54.879971581s) [noise=true , address=45.91.116.10:4081 , piece_id=HNR4SQQNQ5NXURX5UHPBOXU4GA3JXEGYNB47TTDPJONSFT6S6QXQ, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.949205798 (13h19m54.887621647s) [noise=true , address=45.91.116.6:4973 , piece_id=AZIPOBQLKMOYFYYNBSCYVWTXBFTO23D5M3GCR6AAO7B4JQM7ZEVA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.950523069 (13h19m54.888938918s) [noise=true , address=77.90.31.18:4805 , piece_id=IJA4KGDBD6KJD6NXVNI6HEXYY6MPRDZZTWUJX2CNPKBU3T75YNLA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.979618908 (13h19m54.918034757s) [noise=true , address=45.91.116.13:4154 , piece_id=ZPGJKCFH6DY3H7PMDZP6RIUD4756OI72YR6AWXX3BDT2B5VT7WBA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.982696867 (13h19m54.921112716s) [noise=true , address=77.90.31.18:4806 , piece_id=WG3WEWCPUTC3ZPCR6BRN3SKDGZZVVXYY52H2J6OF7UXDBO6HAK5A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.996455200 (13h19m54.934871049s) [noise=true , address=104.36.82.8:4971 , piece_id=TITIMRNQC6XGL7V5D2FFLUKZMH7WS7ZKHQRXQO7UVPP4XZ3H7TJA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.998128342 (13h19m54.936544181s) [noise=true , address=45.91.116.14:4189 , piece_id=SV7CXDGZSOLJRNF66GMH4FAWRO6VUOUVW4GKMCN7RRSZYRPCP34A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.004708831 (13h19m54.94312468s) [noise=true , address=104.36.82.9:4006 , piece_id=PSF3N3N7RPXDCDZVLRXYFYCVOT7WXMEVHYT7JJUZUDUJDDNWJZLA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.007888294 (13h19m54.946304143s) [noise=true , address=104.36.82.7:4911 , piece_id=MQEV5OGZMVK2NDQUJRRM5LBL57H7PV4NQBBFC7ENA6K3QV4G2ZFA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.066682153 (13h19m55.005098002s) [noise=true , address=77.90.31.18:4807 , piece_id=JBDXLQBPQHGWXGJ2Q6MGMG7MRTN3FCV2QHFTKS5XE2ONFSW7VZ6A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.066705959 (13h19m55.005121808s) [seg_pos={0 0}, upload=12768]: Segment reached optimal threshold of 13 pieces. Aug 7 03:28:47.066812673 (13h19m55.005228522s) [noise=true , address=45.91.116.4:4940 , piece_id=T53PUFTY6HYKFKE2IWTFEXOEE2WB5NMSKLOY4AHPNGWEMDUANJRA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:47.066870153 (13h19m55.005285992s) [noise=true , address=77.90.31.11:4555 , piece_id=7LMIE2NKIXDHXK6PSJBOOXDDMV6EDC2B6DKTT54KC2EQTOP6QRRA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:47.066882947 (13h19m55.005298796s) [noise=true , address=77.90.31.15:4698 , piece_id=4DVMT6PTWCEZ4ICGDCJ7ZAHP3GSEBCC3WGS3OTR2AYD2XAQAA6UQ, seg_pos={0 0}, upload=12768]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:47.066892867 (13h19m55.005308716s) [seg_pos={0 0}, upload=12768]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 03:28:47.066966377 (13h19m55.005382226s) [upload=12768]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 03:28:47.066970666 (13h19m55.005386515s) [upload=12768]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 03:28:47.369311744 (13h19m55.307727593s) [upload=12768]: Done uploading segments... Aug 7 03:28:47.369329037 (13h19m55.307744886s) [upload=12768]: Upload finished. err: <nil> Duration: 19.688886672s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................................X..........X..........] duration: 5.574936109s FAIL (2025-08-07 03:29:55 UTC) orbiter warning: operation: DownloadObject uplink: object not found ("orbiter_us_0/4M") Duration: 5.574963429s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 5.895991985s FAIL (2025-08-07 03:29:20 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== DkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:09.452864198 (13h19m17.391280047s) [noise=true , address=45.91.116.11:4118 , piece_id=ZVKDKMJL3MRTSJNHCK6KVVCBYXEFGY4QNSCAMCJFYHAYNMGVFPRQ, seg_pos={0 0}, upload=12758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:09.452874778 (13h19m17.391290627s) [seg_pos={0 0}, upload=12758]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 03:28:09.452958438 (13h19m17.391374287s) [upload=12758]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 03:28:09.452962817 (13h19m17.391378666s) [upload=12758]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 03:28:09.747228138 (13h19m17.685644027s) [upload=12758]: Done uploading segments... Aug 7 03:28:09.747250910 (13h19m17.685666779s) [upload=12758]: Upload finished. err: <nil> Aug 7 03:28:44.605684325 (13h19m52.544100174s) [upload=12768]: Starting upload Aug 7 03:28:44.605739741 (13h19m52.54415559s) [upload=12768]: Done starting upload Aug 7 03:28:44.605848990 (13h19m52.54426484s) [upload=12768]: Uploading segments... Aug 7 03:28:44.605951336 (13h19m52.544367185s) [upload=12768]: Got next segment. Inline: false Aug 7 03:28:44.605995300 (13h19m52.544411149s) [upload=12768]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 03:28:44.606000089 (13h19m52.544415938s) [upload=12768]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 03:28:44.861620101 (13h19m52.80003594s) [seg_pos={0 0}, upload=12768]: Begin upload segment... Aug 7 03:28:44.861673774 (13h19m52.800089613s) [seg_pos={0 0}, upload=12768]: Done begin upload segment. Aug 7 03:28:44.861696257 (13h19m52.800112106s) [noise=true , address=104.36.82.7:4911 , piece_id=MQEV5OGZMVK2NDQUJRRM5LBL57H7PV4NQBBFC7ENA6K3QV4G2ZFA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.861789946 (13h19m52.800205825s) [noise=true , address=45.91.116.13:4154 , piece_id=ZPGJKCFH6DY3H7PMDZP6RIUD4756OI72YR6AWXX3BDT2B5VT7WBA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862065032 (13h19m52.800480881s) [noise=true , address=45.91.116.10:4081 , piece_id=HNR4SQQNQ5NXURX5UHPBOXU4GA3JXEGYNB47TTDPJONSFT6S6QXQ, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862279713 (13h19m52.800695562s) [noise=true , address=104.36.82.8:4971 , piece_id=TITIMRNQC6XGL7V5D2FFLUKZMH7WS7ZKHQRXQO7UVPP4XZ3H7TJA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862316884 (13h19m52.800732733s) [noise=true , address=45.91.116.4:4940 , piece_id=T53PUFTY6HYKFKE2IWTFEXOEE2WB5NMSKLOY4AHPNGWEMDUANJRA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862559979 (13h19m52.800975828s) [noise=true , address=77.90.31.15:4698 , piece_id=4DVMT6PTWCEZ4ICGDCJ7ZAHP3GSEBCC3WGS3OTR2AYD2XAQAA6UQ, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862586841 (13h19m52.80100269s) [noise=true , address=77.90.31.18:4806 , piece_id=WG3WEWCPUTC3ZPCR6BRN3SKDGZZVVXYY52H2J6OF7UXDBO6HAK5A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862803405 (13h19m52.801219254s) [noise=true , address=45.91.116.9:4263 , piece_id=DTT26U5JI4EUIJZOVVVFDCPVXSLAWFCT6BFVVWFGTN63YZ3FRXLA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862906553 (13h19m52.801322402s) [noise=true , address=104.36.82.9:4006 , piece_id=PSF3N3N7RPXDCDZVLRXYFYCVOT7WXMEVHYT7JJUZUDUJDDNWJZLA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863050348 (13h19m52.801466197s) [noise=true , address=77.90.31.18:4805 , piece_id=IJA4KGDBD6KJD6NXVNI6HEXYY6MPRDZZTWUJX2CNPKBU3T75YNLA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863162232 (13h19m52.801578081s) [noise=true , address=77.90.31.10:4517 , piece_id=JROHDGYTTG57KVZ62P6PM7QXHWOS2T55BXDCMHB7C2S4YGF2E73A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863263736 (13h19m52.801679585s) [noise=true , address=45.91.116.6:4973 , piece_id=AZIPOBQLKMOYFYYNBSCYVWTXBFTO23D5M3GCR6AAO7B4JQM7ZEVA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863407952 (13h19m52.801823801s) [noise=true , address=77.90.31.18:4807 , piece_id=JBDXLQBPQHGWXGJ2Q6MGMG7MRTN3FCV2QHFTKS5XE2ONFSW7VZ6A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863462657 (13h19m52.801878506s) [noise=true , address=77.90.31.11:4555 , piece_id=7LMIE2NKIXDHXK6PSJBOOXDDMV6EDC2B6DKTT54KC2EQTOP6QRRA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863671396 (13h19m52.802087235s) [noise=true , address=104.36.82.12:4150 , piece_id=R5KDMNNWKKXP5VH4NZDDBOBLEI6QDIISOCGIZWQC3XGWZJ54HM7A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.866072811 (13h19m52.80448866s) [noise=true , address=45.91.116.14:4189 , piece_id=SV7CXDGZSOLJRNF66GMH4FAWRO6VUOUVW4GKMCN7RRSZYRPCP34A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:46.602566612 (13h19m54.540982461s) [upload=12768]: Next returned nil segment Aug 7 03:28:46.602584987 (13h19m54.541000836s) [upload=12768]: Waiting for error group managing segments... Aug 7 03:28:46.879071462 (13h19m54.817487301s) [noise=true , address=77.90.31.10:4517 , piece_id=JROHDGYTTG57KVZ62P6PM7QXHWOS2T55BXDCMHB7C2S4YGF2E73A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.892476459 (13h19m54.830892298s) [noise=true , address=45.91.116.9:4263 , piece_id=DTT26U5JI4EUIJZOVVVFDCPVXSLAWFCT6BFVVWFGTN63YZ3FRXLA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.922922511 (13h19m54.86133836s) [noise=true , address=104.36.82.12:4150 , piece_id=R5KDMNNWKKXP5VH4NZDDBOBLEI6QDIISOCGIZWQC3XGWZJ54HM7A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.941555732 (13h19m54.879971581s) [noise=true , address=45.91.116.10:4081 , piece_id=HNR4SQQNQ5NXURX5UHPBOXU4GA3JXEGYNB47TTDPJONSFT6S6QXQ, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.949205798 (13h19m54.887621647s) [noise=true , address=45.91.116.6:4973 , piece_id=AZIPOBQLKMOYFYYNBSCYVWTXBFTO23D5M3GCR6AAO7B4JQM7ZEVA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.950523069 (13h19m54.888938918s) [noise=true , address=77.90.31.18:4805 , piece_id=IJA4KGDBD6KJD6NXVNI6HEXYY6MPRDZZTWUJX2CNPKBU3T75YNLA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.979618908 (13h19m54.918034757s) [noise=true , address=45.91.116.13:4154 , piece_id=ZPGJKCFH6DY3H7PMDZP6RIUD4756OI72YR6AWXX3BDT2B5VT7WBA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.982696867 (13h19m54.921112716s) [noise=true , address=77.90.31.18:4806 , piece_id=WG3WEWCPUTC3ZPCR6BRN3SKDGZZVVXYY52H2J6OF7UXDBO6HAK5A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.996455200 (13h19m54.934871049s) [noise=true , address=104.36.82.8:4971 , piece_id=TITIMRNQC6XGL7V5D2FFLUKZMH7WS7ZKHQRXQO7UVPP4XZ3H7TJA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.998128342 (13h19m54.936544181s) [noise=true , address=45.91.116.14:4189 , piece_id=SV7CXDGZSOLJRNF66GMH4FAWRO6VUOUVW4GKMCN7RRSZYRPCP34A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.004708831 (13h19m54.94312468s) [noise=true , address=104.36.82.9:4006 , piece_id=PSF3N3N7RPXDCDZVLRXYFYCVOT7WXMEVHYT7JJUZUDUJDDNWJZLA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.007888294 (13h19m54.946304143s) [noise=true , address=104.36.82.7:4911 , piece_id=MQEV5OGZMVK2NDQUJRRM5LBL57H7PV4NQBBFC7ENA6K3QV4G2ZFA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.066682153 (13h19m55.005098002s) [noise=true , address=77.90.31.18:4807 , piece_id=JBDXLQBPQHGWXGJ2Q6MGMG7MRTN3FCV2QHFTKS5XE2ONFSW7VZ6A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.066705959 (13h19m55.005121808s) [seg_pos={0 0}, upload=12768]: Segment reached optimal threshold of 13 pieces. Aug 7 03:28:47.066812673 (13h19m55.005228522s) [noise=true , address=45.91.116.4:4940 , piece_id=T53PUFTY6HYKFKE2IWTFEXOEE2WB5NMSKLOY4AHPNGWEMDUANJRA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:47.066870153 (13h19m55.005285992s) [noise=true , address=77.90.31.11:4555 , piece_id=7LMIE2NKIXDHXK6PSJBOOXDDMV6EDC2B6DKTT54KC2EQTOP6QRRA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:47.066882947 (13h19m55.005298796s) [noise=true , address=77.90.31.15:4698 , piece_id=4DVMT6PTWCEZ4ICGDCJ7ZAHP3GSEBCC3WGS3OTR2AYD2XAQAA6UQ, seg_pos={0 0}, upload=12768]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:47.066892867 (13h19m55.005308716s) [seg_pos={0 0}, upload=12768]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 03:28:47.066966377 (13h19m55.005382226s) [upload=12768]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 03:28:47.066970666 (13h19m55.005386515s) [upload=12768]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 03:28:47.369311744 (13h19m55.307727593s) [upload=12768]: Done uploading segments... Aug 7 03:28:47.369329037 (13h19m55.307744886s) [upload=12768]: Upload finished. err: <nil> Duration: 5.89600944s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.002953752s FAIL (2025-08-07 03:29:13 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== DkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:09.452864198 (13h19m17.391280047s) [noise=true , address=45.91.116.11:4118 , piece_id=ZVKDKMJL3MRTSJNHCK6KVVCBYXEFGY4QNSCAMCJFYHAYNMGVFPRQ, seg_pos={0 0}, upload=12758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:09.452874778 (13h19m17.391290627s) [seg_pos={0 0}, upload=12758]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 03:28:09.452958438 (13h19m17.391374287s) [upload=12758]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 03:28:09.452962817 (13h19m17.391378666s) [upload=12758]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 03:28:09.747228138 (13h19m17.685644027s) [upload=12758]: Done uploading segments... Aug 7 03:28:09.747250910 (13h19m17.685666779s) [upload=12758]: Upload finished. err: <nil> Aug 7 03:28:44.605684325 (13h19m52.544100174s) [upload=12768]: Starting upload Aug 7 03:28:44.605739741 (13h19m52.54415559s) [upload=12768]: Done starting upload Aug 7 03:28:44.605848990 (13h19m52.54426484s) [upload=12768]: Uploading segments... Aug 7 03:28:44.605951336 (13h19m52.544367185s) [upload=12768]: Got next segment. Inline: false Aug 7 03:28:44.605995300 (13h19m52.544411149s) [upload=12768]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 03:28:44.606000089 (13h19m52.544415938s) [upload=12768]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 03:28:44.861620101 (13h19m52.80003594s) [seg_pos={0 0}, upload=12768]: Begin upload segment... Aug 7 03:28:44.861673774 (13h19m52.800089613s) [seg_pos={0 0}, upload=12768]: Done begin upload segment. Aug 7 03:28:44.861696257 (13h19m52.800112106s) [noise=true , address=104.36.82.7:4911 , piece_id=MQEV5OGZMVK2NDQUJRRM5LBL57H7PV4NQBBFC7ENA6K3QV4G2ZFA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.861789946 (13h19m52.800205825s) [noise=true , address=45.91.116.13:4154 , piece_id=ZPGJKCFH6DY3H7PMDZP6RIUD4756OI72YR6AWXX3BDT2B5VT7WBA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862065032 (13h19m52.800480881s) [noise=true , address=45.91.116.10:4081 , piece_id=HNR4SQQNQ5NXURX5UHPBOXU4GA3JXEGYNB47TTDPJONSFT6S6QXQ, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862279713 (13h19m52.800695562s) [noise=true , address=104.36.82.8:4971 , piece_id=TITIMRNQC6XGL7V5D2FFLUKZMH7WS7ZKHQRXQO7UVPP4XZ3H7TJA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862316884 (13h19m52.800732733s) [noise=true , address=45.91.116.4:4940 , piece_id=T53PUFTY6HYKFKE2IWTFEXOEE2WB5NMSKLOY4AHPNGWEMDUANJRA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862559979 (13h19m52.800975828s) [noise=true , address=77.90.31.15:4698 , piece_id=4DVMT6PTWCEZ4ICGDCJ7ZAHP3GSEBCC3WGS3OTR2AYD2XAQAA6UQ, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862586841 (13h19m52.80100269s) [noise=true , address=77.90.31.18:4806 , piece_id=WG3WEWCPUTC3ZPCR6BRN3SKDGZZVVXYY52H2J6OF7UXDBO6HAK5A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862803405 (13h19m52.801219254s) [noise=true , address=45.91.116.9:4263 , piece_id=DTT26U5JI4EUIJZOVVVFDCPVXSLAWFCT6BFVVWFGTN63YZ3FRXLA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.862906553 (13h19m52.801322402s) [noise=true , address=104.36.82.9:4006 , piece_id=PSF3N3N7RPXDCDZVLRXYFYCVOT7WXMEVHYT7JJUZUDUJDDNWJZLA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863050348 (13h19m52.801466197s) [noise=true , address=77.90.31.18:4805 , piece_id=IJA4KGDBD6KJD6NXVNI6HEXYY6MPRDZZTWUJX2CNPKBU3T75YNLA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863162232 (13h19m52.801578081s) [noise=true , address=77.90.31.10:4517 , piece_id=JROHDGYTTG57KVZ62P6PM7QXHWOS2T55BXDCMHB7C2S4YGF2E73A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863263736 (13h19m52.801679585s) [noise=true , address=45.91.116.6:4973 , piece_id=AZIPOBQLKMOYFYYNBSCYVWTXBFTO23D5M3GCR6AAO7B4JQM7ZEVA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863407952 (13h19m52.801823801s) [noise=true , address=77.90.31.18:4807 , piece_id=JBDXLQBPQHGWXGJ2Q6MGMG7MRTN3FCV2QHFTKS5XE2ONFSW7VZ6A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863462657 (13h19m52.801878506s) [noise=true , address=77.90.31.11:4555 , piece_id=7LMIE2NKIXDHXK6PSJBOOXDDMV6EDC2B6DKTT54KC2EQTOP6QRRA, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.863671396 (13h19m52.802087235s) [noise=true , address=104.36.82.12:4150 , piece_id=R5KDMNNWKKXP5VH4NZDDBOBLEI6QDIISOCGIZWQC3XGWZJ54HM7A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:44.866072811 (13h19m52.80448866s) [noise=true , address=45.91.116.14:4189 , piece_id=SV7CXDGZSOLJRNF66GMH4FAWRO6VUOUVW4GKMCN7RRSZYRPCP34A, seg_pos={0 0}, upload=12768]: Uploading piece... Aug 7 03:28:46.602566612 (13h19m54.540982461s) [upload=12768]: Next returned nil segment Aug 7 03:28:46.602584987 (13h19m54.541000836s) [upload=12768]: Waiting for error group managing segments... Aug 7 03:28:46.879071462 (13h19m54.817487301s) [noise=true , address=77.90.31.10:4517 , piece_id=JROHDGYTTG57KVZ62P6PM7QXHWOS2T55BXDCMHB7C2S4YGF2E73A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.892476459 (13h19m54.830892298s) [noise=true , address=45.91.116.9:4263 , piece_id=DTT26U5JI4EUIJZOVVVFDCPVXSLAWFCT6BFVVWFGTN63YZ3FRXLA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.922922511 (13h19m54.86133836s) [noise=true , address=104.36.82.12:4150 , piece_id=R5KDMNNWKKXP5VH4NZDDBOBLEI6QDIISOCGIZWQC3XGWZJ54HM7A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.941555732 (13h19m54.879971581s) [noise=true , address=45.91.116.10:4081 , piece_id=HNR4SQQNQ5NXURX5UHPBOXU4GA3JXEGYNB47TTDPJONSFT6S6QXQ, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.949205798 (13h19m54.887621647s) [noise=true , address=45.91.116.6:4973 , piece_id=AZIPOBQLKMOYFYYNBSCYVWTXBFTO23D5M3GCR6AAO7B4JQM7ZEVA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.950523069 (13h19m54.888938918s) [noise=true , address=77.90.31.18:4805 , piece_id=IJA4KGDBD6KJD6NXVNI6HEXYY6MPRDZZTWUJX2CNPKBU3T75YNLA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.979618908 (13h19m54.918034757s) [noise=true , address=45.91.116.13:4154 , piece_id=ZPGJKCFH6DY3H7PMDZP6RIUD4756OI72YR6AWXX3BDT2B5VT7WBA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.982696867 (13h19m54.921112716s) [noise=true , address=77.90.31.18:4806 , piece_id=WG3WEWCPUTC3ZPCR6BRN3SKDGZZVVXYY52H2J6OF7UXDBO6HAK5A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.996455200 (13h19m54.934871049s) [noise=true , address=104.36.82.8:4971 , piece_id=TITIMRNQC6XGL7V5D2FFLUKZMH7WS7ZKHQRXQO7UVPP4XZ3H7TJA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:46.998128342 (13h19m54.936544181s) [noise=true , address=45.91.116.14:4189 , piece_id=SV7CXDGZSOLJRNF66GMH4FAWRO6VUOUVW4GKMCN7RRSZYRPCP34A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.004708831 (13h19m54.94312468s) [noise=true , address=104.36.82.9:4006 , piece_id=PSF3N3N7RPXDCDZVLRXYFYCVOT7WXMEVHYT7JJUZUDUJDDNWJZLA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.007888294 (13h19m54.946304143s) [noise=true , address=104.36.82.7:4911 , piece_id=MQEV5OGZMVK2NDQUJRRM5LBL57H7PV4NQBBFC7ENA6K3QV4G2ZFA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.066682153 (13h19m55.005098002s) [noise=true , address=77.90.31.18:4807 , piece_id=JBDXLQBPQHGWXGJ2Q6MGMG7MRTN3FCV2QHFTKS5XE2ONFSW7VZ6A, seg_pos={0 0}, upload=12768]: Done uploading piece. err: <nil> Aug 7 03:28:47.066705959 (13h19m55.005121808s) [seg_pos={0 0}, upload=12768]: Segment reached optimal threshold of 13 pieces. Aug 7 03:28:47.066812673 (13h19m55.005228522s) [noise=true , address=45.91.116.4:4940 , piece_id=T53PUFTY6HYKFKE2IWTFEXOEE2WB5NMSKLOY4AHPNGWEMDUANJRA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:47.066870153 (13h19m55.005285992s) [noise=true , address=77.90.31.11:4555 , piece_id=7LMIE2NKIXDHXK6PSJBOOXDDMV6EDC2B6DKTT54KC2EQTOP6QRRA, seg_pos={0 0}, upload=12768]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:47.066882947 (13h19m55.005298796s) [noise=true , address=77.90.31.15:4698 , piece_id=4DVMT6PTWCEZ4ICGDCJ7ZAHP3GSEBCC3WGS3OTR2AYD2XAQAA6UQ, seg_pos={0 0}, upload=12768]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: expected piece hash; context canceled; EOF Aug 7 03:28:47.066892867 (13h19m55.005308716s) [seg_pos={0 0}, upload=12768]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 03:28:47.066966377 (13h19m55.005382226s) [upload=12768]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 03:28:47.066970666 (13h19m55.005386515s) [upload=12768]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 03:28:47.369311744 (13h19m55.307727593s) [upload=12768]: Done uploading segments... Aug 7 03:28:47.369329037 (13h19m55.307744886s) [upload=12768]: Upload finished. err: <nil> Duration: 30.002975332s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...............X....X....X..................................] duration: 1.813955767s FAIL (2025-08-07 03:29:00 UTC) orbiter warning: operation: DownloadObject uplink: object not found ("orbiter_us_0/1K") Duration: 1.813986114s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......................................X..........X.........] duration: 5.730281948s FAIL (2025-08-07 03:28:58 UTC) orbiter warning: operation: DownloadObject uplink: object not found ("orbiter_us_0/4M") Duration: 5.730304411s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)