Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..X.................................................X.......] duration: 6.047166104s FAIL (2025-08-21 06:11:41 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 21 06:06:16.267376500 (300h40m10.698456631s) [upload=312769]: Starting upload Aug 21 06:06:16.267426706 (300h40m10.698506837s) [upload=312769]: Done starting upload Aug 21 06:06:16.267490137 (300h40m10.698570268s) [upload=312769]: Uploading segments... Aug 21 06:06:16.267595699 (300h40m10.69867583s) [upload=312769]: Got next segment. Inline: false Aug 21 06:06:16.267622370 (300h40m10.698702501s) [upload=312769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 06:06:16.267626668 (300h40m10.698706799s) [upload=312769]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 06:06:16.790975394 (300h40m11.222055566s) [seg_pos={0 0}, upload=312769]: Begin upload segment... Aug 21 06:06:16.791039036 (300h40m11.222119167s) [seg_pos={0 0}, upload=312769]: Done begin upload segment. Aug 21 06:06:16.791053263 (300h40m11.222133494s) [noise=true , address=45.91.116.5:4315 , piece_id=A6FNGYZBLA7JCPWC7LB5ECLBTKXUWAMC4X6CF3O34LXLMRWEGV2A, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.791065567 (300h40m11.222145698s) [noise=true , address=77.90.31.12:4606 , piece_id=TFRYO3KDJW26AQJJPFACOJU665CMLRLEOQIK353Y4URCBRMTHBFQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.791489618 (300h40m11.222569749s) [noise=true , address=104.36.82.5:4849 , piece_id=HUPNEWKLBX2ZI5PZSLKEQPYWTLZRZGSKYR7IZ6RZEVYGLGSEMZPQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.791763172 (300h40m11.222843303s) [noise=true , address=45.91.116.14:4204 , piece_id=UH3BJBUO7TSHPFZU7Q4EELWOINHIUWAIQFN3XAHX3X25VUBLX7EA, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.792115285 (300h40m11.223195417s) [noise=true , address=77.90.31.17:4781 , piece_id=3HMYJXFTSOKFY2NYO25KZ66DEC5J7BKFPWEARPF62QJCL33YDHZQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.792372808 (300h40m11.223452939s) [noise=true , address=77.90.31.10:4531 , piece_id=AGFYUV6WC464ZUXUN5VWA4DWBEACB7GOK2CB4MQ5OH35WZHVAY4A, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.792589663 (300h40m11.223669784s) [noise=true , address=77.90.31.13:4647 , piece_id=U6LAUWTBKQI6VJBKUHADT7N4HTO773BEUYIU2X5C7R5UO2PLKWIQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.792790758 (300h40m11.223870889s) [noise=true , address=104.36.82.49:4011 , piece_id=YKRH27M5WJQCEXQRBJBEKHKWMGMRDBZIO7PK232B63NUOONFQMMA, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.793001260 (300h40m11.224081391s) [noise=true , address=45.91.116.4:4942 , piece_id=SICQFCLAN2TW2VNEQ4YOUWDNFBXDXTOW74NWZJF4SPPAOAR55UVQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.793207105 (300h40m11.224287226s) [noise=true , address=79.127.201.214:4322 , piece_id=G7HI7I5EPC2XTW4MJQXZD2WMNVASM5Z3MTU5YHOR6UGC6HMOVZWQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.793406827 (300h40m11.224486958s) [noise=true , address=79.127.205.233:4638 , piece_id=P77DK4S6TSWFH37UXPMKYOHF7AEEOTOCLJ72PSB2EAJR5EYHG33Q, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.793597281 (300h40m11.224677412s) [noise=true , address=45.91.116.11:4143 , piece_id=3GUVOHZ2XHLPC4CB44RXGGDROQT7O4EDIUY6VUG7LK6ZUNEVHPNA, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.793790541 (300h40m11.224870672s) [noise=true , address=79.127.205.235:4674 , piece_id=GN5RPGMLJK2GNLG3WRED7J525PNVKRR746P63BB2TZNR3ESTPSQA, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.794015731 (300h40m11.225095863s) [noise=true , address=104.36.82.23:4477 , piece_id=MHSUNRIBYXZQNDMSXRDC2S5VHNUDMZ2FR5FQ66J4CCRCJC2VCKUA, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.794291128 (300h40m11.225371259s) [noise=true , address=104.36.82.60:4353 , piece_id=LZQ3W4HLLBSVCHZBVHOLS6ZWT53WEMGCNLUZWB43M7MCEIDVTEKQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.794509356 (300h40m11.225589487s) [noise=true , address=77.90.31.16:4768 , piece_id=NWHBLL5CVIWPQ2HHVVXNAA6RH4FZTVMAYXSM5D62OWSFHIO7AB5A, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.794752481 (300h40m11.225832602s) [noise=true , address=77.90.31.21:4891 , piece_id=FGIV2CPMOD7XITXGJNAJQZMDY7UAGSM2JS7FRH5LOFNKWI76IFXQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.794946252 (300h40m11.226026383s) [noise=true , address=104.36.82.36:4632 , piece_id=N24ZVK6WUQDVNLVXKEQSO67K4QMMQQE2TB4RPVXDJCRE6C6UPIPQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:17.921692057 (300h40m12.352772188s) [upload=312769]: Next returned nil segment Aug 21 06:06:17.921746201 (300h40m12.352826332s) [upload=312769]: Waiting for error group managing segments... Aug 21 06:06:18.206445940 (300h40m12.637526071s) [noise=true , address=79.127.205.233:4638 , piece_id=P77DK4S6TSWFH37UXPMKYOHF7AEEOTOCLJ72PSB2EAJR5EYHG33Q, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.241271585 (300h40m12.672351716s) [noise=true , address=79.127.205.235:4674 , piece_id=GN5RPGMLJK2GNLG3WRED7J525PNVKRR746P63BB2TZNR3ESTPSQA, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.700930117 (300h40m13.132010238s) [noise=true , address=45.91.116.11:4143 , piece_id=3GUVOHZ2XHLPC4CB44RXGGDROQT7O4EDIUY6VUG7LK6ZUNEVHPNA, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.713994383 (300h40m13.145074514s) [noise=true , address=45.91.116.5:4315 , piece_id=A6FNGYZBLA7JCPWC7LB5ECLBTKXUWAMC4X6CF3O34LXLMRWEGV2A, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.715350278 (300h40m13.146430399s) [noise=true , address=45.91.116.4:4942 , piece_id=SICQFCLAN2TW2VNEQ4YOUWDNFBXDXTOW74NWZJF4SPPAOAR55UVQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.745190424 (300h40m13.176270555s) [noise=true , address=77.90.31.21:4891 , piece_id=FGIV2CPMOD7XITXGJNAJQZMDY7UAGSM2JS7FRH5LOFNKWI76IFXQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.779540298 (300h40m13.210620429s) [noise=true , address=79.127.201.214:4322 , piece_id=G7HI7I5EPC2XTW4MJQXZD2WMNVASM5Z3MTU5YHOR6UGC6HMOVZWQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.793222909 (300h40m13.22430304s) [noise=true , address=45.91.116.14:4204 , piece_id=UH3BJBUO7TSHPFZU7Q4EELWOINHIUWAIQFN3XAHX3X25VUBLX7EA, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.824245817 (300h40m13.255325948s) [noise=true , address=77.90.31.12:4606 , piece_id=TFRYO3KDJW26AQJJPFACOJU665CMLRLEOQIK353Y4URCBRMTHBFQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.828009940 (300h40m13.259090071s) [noise=true , address=104.36.82.36:4632 , piece_id=N24ZVK6WUQDVNLVXKEQSO67K4QMMQQE2TB4RPVXDJCRE6C6UPIPQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.831904802 (300h40m13.262984933s) [noise=true , address=77.90.31.13:4647 , piece_id=U6LAUWTBKQI6VJBKUHADT7N4HTO773BEUYIU2X5C7R5UO2PLKWIQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.845088307 (300h40m13.276168438s) [noise=true , address=77.90.31.10:4531 , piece_id=AGFYUV6WC464ZUXUN5VWA4DWBEACB7GOK2CB4MQ5OH35WZHVAY4A, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.900147776 (300h40m13.331227897s) [noise=true , address=104.36.82.49:4011 , piece_id=YKRH27M5WJQCEXQRBJBEKHKWMGMRDBZIO7PK232B63NUOONFQMMA, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.926691354 (300h40m13.357771475s) [noise=true , address=77.90.31.16:4768 , piece_id=NWHBLL5CVIWPQ2HHVVXNAA6RH4FZTVMAYXSM5D62OWSFHIO7AB5A, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.926720550 (300h40m13.357800671s) [seg_pos={0 0}, upload=312769]: Segment reached optimal threshold of 14 pieces. Aug 21 06:06:18.926824459 (300h40m13.35790458s) [noise=true , address=77.90.31.17:4781 , piece_id=3HMYJXFTSOKFY2NYO25KZ66DEC5J7BKFPWEARPF62QJCL33YDHZQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Uc2Hn41mUYgLtyirRtEGNv5iKBv8YqzQo3RYdoE4M1Fj29WgT): protocol: expected piece hash; context canceled; EOF Aug 21 06:06:18.926973314 (300h40m13.358053445s) [noise=true , address=104.36.82.23:4477 , piece_id=MHSUNRIBYXZQNDMSXRDC2S5VHNUDMZ2FR5FQ66J4CCRCJC2VCKUA, seg_pos={0 0}, upload=312769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RP2Zq643WWNtKEr34Tq1iZS29NYA2okr9Fg1jiCpaFTqfLauf): protocol: expected piece hash; context canceled; EOF Aug 21 06:06:18.926978634 (300h40m13.358058765s) [noise=true , address=104.36.82.60:4353 , piece_id=LZQ3W4HLLBSVCHZBVHOLS6ZWT53WEMGCNLUZWB43M7MCEIDVTEKQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF Aug 21 06:06:18.927075128 (300h40m13.358155259s) [noise=true , address=104.36.82.5:4849 , piece_id=HUPNEWKLBX2ZI5PZSLKEQPYWTLZRZGSKYR7IZ6RZEVYGLGSEMZPQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n2gSzVmNCEZcfVsFKibjXHs2jMr82D3SWQEykFQQ4uyhhnrj1): protocol: write tcp 188.166.225.170:58800->104.36.82.5:4849: use of closed network connection; write tcp 188.166.225.170:58800->104.36.82.5:4849: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58800->104.36.82.5:4849: use of closed network connection Aug 21 06:06:18.927108161 (300h40m13.358188292s) [seg_pos={0 0}, upload=312769]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 06:06:18.927184728 (300h40m13.358264859s) [upload=312769]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 06:06:18.927189176 (300h40m13.358269307s) [upload=312769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 06:06:19.232063958 (300h40m13.663144089s) [upload=312769]: Done uploading segments... Aug 21 06:06:19.232084798 (300h40m13.663164929s) [upload=312769]: Upload finished. err: <nil> Duration: 6.047192033s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [....X...........................X.................X......X..] duration: 1.883973421s FAIL (2025-08-21 06:11:30 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 21 06:09:47.523937359 (300h43m41.95501749s) [upload=312830]: Starting upload Aug 21 06:09:47.523987846 (300h43m41.955067977s) [upload=312830]: Done starting upload Aug 21 06:09:47.524096624 (300h43m41.955176755s) [upload=312830]: Uploading segments... Aug 21 06:09:47.524144014 (300h43m41.955224145s) [upload=312830]: Got next segment. Inline: true Aug 21 06:09:47.524148403 (300h43m41.955228534s) [upload=312830]: Waiting for error group managing segments... Aug 21 06:09:47.524182639 (300h43m41.95526277s) [upload=312830]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 06:09:47.524186957 (300h43m41.955267088s) [upload=312830]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 06:09:47.524189501 (300h43m41.955269632s) [upload=312830]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 06:09:47.871597856 (300h43m42.302677987s) [upload=312830]: Done uploading segments... Aug 21 06:09:47.871618045 (300h43m42.302698176s) [upload=312830]: Upload finished. err: <nil> Duration:* 1.883996595s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...X.................................................X......] duration: 6.679398752s FAIL (2025-08-21 06:11:11 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 21 06:06:16.267376500 (300h40m10.698456631s) [upload=312769]: Starting upload Aug 21 06:06:16.267426706 (300h40m10.698506837s) [upload=312769]: Done starting upload Aug 21 06:06:16.267490137 (300h40m10.698570268s) [upload=312769]: Uploading segments... Aug 21 06:06:16.267595699 (300h40m10.69867583s) [upload=312769]: Got next segment. Inline: false Aug 21 06:06:16.267622370 (300h40m10.698702501s) [upload=312769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 06:06:16.267626668 (300h40m10.698706799s) [upload=312769]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 06:06:16.790975394 (300h40m11.222055566s) [seg_pos={0 0}, upload=312769]: Begin upload segment... Aug 21 06:06:16.791039036 (300h40m11.222119167s) [seg_pos={0 0}, upload=312769]: Done begin upload segment. Aug 21 06:06:16.791053263 (300h40m11.222133494s) [noise=true , address=45.91.116.5:4315 , piece_id=A6FNGYZBLA7JCPWC7LB5ECLBTKXUWAMC4X6CF3O34LXLMRWEGV2A, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.791065567 (300h40m11.222145698s) [noise=true , address=77.90.31.12:4606 , piece_id=TFRYO3KDJW26AQJJPFACOJU665CMLRLEOQIK353Y4URCBRMTHBFQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.791489618 (300h40m11.222569749s) [noise=true , address=104.36.82.5:4849 , piece_id=HUPNEWKLBX2ZI5PZSLKEQPYWTLZRZGSKYR7IZ6RZEVYGLGSEMZPQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.791763172 (300h40m11.222843303s) [noise=true , address=45.91.116.14:4204 , piece_id=UH3BJBUO7TSHPFZU7Q4EELWOINHIUWAIQFN3XAHX3X25VUBLX7EA, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.792115285 (300h40m11.223195417s) [noise=true , address=77.90.31.17:4781 , piece_id=3HMYJXFTSOKFY2NYO25KZ66DEC5J7BKFPWEARPF62QJCL33YDHZQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.792372808 (300h40m11.223452939s) [noise=true , address=77.90.31.10:4531 , piece_id=AGFYUV6WC464ZUXUN5VWA4DWBEACB7GOK2CB4MQ5OH35WZHVAY4A, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.792589663 (300h40m11.223669784s) [noise=true , address=77.90.31.13:4647 , piece_id=U6LAUWTBKQI6VJBKUHADT7N4HTO773BEUYIU2X5C7R5UO2PLKWIQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.792790758 (300h40m11.223870889s) [noise=true , address=104.36.82.49:4011 , piece_id=YKRH27M5WJQCEXQRBJBEKHKWMGMRDBZIO7PK232B63NUOONFQMMA, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.793001260 (300h40m11.224081391s) [noise=true , address=45.91.116.4:4942 , piece_id=SICQFCLAN2TW2VNEQ4YOUWDNFBXDXTOW74NWZJF4SPPAOAR55UVQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.793207105 (300h40m11.224287226s) [noise=true , address=79.127.201.214:4322 , piece_id=G7HI7I5EPC2XTW4MJQXZD2WMNVASM5Z3MTU5YHOR6UGC6HMOVZWQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.793406827 (300h40m11.224486958s) [noise=true , address=79.127.205.233:4638 , piece_id=P77DK4S6TSWFH37UXPMKYOHF7AEEOTOCLJ72PSB2EAJR5EYHG33Q, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.793597281 (300h40m11.224677412s) [noise=true , address=45.91.116.11:4143 , piece_id=3GUVOHZ2XHLPC4CB44RXGGDROQT7O4EDIUY6VUG7LK6ZUNEVHPNA, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.793790541 (300h40m11.224870672s) [noise=true , address=79.127.205.235:4674 , piece_id=GN5RPGMLJK2GNLG3WRED7J525PNVKRR746P63BB2TZNR3ESTPSQA, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.794015731 (300h40m11.225095863s) [noise=true , address=104.36.82.23:4477 , piece_id=MHSUNRIBYXZQNDMSXRDC2S5VHNUDMZ2FR5FQ66J4CCRCJC2VCKUA, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.794291128 (300h40m11.225371259s) [noise=true , address=104.36.82.60:4353 , piece_id=LZQ3W4HLLBSVCHZBVHOLS6ZWT53WEMGCNLUZWB43M7MCEIDVTEKQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.794509356 (300h40m11.225589487s) [noise=true , address=77.90.31.16:4768 , piece_id=NWHBLL5CVIWPQ2HHVVXNAA6RH4FZTVMAYXSM5D62OWSFHIO7AB5A, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.794752481 (300h40m11.225832602s) [noise=true , address=77.90.31.21:4891 , piece_id=FGIV2CPMOD7XITXGJNAJQZMDY7UAGSM2JS7FRH5LOFNKWI76IFXQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.794946252 (300h40m11.226026383s) [noise=true , address=104.36.82.36:4632 , piece_id=N24ZVK6WUQDVNLVXKEQSO67K4QMMQQE2TB4RPVXDJCRE6C6UPIPQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:17.921692057 (300h40m12.352772188s) [upload=312769]: Next returned nil segment Aug 21 06:06:17.921746201 (300h40m12.352826332s) [upload=312769]: Waiting for error group managing segments... Aug 21 06:06:18.206445940 (300h40m12.637526071s) [noise=true , address=79.127.205.233:4638 , piece_id=P77DK4S6TSWFH37UXPMKYOHF7AEEOTOCLJ72PSB2EAJR5EYHG33Q, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.241271585 (300h40m12.672351716s) [noise=true , address=79.127.205.235:4674 , piece_id=GN5RPGMLJK2GNLG3WRED7J525PNVKRR746P63BB2TZNR3ESTPSQA, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.700930117 (300h40m13.132010238s) [noise=true , address=45.91.116.11:4143 , piece_id=3GUVOHZ2XHLPC4CB44RXGGDROQT7O4EDIUY6VUG7LK6ZUNEVHPNA, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.713994383 (300h40m13.145074514s) [noise=true , address=45.91.116.5:4315 , piece_id=A6FNGYZBLA7JCPWC7LB5ECLBTKXUWAMC4X6CF3O34LXLMRWEGV2A, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.715350278 (300h40m13.146430399s) [noise=true , address=45.91.116.4:4942 , piece_id=SICQFCLAN2TW2VNEQ4YOUWDNFBXDXTOW74NWZJF4SPPAOAR55UVQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.745190424 (300h40m13.176270555s) [noise=true , address=77.90.31.21:4891 , piece_id=FGIV2CPMOD7XITXGJNAJQZMDY7UAGSM2JS7FRH5LOFNKWI76IFXQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.779540298 (300h40m13.210620429s) [noise=true , address=79.127.201.214:4322 , piece_id=G7HI7I5EPC2XTW4MJQXZD2WMNVASM5Z3MTU5YHOR6UGC6HMOVZWQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.793222909 (300h40m13.22430304s) [noise=true , address=45.91.116.14:4204 , piece_id=UH3BJBUO7TSHPFZU7Q4EELWOINHIUWAIQFN3XAHX3X25VUBLX7EA, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.824245817 (300h40m13.255325948s) [noise=true , address=77.90.31.12:4606 , piece_id=TFRYO3KDJW26AQJJPFACOJU665CMLRLEOQIK353Y4URCBRMTHBFQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.828009940 (300h40m13.259090071s) [noise=true , address=104.36.82.36:4632 , piece_id=N24ZVK6WUQDVNLVXKEQSO67K4QMMQQE2TB4RPVXDJCRE6C6UPIPQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.831904802 (300h40m13.262984933s) [noise=true , address=77.90.31.13:4647 , piece_id=U6LAUWTBKQI6VJBKUHADT7N4HTO773BEUYIU2X5C7R5UO2PLKWIQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.845088307 (300h40m13.276168438s) [noise=true , address=77.90.31.10:4531 , piece_id=AGFYUV6WC464ZUXUN5VWA4DWBEACB7GOK2CB4MQ5OH35WZHVAY4A, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.900147776 (300h40m13.331227897s) [noise=true , address=104.36.82.49:4011 , piece_id=YKRH27M5WJQCEXQRBJBEKHKWMGMRDBZIO7PK232B63NUOONFQMMA, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.926691354 (300h40m13.357771475s) [noise=true , address=77.90.31.16:4768 , piece_id=NWHBLL5CVIWPQ2HHVVXNAA6RH4FZTVMAYXSM5D62OWSFHIO7AB5A, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.926720550 (300h40m13.357800671s) [seg_pos={0 0}, upload=312769]: Segment reached optimal threshold of 14 pieces. Aug 21 06:06:18.926824459 (300h40m13.35790458s) [noise=true , address=77.90.31.17:4781 , piece_id=3HMYJXFTSOKFY2NYO25KZ66DEC5J7BKFPWEARPF62QJCL33YDHZQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Uc2Hn41mUYgLtyirRtEGNv5iKBv8YqzQo3RYdoE4M1Fj29WgT): protocol: expected piece hash; context canceled; EOF Aug 21 06:06:18.926973314 (300h40m13.358053445s) [noise=true , address=104.36.82.23:4477 , piece_id=MHSUNRIBYXZQNDMSXRDC2S5VHNUDMZ2FR5FQ66J4CCRCJC2VCKUA, seg_pos={0 0}, upload=312769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RP2Zq643WWNtKEr34Tq1iZS29NYA2okr9Fg1jiCpaFTqfLauf): protocol: expected piece hash; context canceled; EOF Aug 21 06:06:18.926978634 (300h40m13.358058765s) [noise=true , address=104.36.82.60:4353 , piece_id=LZQ3W4HLLBSVCHZBVHOLS6ZWT53WEMGCNLUZWB43M7MCEIDVTEKQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF Aug 21 06:06:18.927075128 (300h40m13.358155259s) [noise=true , address=104.36.82.5:4849 , piece_id=HUPNEWKLBX2ZI5PZSLKEQPYWTLZRZGSKYR7IZ6RZEVYGLGSEMZPQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n2gSzVmNCEZcfVsFKibjXHs2jMr82D3SWQEykFQQ4uyhhnrj1): protocol: write tcp 188.166.225.170:58800->104.36.82.5:4849: use of closed network connection; write tcp 188.166.225.170:58800->104.36.82.5:4849: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58800->104.36.82.5:4849: use of closed network connection Aug 21 06:06:18.927108161 (300h40m13.358188292s) [seg_pos={0 0}, upload=312769]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 06:06:18.927184728 (300h40m13.358264859s) [upload=312769]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 06:06:18.927189176 (300h40m13.358269307s) [upload=312769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 06:06:19.232063958 (300h40m13.663144089s) [upload=312769]: Done uploading segments... Aug 21 06:06:19.232084798 (300h40m13.663164929s) [upload=312769]: Upload finished. err: <nil> Duration: 6.679425393s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 5.807112652s FAIL (2025-08-21 06:10:56 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 5.807141407s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.....X...........................X.................X......X.] duration: 1.843776117s FAIL (2025-08-21 06:10:24 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 21 06:09:47.523937359 (300h43m41.95501749s) [upload=312830]: Starting upload Aug 21 06:09:47.523987846 (300h43m41.955067977s) [upload=312830]: Done starting upload Aug 21 06:09:47.524096624 (300h43m41.955176755s) [upload=312830]: Uploading segments... Aug 21 06:09:47.524144014 (300h43m41.955224145s) [upload=312830]: Got next segment. Inline: true Aug 21 06:09:47.524148403 (300h43m41.955228534s) [upload=312830]: Waiting for error group managing segments... Aug 21 06:09:47.524182639 (300h43m41.95526277s) [upload=312830]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 06:09:47.524186957 (300h43m41.955267088s) [upload=312830]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 06:09:47.524189501 (300h43m41.955269632s) [upload=312830]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 06:09:47.871597856 (300h43m42.302677987s) [upload=312830]: Done uploading segments... Aug 21 06:09:47.871618045 (300h43m42.302698176s) [upload=312830]: Upload finished. err: <nil> Duration:* 1.84379796s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 5.772921413s FAIL (2025-08-21 06:10:15 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 5.772951139s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [....X.................................................X.....] duration: 5.689781736s FAIL (2025-08-21 06:10:04 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 21 06:06:16.267376500 (300h40m10.698456631s) [upload=312769]: Starting upload Aug 21 06:06:16.267426706 (300h40m10.698506837s) [upload=312769]: Done starting upload Aug 21 06:06:16.267490137 (300h40m10.698570268s) [upload=312769]: Uploading segments... Aug 21 06:06:16.267595699 (300h40m10.69867583s) [upload=312769]: Got next segment. Inline: false Aug 21 06:06:16.267622370 (300h40m10.698702501s) [upload=312769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 06:06:16.267626668 (300h40m10.698706799s) [upload=312769]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 06:06:16.790975394 (300h40m11.222055566s) [seg_pos={0 0}, upload=312769]: Begin upload segment... Aug 21 06:06:16.791039036 (300h40m11.222119167s) [seg_pos={0 0}, upload=312769]: Done begin upload segment. Aug 21 06:06:16.791053263 (300h40m11.222133494s) [noise=true , address=45.91.116.5:4315 , piece_id=A6FNGYZBLA7JCPWC7LB5ECLBTKXUWAMC4X6CF3O34LXLMRWEGV2A, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.791065567 (300h40m11.222145698s) [noise=true , address=77.90.31.12:4606 , piece_id=TFRYO3KDJW26AQJJPFACOJU665CMLRLEOQIK353Y4URCBRMTHBFQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.791489618 (300h40m11.222569749s) [noise=true , address=104.36.82.5:4849 , piece_id=HUPNEWKLBX2ZI5PZSLKEQPYWTLZRZGSKYR7IZ6RZEVYGLGSEMZPQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.791763172 (300h40m11.222843303s) [noise=true , address=45.91.116.14:4204 , piece_id=UH3BJBUO7TSHPFZU7Q4EELWOINHIUWAIQFN3XAHX3X25VUBLX7EA, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.792115285 (300h40m11.223195417s) [noise=true , address=77.90.31.17:4781 , piece_id=3HMYJXFTSOKFY2NYO25KZ66DEC5J7BKFPWEARPF62QJCL33YDHZQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.792372808 (300h40m11.223452939s) [noise=true , address=77.90.31.10:4531 , piece_id=AGFYUV6WC464ZUXUN5VWA4DWBEACB7GOK2CB4MQ5OH35WZHVAY4A, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.792589663 (300h40m11.223669784s) [noise=true , address=77.90.31.13:4647 , piece_id=U6LAUWTBKQI6VJBKUHADT7N4HTO773BEUYIU2X5C7R5UO2PLKWIQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.792790758 (300h40m11.223870889s) [noise=true , address=104.36.82.49:4011 , piece_id=YKRH27M5WJQCEXQRBJBEKHKWMGMRDBZIO7PK232B63NUOONFQMMA, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.793001260 (300h40m11.224081391s) [noise=true , address=45.91.116.4:4942 , piece_id=SICQFCLAN2TW2VNEQ4YOUWDNFBXDXTOW74NWZJF4SPPAOAR55UVQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.793207105 (300h40m11.224287226s) [noise=true , address=79.127.201.214:4322 , piece_id=G7HI7I5EPC2XTW4MJQXZD2WMNVASM5Z3MTU5YHOR6UGC6HMOVZWQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.793406827 (300h40m11.224486958s) [noise=true , address=79.127.205.233:4638 , piece_id=P77DK4S6TSWFH37UXPMKYOHF7AEEOTOCLJ72PSB2EAJR5EYHG33Q, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.793597281 (300h40m11.224677412s) [noise=true , address=45.91.116.11:4143 , piece_id=3GUVOHZ2XHLPC4CB44RXGGDROQT7O4EDIUY6VUG7LK6ZUNEVHPNA, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.793790541 (300h40m11.224870672s) [noise=true , address=79.127.205.235:4674 , piece_id=GN5RPGMLJK2GNLG3WRED7J525PNVKRR746P63BB2TZNR3ESTPSQA, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.794015731 (300h40m11.225095863s) [noise=true , address=104.36.82.23:4477 , piece_id=MHSUNRIBYXZQNDMSXRDC2S5VHNUDMZ2FR5FQ66J4CCRCJC2VCKUA, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.794291128 (300h40m11.225371259s) [noise=true , address=104.36.82.60:4353 , piece_id=LZQ3W4HLLBSVCHZBVHOLS6ZWT53WEMGCNLUZWB43M7MCEIDVTEKQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.794509356 (300h40m11.225589487s) [noise=true , address=77.90.31.16:4768 , piece_id=NWHBLL5CVIWPQ2HHVVXNAA6RH4FZTVMAYXSM5D62OWSFHIO7AB5A, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.794752481 (300h40m11.225832602s) [noise=true , address=77.90.31.21:4891 , piece_id=FGIV2CPMOD7XITXGJNAJQZMDY7UAGSM2JS7FRH5LOFNKWI76IFXQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.794946252 (300h40m11.226026383s) [noise=true , address=104.36.82.36:4632 , piece_id=N24ZVK6WUQDVNLVXKEQSO67K4QMMQQE2TB4RPVXDJCRE6C6UPIPQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:17.921692057 (300h40m12.352772188s) [upload=312769]: Next returned nil segment Aug 21 06:06:17.921746201 (300h40m12.352826332s) [upload=312769]: Waiting for error group managing segments... Aug 21 06:06:18.206445940 (300h40m12.637526071s) [noise=true , address=79.127.205.233:4638 , piece_id=P77DK4S6TSWFH37UXPMKYOHF7AEEOTOCLJ72PSB2EAJR5EYHG33Q, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.241271585 (300h40m12.672351716s) [noise=true , address=79.127.205.235:4674 , piece_id=GN5RPGMLJK2GNLG3WRED7J525PNVKRR746P63BB2TZNR3ESTPSQA, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.700930117 (300h40m13.132010238s) [noise=true , address=45.91.116.11:4143 , piece_id=3GUVOHZ2XHLPC4CB44RXGGDROQT7O4EDIUY6VUG7LK6ZUNEVHPNA, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.713994383 (300h40m13.145074514s) [noise=true , address=45.91.116.5:4315 , piece_id=A6FNGYZBLA7JCPWC7LB5ECLBTKXUWAMC4X6CF3O34LXLMRWEGV2A, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.715350278 (300h40m13.146430399s) [noise=true , address=45.91.116.4:4942 , piece_id=SICQFCLAN2TW2VNEQ4YOUWDNFBXDXTOW74NWZJF4SPPAOAR55UVQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.745190424 (300h40m13.176270555s) [noise=true , address=77.90.31.21:4891 , piece_id=FGIV2CPMOD7XITXGJNAJQZMDY7UAGSM2JS7FRH5LOFNKWI76IFXQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.779540298 (300h40m13.210620429s) [noise=true , address=79.127.201.214:4322 , piece_id=G7HI7I5EPC2XTW4MJQXZD2WMNVASM5Z3MTU5YHOR6UGC6HMOVZWQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.793222909 (300h40m13.22430304s) [noise=true , address=45.91.116.14:4204 , piece_id=UH3BJBUO7TSHPFZU7Q4EELWOINHIUWAIQFN3XAHX3X25VUBLX7EA, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.824245817 (300h40m13.255325948s) [noise=true , address=77.90.31.12:4606 , piece_id=TFRYO3KDJW26AQJJPFACOJU665CMLRLEOQIK353Y4URCBRMTHBFQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.828009940 (300h40m13.259090071s) [noise=true , address=104.36.82.36:4632 , piece_id=N24ZVK6WUQDVNLVXKEQSO67K4QMMQQE2TB4RPVXDJCRE6C6UPIPQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.831904802 (300h40m13.262984933s) [noise=true , address=77.90.31.13:4647 , piece_id=U6LAUWTBKQI6VJBKUHADT7N4HTO773BEUYIU2X5C7R5UO2PLKWIQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.845088307 (300h40m13.276168438s) [noise=true , address=77.90.31.10:4531 , piece_id=AGFYUV6WC464ZUXUN5VWA4DWBEACB7GOK2CB4MQ5OH35WZHVAY4A, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.900147776 (300h40m13.331227897s) [noise=true , address=104.36.82.49:4011 , piece_id=YKRH27M5WJQCEXQRBJBEKHKWMGMRDBZIO7PK232B63NUOONFQMMA, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.926691354 (300h40m13.357771475s) [noise=true , address=77.90.31.16:4768 , piece_id=NWHBLL5CVIWPQ2HHVVXNAA6RH4FZTVMAYXSM5D62OWSFHIO7AB5A, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.926720550 (300h40m13.357800671s) [seg_pos={0 0}, upload=312769]: Segment reached optimal threshold of 14 pieces. Aug 21 06:06:18.926824459 (300h40m13.35790458s) [noise=true , address=77.90.31.17:4781 , piece_id=3HMYJXFTSOKFY2NYO25KZ66DEC5J7BKFPWEARPF62QJCL33YDHZQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Uc2Hn41mUYgLtyirRtEGNv5iKBv8YqzQo3RYdoE4M1Fj29WgT): protocol: expected piece hash; context canceled; EOF Aug 21 06:06:18.926973314 (300h40m13.358053445s) [noise=true , address=104.36.82.23:4477 , piece_id=MHSUNRIBYXZQNDMSXRDC2S5VHNUDMZ2FR5FQ66J4CCRCJC2VCKUA, seg_pos={0 0}, upload=312769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RP2Zq643WWNtKEr34Tq1iZS29NYA2okr9Fg1jiCpaFTqfLauf): protocol: expected piece hash; context canceled; EOF Aug 21 06:06:18.926978634 (300h40m13.358058765s) [noise=true , address=104.36.82.60:4353 , piece_id=LZQ3W4HLLBSVCHZBVHOLS6ZWT53WEMGCNLUZWB43M7MCEIDVTEKQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF Aug 21 06:06:18.927075128 (300h40m13.358155259s) [noise=true , address=104.36.82.5:4849 , piece_id=HUPNEWKLBX2ZI5PZSLKEQPYWTLZRZGSKYR7IZ6RZEVYGLGSEMZPQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n2gSzVmNCEZcfVsFKibjXHs2jMr82D3SWQEykFQQ4uyhhnrj1): protocol: write tcp 188.166.225.170:58800->104.36.82.5:4849: use of closed network connection; write tcp 188.166.225.170:58800->104.36.82.5:4849: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58800->104.36.82.5:4849: use of closed network connection Aug 21 06:06:18.927108161 (300h40m13.358188292s) [seg_pos={0 0}, upload=312769]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 06:06:18.927184728 (300h40m13.358264859s) [upload=312769]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 06:06:18.927189176 (300h40m13.358269307s) [upload=312769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 06:06:19.232063958 (300h40m13.663144089s) [upload=312769]: Done uploading segments... Aug 21 06:06:19.232084798 (300h40m13.663164929s) [upload=312769]: Upload finished. err: <nil> Duration: 5.689810579s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [X.....X...........................X.................X......X] duration: 1.457706068s FAIL (2025-08-21 06:09:48 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 21 06:09:47.523937359 (300h43m41.95501749s) [upload=312830]: Starting upload Aug 21 06:09:47.523987846 (300h43m41.955067977s) [upload=312830]: Done starting upload Aug 21 06:09:47.524096624 (300h43m41.955176755s) [upload=312830]: Uploading segments... Aug 21 06:09:47.524144014 (300h43m41.955224145s) [upload=312830]: Got next segment. Inline: true Aug 21 06:09:47.524148403 (300h43m41.955228534s) [upload=312830]: Waiting for error group managing segments... Aug 21 06:09:47.524182639 (300h43m41.95526277s) [upload=312830]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 06:09:47.524186957 (300h43m41.955267088s) [upload=312830]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 06:09:47.524189501 (300h43m41.955269632s) [upload=312830]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 06:09:47.871597856 (300h43m42.302677987s) [upload=312830]: Done uploading segments... Aug 21 06:09:47.871618045 (300h43m42.302698176s) [upload=312830]: Upload finished. err: <nil> Duration:* 1.457723151s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 5.894373846s FAIL (2025-08-21 06:09:47 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 5.894399937s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.X.....X...........................X.................X......] duration: 1.848094147s FAIL (2025-08-21 06:09:30 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 21 06:05:15.784901024 (300h39m10.215981155s) [upload=312749]: Starting upload Aug 21 06:05:15.784953484 (300h39m10.216033615s) [upload=312749]: Done starting upload Aug 21 06:05:15.785014431 (300h39m10.216094563s) [upload=312749]: Uploading segments... Aug 21 06:05:15.785057283 (300h39m10.216137414s) [upload=312749]: Got next segment. Inline: true Aug 21 06:05:15.785061741 (300h39m10.216141862s) [upload=312749]: Waiting for error group managing segments... Aug 21 06:05:15.785102640 (300h39m10.216182771s) [upload=312749]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 06:05:15.785106998 (300h39m10.216187129s) [upload=312749]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 06:05:15.785110004 (300h39m10.216190135s) [upload=312749]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 06:05:16.792373082 (300h39m11.223453213s) [upload=312749]: Done uploading segments... Aug 21 06:05:16.792391608 (300h39m11.223471739s) [upload=312749]: Upload finished. err: <nil> Duration:* 1.848117514s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 5.679971389s FAIL (2025-08-21 06:09:15 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 5.680001006s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....X.................................................X....] duration: 5.781450337s FAIL (2025-08-21 06:09:12 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 21 06:06:16.267376500 (300h40m10.698456631s) [upload=312769]: Starting upload Aug 21 06:06:16.267426706 (300h40m10.698506837s) [upload=312769]: Done starting upload Aug 21 06:06:16.267490137 (300h40m10.698570268s) [upload=312769]: Uploading segments... Aug 21 06:06:16.267595699 (300h40m10.69867583s) [upload=312769]: Got next segment. Inline: false Aug 21 06:06:16.267622370 (300h40m10.698702501s) [upload=312769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 06:06:16.267626668 (300h40m10.698706799s) [upload=312769]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 06:06:16.790975394 (300h40m11.222055566s) [seg_pos={0 0}, upload=312769]: Begin upload segment... Aug 21 06:06:16.791039036 (300h40m11.222119167s) [seg_pos={0 0}, upload=312769]: Done begin upload segment. Aug 21 06:06:16.791053263 (300h40m11.222133494s) [noise=true , address=45.91.116.5:4315 , piece_id=A6FNGYZBLA7JCPWC7LB5ECLBTKXUWAMC4X6CF3O34LXLMRWEGV2A, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.791065567 (300h40m11.222145698s) [noise=true , address=77.90.31.12:4606 , piece_id=TFRYO3KDJW26AQJJPFACOJU665CMLRLEOQIK353Y4URCBRMTHBFQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.791489618 (300h40m11.222569749s) [noise=true , address=104.36.82.5:4849 , piece_id=HUPNEWKLBX2ZI5PZSLKEQPYWTLZRZGSKYR7IZ6RZEVYGLGSEMZPQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.791763172 (300h40m11.222843303s) [noise=true , address=45.91.116.14:4204 , piece_id=UH3BJBUO7TSHPFZU7Q4EELWOINHIUWAIQFN3XAHX3X25VUBLX7EA, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.792115285 (300h40m11.223195417s) [noise=true , address=77.90.31.17:4781 , piece_id=3HMYJXFTSOKFY2NYO25KZ66DEC5J7BKFPWEARPF62QJCL33YDHZQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.792372808 (300h40m11.223452939s) [noise=true , address=77.90.31.10:4531 , piece_id=AGFYUV6WC464ZUXUN5VWA4DWBEACB7GOK2CB4MQ5OH35WZHVAY4A, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.792589663 (300h40m11.223669784s) [noise=true , address=77.90.31.13:4647 , piece_id=U6LAUWTBKQI6VJBKUHADT7N4HTO773BEUYIU2X5C7R5UO2PLKWIQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.792790758 (300h40m11.223870889s) [noise=true , address=104.36.82.49:4011 , piece_id=YKRH27M5WJQCEXQRBJBEKHKWMGMRDBZIO7PK232B63NUOONFQMMA, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.793001260 (300h40m11.224081391s) [noise=true , address=45.91.116.4:4942 , piece_id=SICQFCLAN2TW2VNEQ4YOUWDNFBXDXTOW74NWZJF4SPPAOAR55UVQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.793207105 (300h40m11.224287226s) [noise=true , address=79.127.201.214:4322 , piece_id=G7HI7I5EPC2XTW4MJQXZD2WMNVASM5Z3MTU5YHOR6UGC6HMOVZWQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.793406827 (300h40m11.224486958s) [noise=true , address=79.127.205.233:4638 , piece_id=P77DK4S6TSWFH37UXPMKYOHF7AEEOTOCLJ72PSB2EAJR5EYHG33Q, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.793597281 (300h40m11.224677412s) [noise=true , address=45.91.116.11:4143 , piece_id=3GUVOHZ2XHLPC4CB44RXGGDROQT7O4EDIUY6VUG7LK6ZUNEVHPNA, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.793790541 (300h40m11.224870672s) [noise=true , address=79.127.205.235:4674 , piece_id=GN5RPGMLJK2GNLG3WRED7J525PNVKRR746P63BB2TZNR3ESTPSQA, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.794015731 (300h40m11.225095863s) [noise=true , address=104.36.82.23:4477 , piece_id=MHSUNRIBYXZQNDMSXRDC2S5VHNUDMZ2FR5FQ66J4CCRCJC2VCKUA, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.794291128 (300h40m11.225371259s) [noise=true , address=104.36.82.60:4353 , piece_id=LZQ3W4HLLBSVCHZBVHOLS6ZWT53WEMGCNLUZWB43M7MCEIDVTEKQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.794509356 (300h40m11.225589487s) [noise=true , address=77.90.31.16:4768 , piece_id=NWHBLL5CVIWPQ2HHVVXNAA6RH4FZTVMAYXSM5D62OWSFHIO7AB5A, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.794752481 (300h40m11.225832602s) [noise=true , address=77.90.31.21:4891 , piece_id=FGIV2CPMOD7XITXGJNAJQZMDY7UAGSM2JS7FRH5LOFNKWI76IFXQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.794946252 (300h40m11.226026383s) [noise=true , address=104.36.82.36:4632 , piece_id=N24ZVK6WUQDVNLVXKEQSO67K4QMMQQE2TB4RPVXDJCRE6C6UPIPQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:17.921692057 (300h40m12.352772188s) [upload=312769]: Next returned nil segment Aug 21 06:06:17.921746201 (300h40m12.352826332s) [upload=312769]: Waiting for error group managing segments... Aug 21 06:06:18.206445940 (300h40m12.637526071s) [noise=true , address=79.127.205.233:4638 , piece_id=P77DK4S6TSWFH37UXPMKYOHF7AEEOTOCLJ72PSB2EAJR5EYHG33Q, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.241271585 (300h40m12.672351716s) [noise=true , address=79.127.205.235:4674 , piece_id=GN5RPGMLJK2GNLG3WRED7J525PNVKRR746P63BB2TZNR3ESTPSQA, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.700930117 (300h40m13.132010238s) [noise=true , address=45.91.116.11:4143 , piece_id=3GUVOHZ2XHLPC4CB44RXGGDROQT7O4EDIUY6VUG7LK6ZUNEVHPNA, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.713994383 (300h40m13.145074514s) [noise=true , address=45.91.116.5:4315 , piece_id=A6FNGYZBLA7JCPWC7LB5ECLBTKXUWAMC4X6CF3O34LXLMRWEGV2A, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.715350278 (300h40m13.146430399s) [noise=true , address=45.91.116.4:4942 , piece_id=SICQFCLAN2TW2VNEQ4YOUWDNFBXDXTOW74NWZJF4SPPAOAR55UVQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.745190424 (300h40m13.176270555s) [noise=true , address=77.90.31.21:4891 , piece_id=FGIV2CPMOD7XITXGJNAJQZMDY7UAGSM2JS7FRH5LOFNKWI76IFXQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.779540298 (300h40m13.210620429s) [noise=true , address=79.127.201.214:4322 , piece_id=G7HI7I5EPC2XTW4MJQXZD2WMNVASM5Z3MTU5YHOR6UGC6HMOVZWQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.793222909 (300h40m13.22430304s) [noise=true , address=45.91.116.14:4204 , piece_id=UH3BJBUO7TSHPFZU7Q4EELWOINHIUWAIQFN3XAHX3X25VUBLX7EA, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.824245817 (300h40m13.255325948s) [noise=true , address=77.90.31.12:4606 , piece_id=TFRYO3KDJW26AQJJPFACOJU665CMLRLEOQIK353Y4URCBRMTHBFQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.828009940 (300h40m13.259090071s) [noise=true , address=104.36.82.36:4632 , piece_id=N24ZVK6WUQDVNLVXKEQSO67K4QMMQQE2TB4RPVXDJCRE6C6UPIPQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.831904802 (300h40m13.262984933s) [noise=true , address=77.90.31.13:4647 , piece_id=U6LAUWTBKQI6VJBKUHADT7N4HTO773BEUYIU2X5C7R5UO2PLKWIQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.845088307 (300h40m13.276168438s) [noise=true , address=77.90.31.10:4531 , piece_id=AGFYUV6WC464ZUXUN5VWA4DWBEACB7GOK2CB4MQ5OH35WZHVAY4A, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.900147776 (300h40m13.331227897s) [noise=true , address=104.36.82.49:4011 , piece_id=YKRH27M5WJQCEXQRBJBEKHKWMGMRDBZIO7PK232B63NUOONFQMMA, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.926691354 (300h40m13.357771475s) [noise=true , address=77.90.31.16:4768 , piece_id=NWHBLL5CVIWPQ2HHVVXNAA6RH4FZTVMAYXSM5D62OWSFHIO7AB5A, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.926720550 (300h40m13.357800671s) [seg_pos={0 0}, upload=312769]: Segment reached optimal threshold of 14 pieces. Aug 21 06:06:18.926824459 (300h40m13.35790458s) [noise=true , address=77.90.31.17:4781 , piece_id=3HMYJXFTSOKFY2NYO25KZ66DEC5J7BKFPWEARPF62QJCL33YDHZQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Uc2Hn41mUYgLtyirRtEGNv5iKBv8YqzQo3RYdoE4M1Fj29WgT): protocol: expected piece hash; context canceled; EOF Aug 21 06:06:18.926973314 (300h40m13.358053445s) [noise=true , address=104.36.82.23:4477 , piece_id=MHSUNRIBYXZQNDMSXRDC2S5VHNUDMZ2FR5FQ66J4CCRCJC2VCKUA, seg_pos={0 0}, upload=312769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RP2Zq643WWNtKEr34Tq1iZS29NYA2okr9Fg1jiCpaFTqfLauf): protocol: expected piece hash; context canceled; EOF Aug 21 06:06:18.926978634 (300h40m13.358058765s) [noise=true , address=104.36.82.60:4353 , piece_id=LZQ3W4HLLBSVCHZBVHOLS6ZWT53WEMGCNLUZWB43M7MCEIDVTEKQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF Aug 21 06:06:18.927075128 (300h40m13.358155259s) [noise=true , address=104.36.82.5:4849 , piece_id=HUPNEWKLBX2ZI5PZSLKEQPYWTLZRZGSKYR7IZ6RZEVYGLGSEMZPQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n2gSzVmNCEZcfVsFKibjXHs2jMr82D3SWQEykFQQ4uyhhnrj1): protocol: write tcp 188.166.225.170:58800->104.36.82.5:4849: use of closed network connection; write tcp 188.166.225.170:58800->104.36.82.5:4849: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58800->104.36.82.5:4849: use of closed network connection Aug 21 06:06:18.927108161 (300h40m13.358188292s) [seg_pos={0 0}, upload=312769]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 06:06:18.927184728 (300h40m13.358264859s) [upload=312769]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 06:06:18.927189176 (300h40m13.358269307s) [upload=312769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 06:06:19.232063958 (300h40m13.663144089s) [upload=312769]: Done uploading segments... Aug 21 06:06:19.232084798 (300h40m13.663164929s) [upload=312769]: Upload finished. err: <nil> Duration: 5.781479084s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [......X.................................................X...] duration: 5.724498008s FAIL (2025-08-21 06:08:32 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 21 06:06:16.267376500 (300h40m10.698456631s) [upload=312769]: Starting upload Aug 21 06:06:16.267426706 (300h40m10.698506837s) [upload=312769]: Done starting upload Aug 21 06:06:16.267490137 (300h40m10.698570268s) [upload=312769]: Uploading segments... Aug 21 06:06:16.267595699 (300h40m10.69867583s) [upload=312769]: Got next segment. Inline: false Aug 21 06:06:16.267622370 (300h40m10.698702501s) [upload=312769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 06:06:16.267626668 (300h40m10.698706799s) [upload=312769]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 06:06:16.790975394 (300h40m11.222055566s) [seg_pos={0 0}, upload=312769]: Begin upload segment... Aug 21 06:06:16.791039036 (300h40m11.222119167s) [seg_pos={0 0}, upload=312769]: Done begin upload segment. Aug 21 06:06:16.791053263 (300h40m11.222133494s) [noise=true , address=45.91.116.5:4315 , piece_id=A6FNGYZBLA7JCPWC7LB5ECLBTKXUWAMC4X6CF3O34LXLMRWEGV2A, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.791065567 (300h40m11.222145698s) [noise=true , address=77.90.31.12:4606 , piece_id=TFRYO3KDJW26AQJJPFACOJU665CMLRLEOQIK353Y4URCBRMTHBFQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.791489618 (300h40m11.222569749s) [noise=true , address=104.36.82.5:4849 , piece_id=HUPNEWKLBX2ZI5PZSLKEQPYWTLZRZGSKYR7IZ6RZEVYGLGSEMZPQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.791763172 (300h40m11.222843303s) [noise=true , address=45.91.116.14:4204 , piece_id=UH3BJBUO7TSHPFZU7Q4EELWOINHIUWAIQFN3XAHX3X25VUBLX7EA, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.792115285 (300h40m11.223195417s) [noise=true , address=77.90.31.17:4781 , piece_id=3HMYJXFTSOKFY2NYO25KZ66DEC5J7BKFPWEARPF62QJCL33YDHZQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.792372808 (300h40m11.223452939s) [noise=true , address=77.90.31.10:4531 , piece_id=AGFYUV6WC464ZUXUN5VWA4DWBEACB7GOK2CB4MQ5OH35WZHVAY4A, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.792589663 (300h40m11.223669784s) [noise=true , address=77.90.31.13:4647 , piece_id=U6LAUWTBKQI6VJBKUHADT7N4HTO773BEUYIU2X5C7R5UO2PLKWIQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.792790758 (300h40m11.223870889s) [noise=true , address=104.36.82.49:4011 , piece_id=YKRH27M5WJQCEXQRBJBEKHKWMGMRDBZIO7PK232B63NUOONFQMMA, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.793001260 (300h40m11.224081391s) [noise=true , address=45.91.116.4:4942 , piece_id=SICQFCLAN2TW2VNEQ4YOUWDNFBXDXTOW74NWZJF4SPPAOAR55UVQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.793207105 (300h40m11.224287226s) [noise=true , address=79.127.201.214:4322 , piece_id=G7HI7I5EPC2XTW4MJQXZD2WMNVASM5Z3MTU5YHOR6UGC6HMOVZWQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.793406827 (300h40m11.224486958s) [noise=true , address=79.127.205.233:4638 , piece_id=P77DK4S6TSWFH37UXPMKYOHF7AEEOTOCLJ72PSB2EAJR5EYHG33Q, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.793597281 (300h40m11.224677412s) [noise=true , address=45.91.116.11:4143 , piece_id=3GUVOHZ2XHLPC4CB44RXGGDROQT7O4EDIUY6VUG7LK6ZUNEVHPNA, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.793790541 (300h40m11.224870672s) [noise=true , address=79.127.205.235:4674 , piece_id=GN5RPGMLJK2GNLG3WRED7J525PNVKRR746P63BB2TZNR3ESTPSQA, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.794015731 (300h40m11.225095863s) [noise=true , address=104.36.82.23:4477 , piece_id=MHSUNRIBYXZQNDMSXRDC2S5VHNUDMZ2FR5FQ66J4CCRCJC2VCKUA, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.794291128 (300h40m11.225371259s) [noise=true , address=104.36.82.60:4353 , piece_id=LZQ3W4HLLBSVCHZBVHOLS6ZWT53WEMGCNLUZWB43M7MCEIDVTEKQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.794509356 (300h40m11.225589487s) [noise=true , address=77.90.31.16:4768 , piece_id=NWHBLL5CVIWPQ2HHVVXNAA6RH4FZTVMAYXSM5D62OWSFHIO7AB5A, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.794752481 (300h40m11.225832602s) [noise=true , address=77.90.31.21:4891 , piece_id=FGIV2CPMOD7XITXGJNAJQZMDY7UAGSM2JS7FRH5LOFNKWI76IFXQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.794946252 (300h40m11.226026383s) [noise=true , address=104.36.82.36:4632 , piece_id=N24ZVK6WUQDVNLVXKEQSO67K4QMMQQE2TB4RPVXDJCRE6C6UPIPQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:17.921692057 (300h40m12.352772188s) [upload=312769]: Next returned nil segment Aug 21 06:06:17.921746201 (300h40m12.352826332s) [upload=312769]: Waiting for error group managing segments... Aug 21 06:06:18.206445940 (300h40m12.637526071s) [noise=true , address=79.127.205.233:4638 , piece_id=P77DK4S6TSWFH37UXPMKYOHF7AEEOTOCLJ72PSB2EAJR5EYHG33Q, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.241271585 (300h40m12.672351716s) [noise=true , address=79.127.205.235:4674 , piece_id=GN5RPGMLJK2GNLG3WRED7J525PNVKRR746P63BB2TZNR3ESTPSQA, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.700930117 (300h40m13.132010238s) [noise=true , address=45.91.116.11:4143 , piece_id=3GUVOHZ2XHLPC4CB44RXGGDROQT7O4EDIUY6VUG7LK6ZUNEVHPNA, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.713994383 (300h40m13.145074514s) [noise=true , address=45.91.116.5:4315 , piece_id=A6FNGYZBLA7JCPWC7LB5ECLBTKXUWAMC4X6CF3O34LXLMRWEGV2A, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.715350278 (300h40m13.146430399s) [noise=true , address=45.91.116.4:4942 , piece_id=SICQFCLAN2TW2VNEQ4YOUWDNFBXDXTOW74NWZJF4SPPAOAR55UVQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.745190424 (300h40m13.176270555s) [noise=true , address=77.90.31.21:4891 , piece_id=FGIV2CPMOD7XITXGJNAJQZMDY7UAGSM2JS7FRH5LOFNKWI76IFXQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.779540298 (300h40m13.210620429s) [noise=true , address=79.127.201.214:4322 , piece_id=G7HI7I5EPC2XTW4MJQXZD2WMNVASM5Z3MTU5YHOR6UGC6HMOVZWQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.793222909 (300h40m13.22430304s) [noise=true , address=45.91.116.14:4204 , piece_id=UH3BJBUO7TSHPFZU7Q4EELWOINHIUWAIQFN3XAHX3X25VUBLX7EA, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.824245817 (300h40m13.255325948s) [noise=true , address=77.90.31.12:4606 , piece_id=TFRYO3KDJW26AQJJPFACOJU665CMLRLEOQIK353Y4URCBRMTHBFQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.828009940 (300h40m13.259090071s) [noise=true , address=104.36.82.36:4632 , piece_id=N24ZVK6WUQDVNLVXKEQSO67K4QMMQQE2TB4RPVXDJCRE6C6UPIPQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.831904802 (300h40m13.262984933s) [noise=true , address=77.90.31.13:4647 , piece_id=U6LAUWTBKQI6VJBKUHADT7N4HTO773BEUYIU2X5C7R5UO2PLKWIQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.845088307 (300h40m13.276168438s) [noise=true , address=77.90.31.10:4531 , piece_id=AGFYUV6WC464ZUXUN5VWA4DWBEACB7GOK2CB4MQ5OH35WZHVAY4A, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.900147776 (300h40m13.331227897s) [noise=true , address=104.36.82.49:4011 , piece_id=YKRH27M5WJQCEXQRBJBEKHKWMGMRDBZIO7PK232B63NUOONFQMMA, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.926691354 (300h40m13.357771475s) [noise=true , address=77.90.31.16:4768 , piece_id=NWHBLL5CVIWPQ2HHVVXNAA6RH4FZTVMAYXSM5D62OWSFHIO7AB5A, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.926720550 (300h40m13.357800671s) [seg_pos={0 0}, upload=312769]: Segment reached optimal threshold of 14 pieces. Aug 21 06:06:18.926824459 (300h40m13.35790458s) [noise=true , address=77.90.31.17:4781 , piece_id=3HMYJXFTSOKFY2NYO25KZ66DEC5J7BKFPWEARPF62QJCL33YDHZQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Uc2Hn41mUYgLtyirRtEGNv5iKBv8YqzQo3RYdoE4M1Fj29WgT): protocol: expected piece hash; context canceled; EOF Aug 21 06:06:18.926973314 (300h40m13.358053445s) [noise=true , address=104.36.82.23:4477 , piece_id=MHSUNRIBYXZQNDMSXRDC2S5VHNUDMZ2FR5FQ66J4CCRCJC2VCKUA, seg_pos={0 0}, upload=312769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RP2Zq643WWNtKEr34Tq1iZS29NYA2okr9Fg1jiCpaFTqfLauf): protocol: expected piece hash; context canceled; EOF Aug 21 06:06:18.926978634 (300h40m13.358058765s) [noise=true , address=104.36.82.60:4353 , piece_id=LZQ3W4HLLBSVCHZBVHOLS6ZWT53WEMGCNLUZWB43M7MCEIDVTEKQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF Aug 21 06:06:18.927075128 (300h40m13.358155259s) [noise=true , address=104.36.82.5:4849 , piece_id=HUPNEWKLBX2ZI5PZSLKEQPYWTLZRZGSKYR7IZ6RZEVYGLGSEMZPQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n2gSzVmNCEZcfVsFKibjXHs2jMr82D3SWQEykFQQ4uyhhnrj1): protocol: write tcp 188.166.225.170:58800->104.36.82.5:4849: use of closed network connection; write tcp 188.166.225.170:58800->104.36.82.5:4849: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58800->104.36.82.5:4849: use of closed network connection Aug 21 06:06:18.927108161 (300h40m13.358188292s) [seg_pos={0 0}, upload=312769]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 06:06:18.927184728 (300h40m13.358264859s) [upload=312769]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 06:06:18.927189176 (300h40m13.358269307s) [upload=312769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 06:06:19.232063958 (300h40m13.663144089s) [upload=312769]: Done uploading segments... Aug 21 06:06:19.232084798 (300h40m13.663164929s) [upload=312769]: Upload finished. err: <nil> Duration: 5.724526884s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [..X.....X...........................X.................X.....] duration: 1.809041367s FAIL (2025-08-21 06:08:16 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 21 06:05:15.784901024 (300h39m10.215981155s) [upload=312749]: Starting upload Aug 21 06:05:15.784953484 (300h39m10.216033615s) [upload=312749]: Done starting upload Aug 21 06:05:15.785014431 (300h39m10.216094563s) [upload=312749]: Uploading segments... Aug 21 06:05:15.785057283 (300h39m10.216137414s) [upload=312749]: Got next segment. Inline: true Aug 21 06:05:15.785061741 (300h39m10.216141862s) [upload=312749]: Waiting for error group managing segments... Aug 21 06:05:15.785102640 (300h39m10.216182771s) [upload=312749]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 06:05:15.785106998 (300h39m10.216187129s) [upload=312749]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 06:05:15.785110004 (300h39m10.216190135s) [upload=312749]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 06:05:16.792373082 (300h39m11.223453213s) [upload=312749]: Done uploading segments... Aug 21 06:05:16.792391608 (300h39m11.223471739s) [upload=312749]: Upload finished. err: <nil> Duration:* 1.809067476s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 5.748375915s FAIL (2025-08-21 06:08:09 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 5.7484043s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......X.................................................X..] duration: 5.835734698s FAIL (2025-08-21 06:07:58 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 21 06:06:16.267376500 (300h40m10.698456631s) [upload=312769]: Starting upload Aug 21 06:06:16.267426706 (300h40m10.698506837s) [upload=312769]: Done starting upload Aug 21 06:06:16.267490137 (300h40m10.698570268s) [upload=312769]: Uploading segments... Aug 21 06:06:16.267595699 (300h40m10.69867583s) [upload=312769]: Got next segment. Inline: false Aug 21 06:06:16.267622370 (300h40m10.698702501s) [upload=312769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 06:06:16.267626668 (300h40m10.698706799s) [upload=312769]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 06:06:16.790975394 (300h40m11.222055566s) [seg_pos={0 0}, upload=312769]: Begin upload segment... Aug 21 06:06:16.791039036 (300h40m11.222119167s) [seg_pos={0 0}, upload=312769]: Done begin upload segment. Aug 21 06:06:16.791053263 (300h40m11.222133494s) [noise=true , address=45.91.116.5:4315 , piece_id=A6FNGYZBLA7JCPWC7LB5ECLBTKXUWAMC4X6CF3O34LXLMRWEGV2A, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.791065567 (300h40m11.222145698s) [noise=true , address=77.90.31.12:4606 , piece_id=TFRYO3KDJW26AQJJPFACOJU665CMLRLEOQIK353Y4URCBRMTHBFQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.791489618 (300h40m11.222569749s) [noise=true , address=104.36.82.5:4849 , piece_id=HUPNEWKLBX2ZI5PZSLKEQPYWTLZRZGSKYR7IZ6RZEVYGLGSEMZPQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.791763172 (300h40m11.222843303s) [noise=true , address=45.91.116.14:4204 , piece_id=UH3BJBUO7TSHPFZU7Q4EELWOINHIUWAIQFN3XAHX3X25VUBLX7EA, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.792115285 (300h40m11.223195417s) [noise=true , address=77.90.31.17:4781 , piece_id=3HMYJXFTSOKFY2NYO25KZ66DEC5J7BKFPWEARPF62QJCL33YDHZQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.792372808 (300h40m11.223452939s) [noise=true , address=77.90.31.10:4531 , piece_id=AGFYUV6WC464ZUXUN5VWA4DWBEACB7GOK2CB4MQ5OH35WZHVAY4A, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.792589663 (300h40m11.223669784s) [noise=true , address=77.90.31.13:4647 , piece_id=U6LAUWTBKQI6VJBKUHADT7N4HTO773BEUYIU2X5C7R5UO2PLKWIQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.792790758 (300h40m11.223870889s) [noise=true , address=104.36.82.49:4011 , piece_id=YKRH27M5WJQCEXQRBJBEKHKWMGMRDBZIO7PK232B63NUOONFQMMA, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.793001260 (300h40m11.224081391s) [noise=true , address=45.91.116.4:4942 , piece_id=SICQFCLAN2TW2VNEQ4YOUWDNFBXDXTOW74NWZJF4SPPAOAR55UVQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.793207105 (300h40m11.224287226s) [noise=true , address=79.127.201.214:4322 , piece_id=G7HI7I5EPC2XTW4MJQXZD2WMNVASM5Z3MTU5YHOR6UGC6HMOVZWQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.793406827 (300h40m11.224486958s) [noise=true , address=79.127.205.233:4638 , piece_id=P77DK4S6TSWFH37UXPMKYOHF7AEEOTOCLJ72PSB2EAJR5EYHG33Q, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.793597281 (300h40m11.224677412s) [noise=true , address=45.91.116.11:4143 , piece_id=3GUVOHZ2XHLPC4CB44RXGGDROQT7O4EDIUY6VUG7LK6ZUNEVHPNA, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.793790541 (300h40m11.224870672s) [noise=true , address=79.127.205.235:4674 , piece_id=GN5RPGMLJK2GNLG3WRED7J525PNVKRR746P63BB2TZNR3ESTPSQA, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.794015731 (300h40m11.225095863s) [noise=true , address=104.36.82.23:4477 , piece_id=MHSUNRIBYXZQNDMSXRDC2S5VHNUDMZ2FR5FQ66J4CCRCJC2VCKUA, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.794291128 (300h40m11.225371259s) [noise=true , address=104.36.82.60:4353 , piece_id=LZQ3W4HLLBSVCHZBVHOLS6ZWT53WEMGCNLUZWB43M7MCEIDVTEKQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.794509356 (300h40m11.225589487s) [noise=true , address=77.90.31.16:4768 , piece_id=NWHBLL5CVIWPQ2HHVVXNAA6RH4FZTVMAYXSM5D62OWSFHIO7AB5A, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.794752481 (300h40m11.225832602s) [noise=true , address=77.90.31.21:4891 , piece_id=FGIV2CPMOD7XITXGJNAJQZMDY7UAGSM2JS7FRH5LOFNKWI76IFXQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.794946252 (300h40m11.226026383s) [noise=true , address=104.36.82.36:4632 , piece_id=N24ZVK6WUQDVNLVXKEQSO67K4QMMQQE2TB4RPVXDJCRE6C6UPIPQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:17.921692057 (300h40m12.352772188s) [upload=312769]: Next returned nil segment Aug 21 06:06:17.921746201 (300h40m12.352826332s) [upload=312769]: Waiting for error group managing segments... Aug 21 06:06:18.206445940 (300h40m12.637526071s) [noise=true , address=79.127.205.233:4638 , piece_id=P77DK4S6TSWFH37UXPMKYOHF7AEEOTOCLJ72PSB2EAJR5EYHG33Q, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.241271585 (300h40m12.672351716s) [noise=true , address=79.127.205.235:4674 , piece_id=GN5RPGMLJK2GNLG3WRED7J525PNVKRR746P63BB2TZNR3ESTPSQA, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.700930117 (300h40m13.132010238s) [noise=true , address=45.91.116.11:4143 , piece_id=3GUVOHZ2XHLPC4CB44RXGGDROQT7O4EDIUY6VUG7LK6ZUNEVHPNA, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.713994383 (300h40m13.145074514s) [noise=true , address=45.91.116.5:4315 , piece_id=A6FNGYZBLA7JCPWC7LB5ECLBTKXUWAMC4X6CF3O34LXLMRWEGV2A, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.715350278 (300h40m13.146430399s) [noise=true , address=45.91.116.4:4942 , piece_id=SICQFCLAN2TW2VNEQ4YOUWDNFBXDXTOW74NWZJF4SPPAOAR55UVQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.745190424 (300h40m13.176270555s) [noise=true , address=77.90.31.21:4891 , piece_id=FGIV2CPMOD7XITXGJNAJQZMDY7UAGSM2JS7FRH5LOFNKWI76IFXQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.779540298 (300h40m13.210620429s) [noise=true , address=79.127.201.214:4322 , piece_id=G7HI7I5EPC2XTW4MJQXZD2WMNVASM5Z3MTU5YHOR6UGC6HMOVZWQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.793222909 (300h40m13.22430304s) [noise=true , address=45.91.116.14:4204 , piece_id=UH3BJBUO7TSHPFZU7Q4EELWOINHIUWAIQFN3XAHX3X25VUBLX7EA, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.824245817 (300h40m13.255325948s) [noise=true , address=77.90.31.12:4606 , piece_id=TFRYO3KDJW26AQJJPFACOJU665CMLRLEOQIK353Y4URCBRMTHBFQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.828009940 (300h40m13.259090071s) [noise=true , address=104.36.82.36:4632 , piece_id=N24ZVK6WUQDVNLVXKEQSO67K4QMMQQE2TB4RPVXDJCRE6C6UPIPQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.831904802 (300h40m13.262984933s) [noise=true , address=77.90.31.13:4647 , piece_id=U6LAUWTBKQI6VJBKUHADT7N4HTO773BEUYIU2X5C7R5UO2PLKWIQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.845088307 (300h40m13.276168438s) [noise=true , address=77.90.31.10:4531 , piece_id=AGFYUV6WC464ZUXUN5VWA4DWBEACB7GOK2CB4MQ5OH35WZHVAY4A, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.900147776 (300h40m13.331227897s) [noise=true , address=104.36.82.49:4011 , piece_id=YKRH27M5WJQCEXQRBJBEKHKWMGMRDBZIO7PK232B63NUOONFQMMA, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.926691354 (300h40m13.357771475s) [noise=true , address=77.90.31.16:4768 , piece_id=NWHBLL5CVIWPQ2HHVVXNAA6RH4FZTVMAYXSM5D62OWSFHIO7AB5A, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.926720550 (300h40m13.357800671s) [seg_pos={0 0}, upload=312769]: Segment reached optimal threshold of 14 pieces. Aug 21 06:06:18.926824459 (300h40m13.35790458s) [noise=true , address=77.90.31.17:4781 , piece_id=3HMYJXFTSOKFY2NYO25KZ66DEC5J7BKFPWEARPF62QJCL33YDHZQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Uc2Hn41mUYgLtyirRtEGNv5iKBv8YqzQo3RYdoE4M1Fj29WgT): protocol: expected piece hash; context canceled; EOF Aug 21 06:06:18.926973314 (300h40m13.358053445s) [noise=true , address=104.36.82.23:4477 , piece_id=MHSUNRIBYXZQNDMSXRDC2S5VHNUDMZ2FR5FQ66J4CCRCJC2VCKUA, seg_pos={0 0}, upload=312769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RP2Zq643WWNtKEr34Tq1iZS29NYA2okr9Fg1jiCpaFTqfLauf): protocol: expected piece hash; context canceled; EOF Aug 21 06:06:18.926978634 (300h40m13.358058765s) [noise=true , address=104.36.82.60:4353 , piece_id=LZQ3W4HLLBSVCHZBVHOLS6ZWT53WEMGCNLUZWB43M7MCEIDVTEKQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF Aug 21 06:06:18.927075128 (300h40m13.358155259s) [noise=true , address=104.36.82.5:4849 , piece_id=HUPNEWKLBX2ZI5PZSLKEQPYWTLZRZGSKYR7IZ6RZEVYGLGSEMZPQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n2gSzVmNCEZcfVsFKibjXHs2jMr82D3SWQEykFQQ4uyhhnrj1): protocol: write tcp 188.166.225.170:58800->104.36.82.5:4849: use of closed network connection; write tcp 188.166.225.170:58800->104.36.82.5:4849: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58800->104.36.82.5:4849: use of closed network connection Aug 21 06:06:18.927108161 (300h40m13.358188292s) [seg_pos={0 0}, upload=312769]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 06:06:18.927184728 (300h40m13.358264859s) [upload=312769]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 06:06:18.927189176 (300h40m13.358269307s) [upload=312769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 06:06:19.232063958 (300h40m13.663144089s) [upload=312769]: Done uploading segments... Aug 21 06:06:19.232084798 (300h40m13.663164929s) [upload=312769]: Upload finished. err: <nil> Duration: 5.835761498s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [X..X.....X...........................X.................X....] duration: 1.972651253s FAIL (2025-08-21 06:07:35 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 21 06:05:15.784901024 (300h39m10.215981155s) [upload=312749]: Starting upload Aug 21 06:05:15.784953484 (300h39m10.216033615s) [upload=312749]: Done starting upload Aug 21 06:05:15.785014431 (300h39m10.216094563s) [upload=312749]: Uploading segments... Aug 21 06:05:15.785057283 (300h39m10.216137414s) [upload=312749]: Got next segment. Inline: true Aug 21 06:05:15.785061741 (300h39m10.216141862s) [upload=312749]: Waiting for error group managing segments... Aug 21 06:05:15.785102640 (300h39m10.216182771s) [upload=312749]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 06:05:15.785106998 (300h39m10.216187129s) [upload=312749]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 06:05:15.785110004 (300h39m10.216190135s) [upload=312749]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 06:05:16.792373082 (300h39m11.223453213s) [upload=312749]: Done uploading segments... Aug 21 06:05:16.792391608 (300h39m11.223471739s) [upload=312749]: Upload finished. err: <nil> Duration:* 1.972685489s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 6.025314538s FAIL (2025-08-21 06:07:24 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 6.025344907s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 5.730226814s FAIL (2025-08-21 06:07:03 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 5.730253595s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.X..X.....X...........................X.................X...] duration: 1.931589561s FAIL (2025-08-21 06:06:59 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 21 06:05:15.784901024 (300h39m10.215981155s) [upload=312749]: Starting upload Aug 21 06:05:15.784953484 (300h39m10.216033615s) [upload=312749]: Done starting upload Aug 21 06:05:15.785014431 (300h39m10.216094563s) [upload=312749]: Uploading segments... Aug 21 06:05:15.785057283 (300h39m10.216137414s) [upload=312749]: Got next segment. Inline: true Aug 21 06:05:15.785061741 (300h39m10.216141862s) [upload=312749]: Waiting for error group managing segments... Aug 21 06:05:15.785102640 (300h39m10.216182771s) [upload=312749]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 06:05:15.785106998 (300h39m10.216187129s) [upload=312749]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 06:05:15.785110004 (300h39m10.216190135s) [upload=312749]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 06:05:16.792373082 (300h39m11.223453213s) [upload=312749]: Done uploading segments... Aug 21 06:05:16.792391608 (300h39m11.223471739s) [upload=312749]: Upload finished. err: <nil> Duration:* 1.931618976s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [........X.................................................X.] duration: 6.265146736s FAIL (2025-08-21 06:06:53 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 21 06:06:16.267376500 (300h40m10.698456631s) [upload=312769]: Starting upload Aug 21 06:06:16.267426706 (300h40m10.698506837s) [upload=312769]: Done starting upload Aug 21 06:06:16.267490137 (300h40m10.698570268s) [upload=312769]: Uploading segments... Aug 21 06:06:16.267595699 (300h40m10.69867583s) [upload=312769]: Got next segment. Inline: false Aug 21 06:06:16.267622370 (300h40m10.698702501s) [upload=312769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 06:06:16.267626668 (300h40m10.698706799s) [upload=312769]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 06:06:16.790975394 (300h40m11.222055566s) [seg_pos={0 0}, upload=312769]: Begin upload segment... Aug 21 06:06:16.791039036 (300h40m11.222119167s) [seg_pos={0 0}, upload=312769]: Done begin upload segment. Aug 21 06:06:16.791053263 (300h40m11.222133494s) [noise=true , address=45.91.116.5:4315 , piece_id=A6FNGYZBLA7JCPWC7LB5ECLBTKXUWAMC4X6CF3O34LXLMRWEGV2A, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.791065567 (300h40m11.222145698s) [noise=true , address=77.90.31.12:4606 , piece_id=TFRYO3KDJW26AQJJPFACOJU665CMLRLEOQIK353Y4URCBRMTHBFQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.791489618 (300h40m11.222569749s) [noise=true , address=104.36.82.5:4849 , piece_id=HUPNEWKLBX2ZI5PZSLKEQPYWTLZRZGSKYR7IZ6RZEVYGLGSEMZPQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.791763172 (300h40m11.222843303s) [noise=true , address=45.91.116.14:4204 , piece_id=UH3BJBUO7TSHPFZU7Q4EELWOINHIUWAIQFN3XAHX3X25VUBLX7EA, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.792115285 (300h40m11.223195417s) [noise=true , address=77.90.31.17:4781 , piece_id=3HMYJXFTSOKFY2NYO25KZ66DEC5J7BKFPWEARPF62QJCL33YDHZQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.792372808 (300h40m11.223452939s) [noise=true , address=77.90.31.10:4531 , piece_id=AGFYUV6WC464ZUXUN5VWA4DWBEACB7GOK2CB4MQ5OH35WZHVAY4A, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.792589663 (300h40m11.223669784s) [noise=true , address=77.90.31.13:4647 , piece_id=U6LAUWTBKQI6VJBKUHADT7N4HTO773BEUYIU2X5C7R5UO2PLKWIQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.792790758 (300h40m11.223870889s) [noise=true , address=104.36.82.49:4011 , piece_id=YKRH27M5WJQCEXQRBJBEKHKWMGMRDBZIO7PK232B63NUOONFQMMA, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.793001260 (300h40m11.224081391s) [noise=true , address=45.91.116.4:4942 , piece_id=SICQFCLAN2TW2VNEQ4YOUWDNFBXDXTOW74NWZJF4SPPAOAR55UVQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.793207105 (300h40m11.224287226s) [noise=true , address=79.127.201.214:4322 , piece_id=G7HI7I5EPC2XTW4MJQXZD2WMNVASM5Z3MTU5YHOR6UGC6HMOVZWQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.793406827 (300h40m11.224486958s) [noise=true , address=79.127.205.233:4638 , piece_id=P77DK4S6TSWFH37UXPMKYOHF7AEEOTOCLJ72PSB2EAJR5EYHG33Q, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.793597281 (300h40m11.224677412s) [noise=true , address=45.91.116.11:4143 , piece_id=3GUVOHZ2XHLPC4CB44RXGGDROQT7O4EDIUY6VUG7LK6ZUNEVHPNA, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.793790541 (300h40m11.224870672s) [noise=true , address=79.127.205.235:4674 , piece_id=GN5RPGMLJK2GNLG3WRED7J525PNVKRR746P63BB2TZNR3ESTPSQA, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.794015731 (300h40m11.225095863s) [noise=true , address=104.36.82.23:4477 , piece_id=MHSUNRIBYXZQNDMSXRDC2S5VHNUDMZ2FR5FQ66J4CCRCJC2VCKUA, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.794291128 (300h40m11.225371259s) [noise=true , address=104.36.82.60:4353 , piece_id=LZQ3W4HLLBSVCHZBVHOLS6ZWT53WEMGCNLUZWB43M7MCEIDVTEKQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.794509356 (300h40m11.225589487s) [noise=true , address=77.90.31.16:4768 , piece_id=NWHBLL5CVIWPQ2HHVVXNAA6RH4FZTVMAYXSM5D62OWSFHIO7AB5A, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.794752481 (300h40m11.225832602s) [noise=true , address=77.90.31.21:4891 , piece_id=FGIV2CPMOD7XITXGJNAJQZMDY7UAGSM2JS7FRH5LOFNKWI76IFXQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.794946252 (300h40m11.226026383s) [noise=true , address=104.36.82.36:4632 , piece_id=N24ZVK6WUQDVNLVXKEQSO67K4QMMQQE2TB4RPVXDJCRE6C6UPIPQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:17.921692057 (300h40m12.352772188s) [upload=312769]: Next returned nil segment Aug 21 06:06:17.921746201 (300h40m12.352826332s) [upload=312769]: Waiting for error group managing segments... Aug 21 06:06:18.206445940 (300h40m12.637526071s) [noise=true , address=79.127.205.233:4638 , piece_id=P77DK4S6TSWFH37UXPMKYOHF7AEEOTOCLJ72PSB2EAJR5EYHG33Q, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.241271585 (300h40m12.672351716s) [noise=true , address=79.127.205.235:4674 , piece_id=GN5RPGMLJK2GNLG3WRED7J525PNVKRR746P63BB2TZNR3ESTPSQA, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.700930117 (300h40m13.132010238s) [noise=true , address=45.91.116.11:4143 , piece_id=3GUVOHZ2XHLPC4CB44RXGGDROQT7O4EDIUY6VUG7LK6ZUNEVHPNA, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.713994383 (300h40m13.145074514s) [noise=true , address=45.91.116.5:4315 , piece_id=A6FNGYZBLA7JCPWC7LB5ECLBTKXUWAMC4X6CF3O34LXLMRWEGV2A, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.715350278 (300h40m13.146430399s) [noise=true , address=45.91.116.4:4942 , piece_id=SICQFCLAN2TW2VNEQ4YOUWDNFBXDXTOW74NWZJF4SPPAOAR55UVQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.745190424 (300h40m13.176270555s) [noise=true , address=77.90.31.21:4891 , piece_id=FGIV2CPMOD7XITXGJNAJQZMDY7UAGSM2JS7FRH5LOFNKWI76IFXQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.779540298 (300h40m13.210620429s) [noise=true , address=79.127.201.214:4322 , piece_id=G7HI7I5EPC2XTW4MJQXZD2WMNVASM5Z3MTU5YHOR6UGC6HMOVZWQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.793222909 (300h40m13.22430304s) [noise=true , address=45.91.116.14:4204 , piece_id=UH3BJBUO7TSHPFZU7Q4EELWOINHIUWAIQFN3XAHX3X25VUBLX7EA, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.824245817 (300h40m13.255325948s) [noise=true , address=77.90.31.12:4606 , piece_id=TFRYO3KDJW26AQJJPFACOJU665CMLRLEOQIK353Y4URCBRMTHBFQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.828009940 (300h40m13.259090071s) [noise=true , address=104.36.82.36:4632 , piece_id=N24ZVK6WUQDVNLVXKEQSO67K4QMMQQE2TB4RPVXDJCRE6C6UPIPQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.831904802 (300h40m13.262984933s) [noise=true , address=77.90.31.13:4647 , piece_id=U6LAUWTBKQI6VJBKUHADT7N4HTO773BEUYIU2X5C7R5UO2PLKWIQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.845088307 (300h40m13.276168438s) [noise=true , address=77.90.31.10:4531 , piece_id=AGFYUV6WC464ZUXUN5VWA4DWBEACB7GOK2CB4MQ5OH35WZHVAY4A, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.900147776 (300h40m13.331227897s) [noise=true , address=104.36.82.49:4011 , piece_id=YKRH27M5WJQCEXQRBJBEKHKWMGMRDBZIO7PK232B63NUOONFQMMA, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.926691354 (300h40m13.357771475s) [noise=true , address=77.90.31.16:4768 , piece_id=NWHBLL5CVIWPQ2HHVVXNAA6RH4FZTVMAYXSM5D62OWSFHIO7AB5A, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.926720550 (300h40m13.357800671s) [seg_pos={0 0}, upload=312769]: Segment reached optimal threshold of 14 pieces. Aug 21 06:06:18.926824459 (300h40m13.35790458s) [noise=true , address=77.90.31.17:4781 , piece_id=3HMYJXFTSOKFY2NYO25KZ66DEC5J7BKFPWEARPF62QJCL33YDHZQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Uc2Hn41mUYgLtyirRtEGNv5iKBv8YqzQo3RYdoE4M1Fj29WgT): protocol: expected piece hash; context canceled; EOF Aug 21 06:06:18.926973314 (300h40m13.358053445s) [noise=true , address=104.36.82.23:4477 , piece_id=MHSUNRIBYXZQNDMSXRDC2S5VHNUDMZ2FR5FQ66J4CCRCJC2VCKUA, seg_pos={0 0}, upload=312769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RP2Zq643WWNtKEr34Tq1iZS29NYA2okr9Fg1jiCpaFTqfLauf): protocol: expected piece hash; context canceled; EOF Aug 21 06:06:18.926978634 (300h40m13.358058765s) [noise=true , address=104.36.82.60:4353 , piece_id=LZQ3W4HLLBSVCHZBVHOLS6ZWT53WEMGCNLUZWB43M7MCEIDVTEKQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF Aug 21 06:06:18.927075128 (300h40m13.358155259s) [noise=true , address=104.36.82.5:4849 , piece_id=HUPNEWKLBX2ZI5PZSLKEQPYWTLZRZGSKYR7IZ6RZEVYGLGSEMZPQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n2gSzVmNCEZcfVsFKibjXHs2jMr82D3SWQEykFQQ4uyhhnrj1): protocol: write tcp 188.166.225.170:58800->104.36.82.5:4849: use of closed network connection; write tcp 188.166.225.170:58800->104.36.82.5:4849: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58800->104.36.82.5:4849: use of closed network connection Aug 21 06:06:18.927108161 (300h40m13.358188292s) [seg_pos={0 0}, upload=312769]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 06:06:18.927184728 (300h40m13.358264859s) [upload=312769]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 06:06:18.927189176 (300h40m13.358269307s) [upload=312769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 06:06:19.232063958 (300h40m13.663144089s) [upload=312769]: Done uploading segments... Aug 21 06:06:19.232084798 (300h40m13.663164929s) [upload=312769]: Upload finished. err: <nil> Duration: 6.265175992s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 5.739092815s FAIL (2025-08-21 06:06:40 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 5.739122602s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [..X..X.....X...........................X.................X..] duration: 3.024239895s FAIL (2025-08-21 06:06:23 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 21 06:05:15.784901024 (300h39m10.215981155s) [upload=312749]: Starting upload Aug 21 06:05:15.784953484 (300h39m10.216033615s) [upload=312749]: Done starting upload Aug 21 06:05:15.785014431 (300h39m10.216094563s) [upload=312749]: Uploading segments... Aug 21 06:05:15.785057283 (300h39m10.216137414s) [upload=312749]: Got next segment. Inline: true Aug 21 06:05:15.785061741 (300h39m10.216141862s) [upload=312749]: Waiting for error group managing segments... Aug 21 06:05:15.785102640 (300h39m10.216182771s) [upload=312749]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 06:05:15.785106998 (300h39m10.216187129s) [upload=312749]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 06:05:15.785110004 (300h39m10.216190135s) [upload=312749]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 06:05:16.792373082 (300h39m11.223453213s) [upload=312749]: Done uploading segments... Aug 21 06:05:16.792391608 (300h39m11.223471739s) [upload=312749]: Upload finished. err: <nil> Duration:* 3.024270053s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........X.................................................X] duration: 4.097193704s FAIL (2025-08-21 06:06:19 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 21 06:06:16.267376500 (300h40m10.698456631s) [upload=312769]: Starting upload Aug 21 06:06:16.267426706 (300h40m10.698506837s) [upload=312769]: Done starting upload Aug 21 06:06:16.267490137 (300h40m10.698570268s) [upload=312769]: Uploading segments... Aug 21 06:06:16.267595699 (300h40m10.69867583s) [upload=312769]: Got next segment. Inline: false Aug 21 06:06:16.267622370 (300h40m10.698702501s) [upload=312769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 06:06:16.267626668 (300h40m10.698706799s) [upload=312769]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 06:06:16.790975394 (300h40m11.222055566s) [seg_pos={0 0}, upload=312769]: Begin upload segment... Aug 21 06:06:16.791039036 (300h40m11.222119167s) [seg_pos={0 0}, upload=312769]: Done begin upload segment. Aug 21 06:06:16.791053263 (300h40m11.222133494s) [noise=true , address=45.91.116.5:4315 , piece_id=A6FNGYZBLA7JCPWC7LB5ECLBTKXUWAMC4X6CF3O34LXLMRWEGV2A, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.791065567 (300h40m11.222145698s) [noise=true , address=77.90.31.12:4606 , piece_id=TFRYO3KDJW26AQJJPFACOJU665CMLRLEOQIK353Y4URCBRMTHBFQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.791489618 (300h40m11.222569749s) [noise=true , address=104.36.82.5:4849 , piece_id=HUPNEWKLBX2ZI5PZSLKEQPYWTLZRZGSKYR7IZ6RZEVYGLGSEMZPQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.791763172 (300h40m11.222843303s) [noise=true , address=45.91.116.14:4204 , piece_id=UH3BJBUO7TSHPFZU7Q4EELWOINHIUWAIQFN3XAHX3X25VUBLX7EA, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.792115285 (300h40m11.223195417s) [noise=true , address=77.90.31.17:4781 , piece_id=3HMYJXFTSOKFY2NYO25KZ66DEC5J7BKFPWEARPF62QJCL33YDHZQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.792372808 (300h40m11.223452939s) [noise=true , address=77.90.31.10:4531 , piece_id=AGFYUV6WC464ZUXUN5VWA4DWBEACB7GOK2CB4MQ5OH35WZHVAY4A, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.792589663 (300h40m11.223669784s) [noise=true , address=77.90.31.13:4647 , piece_id=U6LAUWTBKQI6VJBKUHADT7N4HTO773BEUYIU2X5C7R5UO2PLKWIQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.792790758 (300h40m11.223870889s) [noise=true , address=104.36.82.49:4011 , piece_id=YKRH27M5WJQCEXQRBJBEKHKWMGMRDBZIO7PK232B63NUOONFQMMA, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.793001260 (300h40m11.224081391s) [noise=true , address=45.91.116.4:4942 , piece_id=SICQFCLAN2TW2VNEQ4YOUWDNFBXDXTOW74NWZJF4SPPAOAR55UVQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.793207105 (300h40m11.224287226s) [noise=true , address=79.127.201.214:4322 , piece_id=G7HI7I5EPC2XTW4MJQXZD2WMNVASM5Z3MTU5YHOR6UGC6HMOVZWQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.793406827 (300h40m11.224486958s) [noise=true , address=79.127.205.233:4638 , piece_id=P77DK4S6TSWFH37UXPMKYOHF7AEEOTOCLJ72PSB2EAJR5EYHG33Q, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.793597281 (300h40m11.224677412s) [noise=true , address=45.91.116.11:4143 , piece_id=3GUVOHZ2XHLPC4CB44RXGGDROQT7O4EDIUY6VUG7LK6ZUNEVHPNA, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.793790541 (300h40m11.224870672s) [noise=true , address=79.127.205.235:4674 , piece_id=GN5RPGMLJK2GNLG3WRED7J525PNVKRR746P63BB2TZNR3ESTPSQA, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.794015731 (300h40m11.225095863s) [noise=true , address=104.36.82.23:4477 , piece_id=MHSUNRIBYXZQNDMSXRDC2S5VHNUDMZ2FR5FQ66J4CCRCJC2VCKUA, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.794291128 (300h40m11.225371259s) [noise=true , address=104.36.82.60:4353 , piece_id=LZQ3W4HLLBSVCHZBVHOLS6ZWT53WEMGCNLUZWB43M7MCEIDVTEKQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.794509356 (300h40m11.225589487s) [noise=true , address=77.90.31.16:4768 , piece_id=NWHBLL5CVIWPQ2HHVVXNAA6RH4FZTVMAYXSM5D62OWSFHIO7AB5A, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.794752481 (300h40m11.225832602s) [noise=true , address=77.90.31.21:4891 , piece_id=FGIV2CPMOD7XITXGJNAJQZMDY7UAGSM2JS7FRH5LOFNKWI76IFXQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:16.794946252 (300h40m11.226026383s) [noise=true , address=104.36.82.36:4632 , piece_id=N24ZVK6WUQDVNLVXKEQSO67K4QMMQQE2TB4RPVXDJCRE6C6UPIPQ, seg_pos={0 0}, upload=312769]: Uploading piece... Aug 21 06:06:17.921692057 (300h40m12.352772188s) [upload=312769]: Next returned nil segment Aug 21 06:06:17.921746201 (300h40m12.352826332s) [upload=312769]: Waiting for error group managing segments... Aug 21 06:06:18.206445940 (300h40m12.637526071s) [noise=true , address=79.127.205.233:4638 , piece_id=P77DK4S6TSWFH37UXPMKYOHF7AEEOTOCLJ72PSB2EAJR5EYHG33Q, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.241271585 (300h40m12.672351716s) [noise=true , address=79.127.205.235:4674 , piece_id=GN5RPGMLJK2GNLG3WRED7J525PNVKRR746P63BB2TZNR3ESTPSQA, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.700930117 (300h40m13.132010238s) [noise=true , address=45.91.116.11:4143 , piece_id=3GUVOHZ2XHLPC4CB44RXGGDROQT7O4EDIUY6VUG7LK6ZUNEVHPNA, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.713994383 (300h40m13.145074514s) [noise=true , address=45.91.116.5:4315 , piece_id=A6FNGYZBLA7JCPWC7LB5ECLBTKXUWAMC4X6CF3O34LXLMRWEGV2A, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.715350278 (300h40m13.146430399s) [noise=true , address=45.91.116.4:4942 , piece_id=SICQFCLAN2TW2VNEQ4YOUWDNFBXDXTOW74NWZJF4SPPAOAR55UVQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.745190424 (300h40m13.176270555s) [noise=true , address=77.90.31.21:4891 , piece_id=FGIV2CPMOD7XITXGJNAJQZMDY7UAGSM2JS7FRH5LOFNKWI76IFXQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.779540298 (300h40m13.210620429s) [noise=true , address=79.127.201.214:4322 , piece_id=G7HI7I5EPC2XTW4MJQXZD2WMNVASM5Z3MTU5YHOR6UGC6HMOVZWQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.793222909 (300h40m13.22430304s) [noise=true , address=45.91.116.14:4204 , piece_id=UH3BJBUO7TSHPFZU7Q4EELWOINHIUWAIQFN3XAHX3X25VUBLX7EA, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.824245817 (300h40m13.255325948s) [noise=true , address=77.90.31.12:4606 , piece_id=TFRYO3KDJW26AQJJPFACOJU665CMLRLEOQIK353Y4URCBRMTHBFQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.828009940 (300h40m13.259090071s) [noise=true , address=104.36.82.36:4632 , piece_id=N24ZVK6WUQDVNLVXKEQSO67K4QMMQQE2TB4RPVXDJCRE6C6UPIPQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.831904802 (300h40m13.262984933s) [noise=true , address=77.90.31.13:4647 , piece_id=U6LAUWTBKQI6VJBKUHADT7N4HTO773BEUYIU2X5C7R5UO2PLKWIQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.845088307 (300h40m13.276168438s) [noise=true , address=77.90.31.10:4531 , piece_id=AGFYUV6WC464ZUXUN5VWA4DWBEACB7GOK2CB4MQ5OH35WZHVAY4A, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.900147776 (300h40m13.331227897s) [noise=true , address=104.36.82.49:4011 , piece_id=YKRH27M5WJQCEXQRBJBEKHKWMGMRDBZIO7PK232B63NUOONFQMMA, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.926691354 (300h40m13.357771475s) [noise=true , address=77.90.31.16:4768 , piece_id=NWHBLL5CVIWPQ2HHVVXNAA6RH4FZTVMAYXSM5D62OWSFHIO7AB5A, seg_pos={0 0}, upload=312769]: Done uploading piece. err: <nil> Aug 21 06:06:18.926720550 (300h40m13.357800671s) [seg_pos={0 0}, upload=312769]: Segment reached optimal threshold of 14 pieces. Aug 21 06:06:18.926824459 (300h40m13.35790458s) [noise=true , address=77.90.31.17:4781 , piece_id=3HMYJXFTSOKFY2NYO25KZ66DEC5J7BKFPWEARPF62QJCL33YDHZQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Uc2Hn41mUYgLtyirRtEGNv5iKBv8YqzQo3RYdoE4M1Fj29WgT): protocol: expected piece hash; context canceled; EOF Aug 21 06:06:18.926973314 (300h40m13.358053445s) [noise=true , address=104.36.82.23:4477 , piece_id=MHSUNRIBYXZQNDMSXRDC2S5VHNUDMZ2FR5FQ66J4CCRCJC2VCKUA, seg_pos={0 0}, upload=312769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RP2Zq643WWNtKEr34Tq1iZS29NYA2okr9Fg1jiCpaFTqfLauf): protocol: expected piece hash; context canceled; EOF Aug 21 06:06:18.926978634 (300h40m13.358058765s) [noise=true , address=104.36.82.60:4353 , piece_id=LZQ3W4HLLBSVCHZBVHOLS6ZWT53WEMGCNLUZWB43M7MCEIDVTEKQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF Aug 21 06:06:18.927075128 (300h40m13.358155259s) [noise=true , address=104.36.82.5:4849 , piece_id=HUPNEWKLBX2ZI5PZSLKEQPYWTLZRZGSKYR7IZ6RZEVYGLGSEMZPQ, seg_pos={0 0}, upload=312769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n2gSzVmNCEZcfVsFKibjXHs2jMr82D3SWQEykFQQ4uyhhnrj1): protocol: write tcp 188.166.225.170:58800->104.36.82.5:4849: use of closed network connection; write tcp 188.166.225.170:58800->104.36.82.5:4849: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58800->104.36.82.5:4849: use of closed network connection Aug 21 06:06:18.927108161 (300h40m13.358188292s) [seg_pos={0 0}, upload=312769]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 06:06:18.927184728 (300h40m13.358264859s) [upload=312769]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 06:06:18.927189176 (300h40m13.358269307s) [upload=312769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 06:06:19.232063958 (300h40m13.663144089s) [upload=312769]: Done uploading segments... Aug 21 06:06:19.232084798 (300h40m13.663164929s) [upload=312769]: Upload finished. err: <nil> Duration: 4.097228922s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 5.7646588s FAIL (2025-08-21 06:06:06 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 5.764688797s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 6.364600789s FAIL (2025-08-21 06:05:56 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 21 05:33:59.258571027 (300h7m53.689651158s) [upload=312189]: Starting upload Aug 21 05:33:59.258620962 (300h7m53.689701083s) [upload=312189]: Done starting upload Aug 21 05:33:59.258717777 (300h7m53.689797908s) [upload=312189]: Uploading segments... Aug 21 05:33:59.258848618 (300h7m53.689928739s) [upload=312189]: Got next segment. Inline: false Aug 21 05:33:59.259240016 (300h7m53.690320147s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:33:59.259247862 (300h7m53.690327993s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 05:33:59.717523631 (300h7m54.148603822s) [seg_pos={0 0}, upload=312189]: Begin upload segment... Aug 21 05:33:59.717587663 (300h7m54.148667804s) [seg_pos={0 0}, upload=312189]: Done begin upload segment. Aug 21 05:33:59.717620957 (300h7m54.148701118s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717640064 (300h7m54.148720205s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717759863 (300h7m54.148840034s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718514166 (300h7m54.149594307s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718672789 (300h7m54.14975294s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718938037 (300h7m54.150018188s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.719420230 (300h7m54.150500361s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722170462 (300h7m54.153250593s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722377588 (300h7m54.153457729s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722605594 (300h7m54.153685735s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722920296 (300h7m54.154000437s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723030427 (300h7m54.154110568s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723448697 (300h7m54.154528828s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723477051 (300h7m54.154557182s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723483114 (300h7m54.154563245s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723487282 (300h7m54.154567413s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723491890 (300h7m54.154572021s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723702724 (300h7m54.154782865s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:34:00.856696849 (300h7m55.28777698s) [upload=312189]: Next returned nil segment Aug 21 05:34:00.856716326 (300h7m55.287796457s) [upload=312189]: Waiting for error group managing segments... Aug 21 05:34:01.142354361 (300h7m55.573434492s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.180779383 (300h7m55.611859515s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.604454297 (300h7m56.035534428s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.615816969 (300h7m56.0468971s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.627783065 (300h7m56.058863196s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.636339236 (300h7m56.067419367s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.645253262 (300h7m56.076333393s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.669526536 (300h7m56.100606667s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.684731379 (300h7m56.11581151s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.690813827 (300h7m56.121893958s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.691763003 (300h7m56.122843134s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.702118838 (300h7m56.133198969s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.713908186 (300h7m56.144988317s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720895103 (300h7m56.151975235s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720921173 (300h7m56.152001304s) [seg_pos={0 0}, upload=312189]: Segment reached optimal threshold of 14 pieces. Aug 21 05:34:01.721035914 (300h7m56.152116045s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721065380 (300h7m56.152145521s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129iWqwdULbj7gs2Rd5xjEQn1Mgp6EDVZyFpSaoAZraRwCveyQn): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721092241 (300h7m56.152172373s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zJ9RVdURVEzMruVa7LYGiPmGX4JdTemxSDwYUEbt8bA6U73WB): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721130584 (300h7m56.152210716s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721141725 (300h7m56.152221856s) [seg_pos={0 0}, upload=312189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 05:34:01.721213243 (300h7m56.152293374s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 05:34:01.721217400 (300h7m56.152297531s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:34:02.023292106 (300h7m56.454372237s) [upload=312189]: Done uploading segments... Aug 21 05:34:02.023317093 (300h7m56.454397224s) [upload=312189]: Upload finished. err: <nil> Duration: 6.36462825s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [...X..X.....X...........................X.................X.] duration: 3.938904034s FAIL (2025-08-21 06:05:49 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 21 06:05:15.784901024 (300h39m10.215981155s) [upload=312749]: Starting upload Aug 21 06:05:15.784953484 (300h39m10.216033615s) [upload=312749]: Done starting upload Aug 21 06:05:15.785014431 (300h39m10.216094563s) [upload=312749]: Uploading segments... Aug 21 06:05:15.785057283 (300h39m10.216137414s) [upload=312749]: Got next segment. Inline: true Aug 21 06:05:15.785061741 (300h39m10.216141862s) [upload=312749]: Waiting for error group managing segments... Aug 21 06:05:15.785102640 (300h39m10.216182771s) [upload=312749]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 06:05:15.785106998 (300h39m10.216187129s) [upload=312749]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 06:05:15.785110004 (300h39m10.216190135s) [upload=312749]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 06:05:16.792373082 (300h39m11.223453213s) [upload=312749]: Done uploading segments... Aug 21 06:05:16.792391608 (300h39m11.223471739s) [upload=312749]: Upload finished. err: <nil> Duration:* 3.938929664s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 5.823951587s FAIL (2025-08-21 06:05:30 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 21 05:33:59.258571027 (300h7m53.689651158s) [upload=312189]: Starting upload Aug 21 05:33:59.258620962 (300h7m53.689701083s) [upload=312189]: Done starting upload Aug 21 05:33:59.258717777 (300h7m53.689797908s) [upload=312189]: Uploading segments... Aug 21 05:33:59.258848618 (300h7m53.689928739s) [upload=312189]: Got next segment. Inline: false Aug 21 05:33:59.259240016 (300h7m53.690320147s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:33:59.259247862 (300h7m53.690327993s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 05:33:59.717523631 (300h7m54.148603822s) [seg_pos={0 0}, upload=312189]: Begin upload segment... Aug 21 05:33:59.717587663 (300h7m54.148667804s) [seg_pos={0 0}, upload=312189]: Done begin upload segment. Aug 21 05:33:59.717620957 (300h7m54.148701118s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717640064 (300h7m54.148720205s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717759863 (300h7m54.148840034s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718514166 (300h7m54.149594307s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718672789 (300h7m54.14975294s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718938037 (300h7m54.150018188s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.719420230 (300h7m54.150500361s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722170462 (300h7m54.153250593s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722377588 (300h7m54.153457729s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722605594 (300h7m54.153685735s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722920296 (300h7m54.154000437s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723030427 (300h7m54.154110568s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723448697 (300h7m54.154528828s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723477051 (300h7m54.154557182s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723483114 (300h7m54.154563245s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723487282 (300h7m54.154567413s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723491890 (300h7m54.154572021s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723702724 (300h7m54.154782865s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:34:00.856696849 (300h7m55.28777698s) [upload=312189]: Next returned nil segment Aug 21 05:34:00.856716326 (300h7m55.287796457s) [upload=312189]: Waiting for error group managing segments... Aug 21 05:34:01.142354361 (300h7m55.573434492s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.180779383 (300h7m55.611859515s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.604454297 (300h7m56.035534428s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.615816969 (300h7m56.0468971s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.627783065 (300h7m56.058863196s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.636339236 (300h7m56.067419367s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.645253262 (300h7m56.076333393s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.669526536 (300h7m56.100606667s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.684731379 (300h7m56.11581151s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.690813827 (300h7m56.121893958s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.691763003 (300h7m56.122843134s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.702118838 (300h7m56.133198969s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.713908186 (300h7m56.144988317s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720895103 (300h7m56.151975235s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720921173 (300h7m56.152001304s) [seg_pos={0 0}, upload=312189]: Segment reached optimal threshold of 14 pieces. Aug 21 05:34:01.721035914 (300h7m56.152116045s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721065380 (300h7m56.152145521s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129iWqwdULbj7gs2Rd5xjEQn1Mgp6EDVZyFpSaoAZraRwCveyQn): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721092241 (300h7m56.152172373s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zJ9RVdURVEzMruVa7LYGiPmGX4JdTemxSDwYUEbt8bA6U73WB): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721130584 (300h7m56.152210716s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721141725 (300h7m56.152221856s) [seg_pos={0 0}, upload=312189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 05:34:01.721213243 (300h7m56.152293374s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 05:34:01.721217400 (300h7m56.152297531s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:34:02.023292106 (300h7m56.454372237s) [upload=312189]: Done uploading segments... Aug 21 05:34:02.023317093 (300h7m56.454397224s) [upload=312189]: Upload finished. err: <nil> Duration: 5.823974902s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 5.78051927s FAIL (2025-08-21 06:05:21 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 5.780545529s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [....X..X.....X...........................X.................X] duration: 2.12148424s FAIL (2025-08-21 06:05:17 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 21 06:05:15.784901024 (300h39m10.215981155s) [upload=312749]: Starting upload Aug 21 06:05:15.784953484 (300h39m10.216033615s) [upload=312749]: Done starting upload Aug 21 06:05:15.785014431 (300h39m10.216094563s) [upload=312749]: Uploading segments... Aug 21 06:05:15.785057283 (300h39m10.216137414s) [upload=312749]: Got next segment. Inline: true Aug 21 06:05:15.785061741 (300h39m10.216141862s) [upload=312749]: Waiting for error group managing segments... Aug 21 06:05:15.785102640 (300h39m10.216182771s) [upload=312749]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 06:05:15.785106998 (300h39m10.216187129s) [upload=312749]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 06:05:15.785110004 (300h39m10.216190135s) [upload=312749]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 06:05:16.792373082 (300h39m11.223453213s) [upload=312749]: Done uploading segments... Aug 21 06:05:16.792391608 (300h39m11.223471739s) [upload=312749]: Upload finished. err: <nil> Duration:* 2.121508656s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 5.739536316s FAIL (2025-08-21 06:05:11 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 21 05:33:59.258571027 (300h7m53.689651158s) [upload=312189]: Starting upload Aug 21 05:33:59.258620962 (300h7m53.689701083s) [upload=312189]: Done starting upload Aug 21 05:33:59.258717777 (300h7m53.689797908s) [upload=312189]: Uploading segments... Aug 21 05:33:59.258848618 (300h7m53.689928739s) [upload=312189]: Got next segment. Inline: false Aug 21 05:33:59.259240016 (300h7m53.690320147s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:33:59.259247862 (300h7m53.690327993s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 05:33:59.717523631 (300h7m54.148603822s) [seg_pos={0 0}, upload=312189]: Begin upload segment... Aug 21 05:33:59.717587663 (300h7m54.148667804s) [seg_pos={0 0}, upload=312189]: Done begin upload segment. Aug 21 05:33:59.717620957 (300h7m54.148701118s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717640064 (300h7m54.148720205s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717759863 (300h7m54.148840034s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718514166 (300h7m54.149594307s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718672789 (300h7m54.14975294s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718938037 (300h7m54.150018188s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.719420230 (300h7m54.150500361s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722170462 (300h7m54.153250593s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722377588 (300h7m54.153457729s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722605594 (300h7m54.153685735s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722920296 (300h7m54.154000437s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723030427 (300h7m54.154110568s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723448697 (300h7m54.154528828s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723477051 (300h7m54.154557182s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723483114 (300h7m54.154563245s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723487282 (300h7m54.154567413s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723491890 (300h7m54.154572021s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723702724 (300h7m54.154782865s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:34:00.856696849 (300h7m55.28777698s) [upload=312189]: Next returned nil segment Aug 21 05:34:00.856716326 (300h7m55.287796457s) [upload=312189]: Waiting for error group managing segments... Aug 21 05:34:01.142354361 (300h7m55.573434492s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.180779383 (300h7m55.611859515s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.604454297 (300h7m56.035534428s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.615816969 (300h7m56.0468971s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.627783065 (300h7m56.058863196s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.636339236 (300h7m56.067419367s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.645253262 (300h7m56.076333393s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.669526536 (300h7m56.100606667s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.684731379 (300h7m56.11581151s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.690813827 (300h7m56.121893958s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.691763003 (300h7m56.122843134s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.702118838 (300h7m56.133198969s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.713908186 (300h7m56.144988317s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720895103 (300h7m56.151975235s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720921173 (300h7m56.152001304s) [seg_pos={0 0}, upload=312189]: Segment reached optimal threshold of 14 pieces. Aug 21 05:34:01.721035914 (300h7m56.152116045s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721065380 (300h7m56.152145521s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129iWqwdULbj7gs2Rd5xjEQn1Mgp6EDVZyFpSaoAZraRwCveyQn): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721092241 (300h7m56.152172373s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zJ9RVdURVEzMruVa7LYGiPmGX4JdTemxSDwYUEbt8bA6U73WB): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721130584 (300h7m56.152210716s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721141725 (300h7m56.152221856s) [seg_pos={0 0}, upload=312189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 05:34:01.721213243 (300h7m56.152293374s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 05:34:01.721217400 (300h7m56.152297531s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:34:02.023292106 (300h7m56.454372237s) [upload=312189]: Done uploading segments... Aug 21 05:34:02.023317093 (300h7m56.454397224s) [upload=312189]: Upload finished. err: <nil> Duration: 5.73955961s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 5.96536608s FAIL (2025-08-21 06:04:49 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 21 05:33:59.258571027 (300h7m53.689651158s) [upload=312189]: Starting upload Aug 21 05:33:59.258620962 (300h7m53.689701083s) [upload=312189]: Done starting upload Aug 21 05:33:59.258717777 (300h7m53.689797908s) [upload=312189]: Uploading segments... Aug 21 05:33:59.258848618 (300h7m53.689928739s) [upload=312189]: Got next segment. Inline: false Aug 21 05:33:59.259240016 (300h7m53.690320147s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:33:59.259247862 (300h7m53.690327993s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 05:33:59.717523631 (300h7m54.148603822s) [seg_pos={0 0}, upload=312189]: Begin upload segment... Aug 21 05:33:59.717587663 (300h7m54.148667804s) [seg_pos={0 0}, upload=312189]: Done begin upload segment. Aug 21 05:33:59.717620957 (300h7m54.148701118s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717640064 (300h7m54.148720205s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717759863 (300h7m54.148840034s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718514166 (300h7m54.149594307s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718672789 (300h7m54.14975294s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718938037 (300h7m54.150018188s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.719420230 (300h7m54.150500361s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722170462 (300h7m54.153250593s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722377588 (300h7m54.153457729s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722605594 (300h7m54.153685735s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722920296 (300h7m54.154000437s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723030427 (300h7m54.154110568s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723448697 (300h7m54.154528828s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723477051 (300h7m54.154557182s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723483114 (300h7m54.154563245s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723487282 (300h7m54.154567413s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723491890 (300h7m54.154572021s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723702724 (300h7m54.154782865s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:34:00.856696849 (300h7m55.28777698s) [upload=312189]: Next returned nil segment Aug 21 05:34:00.856716326 (300h7m55.287796457s) [upload=312189]: Waiting for error group managing segments... Aug 21 05:34:01.142354361 (300h7m55.573434492s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.180779383 (300h7m55.611859515s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.604454297 (300h7m56.035534428s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.615816969 (300h7m56.0468971s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.627783065 (300h7m56.058863196s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.636339236 (300h7m56.067419367s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.645253262 (300h7m56.076333393s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.669526536 (300h7m56.100606667s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.684731379 (300h7m56.11581151s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.690813827 (300h7m56.121893958s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.691763003 (300h7m56.122843134s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.702118838 (300h7m56.133198969s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.713908186 (300h7m56.144988317s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720895103 (300h7m56.151975235s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720921173 (300h7m56.152001304s) [seg_pos={0 0}, upload=312189]: Segment reached optimal threshold of 14 pieces. Aug 21 05:34:01.721035914 (300h7m56.152116045s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721065380 (300h7m56.152145521s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129iWqwdULbj7gs2Rd5xjEQn1Mgp6EDVZyFpSaoAZraRwCveyQn): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721092241 (300h7m56.152172373s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zJ9RVdURVEzMruVa7LYGiPmGX4JdTemxSDwYUEbt8bA6U73WB): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721130584 (300h7m56.152210716s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721141725 (300h7m56.152221856s) [seg_pos={0 0}, upload=312189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 05:34:01.721213243 (300h7m56.152293374s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 05:34:01.721217400 (300h7m56.152297531s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:34:02.023292106 (300h7m56.454372237s) [upload=312189]: Done uploading segments... Aug 21 05:34:02.023317093 (300h7m56.454397224s) [upload=312189]: Upload finished. err: <nil> Duration: 5.965391429s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [X.............X.............................................] duration: 5.598981672s FAIL (2025-08-21 06:04:33 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 21 05:33:59.258571027 (300h7m53.689651158s) [upload=312189]: Starting upload Aug 21 05:33:59.258620962 (300h7m53.689701083s) [upload=312189]: Done starting upload Aug 21 05:33:59.258717777 (300h7m53.689797908s) [upload=312189]: Uploading segments... Aug 21 05:33:59.258848618 (300h7m53.689928739s) [upload=312189]: Got next segment. Inline: false Aug 21 05:33:59.259240016 (300h7m53.690320147s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:33:59.259247862 (300h7m53.690327993s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 05:33:59.717523631 (300h7m54.148603822s) [seg_pos={0 0}, upload=312189]: Begin upload segment... Aug 21 05:33:59.717587663 (300h7m54.148667804s) [seg_pos={0 0}, upload=312189]: Done begin upload segment. Aug 21 05:33:59.717620957 (300h7m54.148701118s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717640064 (300h7m54.148720205s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717759863 (300h7m54.148840034s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718514166 (300h7m54.149594307s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718672789 (300h7m54.14975294s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718938037 (300h7m54.150018188s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.719420230 (300h7m54.150500361s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722170462 (300h7m54.153250593s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722377588 (300h7m54.153457729s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722605594 (300h7m54.153685735s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722920296 (300h7m54.154000437s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723030427 (300h7m54.154110568s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723448697 (300h7m54.154528828s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723477051 (300h7m54.154557182s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723483114 (300h7m54.154563245s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723487282 (300h7m54.154567413s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723491890 (300h7m54.154572021s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723702724 (300h7m54.154782865s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:34:00.856696849 (300h7m55.28777698s) [upload=312189]: Next returned nil segment Aug 21 05:34:00.856716326 (300h7m55.287796457s) [upload=312189]: Waiting for error group managing segments... Aug 21 05:34:01.142354361 (300h7m55.573434492s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.180779383 (300h7m55.611859515s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.604454297 (300h7m56.035534428s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.615816969 (300h7m56.0468971s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.627783065 (300h7m56.058863196s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.636339236 (300h7m56.067419367s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.645253262 (300h7m56.076333393s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.669526536 (300h7m56.100606667s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.684731379 (300h7m56.11581151s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.690813827 (300h7m56.121893958s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.691763003 (300h7m56.122843134s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.702118838 (300h7m56.133198969s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.713908186 (300h7m56.144988317s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720895103 (300h7m56.151975235s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720921173 (300h7m56.152001304s) [seg_pos={0 0}, upload=312189]: Segment reached optimal threshold of 14 pieces. Aug 21 05:34:01.721035914 (300h7m56.152116045s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721065380 (300h7m56.152145521s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129iWqwdULbj7gs2Rd5xjEQn1Mgp6EDVZyFpSaoAZraRwCveyQn): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721092241 (300h7m56.152172373s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zJ9RVdURVEzMruVa7LYGiPmGX4JdTemxSDwYUEbt8bA6U73WB): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721130584 (300h7m56.152210716s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721141725 (300h7m56.152221856s) [seg_pos={0 0}, upload=312189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 05:34:01.721213243 (300h7m56.152293374s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 05:34:01.721217400 (300h7m56.152297531s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:34:02.023292106 (300h7m56.454372237s) [upload=312189]: Done uploading segments... Aug 21 05:34:02.023317093 (300h7m56.454397224s) [upload=312189]: Upload finished. err: <nil> Duration: 5.599007481s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.....X..X.....X...........................X.................] duration: 1.916918896s FAIL (2025-08-21 06:04:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 05:51:29.641170105 (300h25m24.072250226s) [upload=312507]: Starting upload Aug 21 05:51:29.641218719 (300h25m24.07229885s) [upload=312507]: Done starting upload Aug 21 05:51:29.641271419 (300h25m24.07235155s) [upload=312507]: Uploading segments... Aug 21 05:51:29.641302519 (300h25m24.07238264s) [upload=312507]: Got next segment. Inline: true Aug 21 05:51:29.641305855 (300h25m24.072385986s) [upload=312507]: Waiting for error group managing segments... Aug 21 05:51:29.641339309 (300h25m24.07241944s) [upload=312507]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:51:29.641343136 (300h25m24.072423267s) [upload=312507]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 05:51:29.641345691 (300h25m24.072425822s) [upload=312507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:51:29.853250117 (300h25m24.284330248s) [upload=312507]: Done uploading segments... Aug 21 05:51:29.853272861 (300h25m24.284353052s) [upload=312507]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.91694699s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 5.874553673s FAIL (2025-08-21 06:04:09 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 5.874582538s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.X.............X............................................] duration: 5.583683742s FAIL (2025-08-21 06:03:47 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 21 05:33:59.258571027 (300h7m53.689651158s) [upload=312189]: Starting upload Aug 21 05:33:59.258620962 (300h7m53.689701083s) [upload=312189]: Done starting upload Aug 21 05:33:59.258717777 (300h7m53.689797908s) [upload=312189]: Uploading segments... Aug 21 05:33:59.258848618 (300h7m53.689928739s) [upload=312189]: Got next segment. Inline: false Aug 21 05:33:59.259240016 (300h7m53.690320147s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:33:59.259247862 (300h7m53.690327993s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 05:33:59.717523631 (300h7m54.148603822s) [seg_pos={0 0}, upload=312189]: Begin upload segment... Aug 21 05:33:59.717587663 (300h7m54.148667804s) [seg_pos={0 0}, upload=312189]: Done begin upload segment. Aug 21 05:33:59.717620957 (300h7m54.148701118s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717640064 (300h7m54.148720205s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717759863 (300h7m54.148840034s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718514166 (300h7m54.149594307s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718672789 (300h7m54.14975294s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718938037 (300h7m54.150018188s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.719420230 (300h7m54.150500361s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722170462 (300h7m54.153250593s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722377588 (300h7m54.153457729s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722605594 (300h7m54.153685735s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722920296 (300h7m54.154000437s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723030427 (300h7m54.154110568s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723448697 (300h7m54.154528828s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723477051 (300h7m54.154557182s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723483114 (300h7m54.154563245s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723487282 (300h7m54.154567413s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723491890 (300h7m54.154572021s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723702724 (300h7m54.154782865s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:34:00.856696849 (300h7m55.28777698s) [upload=312189]: Next returned nil segment Aug 21 05:34:00.856716326 (300h7m55.287796457s) [upload=312189]: Waiting for error group managing segments... Aug 21 05:34:01.142354361 (300h7m55.573434492s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.180779383 (300h7m55.611859515s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.604454297 (300h7m56.035534428s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.615816969 (300h7m56.0468971s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.627783065 (300h7m56.058863196s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.636339236 (300h7m56.067419367s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.645253262 (300h7m56.076333393s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.669526536 (300h7m56.100606667s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.684731379 (300h7m56.11581151s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.690813827 (300h7m56.121893958s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.691763003 (300h7m56.122843134s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.702118838 (300h7m56.133198969s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.713908186 (300h7m56.144988317s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720895103 (300h7m56.151975235s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720921173 (300h7m56.152001304s) [seg_pos={0 0}, upload=312189]: Segment reached optimal threshold of 14 pieces. Aug 21 05:34:01.721035914 (300h7m56.152116045s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721065380 (300h7m56.152145521s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129iWqwdULbj7gs2Rd5xjEQn1Mgp6EDVZyFpSaoAZraRwCveyQn): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721092241 (300h7m56.152172373s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zJ9RVdURVEzMruVa7LYGiPmGX4JdTemxSDwYUEbt8bA6U73WB): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721130584 (300h7m56.152210716s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721141725 (300h7m56.152221856s) [seg_pos={0 0}, upload=312189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 05:34:01.721213243 (300h7m56.152293374s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 05:34:01.721217400 (300h7m56.152297531s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:34:02.023292106 (300h7m56.454372237s) [upload=312189]: Done uploading segments... Aug 21 05:34:02.023317093 (300h7m56.454397224s) [upload=312189]: Upload finished. err: <nil> Duration: 5.583707096s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [......X..X.....X...........................X................] duration: 2.029328792s FAIL (2025-08-21 06:03:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 05:51:29.641170105 (300h25m24.072250226s) [upload=312507]: Starting upload Aug 21 05:51:29.641218719 (300h25m24.07229885s) [upload=312507]: Done starting upload Aug 21 05:51:29.641271419 (300h25m24.07235155s) [upload=312507]: Uploading segments... Aug 21 05:51:29.641302519 (300h25m24.07238264s) [upload=312507]: Got next segment. Inline: true Aug 21 05:51:29.641305855 (300h25m24.072385986s) [upload=312507]: Waiting for error group managing segments... Aug 21 05:51:29.641339309 (300h25m24.07241944s) [upload=312507]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:51:29.641343136 (300h25m24.072423267s) [upload=312507]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 05:51:29.641345691 (300h25m24.072425822s) [upload=312507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:51:29.853250117 (300h25m24.284330248s) [upload=312507]: Done uploading segments... Aug 21 05:51:29.853272861 (300h25m24.284353052s) [upload=312507]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.029361875s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..X.............X...........................................] duration: 5.819388169s FAIL (2025-08-21 06:03:15 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 21 05:33:59.258571027 (300h7m53.689651158s) [upload=312189]: Starting upload Aug 21 05:33:59.258620962 (300h7m53.689701083s) [upload=312189]: Done starting upload Aug 21 05:33:59.258717777 (300h7m53.689797908s) [upload=312189]: Uploading segments... Aug 21 05:33:59.258848618 (300h7m53.689928739s) [upload=312189]: Got next segment. Inline: false Aug 21 05:33:59.259240016 (300h7m53.690320147s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:33:59.259247862 (300h7m53.690327993s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 05:33:59.717523631 (300h7m54.148603822s) [seg_pos={0 0}, upload=312189]: Begin upload segment... Aug 21 05:33:59.717587663 (300h7m54.148667804s) [seg_pos={0 0}, upload=312189]: Done begin upload segment. Aug 21 05:33:59.717620957 (300h7m54.148701118s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717640064 (300h7m54.148720205s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717759863 (300h7m54.148840034s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718514166 (300h7m54.149594307s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718672789 (300h7m54.14975294s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718938037 (300h7m54.150018188s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.719420230 (300h7m54.150500361s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722170462 (300h7m54.153250593s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722377588 (300h7m54.153457729s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722605594 (300h7m54.153685735s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722920296 (300h7m54.154000437s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723030427 (300h7m54.154110568s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723448697 (300h7m54.154528828s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723477051 (300h7m54.154557182s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723483114 (300h7m54.154563245s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723487282 (300h7m54.154567413s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723491890 (300h7m54.154572021s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723702724 (300h7m54.154782865s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:34:00.856696849 (300h7m55.28777698s) [upload=312189]: Next returned nil segment Aug 21 05:34:00.856716326 (300h7m55.287796457s) [upload=312189]: Waiting for error group managing segments... Aug 21 05:34:01.142354361 (300h7m55.573434492s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.180779383 (300h7m55.611859515s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.604454297 (300h7m56.035534428s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.615816969 (300h7m56.0468971s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.627783065 (300h7m56.058863196s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.636339236 (300h7m56.067419367s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.645253262 (300h7m56.076333393s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.669526536 (300h7m56.100606667s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.684731379 (300h7m56.11581151s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.690813827 (300h7m56.121893958s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.691763003 (300h7m56.122843134s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.702118838 (300h7m56.133198969s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.713908186 (300h7m56.144988317s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720895103 (300h7m56.151975235s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720921173 (300h7m56.152001304s) [seg_pos={0 0}, upload=312189]: Segment reached optimal threshold of 14 pieces. Aug 21 05:34:01.721035914 (300h7m56.152116045s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721065380 (300h7m56.152145521s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129iWqwdULbj7gs2Rd5xjEQn1Mgp6EDVZyFpSaoAZraRwCveyQn): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721092241 (300h7m56.152172373s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zJ9RVdURVEzMruVa7LYGiPmGX4JdTemxSDwYUEbt8bA6U73WB): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721130584 (300h7m56.152210716s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721141725 (300h7m56.152221856s) [seg_pos={0 0}, upload=312189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 05:34:01.721213243 (300h7m56.152293374s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 05:34:01.721217400 (300h7m56.152297531s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:34:02.023292106 (300h7m56.454372237s) [upload=312189]: Done uploading segments... Aug 21 05:34:02.023317093 (300h7m56.454397224s) [upload=312189]: Upload finished. err: <nil> Duration: 5.819416732s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 5.863281642s FAIL (2025-08-21 06:03:10 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 5.863312602s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.......X..X.....X...........................X...............] duration: 1.872928265s FAIL (2025-08-21 06:02:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 05:51:29.641170105 (300h25m24.072250226s) [upload=312507]: Starting upload Aug 21 05:51:29.641218719 (300h25m24.07229885s) [upload=312507]: Done starting upload Aug 21 05:51:29.641271419 (300h25m24.07235155s) [upload=312507]: Uploading segments... Aug 21 05:51:29.641302519 (300h25m24.07238264s) [upload=312507]: Got next segment. Inline: true Aug 21 05:51:29.641305855 (300h25m24.072385986s) [upload=312507]: Waiting for error group managing segments... Aug 21 05:51:29.641339309 (300h25m24.07241944s) [upload=312507]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:51:29.641343136 (300h25m24.072423267s) [upload=312507]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 05:51:29.641345691 (300h25m24.072425822s) [upload=312507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:51:29.853250117 (300h25m24.284330248s) [upload=312507]: Done uploading segments... Aug 21 05:51:29.853272861 (300h25m24.284353052s) [upload=312507]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.87295101s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...X.............X..........................................] duration: 5.582150733s FAIL (2025-08-21 06:02:05 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 21 05:33:59.258571027 (300h7m53.689651158s) [upload=312189]: Starting upload Aug 21 05:33:59.258620962 (300h7m53.689701083s) [upload=312189]: Done starting upload Aug 21 05:33:59.258717777 (300h7m53.689797908s) [upload=312189]: Uploading segments... Aug 21 05:33:59.258848618 (300h7m53.689928739s) [upload=312189]: Got next segment. Inline: false Aug 21 05:33:59.259240016 (300h7m53.690320147s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:33:59.259247862 (300h7m53.690327993s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 05:33:59.717523631 (300h7m54.148603822s) [seg_pos={0 0}, upload=312189]: Begin upload segment... Aug 21 05:33:59.717587663 (300h7m54.148667804s) [seg_pos={0 0}, upload=312189]: Done begin upload segment. Aug 21 05:33:59.717620957 (300h7m54.148701118s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717640064 (300h7m54.148720205s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717759863 (300h7m54.148840034s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718514166 (300h7m54.149594307s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718672789 (300h7m54.14975294s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718938037 (300h7m54.150018188s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.719420230 (300h7m54.150500361s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722170462 (300h7m54.153250593s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722377588 (300h7m54.153457729s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722605594 (300h7m54.153685735s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722920296 (300h7m54.154000437s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723030427 (300h7m54.154110568s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723448697 (300h7m54.154528828s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723477051 (300h7m54.154557182s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723483114 (300h7m54.154563245s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723487282 (300h7m54.154567413s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723491890 (300h7m54.154572021s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723702724 (300h7m54.154782865s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:34:00.856696849 (300h7m55.28777698s) [upload=312189]: Next returned nil segment Aug 21 05:34:00.856716326 (300h7m55.287796457s) [upload=312189]: Waiting for error group managing segments... Aug 21 05:34:01.142354361 (300h7m55.573434492s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.180779383 (300h7m55.611859515s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.604454297 (300h7m56.035534428s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.615816969 (300h7m56.0468971s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.627783065 (300h7m56.058863196s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.636339236 (300h7m56.067419367s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.645253262 (300h7m56.076333393s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.669526536 (300h7m56.100606667s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.684731379 (300h7m56.11581151s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.690813827 (300h7m56.121893958s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.691763003 (300h7m56.122843134s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.702118838 (300h7m56.133198969s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.713908186 (300h7m56.144988317s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720895103 (300h7m56.151975235s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720921173 (300h7m56.152001304s) [seg_pos={0 0}, upload=312189]: Segment reached optimal threshold of 14 pieces. Aug 21 05:34:01.721035914 (300h7m56.152116045s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721065380 (300h7m56.152145521s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129iWqwdULbj7gs2Rd5xjEQn1Mgp6EDVZyFpSaoAZraRwCveyQn): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721092241 (300h7m56.152172373s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zJ9RVdURVEzMruVa7LYGiPmGX4JdTemxSDwYUEbt8bA6U73WB): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721130584 (300h7m56.152210716s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721141725 (300h7m56.152221856s) [seg_pos={0 0}, upload=312189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 05:34:01.721213243 (300h7m56.152293374s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 05:34:01.721217400 (300h7m56.152297531s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:34:02.023292106 (300h7m56.454372237s) [upload=312189]: Done uploading segments... Aug 21 05:34:02.023317093 (300h7m56.454397224s) [upload=312189]: Upload finished. err: <nil> Duration: 5.582173006s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [........X..X.....X...........................X..............] duration: 1.945930507s FAIL (2025-08-21 06:02:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 05:51:29.641170105 (300h25m24.072250226s) [upload=312507]: Starting upload Aug 21 05:51:29.641218719 (300h25m24.07229885s) [upload=312507]: Done starting upload Aug 21 05:51:29.641271419 (300h25m24.07235155s) [upload=312507]: Uploading segments... Aug 21 05:51:29.641302519 (300h25m24.07238264s) [upload=312507]: Got next segment. Inline: true Aug 21 05:51:29.641305855 (300h25m24.072385986s) [upload=312507]: Waiting for error group managing segments... Aug 21 05:51:29.641339309 (300h25m24.07241944s) [upload=312507]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:51:29.641343136 (300h25m24.072423267s) [upload=312507]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 05:51:29.641345691 (300h25m24.072425822s) [upload=312507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:51:29.853250117 (300h25m24.284330248s) [upload=312507]: Done uploading segments... Aug 21 05:51:29.853272861 (300h25m24.284353052s) [upload=312507]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.945960044s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 5.787802268s FAIL (2025-08-21 06:01:55 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 5.787829792s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 5.680153312s FAIL (2025-08-21 06:01:38 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 5.680180775s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [....X.............X.........................................] duration: 5.577670171s FAIL (2025-08-21 06:01:15 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 21 05:33:59.258571027 (300h7m53.689651158s) [upload=312189]: Starting upload Aug 21 05:33:59.258620962 (300h7m53.689701083s) [upload=312189]: Done starting upload Aug 21 05:33:59.258717777 (300h7m53.689797908s) [upload=312189]: Uploading segments... Aug 21 05:33:59.258848618 (300h7m53.689928739s) [upload=312189]: Got next segment. Inline: false Aug 21 05:33:59.259240016 (300h7m53.690320147s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:33:59.259247862 (300h7m53.690327993s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 05:33:59.717523631 (300h7m54.148603822s) [seg_pos={0 0}, upload=312189]: Begin upload segment... Aug 21 05:33:59.717587663 (300h7m54.148667804s) [seg_pos={0 0}, upload=312189]: Done begin upload segment. Aug 21 05:33:59.717620957 (300h7m54.148701118s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717640064 (300h7m54.148720205s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717759863 (300h7m54.148840034s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718514166 (300h7m54.149594307s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718672789 (300h7m54.14975294s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718938037 (300h7m54.150018188s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.719420230 (300h7m54.150500361s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722170462 (300h7m54.153250593s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722377588 (300h7m54.153457729s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722605594 (300h7m54.153685735s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722920296 (300h7m54.154000437s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723030427 (300h7m54.154110568s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723448697 (300h7m54.154528828s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723477051 (300h7m54.154557182s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723483114 (300h7m54.154563245s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723487282 (300h7m54.154567413s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723491890 (300h7m54.154572021s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723702724 (300h7m54.154782865s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:34:00.856696849 (300h7m55.28777698s) [upload=312189]: Next returned nil segment Aug 21 05:34:00.856716326 (300h7m55.287796457s) [upload=312189]: Waiting for error group managing segments... Aug 21 05:34:01.142354361 (300h7m55.573434492s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.180779383 (300h7m55.611859515s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.604454297 (300h7m56.035534428s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.615816969 (300h7m56.0468971s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.627783065 (300h7m56.058863196s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.636339236 (300h7m56.067419367s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.645253262 (300h7m56.076333393s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.669526536 (300h7m56.100606667s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.684731379 (300h7m56.11581151s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.690813827 (300h7m56.121893958s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.691763003 (300h7m56.122843134s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.702118838 (300h7m56.133198969s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.713908186 (300h7m56.144988317s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720895103 (300h7m56.151975235s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720921173 (300h7m56.152001304s) [seg_pos={0 0}, upload=312189]: Segment reached optimal threshold of 14 pieces. Aug 21 05:34:01.721035914 (300h7m56.152116045s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721065380 (300h7m56.152145521s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129iWqwdULbj7gs2Rd5xjEQn1Mgp6EDVZyFpSaoAZraRwCveyQn): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721092241 (300h7m56.152172373s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zJ9RVdURVEzMruVa7LYGiPmGX4JdTemxSDwYUEbt8bA6U73WB): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721130584 (300h7m56.152210716s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721141725 (300h7m56.152221856s) [seg_pos={0 0}, upload=312189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 05:34:01.721213243 (300h7m56.152293374s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 05:34:01.721217400 (300h7m56.152297531s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:34:02.023292106 (300h7m56.454372237s) [upload=312189]: Done uploading segments... Aug 21 05:34:02.023317093 (300h7m56.454397224s) [upload=312189]: Upload finished. err: <nil> Duration: 5.577712002s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.........X..X.....X...........................X.............] duration: 1.847969561s FAIL (2025-08-21 06:00:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 05:51:29.641170105 (300h25m24.072250226s) [upload=312507]: Starting upload Aug 21 05:51:29.641218719 (300h25m24.07229885s) [upload=312507]: Done starting upload Aug 21 05:51:29.641271419 (300h25m24.07235155s) [upload=312507]: Uploading segments... Aug 21 05:51:29.641302519 (300h25m24.07238264s) [upload=312507]: Got next segment. Inline: true Aug 21 05:51:29.641305855 (300h25m24.072385986s) [upload=312507]: Waiting for error group managing segments... Aug 21 05:51:29.641339309 (300h25m24.07241944s) [upload=312507]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:51:29.641343136 (300h25m24.072423267s) [upload=312507]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 05:51:29.641345691 (300h25m24.072425822s) [upload=312507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:51:29.853250117 (300h25m24.284330248s) [upload=312507]: Done uploading segments... Aug 21 05:51:29.853272861 (300h25m24.284353052s) [upload=312507]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.848006252s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....X.............X........................................] duration: 5.590469671s FAIL (2025-08-21 06:00:41 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 21 05:33:59.258571027 (300h7m53.689651158s) [upload=312189]: Starting upload Aug 21 05:33:59.258620962 (300h7m53.689701083s) [upload=312189]: Done starting upload Aug 21 05:33:59.258717777 (300h7m53.689797908s) [upload=312189]: Uploading segments... Aug 21 05:33:59.258848618 (300h7m53.689928739s) [upload=312189]: Got next segment. Inline: false Aug 21 05:33:59.259240016 (300h7m53.690320147s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:33:59.259247862 (300h7m53.690327993s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 05:33:59.717523631 (300h7m54.148603822s) [seg_pos={0 0}, upload=312189]: Begin upload segment... Aug 21 05:33:59.717587663 (300h7m54.148667804s) [seg_pos={0 0}, upload=312189]: Done begin upload segment. Aug 21 05:33:59.717620957 (300h7m54.148701118s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717640064 (300h7m54.148720205s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717759863 (300h7m54.148840034s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718514166 (300h7m54.149594307s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718672789 (300h7m54.14975294s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718938037 (300h7m54.150018188s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.719420230 (300h7m54.150500361s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722170462 (300h7m54.153250593s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722377588 (300h7m54.153457729s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722605594 (300h7m54.153685735s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722920296 (300h7m54.154000437s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723030427 (300h7m54.154110568s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723448697 (300h7m54.154528828s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723477051 (300h7m54.154557182s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723483114 (300h7m54.154563245s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723487282 (300h7m54.154567413s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723491890 (300h7m54.154572021s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723702724 (300h7m54.154782865s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:34:00.856696849 (300h7m55.28777698s) [upload=312189]: Next returned nil segment Aug 21 05:34:00.856716326 (300h7m55.287796457s) [upload=312189]: Waiting for error group managing segments... Aug 21 05:34:01.142354361 (300h7m55.573434492s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.180779383 (300h7m55.611859515s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.604454297 (300h7m56.035534428s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.615816969 (300h7m56.0468971s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.627783065 (300h7m56.058863196s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.636339236 (300h7m56.067419367s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.645253262 (300h7m56.076333393s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.669526536 (300h7m56.100606667s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.684731379 (300h7m56.11581151s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.690813827 (300h7m56.121893958s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.691763003 (300h7m56.122843134s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.702118838 (300h7m56.133198969s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.713908186 (300h7m56.144988317s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720895103 (300h7m56.151975235s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720921173 (300h7m56.152001304s) [seg_pos={0 0}, upload=312189]: Segment reached optimal threshold of 14 pieces. Aug 21 05:34:01.721035914 (300h7m56.152116045s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721065380 (300h7m56.152145521s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129iWqwdULbj7gs2Rd5xjEQn1Mgp6EDVZyFpSaoAZraRwCveyQn): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721092241 (300h7m56.152172373s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zJ9RVdURVEzMruVa7LYGiPmGX4JdTemxSDwYUEbt8bA6U73WB): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721130584 (300h7m56.152210716s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721141725 (300h7m56.152221856s) [seg_pos={0 0}, upload=312189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 05:34:01.721213243 (300h7m56.152293374s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 05:34:01.721217400 (300h7m56.152297531s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:34:02.023292106 (300h7m56.454372237s) [upload=312189]: Done uploading segments... Aug 21 05:34:02.023317093 (300h7m56.454397224s) [upload=312189]: Upload finished. err: <nil> Duration: 5.590501052s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 6.015339219s FAIL (2025-08-21 06:00:33 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 6.015372843s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [......X.............X.......................................] duration: 5.892999928s FAIL (2025-08-21 06:00:25 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 21 05:33:59.258571027 (300h7m53.689651158s) [upload=312189]: Starting upload Aug 21 05:33:59.258620962 (300h7m53.689701083s) [upload=312189]: Done starting upload Aug 21 05:33:59.258717777 (300h7m53.689797908s) [upload=312189]: Uploading segments... Aug 21 05:33:59.258848618 (300h7m53.689928739s) [upload=312189]: Got next segment. Inline: false Aug 21 05:33:59.259240016 (300h7m53.690320147s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:33:59.259247862 (300h7m53.690327993s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 05:33:59.717523631 (300h7m54.148603822s) [seg_pos={0 0}, upload=312189]: Begin upload segment... Aug 21 05:33:59.717587663 (300h7m54.148667804s) [seg_pos={0 0}, upload=312189]: Done begin upload segment. Aug 21 05:33:59.717620957 (300h7m54.148701118s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717640064 (300h7m54.148720205s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717759863 (300h7m54.148840034s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718514166 (300h7m54.149594307s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718672789 (300h7m54.14975294s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718938037 (300h7m54.150018188s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.719420230 (300h7m54.150500361s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722170462 (300h7m54.153250593s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722377588 (300h7m54.153457729s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722605594 (300h7m54.153685735s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722920296 (300h7m54.154000437s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723030427 (300h7m54.154110568s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723448697 (300h7m54.154528828s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723477051 (300h7m54.154557182s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723483114 (300h7m54.154563245s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723487282 (300h7m54.154567413s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723491890 (300h7m54.154572021s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723702724 (300h7m54.154782865s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:34:00.856696849 (300h7m55.28777698s) [upload=312189]: Next returned nil segment Aug 21 05:34:00.856716326 (300h7m55.287796457s) [upload=312189]: Waiting for error group managing segments... Aug 21 05:34:01.142354361 (300h7m55.573434492s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.180779383 (300h7m55.611859515s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.604454297 (300h7m56.035534428s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.615816969 (300h7m56.0468971s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.627783065 (300h7m56.058863196s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.636339236 (300h7m56.067419367s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.645253262 (300h7m56.076333393s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.669526536 (300h7m56.100606667s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.684731379 (300h7m56.11581151s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.690813827 (300h7m56.121893958s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.691763003 (300h7m56.122843134s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.702118838 (300h7m56.133198969s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.713908186 (300h7m56.144988317s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720895103 (300h7m56.151975235s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720921173 (300h7m56.152001304s) [seg_pos={0 0}, upload=312189]: Segment reached optimal threshold of 14 pieces. Aug 21 05:34:01.721035914 (300h7m56.152116045s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721065380 (300h7m56.152145521s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129iWqwdULbj7gs2Rd5xjEQn1Mgp6EDVZyFpSaoAZraRwCveyQn): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721092241 (300h7m56.152172373s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zJ9RVdURVEzMruVa7LYGiPmGX4JdTemxSDwYUEbt8bA6U73WB): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721130584 (300h7m56.152210716s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721141725 (300h7m56.152221856s) [seg_pos={0 0}, upload=312189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 05:34:01.721213243 (300h7m56.152293374s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 05:34:01.721217400 (300h7m56.152297531s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:34:02.023292106 (300h7m56.454372237s) [upload=312189]: Done uploading segments... Aug 21 05:34:02.023317093 (300h7m56.454397224s) [upload=312189]: Upload finished. err: <nil> Duration: 5.893042509s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......X.............X......................................] duration: 5.571484479s FAIL (2025-08-21 06:00:08 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 21 05:33:59.258571027 (300h7m53.689651158s) [upload=312189]: Starting upload Aug 21 05:33:59.258620962 (300h7m53.689701083s) [upload=312189]: Done starting upload Aug 21 05:33:59.258717777 (300h7m53.689797908s) [upload=312189]: Uploading segments... Aug 21 05:33:59.258848618 (300h7m53.689928739s) [upload=312189]: Got next segment. Inline: false Aug 21 05:33:59.259240016 (300h7m53.690320147s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:33:59.259247862 (300h7m53.690327993s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 05:33:59.717523631 (300h7m54.148603822s) [seg_pos={0 0}, upload=312189]: Begin upload segment... Aug 21 05:33:59.717587663 (300h7m54.148667804s) [seg_pos={0 0}, upload=312189]: Done begin upload segment. Aug 21 05:33:59.717620957 (300h7m54.148701118s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717640064 (300h7m54.148720205s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717759863 (300h7m54.148840034s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718514166 (300h7m54.149594307s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718672789 (300h7m54.14975294s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718938037 (300h7m54.150018188s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.719420230 (300h7m54.150500361s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722170462 (300h7m54.153250593s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722377588 (300h7m54.153457729s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722605594 (300h7m54.153685735s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722920296 (300h7m54.154000437s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723030427 (300h7m54.154110568s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723448697 (300h7m54.154528828s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723477051 (300h7m54.154557182s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723483114 (300h7m54.154563245s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723487282 (300h7m54.154567413s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723491890 (300h7m54.154572021s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723702724 (300h7m54.154782865s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:34:00.856696849 (300h7m55.28777698s) [upload=312189]: Next returned nil segment Aug 21 05:34:00.856716326 (300h7m55.287796457s) [upload=312189]: Waiting for error group managing segments... Aug 21 05:34:01.142354361 (300h7m55.573434492s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.180779383 (300h7m55.611859515s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.604454297 (300h7m56.035534428s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.615816969 (300h7m56.0468971s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.627783065 (300h7m56.058863196s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.636339236 (300h7m56.067419367s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.645253262 (300h7m56.076333393s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.669526536 (300h7m56.100606667s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.684731379 (300h7m56.11581151s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.690813827 (300h7m56.121893958s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.691763003 (300h7m56.122843134s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.702118838 (300h7m56.133198969s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.713908186 (300h7m56.144988317s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720895103 (300h7m56.151975235s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720921173 (300h7m56.152001304s) [seg_pos={0 0}, upload=312189]: Segment reached optimal threshold of 14 pieces. Aug 21 05:34:01.721035914 (300h7m56.152116045s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721065380 (300h7m56.152145521s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129iWqwdULbj7gs2Rd5xjEQn1Mgp6EDVZyFpSaoAZraRwCveyQn): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721092241 (300h7m56.152172373s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zJ9RVdURVEzMruVa7LYGiPmGX4JdTemxSDwYUEbt8bA6U73WB): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721130584 (300h7m56.152210716s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721141725 (300h7m56.152221856s) [seg_pos={0 0}, upload=312189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 05:34:01.721213243 (300h7m56.152293374s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 05:34:01.721217400 (300h7m56.152297531s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:34:02.023292106 (300h7m56.454372237s) [upload=312189]: Done uploading segments... Aug 21 05:34:02.023317093 (300h7m56.454397224s) [upload=312189]: Upload finished. err: <nil> Duration: 5.571514736s core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)