Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 5.917982253s FAIL (2025-08-11 17:00:02 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 11 16:20:42.438359750 (70h54m36.869439881s) [upload=73915]: Starting upload Aug 11 16:20:42.438414104 (70h54m36.869494225s) [upload=73915]: Done starting upload Aug 11 16:20:42.438489136 (70h54m36.869569267s) [upload=73915]: Uploading segments... Aug 11 16:20:42.438621770 (70h54m36.869701891s) [upload=73915]: Got next segment. Inline: false Aug 11 16:20:42.438664713 (70h54m36.869744844s) [upload=73915]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 16:20:42.438669001 (70h54m36.869749132s) [upload=73915]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 16:20:42.676790711 (70h54m37.107870842s) [seg_pos={0 0}, upload=73915]: Begin upload segment... Aug 11 16:20:42.676835908 (70h54m37.107916039s) [seg_pos={0 0}, upload=73915]: Done begin upload segment. Aug 11 16:20:42.676853832 (70h54m37.107933964s) [noise=true , address=77.90.31.14:4663 , piece_id=I5W3UOQI6RQFDF2A5NGYG7GUXBP2XE3N6LCTBVHAXPEWBMVSV26Q, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.676866747 (70h54m37.107946878s) [noise=true , address=104.36.82.10:4079 , piece_id=CYHDYCMVCYISFUDJOXGK2RCJVPRBZXXBAX3ICDJTH4OUPTQL6RMA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.676910421 (70h54m37.107990552s) [noise=true , address=77.90.31.11:4555 , piece_id=42V6RDCOSJRZYHIH7AUYX35F7GRXVZRHRUNBTI3ZDDQSVK2IYBAA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.676958241 (70h54m37.108038383s) [noise=true , address=45.91.116.13:4153 , piece_id=6FFUWDJYTJPUBXGHDGREUB4OM4DGX6COJTXHFWHLGW7QK3CO2JDA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.677329863 (70h54m37.108409994s) [noise=true , address=45.91.116.6:4974 , piece_id=GUI4A3KX4FASSTLQDMD4PHG75FQZRZEZCWNIMLWEJBBHQ5IH6SIA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.677368517 (70h54m37.108448648s) [noise=true , address=45.91.116.10:4083 , piece_id=ACEAUOZZCKIA4LTESFID3ZWUKFVTJACUI6VB327RTMHJLTPZBYGQ, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.677671015 (70h54m37.108751146s) [noise=true , address=77.90.31.17:4771 , piece_id=4Y664XUE5YWHPNAWUYSZ4BPISRV5YM5IGV4VK53RCPFZYEEBOKIQ, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678009293 (70h54m37.109089424s) [noise=true , address=45.91.116.7:4010 , piece_id=I5FZKKDZEIJAEBGXVY5E4PSKY2XN6FFB6YJI7CTWGTS63FVWC77A, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678247930 (70h54m37.109328061s) [noise=true , address=77.90.31.19:4843 , piece_id=NZ6GA4W7S4VGYLD5TBIOVCTFSBODMTOQY7SBY5OB2XWE766R2B3A, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678532164 (70h54m37.109612285s) [noise=true , address=45.91.116.12:4227 , piece_id=C5NVQ4KJ4UVIIXGUUXYLYGZ6T3TVKESSRQX7KSYQZ7O5PYUS3XVA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678765730 (70h54m37.109845861s) [noise=true , address=104.36.82.12:4151 , piece_id=QUY4X3H5VQPZXZ4JCHFKXLUETZXOBEN34KO7YZEMVYQEVGKR5ZZA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678993456 (70h54m37.110073587s) [noise=true , address=45.91.116.13:4155 , piece_id=YTXBYJIN6WYX2LBRDYH7YU55DKC7ZLLECK3HI22IKBWFRT6ZHTIA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679139145 (70h54m37.110219266s) [noise=true , address=45.91.116.4:4939 , piece_id=D3TLK6SUW4O7UUZVU6PADTAGQZ6SJHYAXYG2UULS7VZNMZ5YSOIA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679376159 (70h54m37.11045629s) [noise=true , address=45.91.116.5:4298 , piece_id=QYRZXB5RPTYY3Y54CVYQA76YEOHCKIPOMOP36Z2W6PSF35JDULFA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679589166 (70h54m37.110669297s) [noise=true , address=104.36.82.5:4839 , piece_id=56H4YACEHZNRC4IGN6LQ2OHVYAL6DFVJ3E5XKXUMAWHO6UCMICGA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679786334 (70h54m37.110866465s) [noise=true , address=77.90.31.18:4807 , piece_id=JZTPSUJQ7H7AAQC2JQLY37UM2ZPSCFVYDNOG7RSCJ6SPTWCVVPLA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:44.458058779 (70h54m38.88913891s) [upload=73915]: Next returned nil segment Aug 11 16:20:44.458076964 (70h54m38.889157095s) [upload=73915]: Waiting for error group managing segments... Aug 11 16:20:44.762791322 (70h54m39.193871453s) [noise=true , address=45.91.116.7:4010 , piece_id=I5FZKKDZEIJAEBGXVY5E4PSKY2XN6FFB6YJI7CTWGTS63FVWC77A, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.819598246 (70h54m39.250678377s) [noise=true , address=45.91.116.4:4939 , piece_id=D3TLK6SUW4O7UUZVU6PADTAGQZ6SJHYAXYG2UULS7VZNMZ5YSOIA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.877739022 (70h54m39.308819143s) [noise=true , address=77.90.31.11:4555 , piece_id=42V6RDCOSJRZYHIH7AUYX35F7GRXVZRHRUNBTI3ZDDQSVK2IYBAA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.936181786 (70h54m39.367261918s) [noise=true , address=45.91.116.10:4083 , piece_id=ACEAUOZZCKIA4LTESFID3ZWUKFVTJACUI6VB327RTMHJLTPZBYGQ, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.937836643 (70h54m39.368916774s) [noise=true , address=77.90.31.18:4807 , piece_id=JZTPSUJQ7H7AAQC2JQLY37UM2ZPSCFVYDNOG7RSCJ6SPTWCVVPLA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.939510475 (70h54m39.370590596s) [noise=true , address=77.90.31.17:4771 , piece_id=4Y664XUE5YWHPNAWUYSZ4BPISRV5YM5IGV4VK53RCPFZYEEBOKIQ, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.944277246 (70h54m39.375357377s) [noise=true , address=104.36.82.12:4151 , piece_id=QUY4X3H5VQPZXZ4JCHFKXLUETZXOBEN34KO7YZEMVYQEVGKR5ZZA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.945075824 (70h54m39.376155955s) [noise=true , address=45.91.116.13:4155 , piece_id=YTXBYJIN6WYX2LBRDYH7YU55DKC7ZLLECK3HI22IKBWFRT6ZHTIA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.006188045 (70h54m39.437268176s) [noise=true , address=45.91.116.5:4298 , piece_id=QYRZXB5RPTYY3Y54CVYQA76YEOHCKIPOMOP36Z2W6PSF35JDULFA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.042863199 (70h54m39.47394333s) [noise=true , address=77.90.31.14:4663 , piece_id=I5W3UOQI6RQFDF2A5NGYG7GUXBP2XE3N6LCTBVHAXPEWBMVSV26Q, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.048316484 (70h54m39.479396645s) [noise=true , address=77.90.31.19:4843 , piece_id=NZ6GA4W7S4VGYLD5TBIOVCTFSBODMTOQY7SBY5OB2XWE766R2B3A, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.054276718 (70h54m39.485356839s) [noise=true , address=45.91.116.12:4227 , piece_id=C5NVQ4KJ4UVIIXGUUXYLYGZ6T3TVKESSRQX7KSYQZ7O5PYUS3XVA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.056028469 (70h54m39.487108601s) [noise=true , address=45.91.116.13:4153 , piece_id=6FFUWDJYTJPUBXGHDGREUB4OM4DGX6COJTXHFWHLGW7QK3CO2JDA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.056044611 (70h54m39.487124732s) [seg_pos={0 0}, upload=73915]: Segment reached optimal threshold of 13 pieces. Aug 11 16:20:45.056165442 (70h54m39.487245573s) [noise=true , address=45.91.116.6:4974 , piece_id=GUI4A3KX4FASSTLQDMD4PHG75FQZRZEZCWNIMLWEJBBHQ5IH6SIA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Aug 11 16:20:45.056214636 (70h54m39.487294767s) [noise=true , address=104.36.82.10:4079 , piece_id=CYHDYCMVCYISFUDJOXGK2RCJVPRBZXXBAX3ICDJTH4OUPTQL6RMA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 11 16:20:45.056367308 (70h54m39.48744744s) [noise=true , address=104.36.82.5:4839 , piece_id=56H4YACEHZNRC4IGN6LQ2OHVYAL6DFVJ3E5XKXUMAWHO6UCMICGA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:33142->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:33142->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33142->104.36.82.5:4839: use of closed network connection Aug 11 16:20:45.056394020 (70h54m39.487474151s) [seg_pos={0 0}, upload=73915]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 11 16:20:45.056469904 (70h54m39.487550035s) [upload=73915]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 16:20:45.056474313 (70h54m39.487554444s) [upload=73915]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 16:20:45.348914657 (70h54m39.779994788s) [upload=73915]: Done uploading segments... Aug 11 16:20:45.348932771 (70h54m39.780012902s) [upload=73915]: Upload finished. err: <nil> Duration: 5.918015287s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 5.805550878s FAIL (2025-08-11 16:59:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 11 16:20:42.438359750 (70h54m36.869439881s) [upload=73915]: Starting upload Aug 11 16:20:42.438414104 (70h54m36.869494225s) [upload=73915]: Done starting upload Aug 11 16:20:42.438489136 (70h54m36.869569267s) [upload=73915]: Uploading segments... Aug 11 16:20:42.438621770 (70h54m36.869701891s) [upload=73915]: Got next segment. Inline: false Aug 11 16:20:42.438664713 (70h54m36.869744844s) [upload=73915]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 16:20:42.438669001 (70h54m36.869749132s) [upload=73915]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 16:20:42.676790711 (70h54m37.107870842s) [seg_pos={0 0}, upload=73915]: Begin upload segment... Aug 11 16:20:42.676835908 (70h54m37.107916039s) [seg_pos={0 0}, upload=73915]: Done begin upload segment. Aug 11 16:20:42.676853832 (70h54m37.107933964s) [noise=true , address=77.90.31.14:4663 , piece_id=I5W3UOQI6RQFDF2A5NGYG7GUXBP2XE3N6LCTBVHAXPEWBMVSV26Q, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.676866747 (70h54m37.107946878s) [noise=true , address=104.36.82.10:4079 , piece_id=CYHDYCMVCYISFUDJOXGK2RCJVPRBZXXBAX3ICDJTH4OUPTQL6RMA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.676910421 (70h54m37.107990552s) [noise=true , address=77.90.31.11:4555 , piece_id=42V6RDCOSJRZYHIH7AUYX35F7GRXVZRHRUNBTI3ZDDQSVK2IYBAA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.676958241 (70h54m37.108038383s) [noise=true , address=45.91.116.13:4153 , piece_id=6FFUWDJYTJPUBXGHDGREUB4OM4DGX6COJTXHFWHLGW7QK3CO2JDA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.677329863 (70h54m37.108409994s) [noise=true , address=45.91.116.6:4974 , piece_id=GUI4A3KX4FASSTLQDMD4PHG75FQZRZEZCWNIMLWEJBBHQ5IH6SIA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.677368517 (70h54m37.108448648s) [noise=true , address=45.91.116.10:4083 , piece_id=ACEAUOZZCKIA4LTESFID3ZWUKFVTJACUI6VB327RTMHJLTPZBYGQ, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.677671015 (70h54m37.108751146s) [noise=true , address=77.90.31.17:4771 , piece_id=4Y664XUE5YWHPNAWUYSZ4BPISRV5YM5IGV4VK53RCPFZYEEBOKIQ, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678009293 (70h54m37.109089424s) [noise=true , address=45.91.116.7:4010 , piece_id=I5FZKKDZEIJAEBGXVY5E4PSKY2XN6FFB6YJI7CTWGTS63FVWC77A, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678247930 (70h54m37.109328061s) [noise=true , address=77.90.31.19:4843 , piece_id=NZ6GA4W7S4VGYLD5TBIOVCTFSBODMTOQY7SBY5OB2XWE766R2B3A, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678532164 (70h54m37.109612285s) [noise=true , address=45.91.116.12:4227 , piece_id=C5NVQ4KJ4UVIIXGUUXYLYGZ6T3TVKESSRQX7KSYQZ7O5PYUS3XVA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678765730 (70h54m37.109845861s) [noise=true , address=104.36.82.12:4151 , piece_id=QUY4X3H5VQPZXZ4JCHFKXLUETZXOBEN34KO7YZEMVYQEVGKR5ZZA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678993456 (70h54m37.110073587s) [noise=true , address=45.91.116.13:4155 , piece_id=YTXBYJIN6WYX2LBRDYH7YU55DKC7ZLLECK3HI22IKBWFRT6ZHTIA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679139145 (70h54m37.110219266s) [noise=true , address=45.91.116.4:4939 , piece_id=D3TLK6SUW4O7UUZVU6PADTAGQZ6SJHYAXYG2UULS7VZNMZ5YSOIA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679376159 (70h54m37.11045629s) [noise=true , address=45.91.116.5:4298 , piece_id=QYRZXB5RPTYY3Y54CVYQA76YEOHCKIPOMOP36Z2W6PSF35JDULFA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679589166 (70h54m37.110669297s) [noise=true , address=104.36.82.5:4839 , piece_id=56H4YACEHZNRC4IGN6LQ2OHVYAL6DFVJ3E5XKXUMAWHO6UCMICGA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679786334 (70h54m37.110866465s) [noise=true , address=77.90.31.18:4807 , piece_id=JZTPSUJQ7H7AAQC2JQLY37UM2ZPSCFVYDNOG7RSCJ6SPTWCVVPLA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:44.458058779 (70h54m38.88913891s) [upload=73915]: Next returned nil segment Aug 11 16:20:44.458076964 (70h54m38.889157095s) [upload=73915]: Waiting for error group managing segments... Aug 11 16:20:44.762791322 (70h54m39.193871453s) [noise=true , address=45.91.116.7:4010 , piece_id=I5FZKKDZEIJAEBGXVY5E4PSKY2XN6FFB6YJI7CTWGTS63FVWC77A, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.819598246 (70h54m39.250678377s) [noise=true , address=45.91.116.4:4939 , piece_id=D3TLK6SUW4O7UUZVU6PADTAGQZ6SJHYAXYG2UULS7VZNMZ5YSOIA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.877739022 (70h54m39.308819143s) [noise=true , address=77.90.31.11:4555 , piece_id=42V6RDCOSJRZYHIH7AUYX35F7GRXVZRHRUNBTI3ZDDQSVK2IYBAA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.936181786 (70h54m39.367261918s) [noise=true , address=45.91.116.10:4083 , piece_id=ACEAUOZZCKIA4LTESFID3ZWUKFVTJACUI6VB327RTMHJLTPZBYGQ, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.937836643 (70h54m39.368916774s) [noise=true , address=77.90.31.18:4807 , piece_id=JZTPSUJQ7H7AAQC2JQLY37UM2ZPSCFVYDNOG7RSCJ6SPTWCVVPLA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.939510475 (70h54m39.370590596s) [noise=true , address=77.90.31.17:4771 , piece_id=4Y664XUE5YWHPNAWUYSZ4BPISRV5YM5IGV4VK53RCPFZYEEBOKIQ, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.944277246 (70h54m39.375357377s) [noise=true , address=104.36.82.12:4151 , piece_id=QUY4X3H5VQPZXZ4JCHFKXLUETZXOBEN34KO7YZEMVYQEVGKR5ZZA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.945075824 (70h54m39.376155955s) [noise=true , address=45.91.116.13:4155 , piece_id=YTXBYJIN6WYX2LBRDYH7YU55DKC7ZLLECK3HI22IKBWFRT6ZHTIA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.006188045 (70h54m39.437268176s) [noise=true , address=45.91.116.5:4298 , piece_id=QYRZXB5RPTYY3Y54CVYQA76YEOHCKIPOMOP36Z2W6PSF35JDULFA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.042863199 (70h54m39.47394333s) [noise=true , address=77.90.31.14:4663 , piece_id=I5W3UOQI6RQFDF2A5NGYG7GUXBP2XE3N6LCTBVHAXPEWBMVSV26Q, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.048316484 (70h54m39.479396645s) [noise=true , address=77.90.31.19:4843 , piece_id=NZ6GA4W7S4VGYLD5TBIOVCTFSBODMTOQY7SBY5OB2XWE766R2B3A, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.054276718 (70h54m39.485356839s) [noise=true , address=45.91.116.12:4227 , piece_id=C5NVQ4KJ4UVIIXGUUXYLYGZ6T3TVKESSRQX7KSYQZ7O5PYUS3XVA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.056028469 (70h54m39.487108601s) [noise=true , address=45.91.116.13:4153 , piece_id=6FFUWDJYTJPUBXGHDGREUB4OM4DGX6COJTXHFWHLGW7QK3CO2JDA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.056044611 (70h54m39.487124732s) [seg_pos={0 0}, upload=73915]: Segment reached optimal threshold of 13 pieces. Aug 11 16:20:45.056165442 (70h54m39.487245573s) [noise=true , address=45.91.116.6:4974 , piece_id=GUI4A3KX4FASSTLQDMD4PHG75FQZRZEZCWNIMLWEJBBHQ5IH6SIA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Aug 11 16:20:45.056214636 (70h54m39.487294767s) [noise=true , address=104.36.82.10:4079 , piece_id=CYHDYCMVCYISFUDJOXGK2RCJVPRBZXXBAX3ICDJTH4OUPTQL6RMA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 11 16:20:45.056367308 (70h54m39.48744744s) [noise=true , address=104.36.82.5:4839 , piece_id=56H4YACEHZNRC4IGN6LQ2OHVYAL6DFVJ3E5XKXUMAWHO6UCMICGA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:33142->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:33142->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33142->104.36.82.5:4839: use of closed network connection Aug 11 16:20:45.056394020 (70h54m39.487474151s) [seg_pos={0 0}, upload=73915]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 11 16:20:45.056469904 (70h54m39.487550035s) [upload=73915]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 16:20:45.056474313 (70h54m39.487554444s) [upload=73915]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 16:20:45.348914657 (70h54m39.779994788s) [upload=73915]: Done uploading segments... Aug 11 16:20:45.348932771 (70h54m39.780012902s) [upload=73915]: Upload finished. err: <nil> Duration: 5.805565947s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [............................X.................X..X.......X..] duration: 5.793685222s FAIL (2025-08-11 16:59:33 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 11 16:57:56.857437130 (71h31m51.288517261s) [upload=74558]: Starting upload Aug 11 16:57:56.857491995 (71h31m51.288572126s) [upload=74558]: Done starting upload Aug 11 16:57:56.857589862 (71h31m51.288669993s) [upload=74558]: Uploading segments... Aug 11 16:57:56.857723718 (71h31m51.288803839s) [upload=74558]: Got next segment. Inline: false Aug 11 16:57:56.857758605 (71h31m51.288838736s) [upload=74558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 16:57:56.857763114 (71h31m51.288843245s) [upload=74558]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 16:57:57.304939778 (71h31m51.736019909s) [seg_pos={0 0}, upload=74558]: Begin upload segment... Aug 11 16:57:57.305031484 (71h31m51.736111616s) [seg_pos={0 0}, upload=74558]: Done begin upload segment. Aug 11 16:57:57.305054858 (71h31m51.736134989s) [noise=true , address=104.36.82.47:4538 , piece_id=7EOGEYG77IU23U554U2YRN3QHCRWS62GQYSYEXCCCQDDWC3JLGWA, seg_pos={0 0}, upload=74558]: Uploading piece... Aug 11 16:57:57.305107249 (71h31m51.73618741s) [noise=true , address=104.36.82.9:4012 , piece_id=RJ5CSIT6VCCTMRI3FLROSADWZOJDXL4VHUVP4RJ7EEJNLYD3NUZA, seg_pos={0 0}, upload=74558]: Uploading piece... Aug 11 16:57:57.305490863 (71h31m51.736570994s) [noise=true , address=104.36.82.14:4245 , piece_id=NJXWJK3WBKA5TOWLJ5YN4GKF2GS4DODJZFVROVZBVIKDSKGBJPHQ, seg_pos={0 0}, upload=74558]: Uploading piece... Aug 11 16:57:57.305586095 (71h31m51.736666227s) [noise=true , address=104.36.82.62:4433 , piece_id=77Y4JSIYPNFHKDL6QHWEIGTJ73CBOEYCUCXOGCCDUBLMYB5NOJMA, seg_pos={0 0}, upload=74558]: Uploading piece... Aug 11 16:57:57.305787781 (71h31m51.736867912s) [noise=true , address=104.36.82.62:4415 , piece_id=RS2A2N2H5UMIPRU4GBEGI4JE2W5M3DBBSMB3AJGUFVZSUMKPZL5A, seg_pos={0 0}, upload=74558]: Uploading piece... Aug 11 16:57:57.306086633 (71h31m51.737166754s) [noise=true , address=104.36.82.5:4847 , piece_id=3HHZ7SQ7GZVIISK2NRIJBPTEFOGDVKZX2N444OKBEEG42JHHKPLA, seg_pos={0 0}, upload=74558]: Uploading piece... Aug 11 16:57:57.306325250 (71h31m51.737405381s) [noise=true , address=104.36.82.44:4877 , piece_id=NP2HVDS6I4K6NM4PNY7RNG3W3LY5PSOXMOMMUT6BP37C2FT6UF3A, seg_pos={0 0}, upload=74558]: Uploading piece... Aug 11 16:57:57.306559939 (71h31m51.73764006s) [noise=true , address=104.36.82.60:4338 , piece_id=JDU6EOILFUFRYMICMN5OHTEMDG7MK763MJGNDSZSQDD5QF7RP4SA, seg_pos={0 0}, upload=74558]: Uploading piece... Aug 11 16:57:57.306803736 (71h31m51.737883867s) [noise=true , address=45.91.116.9:4271 , piece_id=OLIH4VXHA3LXONUJIFAHGXTTQRWBT6RNDYPCILHYDRIBTAIHBV2Q, seg_pos={0 0}, upload=74558]: Uploading piece... Aug 11 16:57:57.307056509 (71h31m51.73813664s) [noise=true , address=104.36.82.23:4451 , piece_id=ROWFR3SQFOMH75RS25ITALP4DE6L2F22PX7WBCOUG67LCODBFTKA, seg_pos={0 0}, upload=74558]: Uploading piece... Aug 11 16:57:57.307248537 (71h31m51.738328668s) [noise=true , address=104.36.82.18:4375 , piece_id=ZNEEIPWGMMXIWUYBSMMYHXTQC7UB3QOR6RETGPGGIM7PP2VGXPUA, seg_pos={0 0}, upload=74558]: Uploading piece... Aug 11 16:57:57.307449731 (71h31m51.738529852s) [noise=true , address=64.49.13.140:4509 , piece_id=SVUJHX3ZV46TOU2LPSAPWRMFW53UUMUYZVN7632UEJKALNIY7PCQ, seg_pos={0 0}, upload=74558]: Uploading piece... Aug 11 16:57:57.307641478 (71h31m51.738721609s) [noise=true , address=104.36.82.38:4705 , piece_id=IWJOCZHOXUD54ZGMTQRTNVLDX7UG3OXVOOAQSOLK7BZOQS5HRQBA, seg_pos={0 0}, upload=74558]: Uploading piece... Aug 11 16:57:57.307843455 (71h31m51.738923586s) [noise=true , address=104.36.82.3:4795 , piece_id=IIEVTHFAUM2ZC7FCGQRHIVM4R32CBKS7IUGZCATNIWOSNFB7POFA, seg_pos={0 0}, upload=74558]: Uploading piece... Aug 11 16:57:57.308044109 (71h31m51.73912424s) [noise=true , address=104.36.82.4:4812 , piece_id=6TBOK7WKA7YCW6TZXH4GAHFF3SLUTKDE3UOY2WDNMIPXHG7TQSMQ, seg_pos={0 0}, upload=74558]: Uploading piece... Aug 11 16:57:57.308227480 (71h31m51.739307611s) [noise=true , address=104.36.82.61:4395 , piece_id=PP6HYV27AAPGVPAE4RSXHF3XQUTVX6JGM5HOUUGCJDNHFEOTPRZA, seg_pos={0 0}, upload=74558]: Uploading piece... Aug 11 16:57:57.308418055 (71h31m51.739498186s) [noise=true , address=104.36.82.43:4843 , piece_id=P2BJPLQVZSBQOK63EOQ7DMGDNAYOJRVRSJYHCWQXUZTGNBTNF7WA, seg_pos={0 0}, upload=74558]: Uploading piece... Aug 11 16:57:57.308629500 (71h31m51.739709661s) [noise=true , address=104.36.82.41:4771 , piece_id=VIGRBSURKL4UKGW4MTPOLRMGD7II5Z2U7RUILC36EIRBYCWEY55A, seg_pos={0 0}, upload=74558]: Uploading piece... Aug 11 16:57:58.407274325 (71h31m52.838354456s) [upload=74558]: Next returned nil segment Aug 11 16:57:58.407290104 (71h31m52.838370236s) [upload=74558]: Waiting for error group managing segments... Aug 11 16:57:58.708817320 (71h31m53.139897441s) [noise=true , address=64.49.13.140:4509 , piece_id=SVUJHX3ZV46TOU2LPSAPWRMFW53UUMUYZVN7632UEJKALNIY7PCQ, seg_pos={0 0}, upload=74558]: Done uploading piece. err: <nil> Aug 11 16:57:59.290930997 (71h31m53.722011128s) [noise=true , address=104.36.82.43:4843 , piece_id=P2BJPLQVZSBQOK63EOQ7DMGDNAYOJRVRSJYHCWQXUZTGNBTNF7WA, seg_pos={0 0}, upload=74558]: Done uploading piece. err: <nil> Aug 11 16:57:59.292920354 (71h31m53.724000485s) [noise=true , address=104.36.82.38:4705 , piece_id=IWJOCZHOXUD54ZGMTQRTNVLDX7UG3OXVOOAQSOLK7BZOQS5HRQBA, seg_pos={0 0}, upload=74558]: Done uploading piece. err: <nil> Aug 11 16:57:59.296695769 (71h31m53.72777589s) [noise=true , address=104.36.82.14:4245 , piece_id=NJXWJK3WBKA5TOWLJ5YN4GKF2GS4DODJZFVROVZBVIKDSKGBJPHQ, seg_pos={0 0}, upload=74558]: Done uploading piece. err: <nil> Aug 11 16:57:59.304598222 (71h31m53.735678353s) [noise=true , address=104.36.82.9:4012 , piece_id=RJ5CSIT6VCCTMRI3FLROSADWZOJDXL4VHUVP4RJ7EEJNLYD3NUZA, seg_pos={0 0}, upload=74558]: Done uploading piece. err: <nil> Aug 11 16:57:59.332823134 (71h31m53.763903255s) [noise=true , address=104.36.82.4:4812 , piece_id=6TBOK7WKA7YCW6TZXH4GAHFF3SLUTKDE3UOY2WDNMIPXHG7TQSMQ, seg_pos={0 0}, upload=74558]: Done uploading piece. err: <nil> Aug 11 16:57:59.343058571 (71h31m53.774138702s) [noise=true , address=104.36.82.44:4877 , piece_id=NP2HVDS6I4K6NM4PNY7RNG3W3LY5PSOXMOMMUT6BP37C2FT6UF3A, seg_pos={0 0}, upload=74558]: Done uploading piece. err: <nil> Aug 11 16:57:59.359080321 (71h31m53.790160442s) [noise=true , address=104.36.82.5:4847 , piece_id=3HHZ7SQ7GZVIISK2NRIJBPTEFOGDVKZX2N444OKBEEG42JHHKPLA, seg_pos={0 0}, upload=74558]: Done uploading piece. err: <nil> Aug 11 16:57:59.372408487 (71h31m53.803488618s) [noise=true , address=104.36.82.3:4795 , piece_id=IIEVTHFAUM2ZC7FCGQRHIVM4R32CBKS7IUGZCATNIWOSNFB7POFA, seg_pos={0 0}, upload=74558]: Done uploading piece. err: <nil> Aug 11 16:57:59.412987329 (71h31m53.844067461s) [noise=true , address=104.36.82.47:4538 , piece_id=7EOGEYG77IU23U554U2YRN3QHCRWS62GQYSYEXCCCQDDWC3JLGWA, seg_pos={0 0}, upload=74558]: Done uploading piece. err: <nil> Aug 11 16:57:59.422622748 (71h31m53.85370288s) [noise=true , address=45.91.116.9:4271 , piece_id=OLIH4VXHA3LXONUJIFAHGXTTQRWBT6RNDYPCILHYDRIBTAIHBV2Q, seg_pos={0 0}, upload=74558]: Done uploading piece. err: <nil> Aug 11 16:57:59.438228412 (71h31m53.869308533s) [noise=true , address=104.36.82.41:4771 , piece_id=VIGRBSURKL4UKGW4MTPOLRMGD7II5Z2U7RUILC36EIRBYCWEY55A, seg_pos={0 0}, upload=74558]: Done uploading piece. err: <nil> Aug 11 16:57:59.459015471 (71h31m53.890095602s) [noise=true , address=104.36.82.62:4415 , piece_id=RS2A2N2H5UMIPRU4GBEGI4JE2W5M3DBBSMB3AJGUFVZSUMKPZL5A, seg_pos={0 0}, upload=74558]: Done uploading piece. err: <nil> Aug 11 16:57:59.473292833 (71h31m53.904372964s) [noise=true , address=104.36.82.60:4338 , piece_id=JDU6EOILFUFRYMICMN5OHTEMDG7MK763MJGNDSZSQDD5QF7RP4SA, seg_pos={0 0}, upload=74558]: Done uploading piece. err: <nil> Aug 11 16:57:59.473319995 (71h31m53.904400126s) [seg_pos={0 0}, upload=74558]: Segment reached optimal threshold of 14 pieces. Aug 11 16:57:59.473444483 (71h31m53.904524604s) [noise=true , address=104.36.82.23:4451 , piece_id=ROWFR3SQFOMH75RS25ITALP4DE6L2F22PX7WBCOUG67LCODBFTKA, seg_pos={0 0}, upload=74558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Aug 11 16:57:59.473500200 (71h31m53.904580331s) [noise=true , address=104.36.82.61:4395 , piece_id=PP6HYV27AAPGVPAE4RSXHF3XQUTVX6JGM5HOUUGCJDNHFEOTPRZA, seg_pos={0 0}, upload=74558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BZnnbpp63tb9YBYEym3fuvJB4fR1L2GPTpWPbESbVgAXHpa64): protocol: expected piece hash; context canceled; EOF Aug 11 16:57:59.473554003 (71h31m53.904634134s) [noise=true , address=104.36.82.18:4375 , piece_id=ZNEEIPWGMMXIWUYBSMMYHXTQC7UB3QOR6RETGPGGIM7PP2VGXPUA, seg_pos={0 0}, upload=74558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pHU3Xp1sDgnmYMcbWZD2DivxdEUzqnBVJaiRaQipuRy2d75u5): protocol: expected piece hash; context canceled; EOF Aug 11 16:57:59.473594280 (71h31m53.904674411s) [noise=true , address=104.36.82.62:4433 , piece_id=77Y4JSIYPNFHKDL6QHWEIGTJ73CBOEYCUCXOGCCDUBLMYB5NOJMA, seg_pos={0 0}, upload=74558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AZCpZQEkwcdGqrnRGdaBr4ufDHbzDejWnUD43v9peicffu32t): protocol: expected piece hash; context canceled; EOF Aug 11 16:57:59.473635549 (71h31m53.90471568s) [seg_pos={0 0}, upload=74558]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 16:57:59.473729498 (71h31m53.904809629s) [upload=74558]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 16:57:59.473734027 (71h31m53.904814158s) [upload=74558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 16:57:59.765304869 (71h31m54.196385s) [upload=74558]: Done uploading segments... Aug 11 16:57:59.765325759 (71h31m54.19640589s) [upload=74558]: Upload finished. err: <nil> Duration: 5.79370991s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...............................X........X...................] duration: 1.980000234s FAIL (2025-08-11 16:59:13 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 7ca3b38f59bef6700c47a71c0ce137786b019861ef4e351f330d4f1e41b86704 != before b8ccbd272fe59726b04686e0542c1e0964e89942b662558e091433dc0e7e3dc5 ======LOGS====== Aug 11 16:46:39.434150567 (71h20m33.865230698s) [upload=74358]: Starting upload Aug 11 16:46:39.434202827 (71h20m33.865282958s) [upload=74358]: Done starting upload Aug 11 16:46:39.434253474 (71h20m33.865333605s) [upload=74358]: Uploading segments... Aug 11 16:46:39.434289643 (71h20m33.865369774s) [upload=74358]: Got next segment. Inline: true Aug 11 16:46:39.434293440 (71h20m33.865373561s) [upload=74358]: Waiting for error group managing segments... Aug 11 16:46:39.434326714 (71h20m33.865406845s) [upload=74358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 16:46:39.434330481 (71h20m33.865410612s) [upload=74358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 16:46:39.434332896 (71h20m33.865413017s) [upload=74358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 16:46:39.727280447 (71h20m34.158360588s) [upload=74358]: Done uploading segments... Aug 11 16:46:39.727301838 (71h20m34.158381969s) [upload=74358]: Upload finished. err: <nil> Duration:* 1.980025261s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.............................X.................X..X.......X.] duration: 5.824618909s FAIL (2025-08-11 16:59:01 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 11 16:57:56.857437130 (71h31m51.288517261s) [upload=74558]: Starting upload Aug 11 16:57:56.857491995 (71h31m51.288572126s) [upload=74558]: Done starting upload Aug 11 16:57:56.857589862 (71h31m51.288669993s) [upload=74558]: Uploading segments... Aug 11 16:57:56.857723718 (71h31m51.288803839s) [upload=74558]: Got next segment. Inline: false Aug 11 16:57:56.857758605 (71h31m51.288838736s) [upload=74558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 16:57:56.857763114 (71h31m51.288843245s) [upload=74558]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 16:57:57.304939778 (71h31m51.736019909s) [seg_pos={0 0}, upload=74558]: Begin upload segment... Aug 11 16:57:57.305031484 (71h31m51.736111616s) [seg_pos={0 0}, upload=74558]: Done begin upload segment. Aug 11 16:57:57.305054858 (71h31m51.736134989s) [noise=true , address=104.36.82.47:4538 , piece_id=7EOGEYG77IU23U554U2YRN3QHCRWS62GQYSYEXCCCQDDWC3JLGWA, seg_pos={0 0}, upload=74558]: Uploading piece... Aug 11 16:57:57.305107249 (71h31m51.73618741s) [noise=true , address=104.36.82.9:4012 , piece_id=RJ5CSIT6VCCTMRI3FLROSADWZOJDXL4VHUVP4RJ7EEJNLYD3NUZA, seg_pos={0 0}, upload=74558]: Uploading piece... Aug 11 16:57:57.305490863 (71h31m51.736570994s) [noise=true , address=104.36.82.14:4245 , piece_id=NJXWJK3WBKA5TOWLJ5YN4GKF2GS4DODJZFVROVZBVIKDSKGBJPHQ, seg_pos={0 0}, upload=74558]: Uploading piece... Aug 11 16:57:57.305586095 (71h31m51.736666227s) [noise=true , address=104.36.82.62:4433 , piece_id=77Y4JSIYPNFHKDL6QHWEIGTJ73CBOEYCUCXOGCCDUBLMYB5NOJMA, seg_pos={0 0}, upload=74558]: Uploading piece... Aug 11 16:57:57.305787781 (71h31m51.736867912s) [noise=true , address=104.36.82.62:4415 , piece_id=RS2A2N2H5UMIPRU4GBEGI4JE2W5M3DBBSMB3AJGUFVZSUMKPZL5A, seg_pos={0 0}, upload=74558]: Uploading piece... Aug 11 16:57:57.306086633 (71h31m51.737166754s) [noise=true , address=104.36.82.5:4847 , piece_id=3HHZ7SQ7GZVIISK2NRIJBPTEFOGDVKZX2N444OKBEEG42JHHKPLA, seg_pos={0 0}, upload=74558]: Uploading piece... Aug 11 16:57:57.306325250 (71h31m51.737405381s) [noise=true , address=104.36.82.44:4877 , piece_id=NP2HVDS6I4K6NM4PNY7RNG3W3LY5PSOXMOMMUT6BP37C2FT6UF3A, seg_pos={0 0}, upload=74558]: Uploading piece... Aug 11 16:57:57.306559939 (71h31m51.73764006s) [noise=true , address=104.36.82.60:4338 , piece_id=JDU6EOILFUFRYMICMN5OHTEMDG7MK763MJGNDSZSQDD5QF7RP4SA, seg_pos={0 0}, upload=74558]: Uploading piece... Aug 11 16:57:57.306803736 (71h31m51.737883867s) [noise=true , address=45.91.116.9:4271 , piece_id=OLIH4VXHA3LXONUJIFAHGXTTQRWBT6RNDYPCILHYDRIBTAIHBV2Q, seg_pos={0 0}, upload=74558]: Uploading piece... Aug 11 16:57:57.307056509 (71h31m51.73813664s) [noise=true , address=104.36.82.23:4451 , piece_id=ROWFR3SQFOMH75RS25ITALP4DE6L2F22PX7WBCOUG67LCODBFTKA, seg_pos={0 0}, upload=74558]: Uploading piece... Aug 11 16:57:57.307248537 (71h31m51.738328668s) [noise=true , address=104.36.82.18:4375 , piece_id=ZNEEIPWGMMXIWUYBSMMYHXTQC7UB3QOR6RETGPGGIM7PP2VGXPUA, seg_pos={0 0}, upload=74558]: Uploading piece... Aug 11 16:57:57.307449731 (71h31m51.738529852s) [noise=true , address=64.49.13.140:4509 , piece_id=SVUJHX3ZV46TOU2LPSAPWRMFW53UUMUYZVN7632UEJKALNIY7PCQ, seg_pos={0 0}, upload=74558]: Uploading piece... Aug 11 16:57:57.307641478 (71h31m51.738721609s) [noise=true , address=104.36.82.38:4705 , piece_id=IWJOCZHOXUD54ZGMTQRTNVLDX7UG3OXVOOAQSOLK7BZOQS5HRQBA, seg_pos={0 0}, upload=74558]: Uploading piece... Aug 11 16:57:57.307843455 (71h31m51.738923586s) [noise=true , address=104.36.82.3:4795 , piece_id=IIEVTHFAUM2ZC7FCGQRHIVM4R32CBKS7IUGZCATNIWOSNFB7POFA, seg_pos={0 0}, upload=74558]: Uploading piece... Aug 11 16:57:57.308044109 (71h31m51.73912424s) [noise=true , address=104.36.82.4:4812 , piece_id=6TBOK7WKA7YCW6TZXH4GAHFF3SLUTKDE3UOY2WDNMIPXHG7TQSMQ, seg_pos={0 0}, upload=74558]: Uploading piece... Aug 11 16:57:57.308227480 (71h31m51.739307611s) [noise=true , address=104.36.82.61:4395 , piece_id=PP6HYV27AAPGVPAE4RSXHF3XQUTVX6JGM5HOUUGCJDNHFEOTPRZA, seg_pos={0 0}, upload=74558]: Uploading piece... Aug 11 16:57:57.308418055 (71h31m51.739498186s) [noise=true , address=104.36.82.43:4843 , piece_id=P2BJPLQVZSBQOK63EOQ7DMGDNAYOJRVRSJYHCWQXUZTGNBTNF7WA, seg_pos={0 0}, upload=74558]: Uploading piece... Aug 11 16:57:57.308629500 (71h31m51.739709661s) [noise=true , address=104.36.82.41:4771 , piece_id=VIGRBSURKL4UKGW4MTPOLRMGD7II5Z2U7RUILC36EIRBYCWEY55A, seg_pos={0 0}, upload=74558]: Uploading piece... Aug 11 16:57:58.407274325 (71h31m52.838354456s) [upload=74558]: Next returned nil segment Aug 11 16:57:58.407290104 (71h31m52.838370236s) [upload=74558]: Waiting for error group managing segments... Aug 11 16:57:58.708817320 (71h31m53.139897441s) [noise=true , address=64.49.13.140:4509 , piece_id=SVUJHX3ZV46TOU2LPSAPWRMFW53UUMUYZVN7632UEJKALNIY7PCQ, seg_pos={0 0}, upload=74558]: Done uploading piece. err: <nil> Aug 11 16:57:59.290930997 (71h31m53.722011128s) [noise=true , address=104.36.82.43:4843 , piece_id=P2BJPLQVZSBQOK63EOQ7DMGDNAYOJRVRSJYHCWQXUZTGNBTNF7WA, seg_pos={0 0}, upload=74558]: Done uploading piece. err: <nil> Aug 11 16:57:59.292920354 (71h31m53.724000485s) [noise=true , address=104.36.82.38:4705 , piece_id=IWJOCZHOXUD54ZGMTQRTNVLDX7UG3OXVOOAQSOLK7BZOQS5HRQBA, seg_pos={0 0}, upload=74558]: Done uploading piece. err: <nil> Aug 11 16:57:59.296695769 (71h31m53.72777589s) [noise=true , address=104.36.82.14:4245 , piece_id=NJXWJK3WBKA5TOWLJ5YN4GKF2GS4DODJZFVROVZBVIKDSKGBJPHQ, seg_pos={0 0}, upload=74558]: Done uploading piece. err: <nil> Aug 11 16:57:59.304598222 (71h31m53.735678353s) [noise=true , address=104.36.82.9:4012 , piece_id=RJ5CSIT6VCCTMRI3FLROSADWZOJDXL4VHUVP4RJ7EEJNLYD3NUZA, seg_pos={0 0}, upload=74558]: Done uploading piece. err: <nil> Aug 11 16:57:59.332823134 (71h31m53.763903255s) [noise=true , address=104.36.82.4:4812 , piece_id=6TBOK7WKA7YCW6TZXH4GAHFF3SLUTKDE3UOY2WDNMIPXHG7TQSMQ, seg_pos={0 0}, upload=74558]: Done uploading piece. err: <nil> Aug 11 16:57:59.343058571 (71h31m53.774138702s) [noise=true , address=104.36.82.44:4877 , piece_id=NP2HVDS6I4K6NM4PNY7RNG3W3LY5PSOXMOMMUT6BP37C2FT6UF3A, seg_pos={0 0}, upload=74558]: Done uploading piece. err: <nil> Aug 11 16:57:59.359080321 (71h31m53.790160442s) [noise=true , address=104.36.82.5:4847 , piece_id=3HHZ7SQ7GZVIISK2NRIJBPTEFOGDVKZX2N444OKBEEG42JHHKPLA, seg_pos={0 0}, upload=74558]: Done uploading piece. err: <nil> Aug 11 16:57:59.372408487 (71h31m53.803488618s) [noise=true , address=104.36.82.3:4795 , piece_id=IIEVTHFAUM2ZC7FCGQRHIVM4R32CBKS7IUGZCATNIWOSNFB7POFA, seg_pos={0 0}, upload=74558]: Done uploading piece. err: <nil> Aug 11 16:57:59.412987329 (71h31m53.844067461s) [noise=true , address=104.36.82.47:4538 , piece_id=7EOGEYG77IU23U554U2YRN3QHCRWS62GQYSYEXCCCQDDWC3JLGWA, seg_pos={0 0}, upload=74558]: Done uploading piece. err: <nil> Aug 11 16:57:59.422622748 (71h31m53.85370288s) [noise=true , address=45.91.116.9:4271 , piece_id=OLIH4VXHA3LXONUJIFAHGXTTQRWBT6RNDYPCILHYDRIBTAIHBV2Q, seg_pos={0 0}, upload=74558]: Done uploading piece. err: <nil> Aug 11 16:57:59.438228412 (71h31m53.869308533s) [noise=true , address=104.36.82.41:4771 , piece_id=VIGRBSURKL4UKGW4MTPOLRMGD7II5Z2U7RUILC36EIRBYCWEY55A, seg_pos={0 0}, upload=74558]: Done uploading piece. err: <nil> Aug 11 16:57:59.459015471 (71h31m53.890095602s) [noise=true , address=104.36.82.62:4415 , piece_id=RS2A2N2H5UMIPRU4GBEGI4JE2W5M3DBBSMB3AJGUFVZSUMKPZL5A, seg_pos={0 0}, upload=74558]: Done uploading piece. err: <nil> Aug 11 16:57:59.473292833 (71h31m53.904372964s) [noise=true , address=104.36.82.60:4338 , piece_id=JDU6EOILFUFRYMICMN5OHTEMDG7MK763MJGNDSZSQDD5QF7RP4SA, seg_pos={0 0}, upload=74558]: Done uploading piece. err: <nil> Aug 11 16:57:59.473319995 (71h31m53.904400126s) [seg_pos={0 0}, upload=74558]: Segment reached optimal threshold of 14 pieces. Aug 11 16:57:59.473444483 (71h31m53.904524604s) [noise=true , address=104.36.82.23:4451 , piece_id=ROWFR3SQFOMH75RS25ITALP4DE6L2F22PX7WBCOUG67LCODBFTKA, seg_pos={0 0}, upload=74558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Aug 11 16:57:59.473500200 (71h31m53.904580331s) [noise=true , address=104.36.82.61:4395 , piece_id=PP6HYV27AAPGVPAE4RSXHF3XQUTVX6JGM5HOUUGCJDNHFEOTPRZA, seg_pos={0 0}, upload=74558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BZnnbpp63tb9YBYEym3fuvJB4fR1L2GPTpWPbESbVgAXHpa64): protocol: expected piece hash; context canceled; EOF Aug 11 16:57:59.473554003 (71h31m53.904634134s) [noise=true , address=104.36.82.18:4375 , piece_id=ZNEEIPWGMMXIWUYBSMMYHXTQC7UB3QOR6RETGPGGIM7PP2VGXPUA, seg_pos={0 0}, upload=74558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pHU3Xp1sDgnmYMcbWZD2DivxdEUzqnBVJaiRaQipuRy2d75u5): protocol: expected piece hash; context canceled; EOF Aug 11 16:57:59.473594280 (71h31m53.904674411s) [noise=true , address=104.36.82.62:4433 , piece_id=77Y4JSIYPNFHKDL6QHWEIGTJ73CBOEYCUCXOGCCDUBLMYB5NOJMA, seg_pos={0 0}, upload=74558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AZCpZQEkwcdGqrnRGdaBr4ufDHbzDejWnUD43v9peicffu32t): protocol: expected piece hash; context canceled; EOF Aug 11 16:57:59.473635549 (71h31m53.90471568s) [seg_pos={0 0}, upload=74558]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 16:57:59.473729498 (71h31m53.904809629s) [upload=74558]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 16:57:59.473734027 (71h31m53.904814158s) [upload=74558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 16:57:59.765304869 (71h31m54.196385s) [upload=74558]: Done uploading segments... Aug 11 16:57:59.765325759 (71h31m54.19640589s) [upload=74558]: Upload finished. err: <nil> Duration: 5.824639558s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 5.96095037s FAIL (2025-08-11 16:58:37 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 11 16:20:42.438359750 (70h54m36.869439881s) [upload=73915]: Starting upload Aug 11 16:20:42.438414104 (70h54m36.869494225s) [upload=73915]: Done starting upload Aug 11 16:20:42.438489136 (70h54m36.869569267s) [upload=73915]: Uploading segments... Aug 11 16:20:42.438621770 (70h54m36.869701891s) [upload=73915]: Got next segment. Inline: false Aug 11 16:20:42.438664713 (70h54m36.869744844s) [upload=73915]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 16:20:42.438669001 (70h54m36.869749132s) [upload=73915]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 16:20:42.676790711 (70h54m37.107870842s) [seg_pos={0 0}, upload=73915]: Begin upload segment... Aug 11 16:20:42.676835908 (70h54m37.107916039s) [seg_pos={0 0}, upload=73915]: Done begin upload segment. Aug 11 16:20:42.676853832 (70h54m37.107933964s) [noise=true , address=77.90.31.14:4663 , piece_id=I5W3UOQI6RQFDF2A5NGYG7GUXBP2XE3N6LCTBVHAXPEWBMVSV26Q, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.676866747 (70h54m37.107946878s) [noise=true , address=104.36.82.10:4079 , piece_id=CYHDYCMVCYISFUDJOXGK2RCJVPRBZXXBAX3ICDJTH4OUPTQL6RMA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.676910421 (70h54m37.107990552s) [noise=true , address=77.90.31.11:4555 , piece_id=42V6RDCOSJRZYHIH7AUYX35F7GRXVZRHRUNBTI3ZDDQSVK2IYBAA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.676958241 (70h54m37.108038383s) [noise=true , address=45.91.116.13:4153 , piece_id=6FFUWDJYTJPUBXGHDGREUB4OM4DGX6COJTXHFWHLGW7QK3CO2JDA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.677329863 (70h54m37.108409994s) [noise=true , address=45.91.116.6:4974 , piece_id=GUI4A3KX4FASSTLQDMD4PHG75FQZRZEZCWNIMLWEJBBHQ5IH6SIA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.677368517 (70h54m37.108448648s) [noise=true , address=45.91.116.10:4083 , piece_id=ACEAUOZZCKIA4LTESFID3ZWUKFVTJACUI6VB327RTMHJLTPZBYGQ, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.677671015 (70h54m37.108751146s) [noise=true , address=77.90.31.17:4771 , piece_id=4Y664XUE5YWHPNAWUYSZ4BPISRV5YM5IGV4VK53RCPFZYEEBOKIQ, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678009293 (70h54m37.109089424s) [noise=true , address=45.91.116.7:4010 , piece_id=I5FZKKDZEIJAEBGXVY5E4PSKY2XN6FFB6YJI7CTWGTS63FVWC77A, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678247930 (70h54m37.109328061s) [noise=true , address=77.90.31.19:4843 , piece_id=NZ6GA4W7S4VGYLD5TBIOVCTFSBODMTOQY7SBY5OB2XWE766R2B3A, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678532164 (70h54m37.109612285s) [noise=true , address=45.91.116.12:4227 , piece_id=C5NVQ4KJ4UVIIXGUUXYLYGZ6T3TVKESSRQX7KSYQZ7O5PYUS3XVA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678765730 (70h54m37.109845861s) [noise=true , address=104.36.82.12:4151 , piece_id=QUY4X3H5VQPZXZ4JCHFKXLUETZXOBEN34KO7YZEMVYQEVGKR5ZZA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678993456 (70h54m37.110073587s) [noise=true , address=45.91.116.13:4155 , piece_id=YTXBYJIN6WYX2LBRDYH7YU55DKC7ZLLECK3HI22IKBWFRT6ZHTIA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679139145 (70h54m37.110219266s) [noise=true , address=45.91.116.4:4939 , piece_id=D3TLK6SUW4O7UUZVU6PADTAGQZ6SJHYAXYG2UULS7VZNMZ5YSOIA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679376159 (70h54m37.11045629s) [noise=true , address=45.91.116.5:4298 , piece_id=QYRZXB5RPTYY3Y54CVYQA76YEOHCKIPOMOP36Z2W6PSF35JDULFA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679589166 (70h54m37.110669297s) [noise=true , address=104.36.82.5:4839 , piece_id=56H4YACEHZNRC4IGN6LQ2OHVYAL6DFVJ3E5XKXUMAWHO6UCMICGA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679786334 (70h54m37.110866465s) [noise=true , address=77.90.31.18:4807 , piece_id=JZTPSUJQ7H7AAQC2JQLY37UM2ZPSCFVYDNOG7RSCJ6SPTWCVVPLA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:44.458058779 (70h54m38.88913891s) [upload=73915]: Next returned nil segment Aug 11 16:20:44.458076964 (70h54m38.889157095s) [upload=73915]: Waiting for error group managing segments... Aug 11 16:20:44.762791322 (70h54m39.193871453s) [noise=true , address=45.91.116.7:4010 , piece_id=I5FZKKDZEIJAEBGXVY5E4PSKY2XN6FFB6YJI7CTWGTS63FVWC77A, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.819598246 (70h54m39.250678377s) [noise=true , address=45.91.116.4:4939 , piece_id=D3TLK6SUW4O7UUZVU6PADTAGQZ6SJHYAXYG2UULS7VZNMZ5YSOIA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.877739022 (70h54m39.308819143s) [noise=true , address=77.90.31.11:4555 , piece_id=42V6RDCOSJRZYHIH7AUYX35F7GRXVZRHRUNBTI3ZDDQSVK2IYBAA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.936181786 (70h54m39.367261918s) [noise=true , address=45.91.116.10:4083 , piece_id=ACEAUOZZCKIA4LTESFID3ZWUKFVTJACUI6VB327RTMHJLTPZBYGQ, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.937836643 (70h54m39.368916774s) [noise=true , address=77.90.31.18:4807 , piece_id=JZTPSUJQ7H7AAQC2JQLY37UM2ZPSCFVYDNOG7RSCJ6SPTWCVVPLA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.939510475 (70h54m39.370590596s) [noise=true , address=77.90.31.17:4771 , piece_id=4Y664XUE5YWHPNAWUYSZ4BPISRV5YM5IGV4VK53RCPFZYEEBOKIQ, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.944277246 (70h54m39.375357377s) [noise=true , address=104.36.82.12:4151 , piece_id=QUY4X3H5VQPZXZ4JCHFKXLUETZXOBEN34KO7YZEMVYQEVGKR5ZZA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.945075824 (70h54m39.376155955s) [noise=true , address=45.91.116.13:4155 , piece_id=YTXBYJIN6WYX2LBRDYH7YU55DKC7ZLLECK3HI22IKBWFRT6ZHTIA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.006188045 (70h54m39.437268176s) [noise=true , address=45.91.116.5:4298 , piece_id=QYRZXB5RPTYY3Y54CVYQA76YEOHCKIPOMOP36Z2W6PSF35JDULFA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.042863199 (70h54m39.47394333s) [noise=true , address=77.90.31.14:4663 , piece_id=I5W3UOQI6RQFDF2A5NGYG7GUXBP2XE3N6LCTBVHAXPEWBMVSV26Q, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.048316484 (70h54m39.479396645s) [noise=true , address=77.90.31.19:4843 , piece_id=NZ6GA4W7S4VGYLD5TBIOVCTFSBODMTOQY7SBY5OB2XWE766R2B3A, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.054276718 (70h54m39.485356839s) [noise=true , address=45.91.116.12:4227 , piece_id=C5NVQ4KJ4UVIIXGUUXYLYGZ6T3TVKESSRQX7KSYQZ7O5PYUS3XVA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.056028469 (70h54m39.487108601s) [noise=true , address=45.91.116.13:4153 , piece_id=6FFUWDJYTJPUBXGHDGREUB4OM4DGX6COJTXHFWHLGW7QK3CO2JDA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.056044611 (70h54m39.487124732s) [seg_pos={0 0}, upload=73915]: Segment reached optimal threshold of 13 pieces. Aug 11 16:20:45.056165442 (70h54m39.487245573s) [noise=true , address=45.91.116.6:4974 , piece_id=GUI4A3KX4FASSTLQDMD4PHG75FQZRZEZCWNIMLWEJBBHQ5IH6SIA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Aug 11 16:20:45.056214636 (70h54m39.487294767s) [noise=true , address=104.36.82.10:4079 , piece_id=CYHDYCMVCYISFUDJOXGK2RCJVPRBZXXBAX3ICDJTH4OUPTQL6RMA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 11 16:20:45.056367308 (70h54m39.48744744s) [noise=true , address=104.36.82.5:4839 , piece_id=56H4YACEHZNRC4IGN6LQ2OHVYAL6DFVJ3E5XKXUMAWHO6UCMICGA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:33142->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:33142->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33142->104.36.82.5:4839: use of closed network connection Aug 11 16:20:45.056394020 (70h54m39.487474151s) [seg_pos={0 0}, upload=73915]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 11 16:20:45.056469904 (70h54m39.487550035s) [upload=73915]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 16:20:45.056474313 (70h54m39.487554444s) [upload=73915]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 16:20:45.348914657 (70h54m39.779994788s) [upload=73915]: Done uploading segments... Aug 11 16:20:45.348932771 (70h54m39.780012902s) [upload=73915]: Upload finished. err: <nil> Duration: 5.960975277s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 5.946144545s FAIL (2025-08-11 16:58:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 11 16:20:42.438359750 (70h54m36.869439881s) [upload=73915]: Starting upload Aug 11 16:20:42.438414104 (70h54m36.869494225s) [upload=73915]: Done starting upload Aug 11 16:20:42.438489136 (70h54m36.869569267s) [upload=73915]: Uploading segments... Aug 11 16:20:42.438621770 (70h54m36.869701891s) [upload=73915]: Got next segment. Inline: false Aug 11 16:20:42.438664713 (70h54m36.869744844s) [upload=73915]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 16:20:42.438669001 (70h54m36.869749132s) [upload=73915]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 16:20:42.676790711 (70h54m37.107870842s) [seg_pos={0 0}, upload=73915]: Begin upload segment... Aug 11 16:20:42.676835908 (70h54m37.107916039s) [seg_pos={0 0}, upload=73915]: Done begin upload segment. Aug 11 16:20:42.676853832 (70h54m37.107933964s) [noise=true , address=77.90.31.14:4663 , piece_id=I5W3UOQI6RQFDF2A5NGYG7GUXBP2XE3N6LCTBVHAXPEWBMVSV26Q, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.676866747 (70h54m37.107946878s) [noise=true , address=104.36.82.10:4079 , piece_id=CYHDYCMVCYISFUDJOXGK2RCJVPRBZXXBAX3ICDJTH4OUPTQL6RMA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.676910421 (70h54m37.107990552s) [noise=true , address=77.90.31.11:4555 , piece_id=42V6RDCOSJRZYHIH7AUYX35F7GRXVZRHRUNBTI3ZDDQSVK2IYBAA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.676958241 (70h54m37.108038383s) [noise=true , address=45.91.116.13:4153 , piece_id=6FFUWDJYTJPUBXGHDGREUB4OM4DGX6COJTXHFWHLGW7QK3CO2JDA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.677329863 (70h54m37.108409994s) [noise=true , address=45.91.116.6:4974 , piece_id=GUI4A3KX4FASSTLQDMD4PHG75FQZRZEZCWNIMLWEJBBHQ5IH6SIA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.677368517 (70h54m37.108448648s) [noise=true , address=45.91.116.10:4083 , piece_id=ACEAUOZZCKIA4LTESFID3ZWUKFVTJACUI6VB327RTMHJLTPZBYGQ, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.677671015 (70h54m37.108751146s) [noise=true , address=77.90.31.17:4771 , piece_id=4Y664XUE5YWHPNAWUYSZ4BPISRV5YM5IGV4VK53RCPFZYEEBOKIQ, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678009293 (70h54m37.109089424s) [noise=true , address=45.91.116.7:4010 , piece_id=I5FZKKDZEIJAEBGXVY5E4PSKY2XN6FFB6YJI7CTWGTS63FVWC77A, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678247930 (70h54m37.109328061s) [noise=true , address=77.90.31.19:4843 , piece_id=NZ6GA4W7S4VGYLD5TBIOVCTFSBODMTOQY7SBY5OB2XWE766R2B3A, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678532164 (70h54m37.109612285s) [noise=true , address=45.91.116.12:4227 , piece_id=C5NVQ4KJ4UVIIXGUUXYLYGZ6T3TVKESSRQX7KSYQZ7O5PYUS3XVA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678765730 (70h54m37.109845861s) [noise=true , address=104.36.82.12:4151 , piece_id=QUY4X3H5VQPZXZ4JCHFKXLUETZXOBEN34KO7YZEMVYQEVGKR5ZZA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678993456 (70h54m37.110073587s) [noise=true , address=45.91.116.13:4155 , piece_id=YTXBYJIN6WYX2LBRDYH7YU55DKC7ZLLECK3HI22IKBWFRT6ZHTIA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679139145 (70h54m37.110219266s) [noise=true , address=45.91.116.4:4939 , piece_id=D3TLK6SUW4O7UUZVU6PADTAGQZ6SJHYAXYG2UULS7VZNMZ5YSOIA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679376159 (70h54m37.11045629s) [noise=true , address=45.91.116.5:4298 , piece_id=QYRZXB5RPTYY3Y54CVYQA76YEOHCKIPOMOP36Z2W6PSF35JDULFA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679589166 (70h54m37.110669297s) [noise=true , address=104.36.82.5:4839 , piece_id=56H4YACEHZNRC4IGN6LQ2OHVYAL6DFVJ3E5XKXUMAWHO6UCMICGA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679786334 (70h54m37.110866465s) [noise=true , address=77.90.31.18:4807 , piece_id=JZTPSUJQ7H7AAQC2JQLY37UM2ZPSCFVYDNOG7RSCJ6SPTWCVVPLA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:44.458058779 (70h54m38.88913891s) [upload=73915]: Next returned nil segment Aug 11 16:20:44.458076964 (70h54m38.889157095s) [upload=73915]: Waiting for error group managing segments... Aug 11 16:20:44.762791322 (70h54m39.193871453s) [noise=true , address=45.91.116.7:4010 , piece_id=I5FZKKDZEIJAEBGXVY5E4PSKY2XN6FFB6YJI7CTWGTS63FVWC77A, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.819598246 (70h54m39.250678377s) [noise=true , address=45.91.116.4:4939 , piece_id=D3TLK6SUW4O7UUZVU6PADTAGQZ6SJHYAXYG2UULS7VZNMZ5YSOIA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.877739022 (70h54m39.308819143s) [noise=true , address=77.90.31.11:4555 , piece_id=42V6RDCOSJRZYHIH7AUYX35F7GRXVZRHRUNBTI3ZDDQSVK2IYBAA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.936181786 (70h54m39.367261918s) [noise=true , address=45.91.116.10:4083 , piece_id=ACEAUOZZCKIA4LTESFID3ZWUKFVTJACUI6VB327RTMHJLTPZBYGQ, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.937836643 (70h54m39.368916774s) [noise=true , address=77.90.31.18:4807 , piece_id=JZTPSUJQ7H7AAQC2JQLY37UM2ZPSCFVYDNOG7RSCJ6SPTWCVVPLA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.939510475 (70h54m39.370590596s) [noise=true , address=77.90.31.17:4771 , piece_id=4Y664XUE5YWHPNAWUYSZ4BPISRV5YM5IGV4VK53RCPFZYEEBOKIQ, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.944277246 (70h54m39.375357377s) [noise=true , address=104.36.82.12:4151 , piece_id=QUY4X3H5VQPZXZ4JCHFKXLUETZXOBEN34KO7YZEMVYQEVGKR5ZZA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.945075824 (70h54m39.376155955s) [noise=true , address=45.91.116.13:4155 , piece_id=YTXBYJIN6WYX2LBRDYH7YU55DKC7ZLLECK3HI22IKBWFRT6ZHTIA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.006188045 (70h54m39.437268176s) [noise=true , address=45.91.116.5:4298 , piece_id=QYRZXB5RPTYY3Y54CVYQA76YEOHCKIPOMOP36Z2W6PSF35JDULFA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.042863199 (70h54m39.47394333s) [noise=true , address=77.90.31.14:4663 , piece_id=I5W3UOQI6RQFDF2A5NGYG7GUXBP2XE3N6LCTBVHAXPEWBMVSV26Q, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.048316484 (70h54m39.479396645s) [noise=true , address=77.90.31.19:4843 , piece_id=NZ6GA4W7S4VGYLD5TBIOVCTFSBODMTOQY7SBY5OB2XWE766R2B3A, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.054276718 (70h54m39.485356839s) [noise=true , address=45.91.116.12:4227 , piece_id=C5NVQ4KJ4UVIIXGUUXYLYGZ6T3TVKESSRQX7KSYQZ7O5PYUS3XVA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.056028469 (70h54m39.487108601s) [noise=true , address=45.91.116.13:4153 , piece_id=6FFUWDJYTJPUBXGHDGREUB4OM4DGX6COJTXHFWHLGW7QK3CO2JDA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.056044611 (70h54m39.487124732s) [seg_pos={0 0}, upload=73915]: Segment reached optimal threshold of 13 pieces. Aug 11 16:20:45.056165442 (70h54m39.487245573s) [noise=true , address=45.91.116.6:4974 , piece_id=GUI4A3KX4FASSTLQDMD4PHG75FQZRZEZCWNIMLWEJBBHQ5IH6SIA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Aug 11 16:20:45.056214636 (70h54m39.487294767s) [noise=true , address=104.36.82.10:4079 , piece_id=CYHDYCMVCYISFUDJOXGK2RCJVPRBZXXBAX3ICDJTH4OUPTQL6RMA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 11 16:20:45.056367308 (70h54m39.48744744s) [noise=true , address=104.36.82.5:4839 , piece_id=56H4YACEHZNRC4IGN6LQ2OHVYAL6DFVJ3E5XKXUMAWHO6UCMICGA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:33142->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:33142->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33142->104.36.82.5:4839: use of closed network connection Aug 11 16:20:45.056394020 (70h54m39.487474151s) [seg_pos={0 0}, upload=73915]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 11 16:20:45.056469904 (70h54m39.487550035s) [upload=73915]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 16:20:45.056474313 (70h54m39.487554444s) [upload=73915]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 16:20:45.348914657 (70h54m39.779994788s) [upload=73915]: Done uploading segments... Aug 11 16:20:45.348932771 (70h54m39.780012902s) [upload=73915]: Upload finished. err: <nil> Duration: 5.946170695s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [X...............................X........X..................] duration: 1.945932029s FAIL (2025-08-11 16:58:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 7ca3b38f59bef6700c47a71c0ce137786b019861ef4e351f330d4f1e41b86704 != before b8ccbd272fe59726b04686e0542c1e0964e89942b662558e091433dc0e7e3dc5 ======LOGS====== Aug 11 16:46:39.434150567 (71h20m33.865230698s) [upload=74358]: Starting upload Aug 11 16:46:39.434202827 (71h20m33.865282958s) [upload=74358]: Done starting upload Aug 11 16:46:39.434253474 (71h20m33.865333605s) [upload=74358]: Uploading segments... Aug 11 16:46:39.434289643 (71h20m33.865369774s) [upload=74358]: Got next segment. Inline: true Aug 11 16:46:39.434293440 (71h20m33.865373561s) [upload=74358]: Waiting for error group managing segments... Aug 11 16:46:39.434326714 (71h20m33.865406845s) [upload=74358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 16:46:39.434330481 (71h20m33.865410612s) [upload=74358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 16:46:39.434332896 (71h20m33.865413017s) [upload=74358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 16:46:39.727280447 (71h20m34.158360588s) [upload=74358]: Done uploading segments... Aug 11 16:46:39.727301838 (71h20m34.158381969s) [upload=74358]: Upload finished. err: <nil> Duration:* 1.945961556s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..............................X.................X..X.......X] duration: 4.295482157s FAIL (2025-08-11 16:58:00 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 11 16:57:56.857437130 (71h31m51.288517261s) [upload=74558]: Starting upload Aug 11 16:57:56.857491995 (71h31m51.288572126s) [upload=74558]: Done starting upload Aug 11 16:57:56.857589862 (71h31m51.288669993s) [upload=74558]: Uploading segments... Aug 11 16:57:56.857723718 (71h31m51.288803839s) [upload=74558]: Got next segment. Inline: false Aug 11 16:57:56.857758605 (71h31m51.288838736s) [upload=74558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 16:57:56.857763114 (71h31m51.288843245s) [upload=74558]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 16:57:57.304939778 (71h31m51.736019909s) [seg_pos={0 0}, upload=74558]: Begin upload segment... Aug 11 16:57:57.305031484 (71h31m51.736111616s) [seg_pos={0 0}, upload=74558]: Done begin upload segment. Aug 11 16:57:57.305054858 (71h31m51.736134989s) [noise=true , address=104.36.82.47:4538 , piece_id=7EOGEYG77IU23U554U2YRN3QHCRWS62GQYSYEXCCCQDDWC3JLGWA, seg_pos={0 0}, upload=74558]: Uploading piece... Aug 11 16:57:57.305107249 (71h31m51.73618741s) [noise=true , address=104.36.82.9:4012 , piece_id=RJ5CSIT6VCCTMRI3FLROSADWZOJDXL4VHUVP4RJ7EEJNLYD3NUZA, seg_pos={0 0}, upload=74558]: Uploading piece... Aug 11 16:57:57.305490863 (71h31m51.736570994s) [noise=true , address=104.36.82.14:4245 , piece_id=NJXWJK3WBKA5TOWLJ5YN4GKF2GS4DODJZFVROVZBVIKDSKGBJPHQ, seg_pos={0 0}, upload=74558]: Uploading piece... Aug 11 16:57:57.305586095 (71h31m51.736666227s) [noise=true , address=104.36.82.62:4433 , piece_id=77Y4JSIYPNFHKDL6QHWEIGTJ73CBOEYCUCXOGCCDUBLMYB5NOJMA, seg_pos={0 0}, upload=74558]: Uploading piece... Aug 11 16:57:57.305787781 (71h31m51.736867912s) [noise=true , address=104.36.82.62:4415 , piece_id=RS2A2N2H5UMIPRU4GBEGI4JE2W5M3DBBSMB3AJGUFVZSUMKPZL5A, seg_pos={0 0}, upload=74558]: Uploading piece... Aug 11 16:57:57.306086633 (71h31m51.737166754s) [noise=true , address=104.36.82.5:4847 , piece_id=3HHZ7SQ7GZVIISK2NRIJBPTEFOGDVKZX2N444OKBEEG42JHHKPLA, seg_pos={0 0}, upload=74558]: Uploading piece... Aug 11 16:57:57.306325250 (71h31m51.737405381s) [noise=true , address=104.36.82.44:4877 , piece_id=NP2HVDS6I4K6NM4PNY7RNG3W3LY5PSOXMOMMUT6BP37C2FT6UF3A, seg_pos={0 0}, upload=74558]: Uploading piece... Aug 11 16:57:57.306559939 (71h31m51.73764006s) [noise=true , address=104.36.82.60:4338 , piece_id=JDU6EOILFUFRYMICMN5OHTEMDG7MK763MJGNDSZSQDD5QF7RP4SA, seg_pos={0 0}, upload=74558]: Uploading piece... Aug 11 16:57:57.306803736 (71h31m51.737883867s) [noise=true , address=45.91.116.9:4271 , piece_id=OLIH4VXHA3LXONUJIFAHGXTTQRWBT6RNDYPCILHYDRIBTAIHBV2Q, seg_pos={0 0}, upload=74558]: Uploading piece... Aug 11 16:57:57.307056509 (71h31m51.73813664s) [noise=true , address=104.36.82.23:4451 , piece_id=ROWFR3SQFOMH75RS25ITALP4DE6L2F22PX7WBCOUG67LCODBFTKA, seg_pos={0 0}, upload=74558]: Uploading piece... Aug 11 16:57:57.307248537 (71h31m51.738328668s) [noise=true , address=104.36.82.18:4375 , piece_id=ZNEEIPWGMMXIWUYBSMMYHXTQC7UB3QOR6RETGPGGIM7PP2VGXPUA, seg_pos={0 0}, upload=74558]: Uploading piece... Aug 11 16:57:57.307449731 (71h31m51.738529852s) [noise=true , address=64.49.13.140:4509 , piece_id=SVUJHX3ZV46TOU2LPSAPWRMFW53UUMUYZVN7632UEJKALNIY7PCQ, seg_pos={0 0}, upload=74558]: Uploading piece... Aug 11 16:57:57.307641478 (71h31m51.738721609s) [noise=true , address=104.36.82.38:4705 , piece_id=IWJOCZHOXUD54ZGMTQRTNVLDX7UG3OXVOOAQSOLK7BZOQS5HRQBA, seg_pos={0 0}, upload=74558]: Uploading piece... Aug 11 16:57:57.307843455 (71h31m51.738923586s) [noise=true , address=104.36.82.3:4795 , piece_id=IIEVTHFAUM2ZC7FCGQRHIVM4R32CBKS7IUGZCATNIWOSNFB7POFA, seg_pos={0 0}, upload=74558]: Uploading piece... Aug 11 16:57:57.308044109 (71h31m51.73912424s) [noise=true , address=104.36.82.4:4812 , piece_id=6TBOK7WKA7YCW6TZXH4GAHFF3SLUTKDE3UOY2WDNMIPXHG7TQSMQ, seg_pos={0 0}, upload=74558]: Uploading piece... Aug 11 16:57:57.308227480 (71h31m51.739307611s) [noise=true , address=104.36.82.61:4395 , piece_id=PP6HYV27AAPGVPAE4RSXHF3XQUTVX6JGM5HOUUGCJDNHFEOTPRZA, seg_pos={0 0}, upload=74558]: Uploading piece... Aug 11 16:57:57.308418055 (71h31m51.739498186s) [noise=true , address=104.36.82.43:4843 , piece_id=P2BJPLQVZSBQOK63EOQ7DMGDNAYOJRVRSJYHCWQXUZTGNBTNF7WA, seg_pos={0 0}, upload=74558]: Uploading piece... Aug 11 16:57:57.308629500 (71h31m51.739709661s) [noise=true , address=104.36.82.41:4771 , piece_id=VIGRBSURKL4UKGW4MTPOLRMGD7II5Z2U7RUILC36EIRBYCWEY55A, seg_pos={0 0}, upload=74558]: Uploading piece... Aug 11 16:57:58.407274325 (71h31m52.838354456s) [upload=74558]: Next returned nil segment Aug 11 16:57:58.407290104 (71h31m52.838370236s) [upload=74558]: Waiting for error group managing segments... Aug 11 16:57:58.708817320 (71h31m53.139897441s) [noise=true , address=64.49.13.140:4509 , piece_id=SVUJHX3ZV46TOU2LPSAPWRMFW53UUMUYZVN7632UEJKALNIY7PCQ, seg_pos={0 0}, upload=74558]: Done uploading piece. err: <nil> Aug 11 16:57:59.290930997 (71h31m53.722011128s) [noise=true , address=104.36.82.43:4843 , piece_id=P2BJPLQVZSBQOK63EOQ7DMGDNAYOJRVRSJYHCWQXUZTGNBTNF7WA, seg_pos={0 0}, upload=74558]: Done uploading piece. err: <nil> Aug 11 16:57:59.292920354 (71h31m53.724000485s) [noise=true , address=104.36.82.38:4705 , piece_id=IWJOCZHOXUD54ZGMTQRTNVLDX7UG3OXVOOAQSOLK7BZOQS5HRQBA, seg_pos={0 0}, upload=74558]: Done uploading piece. err: <nil> Aug 11 16:57:59.296695769 (71h31m53.72777589s) [noise=true , address=104.36.82.14:4245 , piece_id=NJXWJK3WBKA5TOWLJ5YN4GKF2GS4DODJZFVROVZBVIKDSKGBJPHQ, seg_pos={0 0}, upload=74558]: Done uploading piece. err: <nil> Aug 11 16:57:59.304598222 (71h31m53.735678353s) [noise=true , address=104.36.82.9:4012 , piece_id=RJ5CSIT6VCCTMRI3FLROSADWZOJDXL4VHUVP4RJ7EEJNLYD3NUZA, seg_pos={0 0}, upload=74558]: Done uploading piece. err: <nil> Aug 11 16:57:59.332823134 (71h31m53.763903255s) [noise=true , address=104.36.82.4:4812 , piece_id=6TBOK7WKA7YCW6TZXH4GAHFF3SLUTKDE3UOY2WDNMIPXHG7TQSMQ, seg_pos={0 0}, upload=74558]: Done uploading piece. err: <nil> Aug 11 16:57:59.343058571 (71h31m53.774138702s) [noise=true , address=104.36.82.44:4877 , piece_id=NP2HVDS6I4K6NM4PNY7RNG3W3LY5PSOXMOMMUT6BP37C2FT6UF3A, seg_pos={0 0}, upload=74558]: Done uploading piece. err: <nil> Aug 11 16:57:59.359080321 (71h31m53.790160442s) [noise=true , address=104.36.82.5:4847 , piece_id=3HHZ7SQ7GZVIISK2NRIJBPTEFOGDVKZX2N444OKBEEG42JHHKPLA, seg_pos={0 0}, upload=74558]: Done uploading piece. err: <nil> Aug 11 16:57:59.372408487 (71h31m53.803488618s) [noise=true , address=104.36.82.3:4795 , piece_id=IIEVTHFAUM2ZC7FCGQRHIVM4R32CBKS7IUGZCATNIWOSNFB7POFA, seg_pos={0 0}, upload=74558]: Done uploading piece. err: <nil> Aug 11 16:57:59.412987329 (71h31m53.844067461s) [noise=true , address=104.36.82.47:4538 , piece_id=7EOGEYG77IU23U554U2YRN3QHCRWS62GQYSYEXCCCQDDWC3JLGWA, seg_pos={0 0}, upload=74558]: Done uploading piece. err: <nil> Aug 11 16:57:59.422622748 (71h31m53.85370288s) [noise=true , address=45.91.116.9:4271 , piece_id=OLIH4VXHA3LXONUJIFAHGXTTQRWBT6RNDYPCILHYDRIBTAIHBV2Q, seg_pos={0 0}, upload=74558]: Done uploading piece. err: <nil> Aug 11 16:57:59.438228412 (71h31m53.869308533s) [noise=true , address=104.36.82.41:4771 , piece_id=VIGRBSURKL4UKGW4MTPOLRMGD7II5Z2U7RUILC36EIRBYCWEY55A, seg_pos={0 0}, upload=74558]: Done uploading piece. err: <nil> Aug 11 16:57:59.459015471 (71h31m53.890095602s) [noise=true , address=104.36.82.62:4415 , piece_id=RS2A2N2H5UMIPRU4GBEGI4JE2W5M3DBBSMB3AJGUFVZSUMKPZL5A, seg_pos={0 0}, upload=74558]: Done uploading piece. err: <nil> Aug 11 16:57:59.473292833 (71h31m53.904372964s) [noise=true , address=104.36.82.60:4338 , piece_id=JDU6EOILFUFRYMICMN5OHTEMDG7MK763MJGNDSZSQDD5QF7RP4SA, seg_pos={0 0}, upload=74558]: Done uploading piece. err: <nil> Aug 11 16:57:59.473319995 (71h31m53.904400126s) [seg_pos={0 0}, upload=74558]: Segment reached optimal threshold of 14 pieces. Aug 11 16:57:59.473444483 (71h31m53.904524604s) [noise=true , address=104.36.82.23:4451 , piece_id=ROWFR3SQFOMH75RS25ITALP4DE6L2F22PX7WBCOUG67LCODBFTKA, seg_pos={0 0}, upload=74558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Aug 11 16:57:59.473500200 (71h31m53.904580331s) [noise=true , address=104.36.82.61:4395 , piece_id=PP6HYV27AAPGVPAE4RSXHF3XQUTVX6JGM5HOUUGCJDNHFEOTPRZA, seg_pos={0 0}, upload=74558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BZnnbpp63tb9YBYEym3fuvJB4fR1L2GPTpWPbESbVgAXHpa64): protocol: expected piece hash; context canceled; EOF Aug 11 16:57:59.473554003 (71h31m53.904634134s) [noise=true , address=104.36.82.18:4375 , piece_id=ZNEEIPWGMMXIWUYBSMMYHXTQC7UB3QOR6RETGPGGIM7PP2VGXPUA, seg_pos={0 0}, upload=74558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pHU3Xp1sDgnmYMcbWZD2DivxdEUzqnBVJaiRaQipuRy2d75u5): protocol: expected piece hash; context canceled; EOF Aug 11 16:57:59.473594280 (71h31m53.904674411s) [noise=true , address=104.36.82.62:4433 , piece_id=77Y4JSIYPNFHKDL6QHWEIGTJ73CBOEYCUCXOGCCDUBLMYB5NOJMA, seg_pos={0 0}, upload=74558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AZCpZQEkwcdGqrnRGdaBr4ufDHbzDejWnUD43v9peicffu32t): protocol: expected piece hash; context canceled; EOF Aug 11 16:57:59.473635549 (71h31m53.90471568s) [seg_pos={0 0}, upload=74558]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 16:57:59.473729498 (71h31m53.904809629s) [upload=74558]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 16:57:59.473734027 (71h31m53.904814158s) [upload=74558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 16:57:59.765304869 (71h31m54.196385s) [upload=74558]: Done uploading segments... Aug 11 16:57:59.765325759 (71h31m54.19640589s) [upload=74558]: Upload finished. err: <nil> Duration: 4.295500843s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.X...............................X........X.................] duration: 1.876503977s FAIL (2025-08-11 16:57:34 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 7ca3b38f59bef6700c47a71c0ce137786b019861ef4e351f330d4f1e41b86704 != before b8ccbd272fe59726b04686e0542c1e0964e89942b662558e091433dc0e7e3dc5 ======LOGS====== Aug 11 16:46:39.434150567 (71h20m33.865230698s) [upload=74358]: Starting upload Aug 11 16:46:39.434202827 (71h20m33.865282958s) [upload=74358]: Done starting upload Aug 11 16:46:39.434253474 (71h20m33.865333605s) [upload=74358]: Uploading segments... Aug 11 16:46:39.434289643 (71h20m33.865369774s) [upload=74358]: Got next segment. Inline: true Aug 11 16:46:39.434293440 (71h20m33.865373561s) [upload=74358]: Waiting for error group managing segments... Aug 11 16:46:39.434326714 (71h20m33.865406845s) [upload=74358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 16:46:39.434330481 (71h20m33.865410612s) [upload=74358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 16:46:39.434332896 (71h20m33.865413017s) [upload=74358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 16:46:39.727280447 (71h20m34.158360588s) [upload=74358]: Done uploading segments... Aug 11 16:46:39.727301838 (71h20m34.158381969s) [upload=74358]: Upload finished. err: <nil> Duration:* 1.876550486s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...............................X.................X..X.......] duration: 5.593814933s FAIL (2025-08-11 16:57:23 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 057e70622624edd53b9fc51be4b79f2d44d3edfaab7771732fcead8b398b45cf != before 5fa63a3b4367a71718c58f2a9dea4bd743ced7ab5179088fd28949f3defb0b49 ======LOGS====== Aug 11 16:52:00.486330505 (71h25m54.917410636s) [upload=74451]: Starting upload Aug 11 16:52:00.486377434 (71h25m54.917457565s) [upload=74451]: Done starting upload Aug 11 16:52:00.486467226 (71h25m54.917547357s) [upload=74451]: Uploading segments... Aug 11 16:52:00.486565484 (71h25m54.917645615s) [upload=74451]: Got next segment. Inline: false Aug 11 16:52:00.486611342 (71h25m54.917691463s) [upload=74451]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 16:52:00.486615960 (71h25m54.917696091s) [upload=74451]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 16:52:00.936658896 (71h25m55.367739027s) [seg_pos={0 0}, upload=74451]: Begin upload segment... Aug 11 16:52:00.936704133 (71h25m55.367784264s) [seg_pos={0 0}, upload=74451]: Done begin upload segment. Aug 11 16:52:00.936723960 (71h25m55.367804091s) [noise=true , address=104.36.82.9:4018 , piece_id=NBU72ROM7RHSITJ7D7CZJMTG3IR2Y5PU3SIXECRQ6FZHE3BT6DRA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.936760270 (71h25m55.367840401s) [noise=true , address=104.36.82.34:4575 , piece_id=YBYWB3OKPOVXOMX4YTV2R4OKMPCKVPKGAORDS2JBYG66D6UCTA4A, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.937115760 (71h25m55.368195891s) [noise=true , address=104.36.82.38:4701 , piece_id=J4HDMCTPA4XS7DWE5LGJRVYMLR7BYPVHDAMWWGBW5YVJF236VK4Q, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.937240989 (71h25m55.368321121s) [noise=true , address=77.90.31.17:4791 , piece_id=X5DIN2SDWPH4EKQPOBZFINYODZ2AU46ZEIULAPHWDOMSESRXCGUA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.937385226 (71h25m55.368465357s) [noise=true , address=104.36.82.5:4843 , piece_id=XJH5W64QKAIEMSJ7WPDZRWG5GK2S56664IQDPUPW52CBEAT4MASA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.937648880 (71h25m55.368729011s) [noise=true , address=104.36.82.20:4440 , piece_id=2YLIUD4JWKADFVQ73AFWOYFZWRLAKUQ423WM4X5K56W7UOY6XUIA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.937939637 (71h25m55.369019768s) [noise=true , address=104.36.82.16:4312 , piece_id=GUEBWOWC56BV4WHI3HUHNNMOZJ54HZJRO4JLQNTMOJ76H6E3FMSQ, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.938208932 (71h25m55.369289063s) [noise=true , address=79.127.219.48:4086 , piece_id=BIIPBGT2VPPMNHLEHIMBWR4QU4RFB5GG3FU2XJAGQMIR4GSUVSPQ, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.938479660 (71h25m55.369559781s) [noise=true , address=79.127.219.38:4022 , piece_id=RBHTYSRKVYXZA5G4XEVYKVE7DV7V67WSUTH56MKTEIDUGRMXGREQ, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.938700222 (71h25m55.369780353s) [noise=true , address=79.127.220.98:4423 , piece_id=GRPLJQ3CSTHWJVXE7EUROVFV5JPIHVKYIUKFUR5HUYWEOWOIAQ5A, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.938911195 (71h25m55.369991326s) [noise=true , address=77.90.31.15:4732 , piece_id=JHKT2MSCWGGQF2Y2CTQZRGLPWELEGUWDA35CHK4KTGRNI2HNQZBA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.938988644 (71h25m55.370068775s) [noise=true , address=104.36.82.61:4378 , piece_id=ITY2O2P6SFXLNXJWJ4G56X26YJPGOJ4UATMPHYVCXFLEKVNMUKMA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.939229625 (71h25m55.370309756s) [noise=true , address=79.127.220.101:4074 , piece_id=JFTUZQVWSA32A33LCPSFPLBFRTOR6XT4M62XUI752T6CEM55EZQQ, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.939450798 (71h25m55.370530929s) [noise=true , address=104.36.82.59:4306 , piece_id=KNA553JSWSIB3D7EL62I576OQCRPFFJP7E4UL3D3I4MNVRIANVPA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.939676660 (71h25m55.370756791s) [noise=true , address=104.36.82.47:4533 , piece_id=FR55EWHLGG7DLRGUAIJCA56TQ7RPKDBQLGX33K6FHCWYV462WKJQ, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.939888225 (71h25m55.370968346s) [noise=true , address=104.36.82.62:4438 , piece_id=IXFU2VVB6LBSY523KZD4CPL5C5II7MOC7ZRVJCXTZ7DKWCWXEYBA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.940116682 (71h25m55.371196813s) [noise=true , address=104.36.82.45:4915 , piece_id=BEUVRN2GXXIR2XQXDBHIVNYZE7RIJ3EHIQSHMZYEPFUQNXALRTXA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.940314681 (71h25m55.371394812s) [noise=true , address=104.36.82.4:4809 , piece_id=3QKBP7QTZQBWTJ7PFMR7Z4GNKRJ3MLWTUVTZE7RS3AI33HNW7XBA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:02.407046143 (71h25m56.838126274s) [upload=74451]: Next returned nil segment Aug 11 16:52:02.407066482 (71h25m56.838146613s) [upload=74451]: Waiting for error group managing segments... Aug 11 16:52:02.784099481 (71h25m57.215179612s) [noise=true , address=79.127.220.98:4423 , piece_id=GRPLJQ3CSTHWJVXE7EUROVFV5JPIHVKYIUKFUR5HUYWEOWOIAQ5A, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.799355832 (71h25m57.230435963s) [noise=true , address=79.127.220.101:4074 , piece_id=JFTUZQVWSA32A33LCPSFPLBFRTOR6XT4M62XUI752T6CEM55EZQQ, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.824743848 (71h25m57.255823979s) [noise=true , address=79.127.219.48:4086 , piece_id=BIIPBGT2VPPMNHLEHIMBWR4QU4RFB5GG3FU2XJAGQMIR4GSUVSPQ, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.856539797 (71h25m57.287619928s) [noise=true , address=79.127.219.38:4022 , piece_id=RBHTYSRKVYXZA5G4XEVYKVE7DV7V67WSUTH56MKTEIDUGRMXGREQ, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.892199348 (71h25m57.323279499s) [noise=true , address=104.36.82.34:4575 , piece_id=YBYWB3OKPOVXOMX4YTV2R4OKMPCKVPKGAORDS2JBYG66D6UCTA4A, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.900582107 (71h25m57.331662238s) [noise=true , address=104.36.82.38:4701 , piece_id=J4HDMCTPA4XS7DWE5LGJRVYMLR7BYPVHDAMWWGBW5YVJF236VK4Q, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.901661613 (71h25m57.332741744s) [noise=true , address=77.90.31.17:4791 , piece_id=X5DIN2SDWPH4EKQPOBZFINYODZ2AU46ZEIULAPHWDOMSESRXCGUA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.924967335 (71h25m57.356047466s) [noise=true , address=104.36.82.4:4809 , piece_id=3QKBP7QTZQBWTJ7PFMR7Z4GNKRJ3MLWTUVTZE7RS3AI33HNW7XBA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.934432455 (71h25m57.365512586s) [noise=true , address=104.36.82.5:4843 , piece_id=XJH5W64QKAIEMSJ7WPDZRWG5GK2S56664IQDPUPW52CBEAT4MASA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.944250341 (71h25m57.375330472s) [noise=true , address=104.36.82.16:4312 , piece_id=GUEBWOWC56BV4WHI3HUHNNMOZJ54HZJRO4JLQNTMOJ76H6E3FMSQ, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.959326207 (71h25m57.390406338s) [noise=true , address=104.36.82.47:4533 , piece_id=FR55EWHLGG7DLRGUAIJCA56TQ7RPKDBQLGX33K6FHCWYV462WKJQ, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.965101627 (71h25m57.396181758s) [noise=true , address=104.36.82.9:4018 , piece_id=NBU72ROM7RHSITJ7D7CZJMTG3IR2Y5PU3SIXECRQ6FZHE3BT6DRA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.975109015 (71h25m57.406189147s) [noise=true , address=104.36.82.20:4440 , piece_id=2YLIUD4JWKADFVQ73AFWOYFZWRLAKUQ423WM4X5K56W7UOY6XUIA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.989812008 (71h25m57.420892139s) [noise=true , address=104.36.82.62:4438 , piece_id=IXFU2VVB6LBSY523KZD4CPL5C5II7MOC7ZRVJCXTZ7DKWCWXEYBA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.989838749 (71h25m57.42091887s) [seg_pos={0 0}, upload=74451]: Segment reached optimal threshold of 14 pieces. Aug 11 16:52:02.989941887 (71h25m57.421022018s) [noise=true , address=104.36.82.45:4915 , piece_id=BEUVRN2GXXIR2XQXDBHIVNYZE7RIJ3EHIQSHMZYEPFUQNXALRTXA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17rmsv4edxH6jmsN83ceiVJdfEui1qrBK5XBcf7GgvKCn2fknT): protocol: expected piece hash; context canceled; EOF Aug 11 16:52:02.990013944 (71h25m57.421094065s) [noise=true , address=104.36.82.61:4378 , piece_id=ITY2O2P6SFXLNXJWJ4G56X26YJPGOJ4UATMPHYVCXFLEKVNMUKMA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DcpXz1fKrWhdPxTpGUFmydMUuzMQpNFMgGB75BAVrjdMiSkhW): protocol: expected piece hash; context canceled; EOF Aug 11 16:52:02.990088507 (71h25m57.421168638s) [noise=true , address=77.90.31.15:4732 , piece_id=JHKT2MSCWGGQF2Y2CTQZRGLPWELEGUWDA35CHK4KTGRNI2HNQZBA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NyFYdUBbAhAijCDtPWB1zJCjwhgw35vEQoE4qJyg2PywRn5AH): protocol: expected piece hash; context canceled; EOF Aug 11 16:52:02.990112323 (71h25m57.421192454s) [noise=true , address=104.36.82.59:4306 , piece_id=KNA553JSWSIB3D7EL62I576OQCRPFFJP7E4UL3D3I4MNVRIANVPA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12amBPo7WKpjPDzi6mUWw5PcdgrcT7hsUjsSkijfrvKka1bJzNw): protocol: expected piece hash; context canceled; EOF Aug 11 16:52:02.990176205 (71h25m57.421256346s) [seg_pos={0 0}, upload=74451]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 16:52:02.990294881 (71h25m57.421375022s) [upload=74451]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 16:52:02.990301134 (71h25m57.421381275s) [upload=74451]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 16:52:03.289620958 (71h25m57.720701089s) [upload=74451]: Done uploading segments... Aug 11 16:52:03.289639453 (71h25m57.720719574s) [upload=74451]: Upload finished. err: <nil> Duration: 5.593833638s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 5.813441732s FAIL (2025-08-11 16:57:00 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 11 16:20:42.438359750 (70h54m36.869439881s) [upload=73915]: Starting upload Aug 11 16:20:42.438414104 (70h54m36.869494225s) [upload=73915]: Done starting upload Aug 11 16:20:42.438489136 (70h54m36.869569267s) [upload=73915]: Uploading segments... Aug 11 16:20:42.438621770 (70h54m36.869701891s) [upload=73915]: Got next segment. Inline: false Aug 11 16:20:42.438664713 (70h54m36.869744844s) [upload=73915]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 16:20:42.438669001 (70h54m36.869749132s) [upload=73915]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 16:20:42.676790711 (70h54m37.107870842s) [seg_pos={0 0}, upload=73915]: Begin upload segment... Aug 11 16:20:42.676835908 (70h54m37.107916039s) [seg_pos={0 0}, upload=73915]: Done begin upload segment. Aug 11 16:20:42.676853832 (70h54m37.107933964s) [noise=true , address=77.90.31.14:4663 , piece_id=I5W3UOQI6RQFDF2A5NGYG7GUXBP2XE3N6LCTBVHAXPEWBMVSV26Q, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.676866747 (70h54m37.107946878s) [noise=true , address=104.36.82.10:4079 , piece_id=CYHDYCMVCYISFUDJOXGK2RCJVPRBZXXBAX3ICDJTH4OUPTQL6RMA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.676910421 (70h54m37.107990552s) [noise=true , address=77.90.31.11:4555 , piece_id=42V6RDCOSJRZYHIH7AUYX35F7GRXVZRHRUNBTI3ZDDQSVK2IYBAA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.676958241 (70h54m37.108038383s) [noise=true , address=45.91.116.13:4153 , piece_id=6FFUWDJYTJPUBXGHDGREUB4OM4DGX6COJTXHFWHLGW7QK3CO2JDA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.677329863 (70h54m37.108409994s) [noise=true , address=45.91.116.6:4974 , piece_id=GUI4A3KX4FASSTLQDMD4PHG75FQZRZEZCWNIMLWEJBBHQ5IH6SIA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.677368517 (70h54m37.108448648s) [noise=true , address=45.91.116.10:4083 , piece_id=ACEAUOZZCKIA4LTESFID3ZWUKFVTJACUI6VB327RTMHJLTPZBYGQ, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.677671015 (70h54m37.108751146s) [noise=true , address=77.90.31.17:4771 , piece_id=4Y664XUE5YWHPNAWUYSZ4BPISRV5YM5IGV4VK53RCPFZYEEBOKIQ, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678009293 (70h54m37.109089424s) [noise=true , address=45.91.116.7:4010 , piece_id=I5FZKKDZEIJAEBGXVY5E4PSKY2XN6FFB6YJI7CTWGTS63FVWC77A, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678247930 (70h54m37.109328061s) [noise=true , address=77.90.31.19:4843 , piece_id=NZ6GA4W7S4VGYLD5TBIOVCTFSBODMTOQY7SBY5OB2XWE766R2B3A, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678532164 (70h54m37.109612285s) [noise=true , address=45.91.116.12:4227 , piece_id=C5NVQ4KJ4UVIIXGUUXYLYGZ6T3TVKESSRQX7KSYQZ7O5PYUS3XVA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678765730 (70h54m37.109845861s) [noise=true , address=104.36.82.12:4151 , piece_id=QUY4X3H5VQPZXZ4JCHFKXLUETZXOBEN34KO7YZEMVYQEVGKR5ZZA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678993456 (70h54m37.110073587s) [noise=true , address=45.91.116.13:4155 , piece_id=YTXBYJIN6WYX2LBRDYH7YU55DKC7ZLLECK3HI22IKBWFRT6ZHTIA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679139145 (70h54m37.110219266s) [noise=true , address=45.91.116.4:4939 , piece_id=D3TLK6SUW4O7UUZVU6PADTAGQZ6SJHYAXYG2UULS7VZNMZ5YSOIA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679376159 (70h54m37.11045629s) [noise=true , address=45.91.116.5:4298 , piece_id=QYRZXB5RPTYY3Y54CVYQA76YEOHCKIPOMOP36Z2W6PSF35JDULFA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679589166 (70h54m37.110669297s) [noise=true , address=104.36.82.5:4839 , piece_id=56H4YACEHZNRC4IGN6LQ2OHVYAL6DFVJ3E5XKXUMAWHO6UCMICGA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679786334 (70h54m37.110866465s) [noise=true , address=77.90.31.18:4807 , piece_id=JZTPSUJQ7H7AAQC2JQLY37UM2ZPSCFVYDNOG7RSCJ6SPTWCVVPLA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:44.458058779 (70h54m38.88913891s) [upload=73915]: Next returned nil segment Aug 11 16:20:44.458076964 (70h54m38.889157095s) [upload=73915]: Waiting for error group managing segments... Aug 11 16:20:44.762791322 (70h54m39.193871453s) [noise=true , address=45.91.116.7:4010 , piece_id=I5FZKKDZEIJAEBGXVY5E4PSKY2XN6FFB6YJI7CTWGTS63FVWC77A, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.819598246 (70h54m39.250678377s) [noise=true , address=45.91.116.4:4939 , piece_id=D3TLK6SUW4O7UUZVU6PADTAGQZ6SJHYAXYG2UULS7VZNMZ5YSOIA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.877739022 (70h54m39.308819143s) [noise=true , address=77.90.31.11:4555 , piece_id=42V6RDCOSJRZYHIH7AUYX35F7GRXVZRHRUNBTI3ZDDQSVK2IYBAA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.936181786 (70h54m39.367261918s) [noise=true , address=45.91.116.10:4083 , piece_id=ACEAUOZZCKIA4LTESFID3ZWUKFVTJACUI6VB327RTMHJLTPZBYGQ, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.937836643 (70h54m39.368916774s) [noise=true , address=77.90.31.18:4807 , piece_id=JZTPSUJQ7H7AAQC2JQLY37UM2ZPSCFVYDNOG7RSCJ6SPTWCVVPLA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.939510475 (70h54m39.370590596s) [noise=true , address=77.90.31.17:4771 , piece_id=4Y664XUE5YWHPNAWUYSZ4BPISRV5YM5IGV4VK53RCPFZYEEBOKIQ, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.944277246 (70h54m39.375357377s) [noise=true , address=104.36.82.12:4151 , piece_id=QUY4X3H5VQPZXZ4JCHFKXLUETZXOBEN34KO7YZEMVYQEVGKR5ZZA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.945075824 (70h54m39.376155955s) [noise=true , address=45.91.116.13:4155 , piece_id=YTXBYJIN6WYX2LBRDYH7YU55DKC7ZLLECK3HI22IKBWFRT6ZHTIA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.006188045 (70h54m39.437268176s) [noise=true , address=45.91.116.5:4298 , piece_id=QYRZXB5RPTYY3Y54CVYQA76YEOHCKIPOMOP36Z2W6PSF35JDULFA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.042863199 (70h54m39.47394333s) [noise=true , address=77.90.31.14:4663 , piece_id=I5W3UOQI6RQFDF2A5NGYG7GUXBP2XE3N6LCTBVHAXPEWBMVSV26Q, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.048316484 (70h54m39.479396645s) [noise=true , address=77.90.31.19:4843 , piece_id=NZ6GA4W7S4VGYLD5TBIOVCTFSBODMTOQY7SBY5OB2XWE766R2B3A, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.054276718 (70h54m39.485356839s) [noise=true , address=45.91.116.12:4227 , piece_id=C5NVQ4KJ4UVIIXGUUXYLYGZ6T3TVKESSRQX7KSYQZ7O5PYUS3XVA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.056028469 (70h54m39.487108601s) [noise=true , address=45.91.116.13:4153 , piece_id=6FFUWDJYTJPUBXGHDGREUB4OM4DGX6COJTXHFWHLGW7QK3CO2JDA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.056044611 (70h54m39.487124732s) [seg_pos={0 0}, upload=73915]: Segment reached optimal threshold of 13 pieces. Aug 11 16:20:45.056165442 (70h54m39.487245573s) [noise=true , address=45.91.116.6:4974 , piece_id=GUI4A3KX4FASSTLQDMD4PHG75FQZRZEZCWNIMLWEJBBHQ5IH6SIA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Aug 11 16:20:45.056214636 (70h54m39.487294767s) [noise=true , address=104.36.82.10:4079 , piece_id=CYHDYCMVCYISFUDJOXGK2RCJVPRBZXXBAX3ICDJTH4OUPTQL6RMA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 11 16:20:45.056367308 (70h54m39.48744744s) [noise=true , address=104.36.82.5:4839 , piece_id=56H4YACEHZNRC4IGN6LQ2OHVYAL6DFVJ3E5XKXUMAWHO6UCMICGA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:33142->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:33142->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33142->104.36.82.5:4839: use of closed network connection Aug 11 16:20:45.056394020 (70h54m39.487474151s) [seg_pos={0 0}, upload=73915]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 11 16:20:45.056469904 (70h54m39.487550035s) [upload=73915]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 16:20:45.056474313 (70h54m39.487554444s) [upload=73915]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 16:20:45.348914657 (70h54m39.779994788s) [upload=73915]: Done uploading segments... Aug 11 16:20:45.348932771 (70h54m39.780012902s) [upload=73915]: Upload finished. err: <nil> Duration: 5.81346702s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..X...............................X........X................] duration: 2.640705278s FAIL (2025-08-11 16:56:57 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 7ca3b38f59bef6700c47a71c0ce137786b019861ef4e351f330d4f1e41b86704 != before b8ccbd272fe59726b04686e0542c1e0964e89942b662558e091433dc0e7e3dc5 ======LOGS====== Aug 11 16:46:39.434150567 (71h20m33.865230698s) [upload=74358]: Starting upload Aug 11 16:46:39.434202827 (71h20m33.865282958s) [upload=74358]: Done starting upload Aug 11 16:46:39.434253474 (71h20m33.865333605s) [upload=74358]: Uploading segments... Aug 11 16:46:39.434289643 (71h20m33.865369774s) [upload=74358]: Got next segment. Inline: true Aug 11 16:46:39.434293440 (71h20m33.865373561s) [upload=74358]: Waiting for error group managing segments... Aug 11 16:46:39.434326714 (71h20m33.865406845s) [upload=74358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 16:46:39.434330481 (71h20m33.865410612s) [upload=74358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 16:46:39.434332896 (71h20m33.865413017s) [upload=74358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 16:46:39.727280447 (71h20m34.158360588s) [upload=74358]: Done uploading segments... Aug 11 16:46:39.727301838 (71h20m34.158381969s) [upload=74358]: Upload finished. err: <nil> Duration:* 2.640730385s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 5.870695013s FAIL (2025-08-11 16:56:26 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 11 16:20:42.438359750 (70h54m36.869439881s) [upload=73915]: Starting upload Aug 11 16:20:42.438414104 (70h54m36.869494225s) [upload=73915]: Done starting upload Aug 11 16:20:42.438489136 (70h54m36.869569267s) [upload=73915]: Uploading segments... Aug 11 16:20:42.438621770 (70h54m36.869701891s) [upload=73915]: Got next segment. Inline: false Aug 11 16:20:42.438664713 (70h54m36.869744844s) [upload=73915]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 16:20:42.438669001 (70h54m36.869749132s) [upload=73915]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 16:20:42.676790711 (70h54m37.107870842s) [seg_pos={0 0}, upload=73915]: Begin upload segment... Aug 11 16:20:42.676835908 (70h54m37.107916039s) [seg_pos={0 0}, upload=73915]: Done begin upload segment. Aug 11 16:20:42.676853832 (70h54m37.107933964s) [noise=true , address=77.90.31.14:4663 , piece_id=I5W3UOQI6RQFDF2A5NGYG7GUXBP2XE3N6LCTBVHAXPEWBMVSV26Q, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.676866747 (70h54m37.107946878s) [noise=true , address=104.36.82.10:4079 , piece_id=CYHDYCMVCYISFUDJOXGK2RCJVPRBZXXBAX3ICDJTH4OUPTQL6RMA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.676910421 (70h54m37.107990552s) [noise=true , address=77.90.31.11:4555 , piece_id=42V6RDCOSJRZYHIH7AUYX35F7GRXVZRHRUNBTI3ZDDQSVK2IYBAA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.676958241 (70h54m37.108038383s) [noise=true , address=45.91.116.13:4153 , piece_id=6FFUWDJYTJPUBXGHDGREUB4OM4DGX6COJTXHFWHLGW7QK3CO2JDA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.677329863 (70h54m37.108409994s) [noise=true , address=45.91.116.6:4974 , piece_id=GUI4A3KX4FASSTLQDMD4PHG75FQZRZEZCWNIMLWEJBBHQ5IH6SIA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.677368517 (70h54m37.108448648s) [noise=true , address=45.91.116.10:4083 , piece_id=ACEAUOZZCKIA4LTESFID3ZWUKFVTJACUI6VB327RTMHJLTPZBYGQ, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.677671015 (70h54m37.108751146s) [noise=true , address=77.90.31.17:4771 , piece_id=4Y664XUE5YWHPNAWUYSZ4BPISRV5YM5IGV4VK53RCPFZYEEBOKIQ, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678009293 (70h54m37.109089424s) [noise=true , address=45.91.116.7:4010 , piece_id=I5FZKKDZEIJAEBGXVY5E4PSKY2XN6FFB6YJI7CTWGTS63FVWC77A, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678247930 (70h54m37.109328061s) [noise=true , address=77.90.31.19:4843 , piece_id=NZ6GA4W7S4VGYLD5TBIOVCTFSBODMTOQY7SBY5OB2XWE766R2B3A, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678532164 (70h54m37.109612285s) [noise=true , address=45.91.116.12:4227 , piece_id=C5NVQ4KJ4UVIIXGUUXYLYGZ6T3TVKESSRQX7KSYQZ7O5PYUS3XVA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678765730 (70h54m37.109845861s) [noise=true , address=104.36.82.12:4151 , piece_id=QUY4X3H5VQPZXZ4JCHFKXLUETZXOBEN34KO7YZEMVYQEVGKR5ZZA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678993456 (70h54m37.110073587s) [noise=true , address=45.91.116.13:4155 , piece_id=YTXBYJIN6WYX2LBRDYH7YU55DKC7ZLLECK3HI22IKBWFRT6ZHTIA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679139145 (70h54m37.110219266s) [noise=true , address=45.91.116.4:4939 , piece_id=D3TLK6SUW4O7UUZVU6PADTAGQZ6SJHYAXYG2UULS7VZNMZ5YSOIA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679376159 (70h54m37.11045629s) [noise=true , address=45.91.116.5:4298 , piece_id=QYRZXB5RPTYY3Y54CVYQA76YEOHCKIPOMOP36Z2W6PSF35JDULFA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679589166 (70h54m37.110669297s) [noise=true , address=104.36.82.5:4839 , piece_id=56H4YACEHZNRC4IGN6LQ2OHVYAL6DFVJ3E5XKXUMAWHO6UCMICGA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679786334 (70h54m37.110866465s) [noise=true , address=77.90.31.18:4807 , piece_id=JZTPSUJQ7H7AAQC2JQLY37UM2ZPSCFVYDNOG7RSCJ6SPTWCVVPLA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:44.458058779 (70h54m38.88913891s) [upload=73915]: Next returned nil segment Aug 11 16:20:44.458076964 (70h54m38.889157095s) [upload=73915]: Waiting for error group managing segments... Aug 11 16:20:44.762791322 (70h54m39.193871453s) [noise=true , address=45.91.116.7:4010 , piece_id=I5FZKKDZEIJAEBGXVY5E4PSKY2XN6FFB6YJI7CTWGTS63FVWC77A, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.819598246 (70h54m39.250678377s) [noise=true , address=45.91.116.4:4939 , piece_id=D3TLK6SUW4O7UUZVU6PADTAGQZ6SJHYAXYG2UULS7VZNMZ5YSOIA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.877739022 (70h54m39.308819143s) [noise=true , address=77.90.31.11:4555 , piece_id=42V6RDCOSJRZYHIH7AUYX35F7GRXVZRHRUNBTI3ZDDQSVK2IYBAA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.936181786 (70h54m39.367261918s) [noise=true , address=45.91.116.10:4083 , piece_id=ACEAUOZZCKIA4LTESFID3ZWUKFVTJACUI6VB327RTMHJLTPZBYGQ, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.937836643 (70h54m39.368916774s) [noise=true , address=77.90.31.18:4807 , piece_id=JZTPSUJQ7H7AAQC2JQLY37UM2ZPSCFVYDNOG7RSCJ6SPTWCVVPLA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.939510475 (70h54m39.370590596s) [noise=true , address=77.90.31.17:4771 , piece_id=4Y664XUE5YWHPNAWUYSZ4BPISRV5YM5IGV4VK53RCPFZYEEBOKIQ, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.944277246 (70h54m39.375357377s) [noise=true , address=104.36.82.12:4151 , piece_id=QUY4X3H5VQPZXZ4JCHFKXLUETZXOBEN34KO7YZEMVYQEVGKR5ZZA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.945075824 (70h54m39.376155955s) [noise=true , address=45.91.116.13:4155 , piece_id=YTXBYJIN6WYX2LBRDYH7YU55DKC7ZLLECK3HI22IKBWFRT6ZHTIA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.006188045 (70h54m39.437268176s) [noise=true , address=45.91.116.5:4298 , piece_id=QYRZXB5RPTYY3Y54CVYQA76YEOHCKIPOMOP36Z2W6PSF35JDULFA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.042863199 (70h54m39.47394333s) [noise=true , address=77.90.31.14:4663 , piece_id=I5W3UOQI6RQFDF2A5NGYG7GUXBP2XE3N6LCTBVHAXPEWBMVSV26Q, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.048316484 (70h54m39.479396645s) [noise=true , address=77.90.31.19:4843 , piece_id=NZ6GA4W7S4VGYLD5TBIOVCTFSBODMTOQY7SBY5OB2XWE766R2B3A, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.054276718 (70h54m39.485356839s) [noise=true , address=45.91.116.12:4227 , piece_id=C5NVQ4KJ4UVIIXGUUXYLYGZ6T3TVKESSRQX7KSYQZ7O5PYUS3XVA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.056028469 (70h54m39.487108601s) [noise=true , address=45.91.116.13:4153 , piece_id=6FFUWDJYTJPUBXGHDGREUB4OM4DGX6COJTXHFWHLGW7QK3CO2JDA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.056044611 (70h54m39.487124732s) [seg_pos={0 0}, upload=73915]: Segment reached optimal threshold of 13 pieces. Aug 11 16:20:45.056165442 (70h54m39.487245573s) [noise=true , address=45.91.116.6:4974 , piece_id=GUI4A3KX4FASSTLQDMD4PHG75FQZRZEZCWNIMLWEJBBHQ5IH6SIA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Aug 11 16:20:45.056214636 (70h54m39.487294767s) [noise=true , address=104.36.82.10:4079 , piece_id=CYHDYCMVCYISFUDJOXGK2RCJVPRBZXXBAX3ICDJTH4OUPTQL6RMA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 11 16:20:45.056367308 (70h54m39.48744744s) [noise=true , address=104.36.82.5:4839 , piece_id=56H4YACEHZNRC4IGN6LQ2OHVYAL6DFVJ3E5XKXUMAWHO6UCMICGA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:33142->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:33142->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33142->104.36.82.5:4839: use of closed network connection Aug 11 16:20:45.056394020 (70h54m39.487474151s) [seg_pos={0 0}, upload=73915]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 11 16:20:45.056469904 (70h54m39.487550035s) [upload=73915]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 16:20:45.056474313 (70h54m39.487554444s) [upload=73915]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 16:20:45.348914657 (70h54m39.779994788s) [upload=73915]: Done uploading segments... Aug 11 16:20:45.348932771 (70h54m39.780012902s) [upload=73915]: Upload finished. err: <nil> Duration: 5.87071979s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [................................X.................X..X......] duration: 6.01527233s FAIL (2025-08-11 16:56:10 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 057e70622624edd53b9fc51be4b79f2d44d3edfaab7771732fcead8b398b45cf != before 5fa63a3b4367a71718c58f2a9dea4bd743ced7ab5179088fd28949f3defb0b49 ======LOGS====== Aug 11 16:52:00.486330505 (71h25m54.917410636s) [upload=74451]: Starting upload Aug 11 16:52:00.486377434 (71h25m54.917457565s) [upload=74451]: Done starting upload Aug 11 16:52:00.486467226 (71h25m54.917547357s) [upload=74451]: Uploading segments... Aug 11 16:52:00.486565484 (71h25m54.917645615s) [upload=74451]: Got next segment. Inline: false Aug 11 16:52:00.486611342 (71h25m54.917691463s) [upload=74451]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 16:52:00.486615960 (71h25m54.917696091s) [upload=74451]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 16:52:00.936658896 (71h25m55.367739027s) [seg_pos={0 0}, upload=74451]: Begin upload segment... Aug 11 16:52:00.936704133 (71h25m55.367784264s) [seg_pos={0 0}, upload=74451]: Done begin upload segment. Aug 11 16:52:00.936723960 (71h25m55.367804091s) [noise=true , address=104.36.82.9:4018 , piece_id=NBU72ROM7RHSITJ7D7CZJMTG3IR2Y5PU3SIXECRQ6FZHE3BT6DRA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.936760270 (71h25m55.367840401s) [noise=true , address=104.36.82.34:4575 , piece_id=YBYWB3OKPOVXOMX4YTV2R4OKMPCKVPKGAORDS2JBYG66D6UCTA4A, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.937115760 (71h25m55.368195891s) [noise=true , address=104.36.82.38:4701 , piece_id=J4HDMCTPA4XS7DWE5LGJRVYMLR7BYPVHDAMWWGBW5YVJF236VK4Q, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.937240989 (71h25m55.368321121s) [noise=true , address=77.90.31.17:4791 , piece_id=X5DIN2SDWPH4EKQPOBZFINYODZ2AU46ZEIULAPHWDOMSESRXCGUA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.937385226 (71h25m55.368465357s) [noise=true , address=104.36.82.5:4843 , piece_id=XJH5W64QKAIEMSJ7WPDZRWG5GK2S56664IQDPUPW52CBEAT4MASA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.937648880 (71h25m55.368729011s) [noise=true , address=104.36.82.20:4440 , piece_id=2YLIUD4JWKADFVQ73AFWOYFZWRLAKUQ423WM4X5K56W7UOY6XUIA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.937939637 (71h25m55.369019768s) [noise=true , address=104.36.82.16:4312 , piece_id=GUEBWOWC56BV4WHI3HUHNNMOZJ54HZJRO4JLQNTMOJ76H6E3FMSQ, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.938208932 (71h25m55.369289063s) [noise=true , address=79.127.219.48:4086 , piece_id=BIIPBGT2VPPMNHLEHIMBWR4QU4RFB5GG3FU2XJAGQMIR4GSUVSPQ, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.938479660 (71h25m55.369559781s) [noise=true , address=79.127.219.38:4022 , piece_id=RBHTYSRKVYXZA5G4XEVYKVE7DV7V67WSUTH56MKTEIDUGRMXGREQ, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.938700222 (71h25m55.369780353s) [noise=true , address=79.127.220.98:4423 , piece_id=GRPLJQ3CSTHWJVXE7EUROVFV5JPIHVKYIUKFUR5HUYWEOWOIAQ5A, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.938911195 (71h25m55.369991326s) [noise=true , address=77.90.31.15:4732 , piece_id=JHKT2MSCWGGQF2Y2CTQZRGLPWELEGUWDA35CHK4KTGRNI2HNQZBA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.938988644 (71h25m55.370068775s) [noise=true , address=104.36.82.61:4378 , piece_id=ITY2O2P6SFXLNXJWJ4G56X26YJPGOJ4UATMPHYVCXFLEKVNMUKMA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.939229625 (71h25m55.370309756s) [noise=true , address=79.127.220.101:4074 , piece_id=JFTUZQVWSA32A33LCPSFPLBFRTOR6XT4M62XUI752T6CEM55EZQQ, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.939450798 (71h25m55.370530929s) [noise=true , address=104.36.82.59:4306 , piece_id=KNA553JSWSIB3D7EL62I576OQCRPFFJP7E4UL3D3I4MNVRIANVPA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.939676660 (71h25m55.370756791s) [noise=true , address=104.36.82.47:4533 , piece_id=FR55EWHLGG7DLRGUAIJCA56TQ7RPKDBQLGX33K6FHCWYV462WKJQ, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.939888225 (71h25m55.370968346s) [noise=true , address=104.36.82.62:4438 , piece_id=IXFU2VVB6LBSY523KZD4CPL5C5II7MOC7ZRVJCXTZ7DKWCWXEYBA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.940116682 (71h25m55.371196813s) [noise=true , address=104.36.82.45:4915 , piece_id=BEUVRN2GXXIR2XQXDBHIVNYZE7RIJ3EHIQSHMZYEPFUQNXALRTXA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.940314681 (71h25m55.371394812s) [noise=true , address=104.36.82.4:4809 , piece_id=3QKBP7QTZQBWTJ7PFMR7Z4GNKRJ3MLWTUVTZE7RS3AI33HNW7XBA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:02.407046143 (71h25m56.838126274s) [upload=74451]: Next returned nil segment Aug 11 16:52:02.407066482 (71h25m56.838146613s) [upload=74451]: Waiting for error group managing segments... Aug 11 16:52:02.784099481 (71h25m57.215179612s) [noise=true , address=79.127.220.98:4423 , piece_id=GRPLJQ3CSTHWJVXE7EUROVFV5JPIHVKYIUKFUR5HUYWEOWOIAQ5A, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.799355832 (71h25m57.230435963s) [noise=true , address=79.127.220.101:4074 , piece_id=JFTUZQVWSA32A33LCPSFPLBFRTOR6XT4M62XUI752T6CEM55EZQQ, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.824743848 (71h25m57.255823979s) [noise=true , address=79.127.219.48:4086 , piece_id=BIIPBGT2VPPMNHLEHIMBWR4QU4RFB5GG3FU2XJAGQMIR4GSUVSPQ, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.856539797 (71h25m57.287619928s) [noise=true , address=79.127.219.38:4022 , piece_id=RBHTYSRKVYXZA5G4XEVYKVE7DV7V67WSUTH56MKTEIDUGRMXGREQ, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.892199348 (71h25m57.323279499s) [noise=true , address=104.36.82.34:4575 , piece_id=YBYWB3OKPOVXOMX4YTV2R4OKMPCKVPKGAORDS2JBYG66D6UCTA4A, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.900582107 (71h25m57.331662238s) [noise=true , address=104.36.82.38:4701 , piece_id=J4HDMCTPA4XS7DWE5LGJRVYMLR7BYPVHDAMWWGBW5YVJF236VK4Q, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.901661613 (71h25m57.332741744s) [noise=true , address=77.90.31.17:4791 , piece_id=X5DIN2SDWPH4EKQPOBZFINYODZ2AU46ZEIULAPHWDOMSESRXCGUA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.924967335 (71h25m57.356047466s) [noise=true , address=104.36.82.4:4809 , piece_id=3QKBP7QTZQBWTJ7PFMR7Z4GNKRJ3MLWTUVTZE7RS3AI33HNW7XBA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.934432455 (71h25m57.365512586s) [noise=true , address=104.36.82.5:4843 , piece_id=XJH5W64QKAIEMSJ7WPDZRWG5GK2S56664IQDPUPW52CBEAT4MASA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.944250341 (71h25m57.375330472s) [noise=true , address=104.36.82.16:4312 , piece_id=GUEBWOWC56BV4WHI3HUHNNMOZJ54HZJRO4JLQNTMOJ76H6E3FMSQ, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.959326207 (71h25m57.390406338s) [noise=true , address=104.36.82.47:4533 , piece_id=FR55EWHLGG7DLRGUAIJCA56TQ7RPKDBQLGX33K6FHCWYV462WKJQ, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.965101627 (71h25m57.396181758s) [noise=true , address=104.36.82.9:4018 , piece_id=NBU72ROM7RHSITJ7D7CZJMTG3IR2Y5PU3SIXECRQ6FZHE3BT6DRA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.975109015 (71h25m57.406189147s) [noise=true , address=104.36.82.20:4440 , piece_id=2YLIUD4JWKADFVQ73AFWOYFZWRLAKUQ423WM4X5K56W7UOY6XUIA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.989812008 (71h25m57.420892139s) [noise=true , address=104.36.82.62:4438 , piece_id=IXFU2VVB6LBSY523KZD4CPL5C5II7MOC7ZRVJCXTZ7DKWCWXEYBA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.989838749 (71h25m57.42091887s) [seg_pos={0 0}, upload=74451]: Segment reached optimal threshold of 14 pieces. Aug 11 16:52:02.989941887 (71h25m57.421022018s) [noise=true , address=104.36.82.45:4915 , piece_id=BEUVRN2GXXIR2XQXDBHIVNYZE7RIJ3EHIQSHMZYEPFUQNXALRTXA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17rmsv4edxH6jmsN83ceiVJdfEui1qrBK5XBcf7GgvKCn2fknT): protocol: expected piece hash; context canceled; EOF Aug 11 16:52:02.990013944 (71h25m57.421094065s) [noise=true , address=104.36.82.61:4378 , piece_id=ITY2O2P6SFXLNXJWJ4G56X26YJPGOJ4UATMPHYVCXFLEKVNMUKMA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DcpXz1fKrWhdPxTpGUFmydMUuzMQpNFMgGB75BAVrjdMiSkhW): protocol: expected piece hash; context canceled; EOF Aug 11 16:52:02.990088507 (71h25m57.421168638s) [noise=true , address=77.90.31.15:4732 , piece_id=JHKT2MSCWGGQF2Y2CTQZRGLPWELEGUWDA35CHK4KTGRNI2HNQZBA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NyFYdUBbAhAijCDtPWB1zJCjwhgw35vEQoE4qJyg2PywRn5AH): protocol: expected piece hash; context canceled; EOF Aug 11 16:52:02.990112323 (71h25m57.421192454s) [noise=true , address=104.36.82.59:4306 , piece_id=KNA553JSWSIB3D7EL62I576OQCRPFFJP7E4UL3D3I4MNVRIANVPA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12amBPo7WKpjPDzi6mUWw5PcdgrcT7hsUjsSkijfrvKka1bJzNw): protocol: expected piece hash; context canceled; EOF Aug 11 16:52:02.990176205 (71h25m57.421256346s) [seg_pos={0 0}, upload=74451]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 16:52:02.990294881 (71h25m57.421375022s) [upload=74451]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 16:52:02.990301134 (71h25m57.421381275s) [upload=74451]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 16:52:03.289620958 (71h25m57.720701089s) [upload=74451]: Done uploading segments... Aug 11 16:52:03.289639453 (71h25m57.720719574s) [upload=74451]: Upload finished. err: <nil> Duration: 6.01530284s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 6.073627432s FAIL (2025-08-11 16:56:02 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 11 16:20:42.438359750 (70h54m36.869439881s) [upload=73915]: Starting upload Aug 11 16:20:42.438414104 (70h54m36.869494225s) [upload=73915]: Done starting upload Aug 11 16:20:42.438489136 (70h54m36.869569267s) [upload=73915]: Uploading segments... Aug 11 16:20:42.438621770 (70h54m36.869701891s) [upload=73915]: Got next segment. Inline: false Aug 11 16:20:42.438664713 (70h54m36.869744844s) [upload=73915]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 16:20:42.438669001 (70h54m36.869749132s) [upload=73915]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 16:20:42.676790711 (70h54m37.107870842s) [seg_pos={0 0}, upload=73915]: Begin upload segment... Aug 11 16:20:42.676835908 (70h54m37.107916039s) [seg_pos={0 0}, upload=73915]: Done begin upload segment. Aug 11 16:20:42.676853832 (70h54m37.107933964s) [noise=true , address=77.90.31.14:4663 , piece_id=I5W3UOQI6RQFDF2A5NGYG7GUXBP2XE3N6LCTBVHAXPEWBMVSV26Q, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.676866747 (70h54m37.107946878s) [noise=true , address=104.36.82.10:4079 , piece_id=CYHDYCMVCYISFUDJOXGK2RCJVPRBZXXBAX3ICDJTH4OUPTQL6RMA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.676910421 (70h54m37.107990552s) [noise=true , address=77.90.31.11:4555 , piece_id=42V6RDCOSJRZYHIH7AUYX35F7GRXVZRHRUNBTI3ZDDQSVK2IYBAA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.676958241 (70h54m37.108038383s) [noise=true , address=45.91.116.13:4153 , piece_id=6FFUWDJYTJPUBXGHDGREUB4OM4DGX6COJTXHFWHLGW7QK3CO2JDA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.677329863 (70h54m37.108409994s) [noise=true , address=45.91.116.6:4974 , piece_id=GUI4A3KX4FASSTLQDMD4PHG75FQZRZEZCWNIMLWEJBBHQ5IH6SIA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.677368517 (70h54m37.108448648s) [noise=true , address=45.91.116.10:4083 , piece_id=ACEAUOZZCKIA4LTESFID3ZWUKFVTJACUI6VB327RTMHJLTPZBYGQ, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.677671015 (70h54m37.108751146s) [noise=true , address=77.90.31.17:4771 , piece_id=4Y664XUE5YWHPNAWUYSZ4BPISRV5YM5IGV4VK53RCPFZYEEBOKIQ, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678009293 (70h54m37.109089424s) [noise=true , address=45.91.116.7:4010 , piece_id=I5FZKKDZEIJAEBGXVY5E4PSKY2XN6FFB6YJI7CTWGTS63FVWC77A, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678247930 (70h54m37.109328061s) [noise=true , address=77.90.31.19:4843 , piece_id=NZ6GA4W7S4VGYLD5TBIOVCTFSBODMTOQY7SBY5OB2XWE766R2B3A, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678532164 (70h54m37.109612285s) [noise=true , address=45.91.116.12:4227 , piece_id=C5NVQ4KJ4UVIIXGUUXYLYGZ6T3TVKESSRQX7KSYQZ7O5PYUS3XVA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678765730 (70h54m37.109845861s) [noise=true , address=104.36.82.12:4151 , piece_id=QUY4X3H5VQPZXZ4JCHFKXLUETZXOBEN34KO7YZEMVYQEVGKR5ZZA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678993456 (70h54m37.110073587s) [noise=true , address=45.91.116.13:4155 , piece_id=YTXBYJIN6WYX2LBRDYH7YU55DKC7ZLLECK3HI22IKBWFRT6ZHTIA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679139145 (70h54m37.110219266s) [noise=true , address=45.91.116.4:4939 , piece_id=D3TLK6SUW4O7UUZVU6PADTAGQZ6SJHYAXYG2UULS7VZNMZ5YSOIA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679376159 (70h54m37.11045629s) [noise=true , address=45.91.116.5:4298 , piece_id=QYRZXB5RPTYY3Y54CVYQA76YEOHCKIPOMOP36Z2W6PSF35JDULFA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679589166 (70h54m37.110669297s) [noise=true , address=104.36.82.5:4839 , piece_id=56H4YACEHZNRC4IGN6LQ2OHVYAL6DFVJ3E5XKXUMAWHO6UCMICGA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679786334 (70h54m37.110866465s) [noise=true , address=77.90.31.18:4807 , piece_id=JZTPSUJQ7H7AAQC2JQLY37UM2ZPSCFVYDNOG7RSCJ6SPTWCVVPLA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:44.458058779 (70h54m38.88913891s) [upload=73915]: Next returned nil segment Aug 11 16:20:44.458076964 (70h54m38.889157095s) [upload=73915]: Waiting for error group managing segments... Aug 11 16:20:44.762791322 (70h54m39.193871453s) [noise=true , address=45.91.116.7:4010 , piece_id=I5FZKKDZEIJAEBGXVY5E4PSKY2XN6FFB6YJI7CTWGTS63FVWC77A, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.819598246 (70h54m39.250678377s) [noise=true , address=45.91.116.4:4939 , piece_id=D3TLK6SUW4O7UUZVU6PADTAGQZ6SJHYAXYG2UULS7VZNMZ5YSOIA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.877739022 (70h54m39.308819143s) [noise=true , address=77.90.31.11:4555 , piece_id=42V6RDCOSJRZYHIH7AUYX35F7GRXVZRHRUNBTI3ZDDQSVK2IYBAA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.936181786 (70h54m39.367261918s) [noise=true , address=45.91.116.10:4083 , piece_id=ACEAUOZZCKIA4LTESFID3ZWUKFVTJACUI6VB327RTMHJLTPZBYGQ, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.937836643 (70h54m39.368916774s) [noise=true , address=77.90.31.18:4807 , piece_id=JZTPSUJQ7H7AAQC2JQLY37UM2ZPSCFVYDNOG7RSCJ6SPTWCVVPLA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.939510475 (70h54m39.370590596s) [noise=true , address=77.90.31.17:4771 , piece_id=4Y664XUE5YWHPNAWUYSZ4BPISRV5YM5IGV4VK53RCPFZYEEBOKIQ, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.944277246 (70h54m39.375357377s) [noise=true , address=104.36.82.12:4151 , piece_id=QUY4X3H5VQPZXZ4JCHFKXLUETZXOBEN34KO7YZEMVYQEVGKR5ZZA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.945075824 (70h54m39.376155955s) [noise=true , address=45.91.116.13:4155 , piece_id=YTXBYJIN6WYX2LBRDYH7YU55DKC7ZLLECK3HI22IKBWFRT6ZHTIA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.006188045 (70h54m39.437268176s) [noise=true , address=45.91.116.5:4298 , piece_id=QYRZXB5RPTYY3Y54CVYQA76YEOHCKIPOMOP36Z2W6PSF35JDULFA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.042863199 (70h54m39.47394333s) [noise=true , address=77.90.31.14:4663 , piece_id=I5W3UOQI6RQFDF2A5NGYG7GUXBP2XE3N6LCTBVHAXPEWBMVSV26Q, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.048316484 (70h54m39.479396645s) [noise=true , address=77.90.31.19:4843 , piece_id=NZ6GA4W7S4VGYLD5TBIOVCTFSBODMTOQY7SBY5OB2XWE766R2B3A, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.054276718 (70h54m39.485356839s) [noise=true , address=45.91.116.12:4227 , piece_id=C5NVQ4KJ4UVIIXGUUXYLYGZ6T3TVKESSRQX7KSYQZ7O5PYUS3XVA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.056028469 (70h54m39.487108601s) [noise=true , address=45.91.116.13:4153 , piece_id=6FFUWDJYTJPUBXGHDGREUB4OM4DGX6COJTXHFWHLGW7QK3CO2JDA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.056044611 (70h54m39.487124732s) [seg_pos={0 0}, upload=73915]: Segment reached optimal threshold of 13 pieces. Aug 11 16:20:45.056165442 (70h54m39.487245573s) [noise=true , address=45.91.116.6:4974 , piece_id=GUI4A3KX4FASSTLQDMD4PHG75FQZRZEZCWNIMLWEJBBHQ5IH6SIA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Aug 11 16:20:45.056214636 (70h54m39.487294767s) [noise=true , address=104.36.82.10:4079 , piece_id=CYHDYCMVCYISFUDJOXGK2RCJVPRBZXXBAX3ICDJTH4OUPTQL6RMA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 11 16:20:45.056367308 (70h54m39.48744744s) [noise=true , address=104.36.82.5:4839 , piece_id=56H4YACEHZNRC4IGN6LQ2OHVYAL6DFVJ3E5XKXUMAWHO6UCMICGA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:33142->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:33142->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33142->104.36.82.5:4839: use of closed network connection Aug 11 16:20:45.056394020 (70h54m39.487474151s) [seg_pos={0 0}, upload=73915]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 11 16:20:45.056469904 (70h54m39.487550035s) [upload=73915]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 16:20:45.056474313 (70h54m39.487554444s) [upload=73915]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 16:20:45.348914657 (70h54m39.779994788s) [upload=73915]: Done uploading segments... Aug 11 16:20:45.348932771 (70h54m39.780012902s) [upload=73915]: Upload finished. err: <nil> Duration: 6.073655846s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...X...............................X........X...............] duration: 1.88984614s FAIL (2025-08-11 16:55:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 7ca3b38f59bef6700c47a71c0ce137786b019861ef4e351f330d4f1e41b86704 != before b8ccbd272fe59726b04686e0542c1e0964e89942b662558e091433dc0e7e3dc5 ======LOGS====== Aug 11 16:46:39.434150567 (71h20m33.865230698s) [upload=74358]: Starting upload Aug 11 16:46:39.434202827 (71h20m33.865282958s) [upload=74358]: Done starting upload Aug 11 16:46:39.434253474 (71h20m33.865333605s) [upload=74358]: Uploading segments... Aug 11 16:46:39.434289643 (71h20m33.865369774s) [upload=74358]: Got next segment. Inline: true Aug 11 16:46:39.434293440 (71h20m33.865373561s) [upload=74358]: Waiting for error group managing segments... Aug 11 16:46:39.434326714 (71h20m33.865406845s) [upload=74358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 16:46:39.434330481 (71h20m33.865410612s) [upload=74358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 16:46:39.434332896 (71h20m33.865413017s) [upload=74358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 16:46:39.727280447 (71h20m34.158360588s) [upload=74358]: Done uploading segments... Aug 11 16:46:39.727301838 (71h20m34.158381969s) [upload=74358]: Upload finished. err: <nil> Duration:* 1.889868924s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [....X...............................X........X..............] duration: 1.848753962s FAIL (2025-08-11 16:55:31 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 7ca3b38f59bef6700c47a71c0ce137786b019861ef4e351f330d4f1e41b86704 != before b8ccbd272fe59726b04686e0542c1e0964e89942b662558e091433dc0e7e3dc5 ======LOGS====== Aug 11 16:46:39.434150567 (71h20m33.865230698s) [upload=74358]: Starting upload Aug 11 16:46:39.434202827 (71h20m33.865282958s) [upload=74358]: Done starting upload Aug 11 16:46:39.434253474 (71h20m33.865333605s) [upload=74358]: Uploading segments... Aug 11 16:46:39.434289643 (71h20m33.865369774s) [upload=74358]: Got next segment. Inline: true Aug 11 16:46:39.434293440 (71h20m33.865373561s) [upload=74358]: Waiting for error group managing segments... Aug 11 16:46:39.434326714 (71h20m33.865406845s) [upload=74358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 16:46:39.434330481 (71h20m33.865410612s) [upload=74358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 16:46:39.434332896 (71h20m33.865413017s) [upload=74358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 16:46:39.727280447 (71h20m34.158360588s) [upload=74358]: Done uploading segments... Aug 11 16:46:39.727301838 (71h20m34.158381969s) [upload=74358]: Upload finished. err: <nil> Duration:* 1.848786032s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.................................X.................X..X.....] duration: 5.890014723s FAIL (2025-08-11 16:55:02 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 057e70622624edd53b9fc51be4b79f2d44d3edfaab7771732fcead8b398b45cf != before 5fa63a3b4367a71718c58f2a9dea4bd743ced7ab5179088fd28949f3defb0b49 ======LOGS====== Aug 11 16:52:00.486330505 (71h25m54.917410636s) [upload=74451]: Starting upload Aug 11 16:52:00.486377434 (71h25m54.917457565s) [upload=74451]: Done starting upload Aug 11 16:52:00.486467226 (71h25m54.917547357s) [upload=74451]: Uploading segments... Aug 11 16:52:00.486565484 (71h25m54.917645615s) [upload=74451]: Got next segment. Inline: false Aug 11 16:52:00.486611342 (71h25m54.917691463s) [upload=74451]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 16:52:00.486615960 (71h25m54.917696091s) [upload=74451]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 16:52:00.936658896 (71h25m55.367739027s) [seg_pos={0 0}, upload=74451]: Begin upload segment... Aug 11 16:52:00.936704133 (71h25m55.367784264s) [seg_pos={0 0}, upload=74451]: Done begin upload segment. Aug 11 16:52:00.936723960 (71h25m55.367804091s) [noise=true , address=104.36.82.9:4018 , piece_id=NBU72ROM7RHSITJ7D7CZJMTG3IR2Y5PU3SIXECRQ6FZHE3BT6DRA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.936760270 (71h25m55.367840401s) [noise=true , address=104.36.82.34:4575 , piece_id=YBYWB3OKPOVXOMX4YTV2R4OKMPCKVPKGAORDS2JBYG66D6UCTA4A, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.937115760 (71h25m55.368195891s) [noise=true , address=104.36.82.38:4701 , piece_id=J4HDMCTPA4XS7DWE5LGJRVYMLR7BYPVHDAMWWGBW5YVJF236VK4Q, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.937240989 (71h25m55.368321121s) [noise=true , address=77.90.31.17:4791 , piece_id=X5DIN2SDWPH4EKQPOBZFINYODZ2AU46ZEIULAPHWDOMSESRXCGUA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.937385226 (71h25m55.368465357s) [noise=true , address=104.36.82.5:4843 , piece_id=XJH5W64QKAIEMSJ7WPDZRWG5GK2S56664IQDPUPW52CBEAT4MASA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.937648880 (71h25m55.368729011s) [noise=true , address=104.36.82.20:4440 , piece_id=2YLIUD4JWKADFVQ73AFWOYFZWRLAKUQ423WM4X5K56W7UOY6XUIA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.937939637 (71h25m55.369019768s) [noise=true , address=104.36.82.16:4312 , piece_id=GUEBWOWC56BV4WHI3HUHNNMOZJ54HZJRO4JLQNTMOJ76H6E3FMSQ, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.938208932 (71h25m55.369289063s) [noise=true , address=79.127.219.48:4086 , piece_id=BIIPBGT2VPPMNHLEHIMBWR4QU4RFB5GG3FU2XJAGQMIR4GSUVSPQ, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.938479660 (71h25m55.369559781s) [noise=true , address=79.127.219.38:4022 , piece_id=RBHTYSRKVYXZA5G4XEVYKVE7DV7V67WSUTH56MKTEIDUGRMXGREQ, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.938700222 (71h25m55.369780353s) [noise=true , address=79.127.220.98:4423 , piece_id=GRPLJQ3CSTHWJVXE7EUROVFV5JPIHVKYIUKFUR5HUYWEOWOIAQ5A, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.938911195 (71h25m55.369991326s) [noise=true , address=77.90.31.15:4732 , piece_id=JHKT2MSCWGGQF2Y2CTQZRGLPWELEGUWDA35CHK4KTGRNI2HNQZBA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.938988644 (71h25m55.370068775s) [noise=true , address=104.36.82.61:4378 , piece_id=ITY2O2P6SFXLNXJWJ4G56X26YJPGOJ4UATMPHYVCXFLEKVNMUKMA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.939229625 (71h25m55.370309756s) [noise=true , address=79.127.220.101:4074 , piece_id=JFTUZQVWSA32A33LCPSFPLBFRTOR6XT4M62XUI752T6CEM55EZQQ, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.939450798 (71h25m55.370530929s) [noise=true , address=104.36.82.59:4306 , piece_id=KNA553JSWSIB3D7EL62I576OQCRPFFJP7E4UL3D3I4MNVRIANVPA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.939676660 (71h25m55.370756791s) [noise=true , address=104.36.82.47:4533 , piece_id=FR55EWHLGG7DLRGUAIJCA56TQ7RPKDBQLGX33K6FHCWYV462WKJQ, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.939888225 (71h25m55.370968346s) [noise=true , address=104.36.82.62:4438 , piece_id=IXFU2VVB6LBSY523KZD4CPL5C5II7MOC7ZRVJCXTZ7DKWCWXEYBA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.940116682 (71h25m55.371196813s) [noise=true , address=104.36.82.45:4915 , piece_id=BEUVRN2GXXIR2XQXDBHIVNYZE7RIJ3EHIQSHMZYEPFUQNXALRTXA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.940314681 (71h25m55.371394812s) [noise=true , address=104.36.82.4:4809 , piece_id=3QKBP7QTZQBWTJ7PFMR7Z4GNKRJ3MLWTUVTZE7RS3AI33HNW7XBA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:02.407046143 (71h25m56.838126274s) [upload=74451]: Next returned nil segment Aug 11 16:52:02.407066482 (71h25m56.838146613s) [upload=74451]: Waiting for error group managing segments... Aug 11 16:52:02.784099481 (71h25m57.215179612s) [noise=true , address=79.127.220.98:4423 , piece_id=GRPLJQ3CSTHWJVXE7EUROVFV5JPIHVKYIUKFUR5HUYWEOWOIAQ5A, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.799355832 (71h25m57.230435963s) [noise=true , address=79.127.220.101:4074 , piece_id=JFTUZQVWSA32A33LCPSFPLBFRTOR6XT4M62XUI752T6CEM55EZQQ, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.824743848 (71h25m57.255823979s) [noise=true , address=79.127.219.48:4086 , piece_id=BIIPBGT2VPPMNHLEHIMBWR4QU4RFB5GG3FU2XJAGQMIR4GSUVSPQ, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.856539797 (71h25m57.287619928s) [noise=true , address=79.127.219.38:4022 , piece_id=RBHTYSRKVYXZA5G4XEVYKVE7DV7V67WSUTH56MKTEIDUGRMXGREQ, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.892199348 (71h25m57.323279499s) [noise=true , address=104.36.82.34:4575 , piece_id=YBYWB3OKPOVXOMX4YTV2R4OKMPCKVPKGAORDS2JBYG66D6UCTA4A, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.900582107 (71h25m57.331662238s) [noise=true , address=104.36.82.38:4701 , piece_id=J4HDMCTPA4XS7DWE5LGJRVYMLR7BYPVHDAMWWGBW5YVJF236VK4Q, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.901661613 (71h25m57.332741744s) [noise=true , address=77.90.31.17:4791 , piece_id=X5DIN2SDWPH4EKQPOBZFINYODZ2AU46ZEIULAPHWDOMSESRXCGUA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.924967335 (71h25m57.356047466s) [noise=true , address=104.36.82.4:4809 , piece_id=3QKBP7QTZQBWTJ7PFMR7Z4GNKRJ3MLWTUVTZE7RS3AI33HNW7XBA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.934432455 (71h25m57.365512586s) [noise=true , address=104.36.82.5:4843 , piece_id=XJH5W64QKAIEMSJ7WPDZRWG5GK2S56664IQDPUPW52CBEAT4MASA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.944250341 (71h25m57.375330472s) [noise=true , address=104.36.82.16:4312 , piece_id=GUEBWOWC56BV4WHI3HUHNNMOZJ54HZJRO4JLQNTMOJ76H6E3FMSQ, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.959326207 (71h25m57.390406338s) [noise=true , address=104.36.82.47:4533 , piece_id=FR55EWHLGG7DLRGUAIJCA56TQ7RPKDBQLGX33K6FHCWYV462WKJQ, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.965101627 (71h25m57.396181758s) [noise=true , address=104.36.82.9:4018 , piece_id=NBU72ROM7RHSITJ7D7CZJMTG3IR2Y5PU3SIXECRQ6FZHE3BT6DRA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.975109015 (71h25m57.406189147s) [noise=true , address=104.36.82.20:4440 , piece_id=2YLIUD4JWKADFVQ73AFWOYFZWRLAKUQ423WM4X5K56W7UOY6XUIA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.989812008 (71h25m57.420892139s) [noise=true , address=104.36.82.62:4438 , piece_id=IXFU2VVB6LBSY523KZD4CPL5C5II7MOC7ZRVJCXTZ7DKWCWXEYBA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.989838749 (71h25m57.42091887s) [seg_pos={0 0}, upload=74451]: Segment reached optimal threshold of 14 pieces. Aug 11 16:52:02.989941887 (71h25m57.421022018s) [noise=true , address=104.36.82.45:4915 , piece_id=BEUVRN2GXXIR2XQXDBHIVNYZE7RIJ3EHIQSHMZYEPFUQNXALRTXA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17rmsv4edxH6jmsN83ceiVJdfEui1qrBK5XBcf7GgvKCn2fknT): protocol: expected piece hash; context canceled; EOF Aug 11 16:52:02.990013944 (71h25m57.421094065s) [noise=true , address=104.36.82.61:4378 , piece_id=ITY2O2P6SFXLNXJWJ4G56X26YJPGOJ4UATMPHYVCXFLEKVNMUKMA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DcpXz1fKrWhdPxTpGUFmydMUuzMQpNFMgGB75BAVrjdMiSkhW): protocol: expected piece hash; context canceled; EOF Aug 11 16:52:02.990088507 (71h25m57.421168638s) [noise=true , address=77.90.31.15:4732 , piece_id=JHKT2MSCWGGQF2Y2CTQZRGLPWELEGUWDA35CHK4KTGRNI2HNQZBA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NyFYdUBbAhAijCDtPWB1zJCjwhgw35vEQoE4qJyg2PywRn5AH): protocol: expected piece hash; context canceled; EOF Aug 11 16:52:02.990112323 (71h25m57.421192454s) [noise=true , address=104.36.82.59:4306 , piece_id=KNA553JSWSIB3D7EL62I576OQCRPFFJP7E4UL3D3I4MNVRIANVPA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12amBPo7WKpjPDzi6mUWw5PcdgrcT7hsUjsSkijfrvKka1bJzNw): protocol: expected piece hash; context canceled; EOF Aug 11 16:52:02.990176205 (71h25m57.421256346s) [seg_pos={0 0}, upload=74451]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 16:52:02.990294881 (71h25m57.421375022s) [upload=74451]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 16:52:02.990301134 (71h25m57.421381275s) [upload=74451]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 16:52:03.289620958 (71h25m57.720701089s) [upload=74451]: Done uploading segments... Aug 11 16:52:03.289639453 (71h25m57.720719574s) [upload=74451]: Upload finished. err: <nil> Duration: 5.890042246s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.....X...............................X........X.............] duration: 1.874580091s FAIL (2025-08-11 16:54:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 7ca3b38f59bef6700c47a71c0ce137786b019861ef4e351f330d4f1e41b86704 != before b8ccbd272fe59726b04686e0542c1e0964e89942b662558e091433dc0e7e3dc5 ======LOGS====== Aug 11 16:46:39.434150567 (71h20m33.865230698s) [upload=74358]: Starting upload Aug 11 16:46:39.434202827 (71h20m33.865282958s) [upload=74358]: Done starting upload Aug 11 16:46:39.434253474 (71h20m33.865333605s) [upload=74358]: Uploading segments... Aug 11 16:46:39.434289643 (71h20m33.865369774s) [upload=74358]: Got next segment. Inline: true Aug 11 16:46:39.434293440 (71h20m33.865373561s) [upload=74358]: Waiting for error group managing segments... Aug 11 16:46:39.434326714 (71h20m33.865406845s) [upload=74358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 16:46:39.434330481 (71h20m33.865410612s) [upload=74358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 16:46:39.434332896 (71h20m33.865413017s) [upload=74358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 16:46:39.727280447 (71h20m34.158360588s) [upload=74358]: Done uploading segments... Aug 11 16:46:39.727301838 (71h20m34.158381969s) [upload=74358]: Upload finished. err: <nil> Duration:* 1.874609046s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 6.155175391s FAIL (2025-08-11 16:54:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 11 16:20:42.438359750 (70h54m36.869439881s) [upload=73915]: Starting upload Aug 11 16:20:42.438414104 (70h54m36.869494225s) [upload=73915]: Done starting upload Aug 11 16:20:42.438489136 (70h54m36.869569267s) [upload=73915]: Uploading segments... Aug 11 16:20:42.438621770 (70h54m36.869701891s) [upload=73915]: Got next segment. Inline: false Aug 11 16:20:42.438664713 (70h54m36.869744844s) [upload=73915]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 16:20:42.438669001 (70h54m36.869749132s) [upload=73915]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 16:20:42.676790711 (70h54m37.107870842s) [seg_pos={0 0}, upload=73915]: Begin upload segment... Aug 11 16:20:42.676835908 (70h54m37.107916039s) [seg_pos={0 0}, upload=73915]: Done begin upload segment. Aug 11 16:20:42.676853832 (70h54m37.107933964s) [noise=true , address=77.90.31.14:4663 , piece_id=I5W3UOQI6RQFDF2A5NGYG7GUXBP2XE3N6LCTBVHAXPEWBMVSV26Q, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.676866747 (70h54m37.107946878s) [noise=true , address=104.36.82.10:4079 , piece_id=CYHDYCMVCYISFUDJOXGK2RCJVPRBZXXBAX3ICDJTH4OUPTQL6RMA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.676910421 (70h54m37.107990552s) [noise=true , address=77.90.31.11:4555 , piece_id=42V6RDCOSJRZYHIH7AUYX35F7GRXVZRHRUNBTI3ZDDQSVK2IYBAA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.676958241 (70h54m37.108038383s) [noise=true , address=45.91.116.13:4153 , piece_id=6FFUWDJYTJPUBXGHDGREUB4OM4DGX6COJTXHFWHLGW7QK3CO2JDA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.677329863 (70h54m37.108409994s) [noise=true , address=45.91.116.6:4974 , piece_id=GUI4A3KX4FASSTLQDMD4PHG75FQZRZEZCWNIMLWEJBBHQ5IH6SIA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.677368517 (70h54m37.108448648s) [noise=true , address=45.91.116.10:4083 , piece_id=ACEAUOZZCKIA4LTESFID3ZWUKFVTJACUI6VB327RTMHJLTPZBYGQ, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.677671015 (70h54m37.108751146s) [noise=true , address=77.90.31.17:4771 , piece_id=4Y664XUE5YWHPNAWUYSZ4BPISRV5YM5IGV4VK53RCPFZYEEBOKIQ, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678009293 (70h54m37.109089424s) [noise=true , address=45.91.116.7:4010 , piece_id=I5FZKKDZEIJAEBGXVY5E4PSKY2XN6FFB6YJI7CTWGTS63FVWC77A, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678247930 (70h54m37.109328061s) [noise=true , address=77.90.31.19:4843 , piece_id=NZ6GA4W7S4VGYLD5TBIOVCTFSBODMTOQY7SBY5OB2XWE766R2B3A, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678532164 (70h54m37.109612285s) [noise=true , address=45.91.116.12:4227 , piece_id=C5NVQ4KJ4UVIIXGUUXYLYGZ6T3TVKESSRQX7KSYQZ7O5PYUS3XVA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678765730 (70h54m37.109845861s) [noise=true , address=104.36.82.12:4151 , piece_id=QUY4X3H5VQPZXZ4JCHFKXLUETZXOBEN34KO7YZEMVYQEVGKR5ZZA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678993456 (70h54m37.110073587s) [noise=true , address=45.91.116.13:4155 , piece_id=YTXBYJIN6WYX2LBRDYH7YU55DKC7ZLLECK3HI22IKBWFRT6ZHTIA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679139145 (70h54m37.110219266s) [noise=true , address=45.91.116.4:4939 , piece_id=D3TLK6SUW4O7UUZVU6PADTAGQZ6SJHYAXYG2UULS7VZNMZ5YSOIA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679376159 (70h54m37.11045629s) [noise=true , address=45.91.116.5:4298 , piece_id=QYRZXB5RPTYY3Y54CVYQA76YEOHCKIPOMOP36Z2W6PSF35JDULFA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679589166 (70h54m37.110669297s) [noise=true , address=104.36.82.5:4839 , piece_id=56H4YACEHZNRC4IGN6LQ2OHVYAL6DFVJ3E5XKXUMAWHO6UCMICGA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679786334 (70h54m37.110866465s) [noise=true , address=77.90.31.18:4807 , piece_id=JZTPSUJQ7H7AAQC2JQLY37UM2ZPSCFVYDNOG7RSCJ6SPTWCVVPLA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:44.458058779 (70h54m38.88913891s) [upload=73915]: Next returned nil segment Aug 11 16:20:44.458076964 (70h54m38.889157095s) [upload=73915]: Waiting for error group managing segments... Aug 11 16:20:44.762791322 (70h54m39.193871453s) [noise=true , address=45.91.116.7:4010 , piece_id=I5FZKKDZEIJAEBGXVY5E4PSKY2XN6FFB6YJI7CTWGTS63FVWC77A, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.819598246 (70h54m39.250678377s) [noise=true , address=45.91.116.4:4939 , piece_id=D3TLK6SUW4O7UUZVU6PADTAGQZ6SJHYAXYG2UULS7VZNMZ5YSOIA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.877739022 (70h54m39.308819143s) [noise=true , address=77.90.31.11:4555 , piece_id=42V6RDCOSJRZYHIH7AUYX35F7GRXVZRHRUNBTI3ZDDQSVK2IYBAA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.936181786 (70h54m39.367261918s) [noise=true , address=45.91.116.10:4083 , piece_id=ACEAUOZZCKIA4LTESFID3ZWUKFVTJACUI6VB327RTMHJLTPZBYGQ, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.937836643 (70h54m39.368916774s) [noise=true , address=77.90.31.18:4807 , piece_id=JZTPSUJQ7H7AAQC2JQLY37UM2ZPSCFVYDNOG7RSCJ6SPTWCVVPLA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.939510475 (70h54m39.370590596s) [noise=true , address=77.90.31.17:4771 , piece_id=4Y664XUE5YWHPNAWUYSZ4BPISRV5YM5IGV4VK53RCPFZYEEBOKIQ, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.944277246 (70h54m39.375357377s) [noise=true , address=104.36.82.12:4151 , piece_id=QUY4X3H5VQPZXZ4JCHFKXLUETZXOBEN34KO7YZEMVYQEVGKR5ZZA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.945075824 (70h54m39.376155955s) [noise=true , address=45.91.116.13:4155 , piece_id=YTXBYJIN6WYX2LBRDYH7YU55DKC7ZLLECK3HI22IKBWFRT6ZHTIA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.006188045 (70h54m39.437268176s) [noise=true , address=45.91.116.5:4298 , piece_id=QYRZXB5RPTYY3Y54CVYQA76YEOHCKIPOMOP36Z2W6PSF35JDULFA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.042863199 (70h54m39.47394333s) [noise=true , address=77.90.31.14:4663 , piece_id=I5W3UOQI6RQFDF2A5NGYG7GUXBP2XE3N6LCTBVHAXPEWBMVSV26Q, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.048316484 (70h54m39.479396645s) [noise=true , address=77.90.31.19:4843 , piece_id=NZ6GA4W7S4VGYLD5TBIOVCTFSBODMTOQY7SBY5OB2XWE766R2B3A, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.054276718 (70h54m39.485356839s) [noise=true , address=45.91.116.12:4227 , piece_id=C5NVQ4KJ4UVIIXGUUXYLYGZ6T3TVKESSRQX7KSYQZ7O5PYUS3XVA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.056028469 (70h54m39.487108601s) [noise=true , address=45.91.116.13:4153 , piece_id=6FFUWDJYTJPUBXGHDGREUB4OM4DGX6COJTXHFWHLGW7QK3CO2JDA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.056044611 (70h54m39.487124732s) [seg_pos={0 0}, upload=73915]: Segment reached optimal threshold of 13 pieces. Aug 11 16:20:45.056165442 (70h54m39.487245573s) [noise=true , address=45.91.116.6:4974 , piece_id=GUI4A3KX4FASSTLQDMD4PHG75FQZRZEZCWNIMLWEJBBHQ5IH6SIA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Aug 11 16:20:45.056214636 (70h54m39.487294767s) [noise=true , address=104.36.82.10:4079 , piece_id=CYHDYCMVCYISFUDJOXGK2RCJVPRBZXXBAX3ICDJTH4OUPTQL6RMA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 11 16:20:45.056367308 (70h54m39.48744744s) [noise=true , address=104.36.82.5:4839 , piece_id=56H4YACEHZNRC4IGN6LQ2OHVYAL6DFVJ3E5XKXUMAWHO6UCMICGA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:33142->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:33142->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33142->104.36.82.5:4839: use of closed network connection Aug 11 16:20:45.056394020 (70h54m39.487474151s) [seg_pos={0 0}, upload=73915]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 11 16:20:45.056469904 (70h54m39.487550035s) [upload=73915]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 16:20:45.056474313 (70h54m39.487554444s) [upload=73915]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 16:20:45.348914657 (70h54m39.779994788s) [upload=73915]: Done uploading segments... Aug 11 16:20:45.348932771 (70h54m39.780012902s) [upload=73915]: Upload finished. err: <nil> Duration: 6.155201691s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..................................X.................X..X....] duration: 5.627355934s FAIL (2025-08-11 16:54:38 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 057e70622624edd53b9fc51be4b79f2d44d3edfaab7771732fcead8b398b45cf != before 5fa63a3b4367a71718c58f2a9dea4bd743ced7ab5179088fd28949f3defb0b49 ======LOGS====== Aug 11 16:52:00.486330505 (71h25m54.917410636s) [upload=74451]: Starting upload Aug 11 16:52:00.486377434 (71h25m54.917457565s) [upload=74451]: Done starting upload Aug 11 16:52:00.486467226 (71h25m54.917547357s) [upload=74451]: Uploading segments... Aug 11 16:52:00.486565484 (71h25m54.917645615s) [upload=74451]: Got next segment. Inline: false Aug 11 16:52:00.486611342 (71h25m54.917691463s) [upload=74451]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 16:52:00.486615960 (71h25m54.917696091s) [upload=74451]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 16:52:00.936658896 (71h25m55.367739027s) [seg_pos={0 0}, upload=74451]: Begin upload segment... Aug 11 16:52:00.936704133 (71h25m55.367784264s) [seg_pos={0 0}, upload=74451]: Done begin upload segment. Aug 11 16:52:00.936723960 (71h25m55.367804091s) [noise=true , address=104.36.82.9:4018 , piece_id=NBU72ROM7RHSITJ7D7CZJMTG3IR2Y5PU3SIXECRQ6FZHE3BT6DRA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.936760270 (71h25m55.367840401s) [noise=true , address=104.36.82.34:4575 , piece_id=YBYWB3OKPOVXOMX4YTV2R4OKMPCKVPKGAORDS2JBYG66D6UCTA4A, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.937115760 (71h25m55.368195891s) [noise=true , address=104.36.82.38:4701 , piece_id=J4HDMCTPA4XS7DWE5LGJRVYMLR7BYPVHDAMWWGBW5YVJF236VK4Q, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.937240989 (71h25m55.368321121s) [noise=true , address=77.90.31.17:4791 , piece_id=X5DIN2SDWPH4EKQPOBZFINYODZ2AU46ZEIULAPHWDOMSESRXCGUA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.937385226 (71h25m55.368465357s) [noise=true , address=104.36.82.5:4843 , piece_id=XJH5W64QKAIEMSJ7WPDZRWG5GK2S56664IQDPUPW52CBEAT4MASA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.937648880 (71h25m55.368729011s) [noise=true , address=104.36.82.20:4440 , piece_id=2YLIUD4JWKADFVQ73AFWOYFZWRLAKUQ423WM4X5K56W7UOY6XUIA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.937939637 (71h25m55.369019768s) [noise=true , address=104.36.82.16:4312 , piece_id=GUEBWOWC56BV4WHI3HUHNNMOZJ54HZJRO4JLQNTMOJ76H6E3FMSQ, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.938208932 (71h25m55.369289063s) [noise=true , address=79.127.219.48:4086 , piece_id=BIIPBGT2VPPMNHLEHIMBWR4QU4RFB5GG3FU2XJAGQMIR4GSUVSPQ, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.938479660 (71h25m55.369559781s) [noise=true , address=79.127.219.38:4022 , piece_id=RBHTYSRKVYXZA5G4XEVYKVE7DV7V67WSUTH56MKTEIDUGRMXGREQ, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.938700222 (71h25m55.369780353s) [noise=true , address=79.127.220.98:4423 , piece_id=GRPLJQ3CSTHWJVXE7EUROVFV5JPIHVKYIUKFUR5HUYWEOWOIAQ5A, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.938911195 (71h25m55.369991326s) [noise=true , address=77.90.31.15:4732 , piece_id=JHKT2MSCWGGQF2Y2CTQZRGLPWELEGUWDA35CHK4KTGRNI2HNQZBA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.938988644 (71h25m55.370068775s) [noise=true , address=104.36.82.61:4378 , piece_id=ITY2O2P6SFXLNXJWJ4G56X26YJPGOJ4UATMPHYVCXFLEKVNMUKMA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.939229625 (71h25m55.370309756s) [noise=true , address=79.127.220.101:4074 , piece_id=JFTUZQVWSA32A33LCPSFPLBFRTOR6XT4M62XUI752T6CEM55EZQQ, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.939450798 (71h25m55.370530929s) [noise=true , address=104.36.82.59:4306 , piece_id=KNA553JSWSIB3D7EL62I576OQCRPFFJP7E4UL3D3I4MNVRIANVPA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.939676660 (71h25m55.370756791s) [noise=true , address=104.36.82.47:4533 , piece_id=FR55EWHLGG7DLRGUAIJCA56TQ7RPKDBQLGX33K6FHCWYV462WKJQ, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.939888225 (71h25m55.370968346s) [noise=true , address=104.36.82.62:4438 , piece_id=IXFU2VVB6LBSY523KZD4CPL5C5II7MOC7ZRVJCXTZ7DKWCWXEYBA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.940116682 (71h25m55.371196813s) [noise=true , address=104.36.82.45:4915 , piece_id=BEUVRN2GXXIR2XQXDBHIVNYZE7RIJ3EHIQSHMZYEPFUQNXALRTXA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.940314681 (71h25m55.371394812s) [noise=true , address=104.36.82.4:4809 , piece_id=3QKBP7QTZQBWTJ7PFMR7Z4GNKRJ3MLWTUVTZE7RS3AI33HNW7XBA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:02.407046143 (71h25m56.838126274s) [upload=74451]: Next returned nil segment Aug 11 16:52:02.407066482 (71h25m56.838146613s) [upload=74451]: Waiting for error group managing segments... Aug 11 16:52:02.784099481 (71h25m57.215179612s) [noise=true , address=79.127.220.98:4423 , piece_id=GRPLJQ3CSTHWJVXE7EUROVFV5JPIHVKYIUKFUR5HUYWEOWOIAQ5A, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.799355832 (71h25m57.230435963s) [noise=true , address=79.127.220.101:4074 , piece_id=JFTUZQVWSA32A33LCPSFPLBFRTOR6XT4M62XUI752T6CEM55EZQQ, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.824743848 (71h25m57.255823979s) [noise=true , address=79.127.219.48:4086 , piece_id=BIIPBGT2VPPMNHLEHIMBWR4QU4RFB5GG3FU2XJAGQMIR4GSUVSPQ, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.856539797 (71h25m57.287619928s) [noise=true , address=79.127.219.38:4022 , piece_id=RBHTYSRKVYXZA5G4XEVYKVE7DV7V67WSUTH56MKTEIDUGRMXGREQ, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.892199348 (71h25m57.323279499s) [noise=true , address=104.36.82.34:4575 , piece_id=YBYWB3OKPOVXOMX4YTV2R4OKMPCKVPKGAORDS2JBYG66D6UCTA4A, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.900582107 (71h25m57.331662238s) [noise=true , address=104.36.82.38:4701 , piece_id=J4HDMCTPA4XS7DWE5LGJRVYMLR7BYPVHDAMWWGBW5YVJF236VK4Q, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.901661613 (71h25m57.332741744s) [noise=true , address=77.90.31.17:4791 , piece_id=X5DIN2SDWPH4EKQPOBZFINYODZ2AU46ZEIULAPHWDOMSESRXCGUA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.924967335 (71h25m57.356047466s) [noise=true , address=104.36.82.4:4809 , piece_id=3QKBP7QTZQBWTJ7PFMR7Z4GNKRJ3MLWTUVTZE7RS3AI33HNW7XBA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.934432455 (71h25m57.365512586s) [noise=true , address=104.36.82.5:4843 , piece_id=XJH5W64QKAIEMSJ7WPDZRWG5GK2S56664IQDPUPW52CBEAT4MASA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.944250341 (71h25m57.375330472s) [noise=true , address=104.36.82.16:4312 , piece_id=GUEBWOWC56BV4WHI3HUHNNMOZJ54HZJRO4JLQNTMOJ76H6E3FMSQ, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.959326207 (71h25m57.390406338s) [noise=true , address=104.36.82.47:4533 , piece_id=FR55EWHLGG7DLRGUAIJCA56TQ7RPKDBQLGX33K6FHCWYV462WKJQ, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.965101627 (71h25m57.396181758s) [noise=true , address=104.36.82.9:4018 , piece_id=NBU72ROM7RHSITJ7D7CZJMTG3IR2Y5PU3SIXECRQ6FZHE3BT6DRA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.975109015 (71h25m57.406189147s) [noise=true , address=104.36.82.20:4440 , piece_id=2YLIUD4JWKADFVQ73AFWOYFZWRLAKUQ423WM4X5K56W7UOY6XUIA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.989812008 (71h25m57.420892139s) [noise=true , address=104.36.82.62:4438 , piece_id=IXFU2VVB6LBSY523KZD4CPL5C5II7MOC7ZRVJCXTZ7DKWCWXEYBA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.989838749 (71h25m57.42091887s) [seg_pos={0 0}, upload=74451]: Segment reached optimal threshold of 14 pieces. Aug 11 16:52:02.989941887 (71h25m57.421022018s) [noise=true , address=104.36.82.45:4915 , piece_id=BEUVRN2GXXIR2XQXDBHIVNYZE7RIJ3EHIQSHMZYEPFUQNXALRTXA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17rmsv4edxH6jmsN83ceiVJdfEui1qrBK5XBcf7GgvKCn2fknT): protocol: expected piece hash; context canceled; EOF Aug 11 16:52:02.990013944 (71h25m57.421094065s) [noise=true , address=104.36.82.61:4378 , piece_id=ITY2O2P6SFXLNXJWJ4G56X26YJPGOJ4UATMPHYVCXFLEKVNMUKMA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DcpXz1fKrWhdPxTpGUFmydMUuzMQpNFMgGB75BAVrjdMiSkhW): protocol: expected piece hash; context canceled; EOF Aug 11 16:52:02.990088507 (71h25m57.421168638s) [noise=true , address=77.90.31.15:4732 , piece_id=JHKT2MSCWGGQF2Y2CTQZRGLPWELEGUWDA35CHK4KTGRNI2HNQZBA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NyFYdUBbAhAijCDtPWB1zJCjwhgw35vEQoE4qJyg2PywRn5AH): protocol: expected piece hash; context canceled; EOF Aug 11 16:52:02.990112323 (71h25m57.421192454s) [noise=true , address=104.36.82.59:4306 , piece_id=KNA553JSWSIB3D7EL62I576OQCRPFFJP7E4UL3D3I4MNVRIANVPA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12amBPo7WKpjPDzi6mUWw5PcdgrcT7hsUjsSkijfrvKka1bJzNw): protocol: expected piece hash; context canceled; EOF Aug 11 16:52:02.990176205 (71h25m57.421256346s) [seg_pos={0 0}, upload=74451]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 16:52:02.990294881 (71h25m57.421375022s) [upload=74451]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 16:52:02.990301134 (71h25m57.421381275s) [upload=74451]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 16:52:03.289620958 (71h25m57.720701089s) [upload=74451]: Done uploading segments... Aug 11 16:52:03.289639453 (71h25m57.720719574s) [upload=74451]: Upload finished. err: <nil> Duration: 5.627377646s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [......X...............................X........X............] duration: 1.99343667s FAIL (2025-08-11 16:54:21 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 7ca3b38f59bef6700c47a71c0ce137786b019861ef4e351f330d4f1e41b86704 != before b8ccbd272fe59726b04686e0542c1e0964e89942b662558e091433dc0e7e3dc5 ======LOGS====== Aug 11 16:46:39.434150567 (71h20m33.865230698s) [upload=74358]: Starting upload Aug 11 16:46:39.434202827 (71h20m33.865282958s) [upload=74358]: Done starting upload Aug 11 16:46:39.434253474 (71h20m33.865333605s) [upload=74358]: Uploading segments... Aug 11 16:46:39.434289643 (71h20m33.865369774s) [upload=74358]: Got next segment. Inline: true Aug 11 16:46:39.434293440 (71h20m33.865373561s) [upload=74358]: Waiting for error group managing segments... Aug 11 16:46:39.434326714 (71h20m33.865406845s) [upload=74358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 16:46:39.434330481 (71h20m33.865410612s) [upload=74358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 16:46:39.434332896 (71h20m33.865413017s) [upload=74358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 16:46:39.727280447 (71h20m34.158360588s) [upload=74358]: Done uploading segments... Aug 11 16:46:39.727301838 (71h20m34.158381969s) [upload=74358]: Upload finished. err: <nil> Duration:* 1.993457041s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...................................X.................X..X...] duration: 6.094735051s FAIL (2025-08-11 16:54:05 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 057e70622624edd53b9fc51be4b79f2d44d3edfaab7771732fcead8b398b45cf != before 5fa63a3b4367a71718c58f2a9dea4bd743ced7ab5179088fd28949f3defb0b49 ======LOGS====== Aug 11 16:52:00.486330505 (71h25m54.917410636s) [upload=74451]: Starting upload Aug 11 16:52:00.486377434 (71h25m54.917457565s) [upload=74451]: Done starting upload Aug 11 16:52:00.486467226 (71h25m54.917547357s) [upload=74451]: Uploading segments... Aug 11 16:52:00.486565484 (71h25m54.917645615s) [upload=74451]: Got next segment. Inline: false Aug 11 16:52:00.486611342 (71h25m54.917691463s) [upload=74451]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 16:52:00.486615960 (71h25m54.917696091s) [upload=74451]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 16:52:00.936658896 (71h25m55.367739027s) [seg_pos={0 0}, upload=74451]: Begin upload segment... Aug 11 16:52:00.936704133 (71h25m55.367784264s) [seg_pos={0 0}, upload=74451]: Done begin upload segment. Aug 11 16:52:00.936723960 (71h25m55.367804091s) [noise=true , address=104.36.82.9:4018 , piece_id=NBU72ROM7RHSITJ7D7CZJMTG3IR2Y5PU3SIXECRQ6FZHE3BT6DRA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.936760270 (71h25m55.367840401s) [noise=true , address=104.36.82.34:4575 , piece_id=YBYWB3OKPOVXOMX4YTV2R4OKMPCKVPKGAORDS2JBYG66D6UCTA4A, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.937115760 (71h25m55.368195891s) [noise=true , address=104.36.82.38:4701 , piece_id=J4HDMCTPA4XS7DWE5LGJRVYMLR7BYPVHDAMWWGBW5YVJF236VK4Q, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.937240989 (71h25m55.368321121s) [noise=true , address=77.90.31.17:4791 , piece_id=X5DIN2SDWPH4EKQPOBZFINYODZ2AU46ZEIULAPHWDOMSESRXCGUA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.937385226 (71h25m55.368465357s) [noise=true , address=104.36.82.5:4843 , piece_id=XJH5W64QKAIEMSJ7WPDZRWG5GK2S56664IQDPUPW52CBEAT4MASA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.937648880 (71h25m55.368729011s) [noise=true , address=104.36.82.20:4440 , piece_id=2YLIUD4JWKADFVQ73AFWOYFZWRLAKUQ423WM4X5K56W7UOY6XUIA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.937939637 (71h25m55.369019768s) [noise=true , address=104.36.82.16:4312 , piece_id=GUEBWOWC56BV4WHI3HUHNNMOZJ54HZJRO4JLQNTMOJ76H6E3FMSQ, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.938208932 (71h25m55.369289063s) [noise=true , address=79.127.219.48:4086 , piece_id=BIIPBGT2VPPMNHLEHIMBWR4QU4RFB5GG3FU2XJAGQMIR4GSUVSPQ, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.938479660 (71h25m55.369559781s) [noise=true , address=79.127.219.38:4022 , piece_id=RBHTYSRKVYXZA5G4XEVYKVE7DV7V67WSUTH56MKTEIDUGRMXGREQ, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.938700222 (71h25m55.369780353s) [noise=true , address=79.127.220.98:4423 , piece_id=GRPLJQ3CSTHWJVXE7EUROVFV5JPIHVKYIUKFUR5HUYWEOWOIAQ5A, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.938911195 (71h25m55.369991326s) [noise=true , address=77.90.31.15:4732 , piece_id=JHKT2MSCWGGQF2Y2CTQZRGLPWELEGUWDA35CHK4KTGRNI2HNQZBA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.938988644 (71h25m55.370068775s) [noise=true , address=104.36.82.61:4378 , piece_id=ITY2O2P6SFXLNXJWJ4G56X26YJPGOJ4UATMPHYVCXFLEKVNMUKMA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.939229625 (71h25m55.370309756s) [noise=true , address=79.127.220.101:4074 , piece_id=JFTUZQVWSA32A33LCPSFPLBFRTOR6XT4M62XUI752T6CEM55EZQQ, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.939450798 (71h25m55.370530929s) [noise=true , address=104.36.82.59:4306 , piece_id=KNA553JSWSIB3D7EL62I576OQCRPFFJP7E4UL3D3I4MNVRIANVPA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.939676660 (71h25m55.370756791s) [noise=true , address=104.36.82.47:4533 , piece_id=FR55EWHLGG7DLRGUAIJCA56TQ7RPKDBQLGX33K6FHCWYV462WKJQ, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.939888225 (71h25m55.370968346s) [noise=true , address=104.36.82.62:4438 , piece_id=IXFU2VVB6LBSY523KZD4CPL5C5II7MOC7ZRVJCXTZ7DKWCWXEYBA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.940116682 (71h25m55.371196813s) [noise=true , address=104.36.82.45:4915 , piece_id=BEUVRN2GXXIR2XQXDBHIVNYZE7RIJ3EHIQSHMZYEPFUQNXALRTXA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.940314681 (71h25m55.371394812s) [noise=true , address=104.36.82.4:4809 , piece_id=3QKBP7QTZQBWTJ7PFMR7Z4GNKRJ3MLWTUVTZE7RS3AI33HNW7XBA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:02.407046143 (71h25m56.838126274s) [upload=74451]: Next returned nil segment Aug 11 16:52:02.407066482 (71h25m56.838146613s) [upload=74451]: Waiting for error group managing segments... Aug 11 16:52:02.784099481 (71h25m57.215179612s) [noise=true , address=79.127.220.98:4423 , piece_id=GRPLJQ3CSTHWJVXE7EUROVFV5JPIHVKYIUKFUR5HUYWEOWOIAQ5A, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.799355832 (71h25m57.230435963s) [noise=true , address=79.127.220.101:4074 , piece_id=JFTUZQVWSA32A33LCPSFPLBFRTOR6XT4M62XUI752T6CEM55EZQQ, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.824743848 (71h25m57.255823979s) [noise=true , address=79.127.219.48:4086 , piece_id=BIIPBGT2VPPMNHLEHIMBWR4QU4RFB5GG3FU2XJAGQMIR4GSUVSPQ, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.856539797 (71h25m57.287619928s) [noise=true , address=79.127.219.38:4022 , piece_id=RBHTYSRKVYXZA5G4XEVYKVE7DV7V67WSUTH56MKTEIDUGRMXGREQ, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.892199348 (71h25m57.323279499s) [noise=true , address=104.36.82.34:4575 , piece_id=YBYWB3OKPOVXOMX4YTV2R4OKMPCKVPKGAORDS2JBYG66D6UCTA4A, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.900582107 (71h25m57.331662238s) [noise=true , address=104.36.82.38:4701 , piece_id=J4HDMCTPA4XS7DWE5LGJRVYMLR7BYPVHDAMWWGBW5YVJF236VK4Q, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.901661613 (71h25m57.332741744s) [noise=true , address=77.90.31.17:4791 , piece_id=X5DIN2SDWPH4EKQPOBZFINYODZ2AU46ZEIULAPHWDOMSESRXCGUA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.924967335 (71h25m57.356047466s) [noise=true , address=104.36.82.4:4809 , piece_id=3QKBP7QTZQBWTJ7PFMR7Z4GNKRJ3MLWTUVTZE7RS3AI33HNW7XBA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.934432455 (71h25m57.365512586s) [noise=true , address=104.36.82.5:4843 , piece_id=XJH5W64QKAIEMSJ7WPDZRWG5GK2S56664IQDPUPW52CBEAT4MASA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.944250341 (71h25m57.375330472s) [noise=true , address=104.36.82.16:4312 , piece_id=GUEBWOWC56BV4WHI3HUHNNMOZJ54HZJRO4JLQNTMOJ76H6E3FMSQ, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.959326207 (71h25m57.390406338s) [noise=true , address=104.36.82.47:4533 , piece_id=FR55EWHLGG7DLRGUAIJCA56TQ7RPKDBQLGX33K6FHCWYV462WKJQ, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.965101627 (71h25m57.396181758s) [noise=true , address=104.36.82.9:4018 , piece_id=NBU72ROM7RHSITJ7D7CZJMTG3IR2Y5PU3SIXECRQ6FZHE3BT6DRA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.975109015 (71h25m57.406189147s) [noise=true , address=104.36.82.20:4440 , piece_id=2YLIUD4JWKADFVQ73AFWOYFZWRLAKUQ423WM4X5K56W7UOY6XUIA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.989812008 (71h25m57.420892139s) [noise=true , address=104.36.82.62:4438 , piece_id=IXFU2VVB6LBSY523KZD4CPL5C5II7MOC7ZRVJCXTZ7DKWCWXEYBA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.989838749 (71h25m57.42091887s) [seg_pos={0 0}, upload=74451]: Segment reached optimal threshold of 14 pieces. Aug 11 16:52:02.989941887 (71h25m57.421022018s) [noise=true , address=104.36.82.45:4915 , piece_id=BEUVRN2GXXIR2XQXDBHIVNYZE7RIJ3EHIQSHMZYEPFUQNXALRTXA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17rmsv4edxH6jmsN83ceiVJdfEui1qrBK5XBcf7GgvKCn2fknT): protocol: expected piece hash; context canceled; EOF Aug 11 16:52:02.990013944 (71h25m57.421094065s) [noise=true , address=104.36.82.61:4378 , piece_id=ITY2O2P6SFXLNXJWJ4G56X26YJPGOJ4UATMPHYVCXFLEKVNMUKMA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DcpXz1fKrWhdPxTpGUFmydMUuzMQpNFMgGB75BAVrjdMiSkhW): protocol: expected piece hash; context canceled; EOF Aug 11 16:52:02.990088507 (71h25m57.421168638s) [noise=true , address=77.90.31.15:4732 , piece_id=JHKT2MSCWGGQF2Y2CTQZRGLPWELEGUWDA35CHK4KTGRNI2HNQZBA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NyFYdUBbAhAijCDtPWB1zJCjwhgw35vEQoE4qJyg2PywRn5AH): protocol: expected piece hash; context canceled; EOF Aug 11 16:52:02.990112323 (71h25m57.421192454s) [noise=true , address=104.36.82.59:4306 , piece_id=KNA553JSWSIB3D7EL62I576OQCRPFFJP7E4UL3D3I4MNVRIANVPA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12amBPo7WKpjPDzi6mUWw5PcdgrcT7hsUjsSkijfrvKka1bJzNw): protocol: expected piece hash; context canceled; EOF Aug 11 16:52:02.990176205 (71h25m57.421256346s) [seg_pos={0 0}, upload=74451]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 16:52:02.990294881 (71h25m57.421375022s) [upload=74451]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 16:52:02.990301134 (71h25m57.421381275s) [upload=74451]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 16:52:03.289620958 (71h25m57.720701089s) [upload=74451]: Done uploading segments... Aug 11 16:52:03.289639453 (71h25m57.720719574s) [upload=74451]: Upload finished. err: <nil> Duration: 6.094767554s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 5.914539042s FAIL (2025-08-11 16:53:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 11 16:20:42.438359750 (70h54m36.869439881s) [upload=73915]: Starting upload Aug 11 16:20:42.438414104 (70h54m36.869494225s) [upload=73915]: Done starting upload Aug 11 16:20:42.438489136 (70h54m36.869569267s) [upload=73915]: Uploading segments... Aug 11 16:20:42.438621770 (70h54m36.869701891s) [upload=73915]: Got next segment. Inline: false Aug 11 16:20:42.438664713 (70h54m36.869744844s) [upload=73915]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 16:20:42.438669001 (70h54m36.869749132s) [upload=73915]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 16:20:42.676790711 (70h54m37.107870842s) [seg_pos={0 0}, upload=73915]: Begin upload segment... Aug 11 16:20:42.676835908 (70h54m37.107916039s) [seg_pos={0 0}, upload=73915]: Done begin upload segment. Aug 11 16:20:42.676853832 (70h54m37.107933964s) [noise=true , address=77.90.31.14:4663 , piece_id=I5W3UOQI6RQFDF2A5NGYG7GUXBP2XE3N6LCTBVHAXPEWBMVSV26Q, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.676866747 (70h54m37.107946878s) [noise=true , address=104.36.82.10:4079 , piece_id=CYHDYCMVCYISFUDJOXGK2RCJVPRBZXXBAX3ICDJTH4OUPTQL6RMA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.676910421 (70h54m37.107990552s) [noise=true , address=77.90.31.11:4555 , piece_id=42V6RDCOSJRZYHIH7AUYX35F7GRXVZRHRUNBTI3ZDDQSVK2IYBAA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.676958241 (70h54m37.108038383s) [noise=true , address=45.91.116.13:4153 , piece_id=6FFUWDJYTJPUBXGHDGREUB4OM4DGX6COJTXHFWHLGW7QK3CO2JDA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.677329863 (70h54m37.108409994s) [noise=true , address=45.91.116.6:4974 , piece_id=GUI4A3KX4FASSTLQDMD4PHG75FQZRZEZCWNIMLWEJBBHQ5IH6SIA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.677368517 (70h54m37.108448648s) [noise=true , address=45.91.116.10:4083 , piece_id=ACEAUOZZCKIA4LTESFID3ZWUKFVTJACUI6VB327RTMHJLTPZBYGQ, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.677671015 (70h54m37.108751146s) [noise=true , address=77.90.31.17:4771 , piece_id=4Y664XUE5YWHPNAWUYSZ4BPISRV5YM5IGV4VK53RCPFZYEEBOKIQ, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678009293 (70h54m37.109089424s) [noise=true , address=45.91.116.7:4010 , piece_id=I5FZKKDZEIJAEBGXVY5E4PSKY2XN6FFB6YJI7CTWGTS63FVWC77A, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678247930 (70h54m37.109328061s) [noise=true , address=77.90.31.19:4843 , piece_id=NZ6GA4W7S4VGYLD5TBIOVCTFSBODMTOQY7SBY5OB2XWE766R2B3A, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678532164 (70h54m37.109612285s) [noise=true , address=45.91.116.12:4227 , piece_id=C5NVQ4KJ4UVIIXGUUXYLYGZ6T3TVKESSRQX7KSYQZ7O5PYUS3XVA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678765730 (70h54m37.109845861s) [noise=true , address=104.36.82.12:4151 , piece_id=QUY4X3H5VQPZXZ4JCHFKXLUETZXOBEN34KO7YZEMVYQEVGKR5ZZA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678993456 (70h54m37.110073587s) [noise=true , address=45.91.116.13:4155 , piece_id=YTXBYJIN6WYX2LBRDYH7YU55DKC7ZLLECK3HI22IKBWFRT6ZHTIA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679139145 (70h54m37.110219266s) [noise=true , address=45.91.116.4:4939 , piece_id=D3TLK6SUW4O7UUZVU6PADTAGQZ6SJHYAXYG2UULS7VZNMZ5YSOIA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679376159 (70h54m37.11045629s) [noise=true , address=45.91.116.5:4298 , piece_id=QYRZXB5RPTYY3Y54CVYQA76YEOHCKIPOMOP36Z2W6PSF35JDULFA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679589166 (70h54m37.110669297s) [noise=true , address=104.36.82.5:4839 , piece_id=56H4YACEHZNRC4IGN6LQ2OHVYAL6DFVJ3E5XKXUMAWHO6UCMICGA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679786334 (70h54m37.110866465s) [noise=true , address=77.90.31.18:4807 , piece_id=JZTPSUJQ7H7AAQC2JQLY37UM2ZPSCFVYDNOG7RSCJ6SPTWCVVPLA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:44.458058779 (70h54m38.88913891s) [upload=73915]: Next returned nil segment Aug 11 16:20:44.458076964 (70h54m38.889157095s) [upload=73915]: Waiting for error group managing segments... Aug 11 16:20:44.762791322 (70h54m39.193871453s) [noise=true , address=45.91.116.7:4010 , piece_id=I5FZKKDZEIJAEBGXVY5E4PSKY2XN6FFB6YJI7CTWGTS63FVWC77A, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.819598246 (70h54m39.250678377s) [noise=true , address=45.91.116.4:4939 , piece_id=D3TLK6SUW4O7UUZVU6PADTAGQZ6SJHYAXYG2UULS7VZNMZ5YSOIA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.877739022 (70h54m39.308819143s) [noise=true , address=77.90.31.11:4555 , piece_id=42V6RDCOSJRZYHIH7AUYX35F7GRXVZRHRUNBTI3ZDDQSVK2IYBAA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.936181786 (70h54m39.367261918s) [noise=true , address=45.91.116.10:4083 , piece_id=ACEAUOZZCKIA4LTESFID3ZWUKFVTJACUI6VB327RTMHJLTPZBYGQ, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.937836643 (70h54m39.368916774s) [noise=true , address=77.90.31.18:4807 , piece_id=JZTPSUJQ7H7AAQC2JQLY37UM2ZPSCFVYDNOG7RSCJ6SPTWCVVPLA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.939510475 (70h54m39.370590596s) [noise=true , address=77.90.31.17:4771 , piece_id=4Y664XUE5YWHPNAWUYSZ4BPISRV5YM5IGV4VK53RCPFZYEEBOKIQ, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.944277246 (70h54m39.375357377s) [noise=true , address=104.36.82.12:4151 , piece_id=QUY4X3H5VQPZXZ4JCHFKXLUETZXOBEN34KO7YZEMVYQEVGKR5ZZA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.945075824 (70h54m39.376155955s) [noise=true , address=45.91.116.13:4155 , piece_id=YTXBYJIN6WYX2LBRDYH7YU55DKC7ZLLECK3HI22IKBWFRT6ZHTIA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.006188045 (70h54m39.437268176s) [noise=true , address=45.91.116.5:4298 , piece_id=QYRZXB5RPTYY3Y54CVYQA76YEOHCKIPOMOP36Z2W6PSF35JDULFA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.042863199 (70h54m39.47394333s) [noise=true , address=77.90.31.14:4663 , piece_id=I5W3UOQI6RQFDF2A5NGYG7GUXBP2XE3N6LCTBVHAXPEWBMVSV26Q, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.048316484 (70h54m39.479396645s) [noise=true , address=77.90.31.19:4843 , piece_id=NZ6GA4W7S4VGYLD5TBIOVCTFSBODMTOQY7SBY5OB2XWE766R2B3A, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.054276718 (70h54m39.485356839s) [noise=true , address=45.91.116.12:4227 , piece_id=C5NVQ4KJ4UVIIXGUUXYLYGZ6T3TVKESSRQX7KSYQZ7O5PYUS3XVA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.056028469 (70h54m39.487108601s) [noise=true , address=45.91.116.13:4153 , piece_id=6FFUWDJYTJPUBXGHDGREUB4OM4DGX6COJTXHFWHLGW7QK3CO2JDA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.056044611 (70h54m39.487124732s) [seg_pos={0 0}, upload=73915]: Segment reached optimal threshold of 13 pieces. Aug 11 16:20:45.056165442 (70h54m39.487245573s) [noise=true , address=45.91.116.6:4974 , piece_id=GUI4A3KX4FASSTLQDMD4PHG75FQZRZEZCWNIMLWEJBBHQ5IH6SIA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Aug 11 16:20:45.056214636 (70h54m39.487294767s) [noise=true , address=104.36.82.10:4079 , piece_id=CYHDYCMVCYISFUDJOXGK2RCJVPRBZXXBAX3ICDJTH4OUPTQL6RMA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 11 16:20:45.056367308 (70h54m39.48744744s) [noise=true , address=104.36.82.5:4839 , piece_id=56H4YACEHZNRC4IGN6LQ2OHVYAL6DFVJ3E5XKXUMAWHO6UCMICGA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:33142->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:33142->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33142->104.36.82.5:4839: use of closed network connection Aug 11 16:20:45.056394020 (70h54m39.487474151s) [seg_pos={0 0}, upload=73915]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 11 16:20:45.056469904 (70h54m39.487550035s) [upload=73915]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 16:20:45.056474313 (70h54m39.487554444s) [upload=73915]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 16:20:45.348914657 (70h54m39.779994788s) [upload=73915]: Done uploading segments... Aug 11 16:20:45.348932771 (70h54m39.780012902s) [upload=73915]: Upload finished. err: <nil> Duration: 5.914571795s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.......X...............................X........X...........] duration: 1.830218883s FAIL (2025-08-11 16:53:40 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 7ca3b38f59bef6700c47a71c0ce137786b019861ef4e351f330d4f1e41b86704 != before b8ccbd272fe59726b04686e0542c1e0964e89942b662558e091433dc0e7e3dc5 ======LOGS====== Aug 11 16:46:39.434150567 (71h20m33.865230698s) [upload=74358]: Starting upload Aug 11 16:46:39.434202827 (71h20m33.865282958s) [upload=74358]: Done starting upload Aug 11 16:46:39.434253474 (71h20m33.865333605s) [upload=74358]: Uploading segments... Aug 11 16:46:39.434289643 (71h20m33.865369774s) [upload=74358]: Got next segment. Inline: true Aug 11 16:46:39.434293440 (71h20m33.865373561s) [upload=74358]: Waiting for error group managing segments... Aug 11 16:46:39.434326714 (71h20m33.865406845s) [upload=74358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 16:46:39.434330481 (71h20m33.865410612s) [upload=74358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 16:46:39.434332896 (71h20m33.865413017s) [upload=74358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 16:46:39.727280447 (71h20m34.158360588s) [upload=74358]: Done uploading segments... Aug 11 16:46:39.727301838 (71h20m34.158381969s) [upload=74358]: Upload finished. err: <nil> Duration:* 1.830249702s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 5.86088765s FAIL (2025-08-11 16:53:24 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 11 16:20:42.438359750 (70h54m36.869439881s) [upload=73915]: Starting upload Aug 11 16:20:42.438414104 (70h54m36.869494225s) [upload=73915]: Done starting upload Aug 11 16:20:42.438489136 (70h54m36.869569267s) [upload=73915]: Uploading segments... Aug 11 16:20:42.438621770 (70h54m36.869701891s) [upload=73915]: Got next segment. Inline: false Aug 11 16:20:42.438664713 (70h54m36.869744844s) [upload=73915]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 16:20:42.438669001 (70h54m36.869749132s) [upload=73915]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 16:20:42.676790711 (70h54m37.107870842s) [seg_pos={0 0}, upload=73915]: Begin upload segment... Aug 11 16:20:42.676835908 (70h54m37.107916039s) [seg_pos={0 0}, upload=73915]: Done begin upload segment. Aug 11 16:20:42.676853832 (70h54m37.107933964s) [noise=true , address=77.90.31.14:4663 , piece_id=I5W3UOQI6RQFDF2A5NGYG7GUXBP2XE3N6LCTBVHAXPEWBMVSV26Q, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.676866747 (70h54m37.107946878s) [noise=true , address=104.36.82.10:4079 , piece_id=CYHDYCMVCYISFUDJOXGK2RCJVPRBZXXBAX3ICDJTH4OUPTQL6RMA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.676910421 (70h54m37.107990552s) [noise=true , address=77.90.31.11:4555 , piece_id=42V6RDCOSJRZYHIH7AUYX35F7GRXVZRHRUNBTI3ZDDQSVK2IYBAA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.676958241 (70h54m37.108038383s) [noise=true , address=45.91.116.13:4153 , piece_id=6FFUWDJYTJPUBXGHDGREUB4OM4DGX6COJTXHFWHLGW7QK3CO2JDA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.677329863 (70h54m37.108409994s) [noise=true , address=45.91.116.6:4974 , piece_id=GUI4A3KX4FASSTLQDMD4PHG75FQZRZEZCWNIMLWEJBBHQ5IH6SIA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.677368517 (70h54m37.108448648s) [noise=true , address=45.91.116.10:4083 , piece_id=ACEAUOZZCKIA4LTESFID3ZWUKFVTJACUI6VB327RTMHJLTPZBYGQ, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.677671015 (70h54m37.108751146s) [noise=true , address=77.90.31.17:4771 , piece_id=4Y664XUE5YWHPNAWUYSZ4BPISRV5YM5IGV4VK53RCPFZYEEBOKIQ, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678009293 (70h54m37.109089424s) [noise=true , address=45.91.116.7:4010 , piece_id=I5FZKKDZEIJAEBGXVY5E4PSKY2XN6FFB6YJI7CTWGTS63FVWC77A, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678247930 (70h54m37.109328061s) [noise=true , address=77.90.31.19:4843 , piece_id=NZ6GA4W7S4VGYLD5TBIOVCTFSBODMTOQY7SBY5OB2XWE766R2B3A, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678532164 (70h54m37.109612285s) [noise=true , address=45.91.116.12:4227 , piece_id=C5NVQ4KJ4UVIIXGUUXYLYGZ6T3TVKESSRQX7KSYQZ7O5PYUS3XVA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678765730 (70h54m37.109845861s) [noise=true , address=104.36.82.12:4151 , piece_id=QUY4X3H5VQPZXZ4JCHFKXLUETZXOBEN34KO7YZEMVYQEVGKR5ZZA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678993456 (70h54m37.110073587s) [noise=true , address=45.91.116.13:4155 , piece_id=YTXBYJIN6WYX2LBRDYH7YU55DKC7ZLLECK3HI22IKBWFRT6ZHTIA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679139145 (70h54m37.110219266s) [noise=true , address=45.91.116.4:4939 , piece_id=D3TLK6SUW4O7UUZVU6PADTAGQZ6SJHYAXYG2UULS7VZNMZ5YSOIA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679376159 (70h54m37.11045629s) [noise=true , address=45.91.116.5:4298 , piece_id=QYRZXB5RPTYY3Y54CVYQA76YEOHCKIPOMOP36Z2W6PSF35JDULFA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679589166 (70h54m37.110669297s) [noise=true , address=104.36.82.5:4839 , piece_id=56H4YACEHZNRC4IGN6LQ2OHVYAL6DFVJ3E5XKXUMAWHO6UCMICGA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679786334 (70h54m37.110866465s) [noise=true , address=77.90.31.18:4807 , piece_id=JZTPSUJQ7H7AAQC2JQLY37UM2ZPSCFVYDNOG7RSCJ6SPTWCVVPLA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:44.458058779 (70h54m38.88913891s) [upload=73915]: Next returned nil segment Aug 11 16:20:44.458076964 (70h54m38.889157095s) [upload=73915]: Waiting for error group managing segments... Aug 11 16:20:44.762791322 (70h54m39.193871453s) [noise=true , address=45.91.116.7:4010 , piece_id=I5FZKKDZEIJAEBGXVY5E4PSKY2XN6FFB6YJI7CTWGTS63FVWC77A, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.819598246 (70h54m39.250678377s) [noise=true , address=45.91.116.4:4939 , piece_id=D3TLK6SUW4O7UUZVU6PADTAGQZ6SJHYAXYG2UULS7VZNMZ5YSOIA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.877739022 (70h54m39.308819143s) [noise=true , address=77.90.31.11:4555 , piece_id=42V6RDCOSJRZYHIH7AUYX35F7GRXVZRHRUNBTI3ZDDQSVK2IYBAA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.936181786 (70h54m39.367261918s) [noise=true , address=45.91.116.10:4083 , piece_id=ACEAUOZZCKIA4LTESFID3ZWUKFVTJACUI6VB327RTMHJLTPZBYGQ, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.937836643 (70h54m39.368916774s) [noise=true , address=77.90.31.18:4807 , piece_id=JZTPSUJQ7H7AAQC2JQLY37UM2ZPSCFVYDNOG7RSCJ6SPTWCVVPLA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.939510475 (70h54m39.370590596s) [noise=true , address=77.90.31.17:4771 , piece_id=4Y664XUE5YWHPNAWUYSZ4BPISRV5YM5IGV4VK53RCPFZYEEBOKIQ, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.944277246 (70h54m39.375357377s) [noise=true , address=104.36.82.12:4151 , piece_id=QUY4X3H5VQPZXZ4JCHFKXLUETZXOBEN34KO7YZEMVYQEVGKR5ZZA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.945075824 (70h54m39.376155955s) [noise=true , address=45.91.116.13:4155 , piece_id=YTXBYJIN6WYX2LBRDYH7YU55DKC7ZLLECK3HI22IKBWFRT6ZHTIA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.006188045 (70h54m39.437268176s) [noise=true , address=45.91.116.5:4298 , piece_id=QYRZXB5RPTYY3Y54CVYQA76YEOHCKIPOMOP36Z2W6PSF35JDULFA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.042863199 (70h54m39.47394333s) [noise=true , address=77.90.31.14:4663 , piece_id=I5W3UOQI6RQFDF2A5NGYG7GUXBP2XE3N6LCTBVHAXPEWBMVSV26Q, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.048316484 (70h54m39.479396645s) [noise=true , address=77.90.31.19:4843 , piece_id=NZ6GA4W7S4VGYLD5TBIOVCTFSBODMTOQY7SBY5OB2XWE766R2B3A, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.054276718 (70h54m39.485356839s) [noise=true , address=45.91.116.12:4227 , piece_id=C5NVQ4KJ4UVIIXGUUXYLYGZ6T3TVKESSRQX7KSYQZ7O5PYUS3XVA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.056028469 (70h54m39.487108601s) [noise=true , address=45.91.116.13:4153 , piece_id=6FFUWDJYTJPUBXGHDGREUB4OM4DGX6COJTXHFWHLGW7QK3CO2JDA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.056044611 (70h54m39.487124732s) [seg_pos={0 0}, upload=73915]: Segment reached optimal threshold of 13 pieces. Aug 11 16:20:45.056165442 (70h54m39.487245573s) [noise=true , address=45.91.116.6:4974 , piece_id=GUI4A3KX4FASSTLQDMD4PHG75FQZRZEZCWNIMLWEJBBHQ5IH6SIA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Aug 11 16:20:45.056214636 (70h54m39.487294767s) [noise=true , address=104.36.82.10:4079 , piece_id=CYHDYCMVCYISFUDJOXGK2RCJVPRBZXXBAX3ICDJTH4OUPTQL6RMA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 11 16:20:45.056367308 (70h54m39.48744744s) [noise=true , address=104.36.82.5:4839 , piece_id=56H4YACEHZNRC4IGN6LQ2OHVYAL6DFVJ3E5XKXUMAWHO6UCMICGA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:33142->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:33142->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33142->104.36.82.5:4839: use of closed network connection Aug 11 16:20:45.056394020 (70h54m39.487474151s) [seg_pos={0 0}, upload=73915]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 11 16:20:45.056469904 (70h54m39.487550035s) [upload=73915]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 16:20:45.056474313 (70h54m39.487554444s) [upload=73915]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 16:20:45.348914657 (70h54m39.779994788s) [upload=73915]: Done uploading segments... Aug 11 16:20:45.348932771 (70h54m39.780012902s) [upload=73915]: Upload finished. err: <nil> Duration: 5.860912178s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [....................................X.................X..X..] duration: 5.804108901s FAIL (2025-08-11 16:53:06 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 057e70622624edd53b9fc51be4b79f2d44d3edfaab7771732fcead8b398b45cf != before 5fa63a3b4367a71718c58f2a9dea4bd743ced7ab5179088fd28949f3defb0b49 ======LOGS====== Aug 11 16:52:00.486330505 (71h25m54.917410636s) [upload=74451]: Starting upload Aug 11 16:52:00.486377434 (71h25m54.917457565s) [upload=74451]: Done starting upload Aug 11 16:52:00.486467226 (71h25m54.917547357s) [upload=74451]: Uploading segments... Aug 11 16:52:00.486565484 (71h25m54.917645615s) [upload=74451]: Got next segment. Inline: false Aug 11 16:52:00.486611342 (71h25m54.917691463s) [upload=74451]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 16:52:00.486615960 (71h25m54.917696091s) [upload=74451]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 16:52:00.936658896 (71h25m55.367739027s) [seg_pos={0 0}, upload=74451]: Begin upload segment... Aug 11 16:52:00.936704133 (71h25m55.367784264s) [seg_pos={0 0}, upload=74451]: Done begin upload segment. Aug 11 16:52:00.936723960 (71h25m55.367804091s) [noise=true , address=104.36.82.9:4018 , piece_id=NBU72ROM7RHSITJ7D7CZJMTG3IR2Y5PU3SIXECRQ6FZHE3BT6DRA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.936760270 (71h25m55.367840401s) [noise=true , address=104.36.82.34:4575 , piece_id=YBYWB3OKPOVXOMX4YTV2R4OKMPCKVPKGAORDS2JBYG66D6UCTA4A, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.937115760 (71h25m55.368195891s) [noise=true , address=104.36.82.38:4701 , piece_id=J4HDMCTPA4XS7DWE5LGJRVYMLR7BYPVHDAMWWGBW5YVJF236VK4Q, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.937240989 (71h25m55.368321121s) [noise=true , address=77.90.31.17:4791 , piece_id=X5DIN2SDWPH4EKQPOBZFINYODZ2AU46ZEIULAPHWDOMSESRXCGUA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.937385226 (71h25m55.368465357s) [noise=true , address=104.36.82.5:4843 , piece_id=XJH5W64QKAIEMSJ7WPDZRWG5GK2S56664IQDPUPW52CBEAT4MASA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.937648880 (71h25m55.368729011s) [noise=true , address=104.36.82.20:4440 , piece_id=2YLIUD4JWKADFVQ73AFWOYFZWRLAKUQ423WM4X5K56W7UOY6XUIA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.937939637 (71h25m55.369019768s) [noise=true , address=104.36.82.16:4312 , piece_id=GUEBWOWC56BV4WHI3HUHNNMOZJ54HZJRO4JLQNTMOJ76H6E3FMSQ, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.938208932 (71h25m55.369289063s) [noise=true , address=79.127.219.48:4086 , piece_id=BIIPBGT2VPPMNHLEHIMBWR4QU4RFB5GG3FU2XJAGQMIR4GSUVSPQ, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.938479660 (71h25m55.369559781s) [noise=true , address=79.127.219.38:4022 , piece_id=RBHTYSRKVYXZA5G4XEVYKVE7DV7V67WSUTH56MKTEIDUGRMXGREQ, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.938700222 (71h25m55.369780353s) [noise=true , address=79.127.220.98:4423 , piece_id=GRPLJQ3CSTHWJVXE7EUROVFV5JPIHVKYIUKFUR5HUYWEOWOIAQ5A, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.938911195 (71h25m55.369991326s) [noise=true , address=77.90.31.15:4732 , piece_id=JHKT2MSCWGGQF2Y2CTQZRGLPWELEGUWDA35CHK4KTGRNI2HNQZBA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.938988644 (71h25m55.370068775s) [noise=true , address=104.36.82.61:4378 , piece_id=ITY2O2P6SFXLNXJWJ4G56X26YJPGOJ4UATMPHYVCXFLEKVNMUKMA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.939229625 (71h25m55.370309756s) [noise=true , address=79.127.220.101:4074 , piece_id=JFTUZQVWSA32A33LCPSFPLBFRTOR6XT4M62XUI752T6CEM55EZQQ, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.939450798 (71h25m55.370530929s) [noise=true , address=104.36.82.59:4306 , piece_id=KNA553JSWSIB3D7EL62I576OQCRPFFJP7E4UL3D3I4MNVRIANVPA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.939676660 (71h25m55.370756791s) [noise=true , address=104.36.82.47:4533 , piece_id=FR55EWHLGG7DLRGUAIJCA56TQ7RPKDBQLGX33K6FHCWYV462WKJQ, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.939888225 (71h25m55.370968346s) [noise=true , address=104.36.82.62:4438 , piece_id=IXFU2VVB6LBSY523KZD4CPL5C5II7MOC7ZRVJCXTZ7DKWCWXEYBA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.940116682 (71h25m55.371196813s) [noise=true , address=104.36.82.45:4915 , piece_id=BEUVRN2GXXIR2XQXDBHIVNYZE7RIJ3EHIQSHMZYEPFUQNXALRTXA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.940314681 (71h25m55.371394812s) [noise=true , address=104.36.82.4:4809 , piece_id=3QKBP7QTZQBWTJ7PFMR7Z4GNKRJ3MLWTUVTZE7RS3AI33HNW7XBA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:02.407046143 (71h25m56.838126274s) [upload=74451]: Next returned nil segment Aug 11 16:52:02.407066482 (71h25m56.838146613s) [upload=74451]: Waiting for error group managing segments... Aug 11 16:52:02.784099481 (71h25m57.215179612s) [noise=true , address=79.127.220.98:4423 , piece_id=GRPLJQ3CSTHWJVXE7EUROVFV5JPIHVKYIUKFUR5HUYWEOWOIAQ5A, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.799355832 (71h25m57.230435963s) [noise=true , address=79.127.220.101:4074 , piece_id=JFTUZQVWSA32A33LCPSFPLBFRTOR6XT4M62XUI752T6CEM55EZQQ, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.824743848 (71h25m57.255823979s) [noise=true , address=79.127.219.48:4086 , piece_id=BIIPBGT2VPPMNHLEHIMBWR4QU4RFB5GG3FU2XJAGQMIR4GSUVSPQ, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.856539797 (71h25m57.287619928s) [noise=true , address=79.127.219.38:4022 , piece_id=RBHTYSRKVYXZA5G4XEVYKVE7DV7V67WSUTH56MKTEIDUGRMXGREQ, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.892199348 (71h25m57.323279499s) [noise=true , address=104.36.82.34:4575 , piece_id=YBYWB3OKPOVXOMX4YTV2R4OKMPCKVPKGAORDS2JBYG66D6UCTA4A, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.900582107 (71h25m57.331662238s) [noise=true , address=104.36.82.38:4701 , piece_id=J4HDMCTPA4XS7DWE5LGJRVYMLR7BYPVHDAMWWGBW5YVJF236VK4Q, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.901661613 (71h25m57.332741744s) [noise=true , address=77.90.31.17:4791 , piece_id=X5DIN2SDWPH4EKQPOBZFINYODZ2AU46ZEIULAPHWDOMSESRXCGUA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.924967335 (71h25m57.356047466s) [noise=true , address=104.36.82.4:4809 , piece_id=3QKBP7QTZQBWTJ7PFMR7Z4GNKRJ3MLWTUVTZE7RS3AI33HNW7XBA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.934432455 (71h25m57.365512586s) [noise=true , address=104.36.82.5:4843 , piece_id=XJH5W64QKAIEMSJ7WPDZRWG5GK2S56664IQDPUPW52CBEAT4MASA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.944250341 (71h25m57.375330472s) [noise=true , address=104.36.82.16:4312 , piece_id=GUEBWOWC56BV4WHI3HUHNNMOZJ54HZJRO4JLQNTMOJ76H6E3FMSQ, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.959326207 (71h25m57.390406338s) [noise=true , address=104.36.82.47:4533 , piece_id=FR55EWHLGG7DLRGUAIJCA56TQ7RPKDBQLGX33K6FHCWYV462WKJQ, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.965101627 (71h25m57.396181758s) [noise=true , address=104.36.82.9:4018 , piece_id=NBU72ROM7RHSITJ7D7CZJMTG3IR2Y5PU3SIXECRQ6FZHE3BT6DRA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.975109015 (71h25m57.406189147s) [noise=true , address=104.36.82.20:4440 , piece_id=2YLIUD4JWKADFVQ73AFWOYFZWRLAKUQ423WM4X5K56W7UOY6XUIA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.989812008 (71h25m57.420892139s) [noise=true , address=104.36.82.62:4438 , piece_id=IXFU2VVB6LBSY523KZD4CPL5C5II7MOC7ZRVJCXTZ7DKWCWXEYBA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.989838749 (71h25m57.42091887s) [seg_pos={0 0}, upload=74451]: Segment reached optimal threshold of 14 pieces. Aug 11 16:52:02.989941887 (71h25m57.421022018s) [noise=true , address=104.36.82.45:4915 , piece_id=BEUVRN2GXXIR2XQXDBHIVNYZE7RIJ3EHIQSHMZYEPFUQNXALRTXA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17rmsv4edxH6jmsN83ceiVJdfEui1qrBK5XBcf7GgvKCn2fknT): protocol: expected piece hash; context canceled; EOF Aug 11 16:52:02.990013944 (71h25m57.421094065s) [noise=true , address=104.36.82.61:4378 , piece_id=ITY2O2P6SFXLNXJWJ4G56X26YJPGOJ4UATMPHYVCXFLEKVNMUKMA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DcpXz1fKrWhdPxTpGUFmydMUuzMQpNFMgGB75BAVrjdMiSkhW): protocol: expected piece hash; context canceled; EOF Aug 11 16:52:02.990088507 (71h25m57.421168638s) [noise=true , address=77.90.31.15:4732 , piece_id=JHKT2MSCWGGQF2Y2CTQZRGLPWELEGUWDA35CHK4KTGRNI2HNQZBA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NyFYdUBbAhAijCDtPWB1zJCjwhgw35vEQoE4qJyg2PywRn5AH): protocol: expected piece hash; context canceled; EOF Aug 11 16:52:02.990112323 (71h25m57.421192454s) [noise=true , address=104.36.82.59:4306 , piece_id=KNA553JSWSIB3D7EL62I576OQCRPFFJP7E4UL3D3I4MNVRIANVPA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12amBPo7WKpjPDzi6mUWw5PcdgrcT7hsUjsSkijfrvKka1bJzNw): protocol: expected piece hash; context canceled; EOF Aug 11 16:52:02.990176205 (71h25m57.421256346s) [seg_pos={0 0}, upload=74451]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 16:52:02.990294881 (71h25m57.421375022s) [upload=74451]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 16:52:02.990301134 (71h25m57.421381275s) [upload=74451]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 16:52:03.289620958 (71h25m57.720701089s) [upload=74451]: Done uploading segments... Aug 11 16:52:03.289639453 (71h25m57.720719574s) [upload=74451]: Upload finished. err: <nil> Duration: 5.8041284s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [........X...............................X........X..........] duration: 1.851612756s FAIL (2025-08-11 16:52:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 7ca3b38f59bef6700c47a71c0ce137786b019861ef4e351f330d4f1e41b86704 != before b8ccbd272fe59726b04686e0542c1e0964e89942b662558e091433dc0e7e3dc5 ======LOGS====== Aug 11 16:46:39.434150567 (71h20m33.865230698s) [upload=74358]: Starting upload Aug 11 16:46:39.434202827 (71h20m33.865282958s) [upload=74358]: Done starting upload Aug 11 16:46:39.434253474 (71h20m33.865333605s) [upload=74358]: Uploading segments... Aug 11 16:46:39.434289643 (71h20m33.865369774s) [upload=74358]: Got next segment. Inline: true Aug 11 16:46:39.434293440 (71h20m33.865373561s) [upload=74358]: Waiting for error group managing segments... Aug 11 16:46:39.434326714 (71h20m33.865406845s) [upload=74358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 16:46:39.434330481 (71h20m33.865410612s) [upload=74358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 16:46:39.434332896 (71h20m33.865413017s) [upload=74358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 16:46:39.727280447 (71h20m34.158360588s) [upload=74358]: Done uploading segments... Aug 11 16:46:39.727301838 (71h20m34.158381969s) [upload=74358]: Upload finished. err: <nil> Duration:* 1.851630841s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....................................X.................X..X.] duration: 5.706386533s FAIL (2025-08-11 16:52:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 057e70622624edd53b9fc51be4b79f2d44d3edfaab7771732fcead8b398b45cf != before 5fa63a3b4367a71718c58f2a9dea4bd743ced7ab5179088fd28949f3defb0b49 ======LOGS====== Aug 11 16:52:00.486330505 (71h25m54.917410636s) [upload=74451]: Starting upload Aug 11 16:52:00.486377434 (71h25m54.917457565s) [upload=74451]: Done starting upload Aug 11 16:52:00.486467226 (71h25m54.917547357s) [upload=74451]: Uploading segments... Aug 11 16:52:00.486565484 (71h25m54.917645615s) [upload=74451]: Got next segment. Inline: false Aug 11 16:52:00.486611342 (71h25m54.917691463s) [upload=74451]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 16:52:00.486615960 (71h25m54.917696091s) [upload=74451]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 16:52:00.936658896 (71h25m55.367739027s) [seg_pos={0 0}, upload=74451]: Begin upload segment... Aug 11 16:52:00.936704133 (71h25m55.367784264s) [seg_pos={0 0}, upload=74451]: Done begin upload segment. Aug 11 16:52:00.936723960 (71h25m55.367804091s) [noise=true , address=104.36.82.9:4018 , piece_id=NBU72ROM7RHSITJ7D7CZJMTG3IR2Y5PU3SIXECRQ6FZHE3BT6DRA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.936760270 (71h25m55.367840401s) [noise=true , address=104.36.82.34:4575 , piece_id=YBYWB3OKPOVXOMX4YTV2R4OKMPCKVPKGAORDS2JBYG66D6UCTA4A, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.937115760 (71h25m55.368195891s) [noise=true , address=104.36.82.38:4701 , piece_id=J4HDMCTPA4XS7DWE5LGJRVYMLR7BYPVHDAMWWGBW5YVJF236VK4Q, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.937240989 (71h25m55.368321121s) [noise=true , address=77.90.31.17:4791 , piece_id=X5DIN2SDWPH4EKQPOBZFINYODZ2AU46ZEIULAPHWDOMSESRXCGUA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.937385226 (71h25m55.368465357s) [noise=true , address=104.36.82.5:4843 , piece_id=XJH5W64QKAIEMSJ7WPDZRWG5GK2S56664IQDPUPW52CBEAT4MASA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.937648880 (71h25m55.368729011s) [noise=true , address=104.36.82.20:4440 , piece_id=2YLIUD4JWKADFVQ73AFWOYFZWRLAKUQ423WM4X5K56W7UOY6XUIA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.937939637 (71h25m55.369019768s) [noise=true , address=104.36.82.16:4312 , piece_id=GUEBWOWC56BV4WHI3HUHNNMOZJ54HZJRO4JLQNTMOJ76H6E3FMSQ, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.938208932 (71h25m55.369289063s) [noise=true , address=79.127.219.48:4086 , piece_id=BIIPBGT2VPPMNHLEHIMBWR4QU4RFB5GG3FU2XJAGQMIR4GSUVSPQ, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.938479660 (71h25m55.369559781s) [noise=true , address=79.127.219.38:4022 , piece_id=RBHTYSRKVYXZA5G4XEVYKVE7DV7V67WSUTH56MKTEIDUGRMXGREQ, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.938700222 (71h25m55.369780353s) [noise=true , address=79.127.220.98:4423 , piece_id=GRPLJQ3CSTHWJVXE7EUROVFV5JPIHVKYIUKFUR5HUYWEOWOIAQ5A, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.938911195 (71h25m55.369991326s) [noise=true , address=77.90.31.15:4732 , piece_id=JHKT2MSCWGGQF2Y2CTQZRGLPWELEGUWDA35CHK4KTGRNI2HNQZBA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.938988644 (71h25m55.370068775s) [noise=true , address=104.36.82.61:4378 , piece_id=ITY2O2P6SFXLNXJWJ4G56X26YJPGOJ4UATMPHYVCXFLEKVNMUKMA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.939229625 (71h25m55.370309756s) [noise=true , address=79.127.220.101:4074 , piece_id=JFTUZQVWSA32A33LCPSFPLBFRTOR6XT4M62XUI752T6CEM55EZQQ, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.939450798 (71h25m55.370530929s) [noise=true , address=104.36.82.59:4306 , piece_id=KNA553JSWSIB3D7EL62I576OQCRPFFJP7E4UL3D3I4MNVRIANVPA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.939676660 (71h25m55.370756791s) [noise=true , address=104.36.82.47:4533 , piece_id=FR55EWHLGG7DLRGUAIJCA56TQ7RPKDBQLGX33K6FHCWYV462WKJQ, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.939888225 (71h25m55.370968346s) [noise=true , address=104.36.82.62:4438 , piece_id=IXFU2VVB6LBSY523KZD4CPL5C5II7MOC7ZRVJCXTZ7DKWCWXEYBA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.940116682 (71h25m55.371196813s) [noise=true , address=104.36.82.45:4915 , piece_id=BEUVRN2GXXIR2XQXDBHIVNYZE7RIJ3EHIQSHMZYEPFUQNXALRTXA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.940314681 (71h25m55.371394812s) [noise=true , address=104.36.82.4:4809 , piece_id=3QKBP7QTZQBWTJ7PFMR7Z4GNKRJ3MLWTUVTZE7RS3AI33HNW7XBA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:02.407046143 (71h25m56.838126274s) [upload=74451]: Next returned nil segment Aug 11 16:52:02.407066482 (71h25m56.838146613s) [upload=74451]: Waiting for error group managing segments... Aug 11 16:52:02.784099481 (71h25m57.215179612s) [noise=true , address=79.127.220.98:4423 , piece_id=GRPLJQ3CSTHWJVXE7EUROVFV5JPIHVKYIUKFUR5HUYWEOWOIAQ5A, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.799355832 (71h25m57.230435963s) [noise=true , address=79.127.220.101:4074 , piece_id=JFTUZQVWSA32A33LCPSFPLBFRTOR6XT4M62XUI752T6CEM55EZQQ, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.824743848 (71h25m57.255823979s) [noise=true , address=79.127.219.48:4086 , piece_id=BIIPBGT2VPPMNHLEHIMBWR4QU4RFB5GG3FU2XJAGQMIR4GSUVSPQ, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.856539797 (71h25m57.287619928s) [noise=true , address=79.127.219.38:4022 , piece_id=RBHTYSRKVYXZA5G4XEVYKVE7DV7V67WSUTH56MKTEIDUGRMXGREQ, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.892199348 (71h25m57.323279499s) [noise=true , address=104.36.82.34:4575 , piece_id=YBYWB3OKPOVXOMX4YTV2R4OKMPCKVPKGAORDS2JBYG66D6UCTA4A, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.900582107 (71h25m57.331662238s) [noise=true , address=104.36.82.38:4701 , piece_id=J4HDMCTPA4XS7DWE5LGJRVYMLR7BYPVHDAMWWGBW5YVJF236VK4Q, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.901661613 (71h25m57.332741744s) [noise=true , address=77.90.31.17:4791 , piece_id=X5DIN2SDWPH4EKQPOBZFINYODZ2AU46ZEIULAPHWDOMSESRXCGUA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.924967335 (71h25m57.356047466s) [noise=true , address=104.36.82.4:4809 , piece_id=3QKBP7QTZQBWTJ7PFMR7Z4GNKRJ3MLWTUVTZE7RS3AI33HNW7XBA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.934432455 (71h25m57.365512586s) [noise=true , address=104.36.82.5:4843 , piece_id=XJH5W64QKAIEMSJ7WPDZRWG5GK2S56664IQDPUPW52CBEAT4MASA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.944250341 (71h25m57.375330472s) [noise=true , address=104.36.82.16:4312 , piece_id=GUEBWOWC56BV4WHI3HUHNNMOZJ54HZJRO4JLQNTMOJ76H6E3FMSQ, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.959326207 (71h25m57.390406338s) [noise=true , address=104.36.82.47:4533 , piece_id=FR55EWHLGG7DLRGUAIJCA56TQ7RPKDBQLGX33K6FHCWYV462WKJQ, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.965101627 (71h25m57.396181758s) [noise=true , address=104.36.82.9:4018 , piece_id=NBU72ROM7RHSITJ7D7CZJMTG3IR2Y5PU3SIXECRQ6FZHE3BT6DRA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.975109015 (71h25m57.406189147s) [noise=true , address=104.36.82.20:4440 , piece_id=2YLIUD4JWKADFVQ73AFWOYFZWRLAKUQ423WM4X5K56W7UOY6XUIA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.989812008 (71h25m57.420892139s) [noise=true , address=104.36.82.62:4438 , piece_id=IXFU2VVB6LBSY523KZD4CPL5C5II7MOC7ZRVJCXTZ7DKWCWXEYBA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.989838749 (71h25m57.42091887s) [seg_pos={0 0}, upload=74451]: Segment reached optimal threshold of 14 pieces. Aug 11 16:52:02.989941887 (71h25m57.421022018s) [noise=true , address=104.36.82.45:4915 , piece_id=BEUVRN2GXXIR2XQXDBHIVNYZE7RIJ3EHIQSHMZYEPFUQNXALRTXA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17rmsv4edxH6jmsN83ceiVJdfEui1qrBK5XBcf7GgvKCn2fknT): protocol: expected piece hash; context canceled; EOF Aug 11 16:52:02.990013944 (71h25m57.421094065s) [noise=true , address=104.36.82.61:4378 , piece_id=ITY2O2P6SFXLNXJWJ4G56X26YJPGOJ4UATMPHYVCXFLEKVNMUKMA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DcpXz1fKrWhdPxTpGUFmydMUuzMQpNFMgGB75BAVrjdMiSkhW): protocol: expected piece hash; context canceled; EOF Aug 11 16:52:02.990088507 (71h25m57.421168638s) [noise=true , address=77.90.31.15:4732 , piece_id=JHKT2MSCWGGQF2Y2CTQZRGLPWELEGUWDA35CHK4KTGRNI2HNQZBA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NyFYdUBbAhAijCDtPWB1zJCjwhgw35vEQoE4qJyg2PywRn5AH): protocol: expected piece hash; context canceled; EOF Aug 11 16:52:02.990112323 (71h25m57.421192454s) [noise=true , address=104.36.82.59:4306 , piece_id=KNA553JSWSIB3D7EL62I576OQCRPFFJP7E4UL3D3I4MNVRIANVPA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12amBPo7WKpjPDzi6mUWw5PcdgrcT7hsUjsSkijfrvKka1bJzNw): protocol: expected piece hash; context canceled; EOF Aug 11 16:52:02.990176205 (71h25m57.421256346s) [seg_pos={0 0}, upload=74451]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 16:52:02.990294881 (71h25m57.421375022s) [upload=74451]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 16:52:02.990301134 (71h25m57.421381275s) [upload=74451]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 16:52:03.289620958 (71h25m57.720701089s) [upload=74451]: Done uploading segments... Aug 11 16:52:03.289639453 (71h25m57.720719574s) [upload=74451]: Upload finished. err: <nil> Duration: 5.70641063s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.........X...............................X........X.........] duration: 2.081659525s FAIL (2025-08-11 16:52:41 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 7ca3b38f59bef6700c47a71c0ce137786b019861ef4e351f330d4f1e41b86704 != before b8ccbd272fe59726b04686e0542c1e0964e89942b662558e091433dc0e7e3dc5 ======LOGS====== Aug 11 16:46:39.434150567 (71h20m33.865230698s) [upload=74358]: Starting upload Aug 11 16:46:39.434202827 (71h20m33.865282958s) [upload=74358]: Done starting upload Aug 11 16:46:39.434253474 (71h20m33.865333605s) [upload=74358]: Uploading segments... Aug 11 16:46:39.434289643 (71h20m33.865369774s) [upload=74358]: Got next segment. Inline: true Aug 11 16:46:39.434293440 (71h20m33.865373561s) [upload=74358]: Waiting for error group managing segments... Aug 11 16:46:39.434326714 (71h20m33.865406845s) [upload=74358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 16:46:39.434330481 (71h20m33.865410612s) [upload=74358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 16:46:39.434332896 (71h20m33.865413017s) [upload=74358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 16:46:39.727280447 (71h20m34.158360588s) [upload=74358]: Done uploading segments... Aug 11 16:46:39.727301838 (71h20m34.158381969s) [upload=74358]: Upload finished. err: <nil> Duration:* 2.081689903s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 5.880271822s FAIL (2025-08-11 16:52:29 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 11 16:20:42.438359750 (70h54m36.869439881s) [upload=73915]: Starting upload Aug 11 16:20:42.438414104 (70h54m36.869494225s) [upload=73915]: Done starting upload Aug 11 16:20:42.438489136 (70h54m36.869569267s) [upload=73915]: Uploading segments... Aug 11 16:20:42.438621770 (70h54m36.869701891s) [upload=73915]: Got next segment. Inline: false Aug 11 16:20:42.438664713 (70h54m36.869744844s) [upload=73915]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 16:20:42.438669001 (70h54m36.869749132s) [upload=73915]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 16:20:42.676790711 (70h54m37.107870842s) [seg_pos={0 0}, upload=73915]: Begin upload segment... Aug 11 16:20:42.676835908 (70h54m37.107916039s) [seg_pos={0 0}, upload=73915]: Done begin upload segment. Aug 11 16:20:42.676853832 (70h54m37.107933964s) [noise=true , address=77.90.31.14:4663 , piece_id=I5W3UOQI6RQFDF2A5NGYG7GUXBP2XE3N6LCTBVHAXPEWBMVSV26Q, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.676866747 (70h54m37.107946878s) [noise=true , address=104.36.82.10:4079 , piece_id=CYHDYCMVCYISFUDJOXGK2RCJVPRBZXXBAX3ICDJTH4OUPTQL6RMA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.676910421 (70h54m37.107990552s) [noise=true , address=77.90.31.11:4555 , piece_id=42V6RDCOSJRZYHIH7AUYX35F7GRXVZRHRUNBTI3ZDDQSVK2IYBAA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.676958241 (70h54m37.108038383s) [noise=true , address=45.91.116.13:4153 , piece_id=6FFUWDJYTJPUBXGHDGREUB4OM4DGX6COJTXHFWHLGW7QK3CO2JDA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.677329863 (70h54m37.108409994s) [noise=true , address=45.91.116.6:4974 , piece_id=GUI4A3KX4FASSTLQDMD4PHG75FQZRZEZCWNIMLWEJBBHQ5IH6SIA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.677368517 (70h54m37.108448648s) [noise=true , address=45.91.116.10:4083 , piece_id=ACEAUOZZCKIA4LTESFID3ZWUKFVTJACUI6VB327RTMHJLTPZBYGQ, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.677671015 (70h54m37.108751146s) [noise=true , address=77.90.31.17:4771 , piece_id=4Y664XUE5YWHPNAWUYSZ4BPISRV5YM5IGV4VK53RCPFZYEEBOKIQ, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678009293 (70h54m37.109089424s) [noise=true , address=45.91.116.7:4010 , piece_id=I5FZKKDZEIJAEBGXVY5E4PSKY2XN6FFB6YJI7CTWGTS63FVWC77A, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678247930 (70h54m37.109328061s) [noise=true , address=77.90.31.19:4843 , piece_id=NZ6GA4W7S4VGYLD5TBIOVCTFSBODMTOQY7SBY5OB2XWE766R2B3A, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678532164 (70h54m37.109612285s) [noise=true , address=45.91.116.12:4227 , piece_id=C5NVQ4KJ4UVIIXGUUXYLYGZ6T3TVKESSRQX7KSYQZ7O5PYUS3XVA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678765730 (70h54m37.109845861s) [noise=true , address=104.36.82.12:4151 , piece_id=QUY4X3H5VQPZXZ4JCHFKXLUETZXOBEN34KO7YZEMVYQEVGKR5ZZA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678993456 (70h54m37.110073587s) [noise=true , address=45.91.116.13:4155 , piece_id=YTXBYJIN6WYX2LBRDYH7YU55DKC7ZLLECK3HI22IKBWFRT6ZHTIA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679139145 (70h54m37.110219266s) [noise=true , address=45.91.116.4:4939 , piece_id=D3TLK6SUW4O7UUZVU6PADTAGQZ6SJHYAXYG2UULS7VZNMZ5YSOIA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679376159 (70h54m37.11045629s) [noise=true , address=45.91.116.5:4298 , piece_id=QYRZXB5RPTYY3Y54CVYQA76YEOHCKIPOMOP36Z2W6PSF35JDULFA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679589166 (70h54m37.110669297s) [noise=true , address=104.36.82.5:4839 , piece_id=56H4YACEHZNRC4IGN6LQ2OHVYAL6DFVJ3E5XKXUMAWHO6UCMICGA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679786334 (70h54m37.110866465s) [noise=true , address=77.90.31.18:4807 , piece_id=JZTPSUJQ7H7AAQC2JQLY37UM2ZPSCFVYDNOG7RSCJ6SPTWCVVPLA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:44.458058779 (70h54m38.88913891s) [upload=73915]: Next returned nil segment Aug 11 16:20:44.458076964 (70h54m38.889157095s) [upload=73915]: Waiting for error group managing segments... Aug 11 16:20:44.762791322 (70h54m39.193871453s) [noise=true , address=45.91.116.7:4010 , piece_id=I5FZKKDZEIJAEBGXVY5E4PSKY2XN6FFB6YJI7CTWGTS63FVWC77A, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.819598246 (70h54m39.250678377s) [noise=true , address=45.91.116.4:4939 , piece_id=D3TLK6SUW4O7UUZVU6PADTAGQZ6SJHYAXYG2UULS7VZNMZ5YSOIA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.877739022 (70h54m39.308819143s) [noise=true , address=77.90.31.11:4555 , piece_id=42V6RDCOSJRZYHIH7AUYX35F7GRXVZRHRUNBTI3ZDDQSVK2IYBAA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.936181786 (70h54m39.367261918s) [noise=true , address=45.91.116.10:4083 , piece_id=ACEAUOZZCKIA4LTESFID3ZWUKFVTJACUI6VB327RTMHJLTPZBYGQ, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.937836643 (70h54m39.368916774s) [noise=true , address=77.90.31.18:4807 , piece_id=JZTPSUJQ7H7AAQC2JQLY37UM2ZPSCFVYDNOG7RSCJ6SPTWCVVPLA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.939510475 (70h54m39.370590596s) [noise=true , address=77.90.31.17:4771 , piece_id=4Y664XUE5YWHPNAWUYSZ4BPISRV5YM5IGV4VK53RCPFZYEEBOKIQ, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.944277246 (70h54m39.375357377s) [noise=true , address=104.36.82.12:4151 , piece_id=QUY4X3H5VQPZXZ4JCHFKXLUETZXOBEN34KO7YZEMVYQEVGKR5ZZA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.945075824 (70h54m39.376155955s) [noise=true , address=45.91.116.13:4155 , piece_id=YTXBYJIN6WYX2LBRDYH7YU55DKC7ZLLECK3HI22IKBWFRT6ZHTIA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.006188045 (70h54m39.437268176s) [noise=true , address=45.91.116.5:4298 , piece_id=QYRZXB5RPTYY3Y54CVYQA76YEOHCKIPOMOP36Z2W6PSF35JDULFA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.042863199 (70h54m39.47394333s) [noise=true , address=77.90.31.14:4663 , piece_id=I5W3UOQI6RQFDF2A5NGYG7GUXBP2XE3N6LCTBVHAXPEWBMVSV26Q, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.048316484 (70h54m39.479396645s) [noise=true , address=77.90.31.19:4843 , piece_id=NZ6GA4W7S4VGYLD5TBIOVCTFSBODMTOQY7SBY5OB2XWE766R2B3A, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.054276718 (70h54m39.485356839s) [noise=true , address=45.91.116.12:4227 , piece_id=C5NVQ4KJ4UVIIXGUUXYLYGZ6T3TVKESSRQX7KSYQZ7O5PYUS3XVA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.056028469 (70h54m39.487108601s) [noise=true , address=45.91.116.13:4153 , piece_id=6FFUWDJYTJPUBXGHDGREUB4OM4DGX6COJTXHFWHLGW7QK3CO2JDA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.056044611 (70h54m39.487124732s) [seg_pos={0 0}, upload=73915]: Segment reached optimal threshold of 13 pieces. Aug 11 16:20:45.056165442 (70h54m39.487245573s) [noise=true , address=45.91.116.6:4974 , piece_id=GUI4A3KX4FASSTLQDMD4PHG75FQZRZEZCWNIMLWEJBBHQ5IH6SIA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Aug 11 16:20:45.056214636 (70h54m39.487294767s) [noise=true , address=104.36.82.10:4079 , piece_id=CYHDYCMVCYISFUDJOXGK2RCJVPRBZXXBAX3ICDJTH4OUPTQL6RMA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 11 16:20:45.056367308 (70h54m39.48744744s) [noise=true , address=104.36.82.5:4839 , piece_id=56H4YACEHZNRC4IGN6LQ2OHVYAL6DFVJ3E5XKXUMAWHO6UCMICGA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:33142->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:33142->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33142->104.36.82.5:4839: use of closed network connection Aug 11 16:20:45.056394020 (70h54m39.487474151s) [seg_pos={0 0}, upload=73915]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 11 16:20:45.056469904 (70h54m39.487550035s) [upload=73915]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 16:20:45.056474313 (70h54m39.487554444s) [upload=73915]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 16:20:45.348914657 (70h54m39.779994788s) [upload=73915]: Done uploading segments... Aug 11 16:20:45.348932771 (70h54m39.780012902s) [upload=73915]: Upload finished. err: <nil> Duration: 5.880299946s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [......................................X.................X..X] duration: 5.643307117s FAIL (2025-08-11 16:52:05 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 057e70622624edd53b9fc51be4b79f2d44d3edfaab7771732fcead8b398b45cf != before 5fa63a3b4367a71718c58f2a9dea4bd743ced7ab5179088fd28949f3defb0b49 ======LOGS====== Aug 11 16:52:00.486330505 (71h25m54.917410636s) [upload=74451]: Starting upload Aug 11 16:52:00.486377434 (71h25m54.917457565s) [upload=74451]: Done starting upload Aug 11 16:52:00.486467226 (71h25m54.917547357s) [upload=74451]: Uploading segments... Aug 11 16:52:00.486565484 (71h25m54.917645615s) [upload=74451]: Got next segment. Inline: false Aug 11 16:52:00.486611342 (71h25m54.917691463s) [upload=74451]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 16:52:00.486615960 (71h25m54.917696091s) [upload=74451]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 16:52:00.936658896 (71h25m55.367739027s) [seg_pos={0 0}, upload=74451]: Begin upload segment... Aug 11 16:52:00.936704133 (71h25m55.367784264s) [seg_pos={0 0}, upload=74451]: Done begin upload segment. Aug 11 16:52:00.936723960 (71h25m55.367804091s) [noise=true , address=104.36.82.9:4018 , piece_id=NBU72ROM7RHSITJ7D7CZJMTG3IR2Y5PU3SIXECRQ6FZHE3BT6DRA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.936760270 (71h25m55.367840401s) [noise=true , address=104.36.82.34:4575 , piece_id=YBYWB3OKPOVXOMX4YTV2R4OKMPCKVPKGAORDS2JBYG66D6UCTA4A, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.937115760 (71h25m55.368195891s) [noise=true , address=104.36.82.38:4701 , piece_id=J4HDMCTPA4XS7DWE5LGJRVYMLR7BYPVHDAMWWGBW5YVJF236VK4Q, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.937240989 (71h25m55.368321121s) [noise=true , address=77.90.31.17:4791 , piece_id=X5DIN2SDWPH4EKQPOBZFINYODZ2AU46ZEIULAPHWDOMSESRXCGUA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.937385226 (71h25m55.368465357s) [noise=true , address=104.36.82.5:4843 , piece_id=XJH5W64QKAIEMSJ7WPDZRWG5GK2S56664IQDPUPW52CBEAT4MASA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.937648880 (71h25m55.368729011s) [noise=true , address=104.36.82.20:4440 , piece_id=2YLIUD4JWKADFVQ73AFWOYFZWRLAKUQ423WM4X5K56W7UOY6XUIA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.937939637 (71h25m55.369019768s) [noise=true , address=104.36.82.16:4312 , piece_id=GUEBWOWC56BV4WHI3HUHNNMOZJ54HZJRO4JLQNTMOJ76H6E3FMSQ, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.938208932 (71h25m55.369289063s) [noise=true , address=79.127.219.48:4086 , piece_id=BIIPBGT2VPPMNHLEHIMBWR4QU4RFB5GG3FU2XJAGQMIR4GSUVSPQ, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.938479660 (71h25m55.369559781s) [noise=true , address=79.127.219.38:4022 , piece_id=RBHTYSRKVYXZA5G4XEVYKVE7DV7V67WSUTH56MKTEIDUGRMXGREQ, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.938700222 (71h25m55.369780353s) [noise=true , address=79.127.220.98:4423 , piece_id=GRPLJQ3CSTHWJVXE7EUROVFV5JPIHVKYIUKFUR5HUYWEOWOIAQ5A, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.938911195 (71h25m55.369991326s) [noise=true , address=77.90.31.15:4732 , piece_id=JHKT2MSCWGGQF2Y2CTQZRGLPWELEGUWDA35CHK4KTGRNI2HNQZBA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.938988644 (71h25m55.370068775s) [noise=true , address=104.36.82.61:4378 , piece_id=ITY2O2P6SFXLNXJWJ4G56X26YJPGOJ4UATMPHYVCXFLEKVNMUKMA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.939229625 (71h25m55.370309756s) [noise=true , address=79.127.220.101:4074 , piece_id=JFTUZQVWSA32A33LCPSFPLBFRTOR6XT4M62XUI752T6CEM55EZQQ, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.939450798 (71h25m55.370530929s) [noise=true , address=104.36.82.59:4306 , piece_id=KNA553JSWSIB3D7EL62I576OQCRPFFJP7E4UL3D3I4MNVRIANVPA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.939676660 (71h25m55.370756791s) [noise=true , address=104.36.82.47:4533 , piece_id=FR55EWHLGG7DLRGUAIJCA56TQ7RPKDBQLGX33K6FHCWYV462WKJQ, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.939888225 (71h25m55.370968346s) [noise=true , address=104.36.82.62:4438 , piece_id=IXFU2VVB6LBSY523KZD4CPL5C5II7MOC7ZRVJCXTZ7DKWCWXEYBA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.940116682 (71h25m55.371196813s) [noise=true , address=104.36.82.45:4915 , piece_id=BEUVRN2GXXIR2XQXDBHIVNYZE7RIJ3EHIQSHMZYEPFUQNXALRTXA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:00.940314681 (71h25m55.371394812s) [noise=true , address=104.36.82.4:4809 , piece_id=3QKBP7QTZQBWTJ7PFMR7Z4GNKRJ3MLWTUVTZE7RS3AI33HNW7XBA, seg_pos={0 0}, upload=74451]: Uploading piece... Aug 11 16:52:02.407046143 (71h25m56.838126274s) [upload=74451]: Next returned nil segment Aug 11 16:52:02.407066482 (71h25m56.838146613s) [upload=74451]: Waiting for error group managing segments... Aug 11 16:52:02.784099481 (71h25m57.215179612s) [noise=true , address=79.127.220.98:4423 , piece_id=GRPLJQ3CSTHWJVXE7EUROVFV5JPIHVKYIUKFUR5HUYWEOWOIAQ5A, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.799355832 (71h25m57.230435963s) [noise=true , address=79.127.220.101:4074 , piece_id=JFTUZQVWSA32A33LCPSFPLBFRTOR6XT4M62XUI752T6CEM55EZQQ, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.824743848 (71h25m57.255823979s) [noise=true , address=79.127.219.48:4086 , piece_id=BIIPBGT2VPPMNHLEHIMBWR4QU4RFB5GG3FU2XJAGQMIR4GSUVSPQ, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.856539797 (71h25m57.287619928s) [noise=true , address=79.127.219.38:4022 , piece_id=RBHTYSRKVYXZA5G4XEVYKVE7DV7V67WSUTH56MKTEIDUGRMXGREQ, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.892199348 (71h25m57.323279499s) [noise=true , address=104.36.82.34:4575 , piece_id=YBYWB3OKPOVXOMX4YTV2R4OKMPCKVPKGAORDS2JBYG66D6UCTA4A, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.900582107 (71h25m57.331662238s) [noise=true , address=104.36.82.38:4701 , piece_id=J4HDMCTPA4XS7DWE5LGJRVYMLR7BYPVHDAMWWGBW5YVJF236VK4Q, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.901661613 (71h25m57.332741744s) [noise=true , address=77.90.31.17:4791 , piece_id=X5DIN2SDWPH4EKQPOBZFINYODZ2AU46ZEIULAPHWDOMSESRXCGUA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.924967335 (71h25m57.356047466s) [noise=true , address=104.36.82.4:4809 , piece_id=3QKBP7QTZQBWTJ7PFMR7Z4GNKRJ3MLWTUVTZE7RS3AI33HNW7XBA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.934432455 (71h25m57.365512586s) [noise=true , address=104.36.82.5:4843 , piece_id=XJH5W64QKAIEMSJ7WPDZRWG5GK2S56664IQDPUPW52CBEAT4MASA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.944250341 (71h25m57.375330472s) [noise=true , address=104.36.82.16:4312 , piece_id=GUEBWOWC56BV4WHI3HUHNNMOZJ54HZJRO4JLQNTMOJ76H6E3FMSQ, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.959326207 (71h25m57.390406338s) [noise=true , address=104.36.82.47:4533 , piece_id=FR55EWHLGG7DLRGUAIJCA56TQ7RPKDBQLGX33K6FHCWYV462WKJQ, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.965101627 (71h25m57.396181758s) [noise=true , address=104.36.82.9:4018 , piece_id=NBU72ROM7RHSITJ7D7CZJMTG3IR2Y5PU3SIXECRQ6FZHE3BT6DRA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.975109015 (71h25m57.406189147s) [noise=true , address=104.36.82.20:4440 , piece_id=2YLIUD4JWKADFVQ73AFWOYFZWRLAKUQ423WM4X5K56W7UOY6XUIA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.989812008 (71h25m57.420892139s) [noise=true , address=104.36.82.62:4438 , piece_id=IXFU2VVB6LBSY523KZD4CPL5C5II7MOC7ZRVJCXTZ7DKWCWXEYBA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: <nil> Aug 11 16:52:02.989838749 (71h25m57.42091887s) [seg_pos={0 0}, upload=74451]: Segment reached optimal threshold of 14 pieces. Aug 11 16:52:02.989941887 (71h25m57.421022018s) [noise=true , address=104.36.82.45:4915 , piece_id=BEUVRN2GXXIR2XQXDBHIVNYZE7RIJ3EHIQSHMZYEPFUQNXALRTXA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17rmsv4edxH6jmsN83ceiVJdfEui1qrBK5XBcf7GgvKCn2fknT): protocol: expected piece hash; context canceled; EOF Aug 11 16:52:02.990013944 (71h25m57.421094065s) [noise=true , address=104.36.82.61:4378 , piece_id=ITY2O2P6SFXLNXJWJ4G56X26YJPGOJ4UATMPHYVCXFLEKVNMUKMA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DcpXz1fKrWhdPxTpGUFmydMUuzMQpNFMgGB75BAVrjdMiSkhW): protocol: expected piece hash; context canceled; EOF Aug 11 16:52:02.990088507 (71h25m57.421168638s) [noise=true , address=77.90.31.15:4732 , piece_id=JHKT2MSCWGGQF2Y2CTQZRGLPWELEGUWDA35CHK4KTGRNI2HNQZBA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NyFYdUBbAhAijCDtPWB1zJCjwhgw35vEQoE4qJyg2PywRn5AH): protocol: expected piece hash; context canceled; EOF Aug 11 16:52:02.990112323 (71h25m57.421192454s) [noise=true , address=104.36.82.59:4306 , piece_id=KNA553JSWSIB3D7EL62I576OQCRPFFJP7E4UL3D3I4MNVRIANVPA, seg_pos={0 0}, upload=74451]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12amBPo7WKpjPDzi6mUWw5PcdgrcT7hsUjsSkijfrvKka1bJzNw): protocol: expected piece hash; context canceled; EOF Aug 11 16:52:02.990176205 (71h25m57.421256346s) [seg_pos={0 0}, upload=74451]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 16:52:02.990294881 (71h25m57.421375022s) [upload=74451]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 16:52:02.990301134 (71h25m57.421381275s) [upload=74451]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 16:52:03.289620958 (71h25m57.720701089s) [upload=74451]: Done uploading segments... Aug 11 16:52:03.289639453 (71h25m57.720719574s) [upload=74451]: Upload finished. err: <nil> Duration: 5.643327506s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..........X...............................X........X........] duration: 1.839302351s FAIL (2025-08-11 16:51:41 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 7ca3b38f59bef6700c47a71c0ce137786b019861ef4e351f330d4f1e41b86704 != before b8ccbd272fe59726b04686e0542c1e0964e89942b662558e091433dc0e7e3dc5 ======LOGS====== Aug 11 16:46:39.434150567 (71h20m33.865230698s) [upload=74358]: Starting upload Aug 11 16:46:39.434202827 (71h20m33.865282958s) [upload=74358]: Done starting upload Aug 11 16:46:39.434253474 (71h20m33.865333605s) [upload=74358]: Uploading segments... Aug 11 16:46:39.434289643 (71h20m33.865369774s) [upload=74358]: Got next segment. Inline: true Aug 11 16:46:39.434293440 (71h20m33.865373561s) [upload=74358]: Waiting for error group managing segments... Aug 11 16:46:39.434326714 (71h20m33.865406845s) [upload=74358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 16:46:39.434330481 (71h20m33.865410612s) [upload=74358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 16:46:39.434332896 (71h20m33.865413017s) [upload=74358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 16:46:39.727280447 (71h20m34.158360588s) [upload=74358]: Done uploading segments... Aug 11 16:46:39.727301838 (71h20m34.158381969s) [upload=74358]: Upload finished. err: <nil> Duration:* 1.839326889s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 5.912173768s FAIL (2025-08-11 16:51:23 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 11 16:20:42.438359750 (70h54m36.869439881s) [upload=73915]: Starting upload Aug 11 16:20:42.438414104 (70h54m36.869494225s) [upload=73915]: Done starting upload Aug 11 16:20:42.438489136 (70h54m36.869569267s) [upload=73915]: Uploading segments... Aug 11 16:20:42.438621770 (70h54m36.869701891s) [upload=73915]: Got next segment. Inline: false Aug 11 16:20:42.438664713 (70h54m36.869744844s) [upload=73915]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 16:20:42.438669001 (70h54m36.869749132s) [upload=73915]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 16:20:42.676790711 (70h54m37.107870842s) [seg_pos={0 0}, upload=73915]: Begin upload segment... Aug 11 16:20:42.676835908 (70h54m37.107916039s) [seg_pos={0 0}, upload=73915]: Done begin upload segment. Aug 11 16:20:42.676853832 (70h54m37.107933964s) [noise=true , address=77.90.31.14:4663 , piece_id=I5W3UOQI6RQFDF2A5NGYG7GUXBP2XE3N6LCTBVHAXPEWBMVSV26Q, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.676866747 (70h54m37.107946878s) [noise=true , address=104.36.82.10:4079 , piece_id=CYHDYCMVCYISFUDJOXGK2RCJVPRBZXXBAX3ICDJTH4OUPTQL6RMA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.676910421 (70h54m37.107990552s) [noise=true , address=77.90.31.11:4555 , piece_id=42V6RDCOSJRZYHIH7AUYX35F7GRXVZRHRUNBTI3ZDDQSVK2IYBAA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.676958241 (70h54m37.108038383s) [noise=true , address=45.91.116.13:4153 , piece_id=6FFUWDJYTJPUBXGHDGREUB4OM4DGX6COJTXHFWHLGW7QK3CO2JDA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.677329863 (70h54m37.108409994s) [noise=true , address=45.91.116.6:4974 , piece_id=GUI4A3KX4FASSTLQDMD4PHG75FQZRZEZCWNIMLWEJBBHQ5IH6SIA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.677368517 (70h54m37.108448648s) [noise=true , address=45.91.116.10:4083 , piece_id=ACEAUOZZCKIA4LTESFID3ZWUKFVTJACUI6VB327RTMHJLTPZBYGQ, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.677671015 (70h54m37.108751146s) [noise=true , address=77.90.31.17:4771 , piece_id=4Y664XUE5YWHPNAWUYSZ4BPISRV5YM5IGV4VK53RCPFZYEEBOKIQ, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678009293 (70h54m37.109089424s) [noise=true , address=45.91.116.7:4010 , piece_id=I5FZKKDZEIJAEBGXVY5E4PSKY2XN6FFB6YJI7CTWGTS63FVWC77A, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678247930 (70h54m37.109328061s) [noise=true , address=77.90.31.19:4843 , piece_id=NZ6GA4W7S4VGYLD5TBIOVCTFSBODMTOQY7SBY5OB2XWE766R2B3A, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678532164 (70h54m37.109612285s) [noise=true , address=45.91.116.12:4227 , piece_id=C5NVQ4KJ4UVIIXGUUXYLYGZ6T3TVKESSRQX7KSYQZ7O5PYUS3XVA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678765730 (70h54m37.109845861s) [noise=true , address=104.36.82.12:4151 , piece_id=QUY4X3H5VQPZXZ4JCHFKXLUETZXOBEN34KO7YZEMVYQEVGKR5ZZA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678993456 (70h54m37.110073587s) [noise=true , address=45.91.116.13:4155 , piece_id=YTXBYJIN6WYX2LBRDYH7YU55DKC7ZLLECK3HI22IKBWFRT6ZHTIA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679139145 (70h54m37.110219266s) [noise=true , address=45.91.116.4:4939 , piece_id=D3TLK6SUW4O7UUZVU6PADTAGQZ6SJHYAXYG2UULS7VZNMZ5YSOIA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679376159 (70h54m37.11045629s) [noise=true , address=45.91.116.5:4298 , piece_id=QYRZXB5RPTYY3Y54CVYQA76YEOHCKIPOMOP36Z2W6PSF35JDULFA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679589166 (70h54m37.110669297s) [noise=true , address=104.36.82.5:4839 , piece_id=56H4YACEHZNRC4IGN6LQ2OHVYAL6DFVJ3E5XKXUMAWHO6UCMICGA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679786334 (70h54m37.110866465s) [noise=true , address=77.90.31.18:4807 , piece_id=JZTPSUJQ7H7AAQC2JQLY37UM2ZPSCFVYDNOG7RSCJ6SPTWCVVPLA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:44.458058779 (70h54m38.88913891s) [upload=73915]: Next returned nil segment Aug 11 16:20:44.458076964 (70h54m38.889157095s) [upload=73915]: Waiting for error group managing segments... Aug 11 16:20:44.762791322 (70h54m39.193871453s) [noise=true , address=45.91.116.7:4010 , piece_id=I5FZKKDZEIJAEBGXVY5E4PSKY2XN6FFB6YJI7CTWGTS63FVWC77A, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.819598246 (70h54m39.250678377s) [noise=true , address=45.91.116.4:4939 , piece_id=D3TLK6SUW4O7UUZVU6PADTAGQZ6SJHYAXYG2UULS7VZNMZ5YSOIA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.877739022 (70h54m39.308819143s) [noise=true , address=77.90.31.11:4555 , piece_id=42V6RDCOSJRZYHIH7AUYX35F7GRXVZRHRUNBTI3ZDDQSVK2IYBAA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.936181786 (70h54m39.367261918s) [noise=true , address=45.91.116.10:4083 , piece_id=ACEAUOZZCKIA4LTESFID3ZWUKFVTJACUI6VB327RTMHJLTPZBYGQ, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.937836643 (70h54m39.368916774s) [noise=true , address=77.90.31.18:4807 , piece_id=JZTPSUJQ7H7AAQC2JQLY37UM2ZPSCFVYDNOG7RSCJ6SPTWCVVPLA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.939510475 (70h54m39.370590596s) [noise=true , address=77.90.31.17:4771 , piece_id=4Y664XUE5YWHPNAWUYSZ4BPISRV5YM5IGV4VK53RCPFZYEEBOKIQ, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.944277246 (70h54m39.375357377s) [noise=true , address=104.36.82.12:4151 , piece_id=QUY4X3H5VQPZXZ4JCHFKXLUETZXOBEN34KO7YZEMVYQEVGKR5ZZA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.945075824 (70h54m39.376155955s) [noise=true , address=45.91.116.13:4155 , piece_id=YTXBYJIN6WYX2LBRDYH7YU55DKC7ZLLECK3HI22IKBWFRT6ZHTIA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.006188045 (70h54m39.437268176s) [noise=true , address=45.91.116.5:4298 , piece_id=QYRZXB5RPTYY3Y54CVYQA76YEOHCKIPOMOP36Z2W6PSF35JDULFA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.042863199 (70h54m39.47394333s) [noise=true , address=77.90.31.14:4663 , piece_id=I5W3UOQI6RQFDF2A5NGYG7GUXBP2XE3N6LCTBVHAXPEWBMVSV26Q, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.048316484 (70h54m39.479396645s) [noise=true , address=77.90.31.19:4843 , piece_id=NZ6GA4W7S4VGYLD5TBIOVCTFSBODMTOQY7SBY5OB2XWE766R2B3A, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.054276718 (70h54m39.485356839s) [noise=true , address=45.91.116.12:4227 , piece_id=C5NVQ4KJ4UVIIXGUUXYLYGZ6T3TVKESSRQX7KSYQZ7O5PYUS3XVA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.056028469 (70h54m39.487108601s) [noise=true , address=45.91.116.13:4153 , piece_id=6FFUWDJYTJPUBXGHDGREUB4OM4DGX6COJTXHFWHLGW7QK3CO2JDA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.056044611 (70h54m39.487124732s) [seg_pos={0 0}, upload=73915]: Segment reached optimal threshold of 13 pieces. Aug 11 16:20:45.056165442 (70h54m39.487245573s) [noise=true , address=45.91.116.6:4974 , piece_id=GUI4A3KX4FASSTLQDMD4PHG75FQZRZEZCWNIMLWEJBBHQ5IH6SIA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Aug 11 16:20:45.056214636 (70h54m39.487294767s) [noise=true , address=104.36.82.10:4079 , piece_id=CYHDYCMVCYISFUDJOXGK2RCJVPRBZXXBAX3ICDJTH4OUPTQL6RMA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 11 16:20:45.056367308 (70h54m39.48744744s) [noise=true , address=104.36.82.5:4839 , piece_id=56H4YACEHZNRC4IGN6LQ2OHVYAL6DFVJ3E5XKXUMAWHO6UCMICGA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:33142->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:33142->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33142->104.36.82.5:4839: use of closed network connection Aug 11 16:20:45.056394020 (70h54m39.487474151s) [seg_pos={0 0}, upload=73915]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 11 16:20:45.056469904 (70h54m39.487550035s) [upload=73915]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 16:20:45.056474313 (70h54m39.487554444s) [upload=73915]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 16:20:45.348914657 (70h54m39.779994788s) [upload=73915]: Done uploading segments... Aug 11 16:20:45.348932771 (70h54m39.780012902s) [upload=73915]: Upload finished. err: <nil> Duration: 5.912201131s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......................................X.................X..] duration: 5.962366496s FAIL (2025-08-11 16:51:15 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 11 16:49:18.944471487 (71h23m13.375551618s) [upload=74403]: Starting upload Aug 11 16:49:18.944518647 (71h23m13.375598778s) [upload=74403]: Done starting upload Aug 11 16:49:18.944627255 (71h23m13.375707386s) [upload=74403]: Uploading segments... Aug 11 16:49:18.944705966 (71h23m13.375786087s) [upload=74403]: Got next segment. Inline: false Aug 11 16:49:18.944736013 (71h23m13.375816144s) [upload=74403]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 16:49:18.944740451 (71h23m13.375820582s) [upload=74403]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 16:49:19.412483995 (71h23m13.843564126s) [seg_pos={0 0}, upload=74403]: Begin upload segment... Aug 11 16:49:19.412592252 (71h23m13.843672383s) [seg_pos={0 0}, upload=74403]: Done begin upload segment. Aug 11 16:49:19.412616048 (71h23m13.843696179s) [noise=true , address=104.36.82.22:4535 , piece_id=26WEYM4OIWDWC73DJW7YFGNWNWNGWABTUJVW26E2G2P35SCVJ4AA, seg_pos={0 0}, upload=74403]: Uploading piece... Aug 11 16:49:19.412642639 (71h23m13.84372277s) [noise=true , address=104.36.82.2:4749 , piece_id=RXSUPO45DQCUATOEC5IBVALVTOEEUAUGON6VDGYHEE5QXECCMWPA, seg_pos={0 0}, upload=74403]: Uploading piece... Aug 11 16:49:19.412975856 (71h23m13.844055987s) [noise=true , address=104.36.82.17:4353 , piece_id=WI44F7R7JWGMLJZ7DMHNXDXQXY5MWPABRGC6BNSJUUMTL7PMZCGA, seg_pos={0 0}, upload=74403]: Uploading piece... Aug 11 16:49:19.413108280 (71h23m13.844188411s) [noise=true , address=79.127.219.47:4054 , piece_id=PMLML2PLMN4MKR3FQK3F2XGNTNXFVRYDI3TVARBU2K6LSOB6BZAA, seg_pos={0 0}, upload=74403]: Uploading piece... Aug 11 16:49:19.413277503 (71h23m13.844357634s) [noise=true , address=77.90.31.12:4606 , piece_id=WJE5A37TPGJXWKDHVZNQIRMG4YRQQKRMX5FJRL3SEOVBH6GHWJGA, seg_pos={0 0}, upload=74403]: Uploading piece... Aug 11 16:49:19.413397412 (71h23m13.844477543s) [noise=true , address=104.36.82.8:4990 , piece_id=QGJJXDBGZEP2DEWMRXUKIC73VGJEEK4YCWW2LA2OGQBIBR46CL7Q, seg_pos={0 0}, upload=74403]: Uploading piece... Aug 11 16:49:19.413566917 (71h23m13.844647048s) [noise=true , address=77.90.31.16:4755 , piece_id=37GJASWFAMBEKZZ7DFUFHOBTE4Q3KX6TKM5TD3VAJ4TFSTO2CBPA, seg_pos={0 0}, upload=74403]: Uploading piece... Aug 11 16:49:19.413683079 (71h23m13.8447632s) [noise=true , address=104.36.82.42:4822 , piece_id=YWMOKUGKB57UK33OEYHECUTM5WIP3ILYTBYTTIVL5N7JN6RGLJJA, seg_pos={0 0}, upload=74403]: Uploading piece... Aug 11 16:49:19.413866561 (71h23m13.844946692s) [noise=true , address=104.36.82.23:4467 , piece_id=T2OXSWDKINFO4MYRGPF7SYEQS2MIYFQD2CHD2QXUMEROGAOCENJA, seg_pos={0 0}, upload=74403]: Uploading piece... Aug 11 16:49:19.413969918 (71h23m13.845050049s) [noise=true , address=104.36.82.37:4688 , piece_id=QBMPNTZAYDYFBJVVF625AT5AVPU7GMCTLCB7TAMGSK64PKHPFHUA, seg_pos={0 0}, upload=74403]: Uploading piece... Aug 11 16:49:19.414154862 (71h23m13.845234993s) [noise=true , address=104.36.82.4:4826 , piece_id=7XVGNAJ5IW2PGT7GOTQLZAGEHDBN6P4WCMYJPSN3FFPB7ZSNBXMA, seg_pos={0 0}, upload=74403]: Uploading piece... Aug 11 16:49:19.414201211 (71h23m13.845281342s) [noise=true , address=104.36.82.62:4416 , piece_id=3U7JT6LG5LGRX4L6FKGNWESD4CJK4666NOTN7XEC6MU27TZVZ64A, seg_pos={0 0}, upload=74403]: Uploading piece... Aug 11 16:49:19.414453503 (71h23m13.845533634s) [noise=true , address=104.36.82.36:4624 , piece_id=DHLJH5KQX2I4Y2BJQB2ZX4DDG3OAKQIKY3NBPJEJLP3WTQ6WH4PA, seg_pos={0 0}, upload=74403]: Uploading piece... Aug 11 16:49:19.414465746 (71h23m13.845545877s) [noise=true , address=104.36.82.39:4734 , piece_id=ME7BVX3VAEBZFIRX6WYGFWVAOS6SVZ6UKV77N23JP4LEMCH5GODQ, seg_pos={0 0}, upload=74403]: Uploading piece... Aug 11 16:49:19.415249597 (71h23m13.846329728s) [noise=true , address=104.36.82.43:4846 , piece_id=ZWLEYGESEJIVJRS4Z55EZ5VAV2DVU7ENHCBRLFSP7ZPREGUV4MLA, seg_pos={0 0}, upload=74403]: Uploading piece... Aug 11 16:49:19.415682846 (71h23m13.846762977s) [noise=true , address=104.36.82.18:4388 , piece_id=2LFQWJTHZMW2NXLYQAMFNFYJS7KH3DJHGHPSFA2RVYDSG7I72CQA, seg_pos={0 0}, upload=74403]: Uploading piece... Aug 11 16:49:19.416173114 (71h23m13.847253245s) [noise=true , address=104.36.82.38:4712 , piece_id=ZG27CPMFX2GCT35YU4A4AUZTQ5ZTC7HMNBK5PTYIHUT3NJJEPQAQ, seg_pos={0 0}, upload=74403]: Uploading piece... Aug 11 16:49:19.416712255 (71h23m13.847792386s) [noise=true , address=104.36.82.58:4272 , piece_id=SIB7YP5BUG5H36PN77DO6U75JUD5MTFAQANHMMZ2RN5KGTIQFEYA, seg_pos={0 0}, upload=74403]: Uploading piece... Aug 11 16:49:20.920556665 (71h23m15.351636796s) [upload=74403]: Next returned nil segment Aug 11 16:49:20.920587855 (71h23m15.351667976s) [upload=74403]: Waiting for error group managing segments... Aug 11 16:49:21.305980179 (71h23m15.73706031s) [noise=true , address=79.127.219.47:4054 , piece_id=PMLML2PLMN4MKR3FQK3F2XGNTNXFVRYDI3TVARBU2K6LSOB6BZAA, seg_pos={0 0}, upload=74403]: Done uploading piece. err: <nil> Aug 11 16:49:21.368620624 (71h23m15.799700755s) [noise=true , address=104.36.82.39:4734 , piece_id=ME7BVX3VAEBZFIRX6WYGFWVAOS6SVZ6UKV77N23JP4LEMCH5GODQ, seg_pos={0 0}, upload=74403]: Done uploading piece. err: <nil> Aug 11 16:49:21.413382250 (71h23m15.844462371s) [noise=true , address=104.36.82.18:4388 , piece_id=2LFQWJTHZMW2NXLYQAMFNFYJS7KH3DJHGHPSFA2RVYDSG7I72CQA, seg_pos={0 0}, upload=74403]: Done uploading piece. err: <nil> Aug 11 16:49:21.414042083 (71h23m15.845122204s) [noise=true , address=104.36.82.38:4712 , piece_id=ZG27CPMFX2GCT35YU4A4AUZTQ5ZTC7HMNBK5PTYIHUT3NJJEPQAQ, seg_pos={0 0}, upload=74403]: Done uploading piece. err: <nil> Aug 11 16:49:21.425564870 (71h23m15.856645041s) [noise=true , address=104.36.82.4:4826 , piece_id=7XVGNAJ5IW2PGT7GOTQLZAGEHDBN6P4WCMYJPSN3FFPB7ZSNBXMA, seg_pos={0 0}, upload=74403]: Done uploading piece. err: <nil> Aug 11 16:49:21.452663190 (71h23m15.883743351s) [noise=true , address=77.90.31.16:4755 , piece_id=37GJASWFAMBEKZZ7DFUFHOBTE4Q3KX6TKM5TD3VAJ4TFSTO2CBPA, seg_pos={0 0}, upload=74403]: Done uploading piece. err: <nil> Aug 11 16:49:21.456150162 (71h23m15.887230293s) [noise=true , address=104.36.82.22:4535 , piece_id=26WEYM4OIWDWC73DJW7YFGNWNWNGWABTUJVW26E2G2P35SCVJ4AA, seg_pos={0 0}, upload=74403]: Done uploading piece. err: <nil> Aug 11 16:49:21.470305246 (71h23m15.901385377s) [noise=true , address=104.36.82.43:4846 , piece_id=ZWLEYGESEJIVJRS4Z55EZ5VAV2DVU7ENHCBRLFSP7ZPREGUV4MLA, seg_pos={0 0}, upload=74403]: Done uploading piece. err: <nil> Aug 11 16:49:21.471577289 (71h23m15.90265742s) [noise=true , address=104.36.82.8:4990 , piece_id=QGJJXDBGZEP2DEWMRXUKIC73VGJEEK4YCWW2LA2OGQBIBR46CL7Q, seg_pos={0 0}, upload=74403]: Done uploading piece. err: <nil> Aug 11 16:49:21.486989349 (71h23m15.91806948s) [noise=true , address=104.36.82.62:4416 , piece_id=3U7JT6LG5LGRX4L6FKGNWESD4CJK4666NOTN7XEC6MU27TZVZ64A, seg_pos={0 0}, upload=74403]: Done uploading piece. err: <nil> Aug 11 16:49:21.520684981 (71h23m15.951765112s) [noise=true , address=104.36.82.58:4272 , piece_id=SIB7YP5BUG5H36PN77DO6U75JUD5MTFAQANHMMZ2RN5KGTIQFEYA, seg_pos={0 0}, upload=74403]: Done uploading piece. err: <nil> Aug 11 16:49:21.523583547 (71h23m15.954663668s) [noise=true , address=104.36.82.36:4624 , piece_id=DHLJH5KQX2I4Y2BJQB2ZX4DDG3OAKQIKY3NBPJEJLP3WTQ6WH4PA, seg_pos={0 0}, upload=74403]: Done uploading piece. err: <nil> Aug 11 16:49:21.547772049 (71h23m15.978852181s) [noise=true , address=104.36.82.23:4467 , piece_id=T2OXSWDKINFO4MYRGPF7SYEQS2MIYFQD2CHD2QXUMEROGAOCENJA, seg_pos={0 0}, upload=74403]: Done uploading piece. err: <nil> Aug 11 16:49:21.601922691 (71h23m16.033002822s) [noise=true , address=104.36.82.17:4353 , piece_id=WI44F7R7JWGMLJZ7DMHNXDXQXY5MWPABRGC6BNSJUUMTL7PMZCGA, seg_pos={0 0}, upload=74403]: Done uploading piece. err: <nil> Aug 11 16:49:21.601948460 (71h23m16.033028591s) [seg_pos={0 0}, upload=74403]: Segment reached optimal threshold of 14 pieces. Aug 11 16:49:21.602053992 (71h23m16.033134123s) [noise=true , address=104.36.82.37:4688 , piece_id=QBMPNTZAYDYFBJVVF625AT5AVPU7GMCTLCB7TAMGSK64PKHPFHUA, seg_pos={0 0}, upload=74403]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XHxPHd22b7s5tj2pYXzUnC6AXMnPnNSB4jw3RYfKtwu6jwaVN): protocol: expected piece hash; context canceled; EOF Aug 11 16:49:21.602085342 (71h23m16.033165473s) [noise=true , address=104.36.82.2:4749 , piece_id=RXSUPO45DQCUATOEC5IBVALVTOEEUAUGON6VDGYHEE5QXECCMWPA, seg_pos={0 0}, upload=74403]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm): protocol: expected piece hash; context canceled; EOF Aug 11 16:49:21.602143503 (71h23m16.033223634s) [noise=true , address=77.90.31.12:4606 , piece_id=WJE5A37TPGJXWKDHVZNQIRMG4YRQQKRMX5FJRL3SEOVBH6GHWJGA, seg_pos={0 0}, upload=74403]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pLKmTja7ttT6vqjq8vHMYR9RLfnpqxY9xm9GDBG8ez9aHujs): protocol: expected piece hash; context canceled; EOF Aug 11 16:49:21.602181275 (71h23m16.033261406s) [noise=true , address=104.36.82.42:4822 , piece_id=YWMOKUGKB57UK33OEYHECUTM5WIP3ILYTBYTTIVL5N7JN6RGLJJA, seg_pos={0 0}, upload=74403]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127uUPZhKGPaiMVxTEH919M1WvLqDM9VLgaBkuaTBuPbdaXKLLG): protocol: write tcp 188.166.225.170:40354->104.36.82.42:4822: use of closed network connection; write tcp 188.166.225.170:40354->104.36.82.42:4822: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40354->104.36.82.42:4822: use of closed network connection Aug 11 16:49:21.602195823 (71h23m16.033275954s) [seg_pos={0 0}, upload=74403]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 16:49:21.602256068 (71h23m16.033336199s) [upload=74403]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 16:49:21.602260126 (71h23m16.033340247s) [upload=74403]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 16:49:21.983977859 (71h23m16.41505799s) [upload=74403]: Done uploading segments... Aug 11 16:49:21.983996234 (71h23m16.415076365s) [upload=74403]: Upload finished. err: <nil> Duration: 5.962394259s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...........X...............................X........X.......] duration: 1.882490398s FAIL (2025-08-11 16:51:13 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 7ca3b38f59bef6700c47a71c0ce137786b019861ef4e351f330d4f1e41b86704 != before b8ccbd272fe59726b04686e0542c1e0964e89942b662558e091433dc0e7e3dc5 ======LOGS====== Aug 11 16:46:39.434150567 (71h20m33.865230698s) [upload=74358]: Starting upload Aug 11 16:46:39.434202827 (71h20m33.865282958s) [upload=74358]: Done starting upload Aug 11 16:46:39.434253474 (71h20m33.865333605s) [upload=74358]: Uploading segments... Aug 11 16:46:39.434289643 (71h20m33.865369774s) [upload=74358]: Got next segment. Inline: true Aug 11 16:46:39.434293440 (71h20m33.865373561s) [upload=74358]: Waiting for error group managing segments... Aug 11 16:46:39.434326714 (71h20m33.865406845s) [upload=74358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 16:46:39.434330481 (71h20m33.865410612s) [upload=74358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 16:46:39.434332896 (71h20m33.865413017s) [upload=74358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 16:46:39.727280447 (71h20m34.158360588s) [upload=74358]: Done uploading segments... Aug 11 16:46:39.727301838 (71h20m34.158381969s) [upload=74358]: Upload finished. err: <nil> Duration:* 1.882510137s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [............X...............................X........X......] duration: 1.85933841s FAIL (2025-08-11 16:50:46 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 7ca3b38f59bef6700c47a71c0ce137786b019861ef4e351f330d4f1e41b86704 != before b8ccbd272fe59726b04686e0542c1e0964e89942b662558e091433dc0e7e3dc5 ======LOGS====== Aug 11 16:46:39.434150567 (71h20m33.865230698s) [upload=74358]: Starting upload Aug 11 16:46:39.434202827 (71h20m33.865282958s) [upload=74358]: Done starting upload Aug 11 16:46:39.434253474 (71h20m33.865333605s) [upload=74358]: Uploading segments... Aug 11 16:46:39.434289643 (71h20m33.865369774s) [upload=74358]: Got next segment. Inline: true Aug 11 16:46:39.434293440 (71h20m33.865373561s) [upload=74358]: Waiting for error group managing segments... Aug 11 16:46:39.434326714 (71h20m33.865406845s) [upload=74358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 16:46:39.434330481 (71h20m33.865410612s) [upload=74358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 16:46:39.434332896 (71h20m33.865413017s) [upload=74358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 16:46:39.727280447 (71h20m34.158360588s) [upload=74358]: Done uploading segments... Aug 11 16:46:39.727301838 (71h20m34.158381969s) [upload=74358]: Upload finished. err: <nil> Duration:* 1.859365452s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 6.279214913s FAIL (2025-08-11 16:50:30 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 11 16:20:42.438359750 (70h54m36.869439881s) [upload=73915]: Starting upload Aug 11 16:20:42.438414104 (70h54m36.869494225s) [upload=73915]: Done starting upload Aug 11 16:20:42.438489136 (70h54m36.869569267s) [upload=73915]: Uploading segments... Aug 11 16:20:42.438621770 (70h54m36.869701891s) [upload=73915]: Got next segment. Inline: false Aug 11 16:20:42.438664713 (70h54m36.869744844s) [upload=73915]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 16:20:42.438669001 (70h54m36.869749132s) [upload=73915]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 16:20:42.676790711 (70h54m37.107870842s) [seg_pos={0 0}, upload=73915]: Begin upload segment... Aug 11 16:20:42.676835908 (70h54m37.107916039s) [seg_pos={0 0}, upload=73915]: Done begin upload segment. Aug 11 16:20:42.676853832 (70h54m37.107933964s) [noise=true , address=77.90.31.14:4663 , piece_id=I5W3UOQI6RQFDF2A5NGYG7GUXBP2XE3N6LCTBVHAXPEWBMVSV26Q, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.676866747 (70h54m37.107946878s) [noise=true , address=104.36.82.10:4079 , piece_id=CYHDYCMVCYISFUDJOXGK2RCJVPRBZXXBAX3ICDJTH4OUPTQL6RMA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.676910421 (70h54m37.107990552s) [noise=true , address=77.90.31.11:4555 , piece_id=42V6RDCOSJRZYHIH7AUYX35F7GRXVZRHRUNBTI3ZDDQSVK2IYBAA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.676958241 (70h54m37.108038383s) [noise=true , address=45.91.116.13:4153 , piece_id=6FFUWDJYTJPUBXGHDGREUB4OM4DGX6COJTXHFWHLGW7QK3CO2JDA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.677329863 (70h54m37.108409994s) [noise=true , address=45.91.116.6:4974 , piece_id=GUI4A3KX4FASSTLQDMD4PHG75FQZRZEZCWNIMLWEJBBHQ5IH6SIA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.677368517 (70h54m37.108448648s) [noise=true , address=45.91.116.10:4083 , piece_id=ACEAUOZZCKIA4LTESFID3ZWUKFVTJACUI6VB327RTMHJLTPZBYGQ, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.677671015 (70h54m37.108751146s) [noise=true , address=77.90.31.17:4771 , piece_id=4Y664XUE5YWHPNAWUYSZ4BPISRV5YM5IGV4VK53RCPFZYEEBOKIQ, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678009293 (70h54m37.109089424s) [noise=true , address=45.91.116.7:4010 , piece_id=I5FZKKDZEIJAEBGXVY5E4PSKY2XN6FFB6YJI7CTWGTS63FVWC77A, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678247930 (70h54m37.109328061s) [noise=true , address=77.90.31.19:4843 , piece_id=NZ6GA4W7S4VGYLD5TBIOVCTFSBODMTOQY7SBY5OB2XWE766R2B3A, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678532164 (70h54m37.109612285s) [noise=true , address=45.91.116.12:4227 , piece_id=C5NVQ4KJ4UVIIXGUUXYLYGZ6T3TVKESSRQX7KSYQZ7O5PYUS3XVA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678765730 (70h54m37.109845861s) [noise=true , address=104.36.82.12:4151 , piece_id=QUY4X3H5VQPZXZ4JCHFKXLUETZXOBEN34KO7YZEMVYQEVGKR5ZZA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678993456 (70h54m37.110073587s) [noise=true , address=45.91.116.13:4155 , piece_id=YTXBYJIN6WYX2LBRDYH7YU55DKC7ZLLECK3HI22IKBWFRT6ZHTIA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679139145 (70h54m37.110219266s) [noise=true , address=45.91.116.4:4939 , piece_id=D3TLK6SUW4O7UUZVU6PADTAGQZ6SJHYAXYG2UULS7VZNMZ5YSOIA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679376159 (70h54m37.11045629s) [noise=true , address=45.91.116.5:4298 , piece_id=QYRZXB5RPTYY3Y54CVYQA76YEOHCKIPOMOP36Z2W6PSF35JDULFA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679589166 (70h54m37.110669297s) [noise=true , address=104.36.82.5:4839 , piece_id=56H4YACEHZNRC4IGN6LQ2OHVYAL6DFVJ3E5XKXUMAWHO6UCMICGA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679786334 (70h54m37.110866465s) [noise=true , address=77.90.31.18:4807 , piece_id=JZTPSUJQ7H7AAQC2JQLY37UM2ZPSCFVYDNOG7RSCJ6SPTWCVVPLA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:44.458058779 (70h54m38.88913891s) [upload=73915]: Next returned nil segment Aug 11 16:20:44.458076964 (70h54m38.889157095s) [upload=73915]: Waiting for error group managing segments... Aug 11 16:20:44.762791322 (70h54m39.193871453s) [noise=true , address=45.91.116.7:4010 , piece_id=I5FZKKDZEIJAEBGXVY5E4PSKY2XN6FFB6YJI7CTWGTS63FVWC77A, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.819598246 (70h54m39.250678377s) [noise=true , address=45.91.116.4:4939 , piece_id=D3TLK6SUW4O7UUZVU6PADTAGQZ6SJHYAXYG2UULS7VZNMZ5YSOIA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.877739022 (70h54m39.308819143s) [noise=true , address=77.90.31.11:4555 , piece_id=42V6RDCOSJRZYHIH7AUYX35F7GRXVZRHRUNBTI3ZDDQSVK2IYBAA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.936181786 (70h54m39.367261918s) [noise=true , address=45.91.116.10:4083 , piece_id=ACEAUOZZCKIA4LTESFID3ZWUKFVTJACUI6VB327RTMHJLTPZBYGQ, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.937836643 (70h54m39.368916774s) [noise=true , address=77.90.31.18:4807 , piece_id=JZTPSUJQ7H7AAQC2JQLY37UM2ZPSCFVYDNOG7RSCJ6SPTWCVVPLA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.939510475 (70h54m39.370590596s) [noise=true , address=77.90.31.17:4771 , piece_id=4Y664XUE5YWHPNAWUYSZ4BPISRV5YM5IGV4VK53RCPFZYEEBOKIQ, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.944277246 (70h54m39.375357377s) [noise=true , address=104.36.82.12:4151 , piece_id=QUY4X3H5VQPZXZ4JCHFKXLUETZXOBEN34KO7YZEMVYQEVGKR5ZZA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.945075824 (70h54m39.376155955s) [noise=true , address=45.91.116.13:4155 , piece_id=YTXBYJIN6WYX2LBRDYH7YU55DKC7ZLLECK3HI22IKBWFRT6ZHTIA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.006188045 (70h54m39.437268176s) [noise=true , address=45.91.116.5:4298 , piece_id=QYRZXB5RPTYY3Y54CVYQA76YEOHCKIPOMOP36Z2W6PSF35JDULFA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.042863199 (70h54m39.47394333s) [noise=true , address=77.90.31.14:4663 , piece_id=I5W3UOQI6RQFDF2A5NGYG7GUXBP2XE3N6LCTBVHAXPEWBMVSV26Q, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.048316484 (70h54m39.479396645s) [noise=true , address=77.90.31.19:4843 , piece_id=NZ6GA4W7S4VGYLD5TBIOVCTFSBODMTOQY7SBY5OB2XWE766R2B3A, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.054276718 (70h54m39.485356839s) [noise=true , address=45.91.116.12:4227 , piece_id=C5NVQ4KJ4UVIIXGUUXYLYGZ6T3TVKESSRQX7KSYQZ7O5PYUS3XVA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.056028469 (70h54m39.487108601s) [noise=true , address=45.91.116.13:4153 , piece_id=6FFUWDJYTJPUBXGHDGREUB4OM4DGX6COJTXHFWHLGW7QK3CO2JDA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.056044611 (70h54m39.487124732s) [seg_pos={0 0}, upload=73915]: Segment reached optimal threshold of 13 pieces. Aug 11 16:20:45.056165442 (70h54m39.487245573s) [noise=true , address=45.91.116.6:4974 , piece_id=GUI4A3KX4FASSTLQDMD4PHG75FQZRZEZCWNIMLWEJBBHQ5IH6SIA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Aug 11 16:20:45.056214636 (70h54m39.487294767s) [noise=true , address=104.36.82.10:4079 , piece_id=CYHDYCMVCYISFUDJOXGK2RCJVPRBZXXBAX3ICDJTH4OUPTQL6RMA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 11 16:20:45.056367308 (70h54m39.48744744s) [noise=true , address=104.36.82.5:4839 , piece_id=56H4YACEHZNRC4IGN6LQ2OHVYAL6DFVJ3E5XKXUMAWHO6UCMICGA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:33142->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:33142->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33142->104.36.82.5:4839: use of closed network connection Aug 11 16:20:45.056394020 (70h54m39.487474151s) [seg_pos={0 0}, upload=73915]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 11 16:20:45.056469904 (70h54m39.487550035s) [upload=73915]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 16:20:45.056474313 (70h54m39.487554444s) [upload=73915]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 16:20:45.348914657 (70h54m39.779994788s) [upload=73915]: Done uploading segments... Aug 11 16:20:45.348932771 (70h54m39.780012902s) [upload=73915]: Upload finished. err: <nil> Duration: 6.279236444s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.............X...............................X........X.....] duration: 1.922825575s FAIL (2025-08-11 16:50:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 7ca3b38f59bef6700c47a71c0ce137786b019861ef4e351f330d4f1e41b86704 != before b8ccbd272fe59726b04686e0542c1e0964e89942b662558e091433dc0e7e3dc5 ======LOGS====== Aug 11 16:46:39.434150567 (71h20m33.865230698s) [upload=74358]: Starting upload Aug 11 16:46:39.434202827 (71h20m33.865282958s) [upload=74358]: Done starting upload Aug 11 16:46:39.434253474 (71h20m33.865333605s) [upload=74358]: Uploading segments... Aug 11 16:46:39.434289643 (71h20m33.865369774s) [upload=74358]: Got next segment. Inline: true Aug 11 16:46:39.434293440 (71h20m33.865373561s) [upload=74358]: Waiting for error group managing segments... Aug 11 16:46:39.434326714 (71h20m33.865406845s) [upload=74358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 16:46:39.434330481 (71h20m33.865410612s) [upload=74358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 16:46:39.434332896 (71h20m33.865413017s) [upload=74358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 16:46:39.727280447 (71h20m34.158360588s) [upload=74358]: Done uploading segments... Aug 11 16:46:39.727301838 (71h20m34.158381969s) [upload=74358]: Upload finished. err: <nil> Duration:* 1.922858338s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [........................................X.................X.] duration: 5.879398711s FAIL (2025-08-11 16:50:03 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 11 16:49:18.944471487 (71h23m13.375551618s) [upload=74403]: Starting upload Aug 11 16:49:18.944518647 (71h23m13.375598778s) [upload=74403]: Done starting upload Aug 11 16:49:18.944627255 (71h23m13.375707386s) [upload=74403]: Uploading segments... Aug 11 16:49:18.944705966 (71h23m13.375786087s) [upload=74403]: Got next segment. Inline: false Aug 11 16:49:18.944736013 (71h23m13.375816144s) [upload=74403]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 16:49:18.944740451 (71h23m13.375820582s) [upload=74403]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 16:49:19.412483995 (71h23m13.843564126s) [seg_pos={0 0}, upload=74403]: Begin upload segment... Aug 11 16:49:19.412592252 (71h23m13.843672383s) [seg_pos={0 0}, upload=74403]: Done begin upload segment. Aug 11 16:49:19.412616048 (71h23m13.843696179s) [noise=true , address=104.36.82.22:4535 , piece_id=26WEYM4OIWDWC73DJW7YFGNWNWNGWABTUJVW26E2G2P35SCVJ4AA, seg_pos={0 0}, upload=74403]: Uploading piece... Aug 11 16:49:19.412642639 (71h23m13.84372277s) [noise=true , address=104.36.82.2:4749 , piece_id=RXSUPO45DQCUATOEC5IBVALVTOEEUAUGON6VDGYHEE5QXECCMWPA, seg_pos={0 0}, upload=74403]: Uploading piece... Aug 11 16:49:19.412975856 (71h23m13.844055987s) [noise=true , address=104.36.82.17:4353 , piece_id=WI44F7R7JWGMLJZ7DMHNXDXQXY5MWPABRGC6BNSJUUMTL7PMZCGA, seg_pos={0 0}, upload=74403]: Uploading piece... Aug 11 16:49:19.413108280 (71h23m13.844188411s) [noise=true , address=79.127.219.47:4054 , piece_id=PMLML2PLMN4MKR3FQK3F2XGNTNXFVRYDI3TVARBU2K6LSOB6BZAA, seg_pos={0 0}, upload=74403]: Uploading piece... Aug 11 16:49:19.413277503 (71h23m13.844357634s) [noise=true , address=77.90.31.12:4606 , piece_id=WJE5A37TPGJXWKDHVZNQIRMG4YRQQKRMX5FJRL3SEOVBH6GHWJGA, seg_pos={0 0}, upload=74403]: Uploading piece... Aug 11 16:49:19.413397412 (71h23m13.844477543s) [noise=true , address=104.36.82.8:4990 , piece_id=QGJJXDBGZEP2DEWMRXUKIC73VGJEEK4YCWW2LA2OGQBIBR46CL7Q, seg_pos={0 0}, upload=74403]: Uploading piece... Aug 11 16:49:19.413566917 (71h23m13.844647048s) [noise=true , address=77.90.31.16:4755 , piece_id=37GJASWFAMBEKZZ7DFUFHOBTE4Q3KX6TKM5TD3VAJ4TFSTO2CBPA, seg_pos={0 0}, upload=74403]: Uploading piece... Aug 11 16:49:19.413683079 (71h23m13.8447632s) [noise=true , address=104.36.82.42:4822 , piece_id=YWMOKUGKB57UK33OEYHECUTM5WIP3ILYTBYTTIVL5N7JN6RGLJJA, seg_pos={0 0}, upload=74403]: Uploading piece... Aug 11 16:49:19.413866561 (71h23m13.844946692s) [noise=true , address=104.36.82.23:4467 , piece_id=T2OXSWDKINFO4MYRGPF7SYEQS2MIYFQD2CHD2QXUMEROGAOCENJA, seg_pos={0 0}, upload=74403]: Uploading piece... Aug 11 16:49:19.413969918 (71h23m13.845050049s) [noise=true , address=104.36.82.37:4688 , piece_id=QBMPNTZAYDYFBJVVF625AT5AVPU7GMCTLCB7TAMGSK64PKHPFHUA, seg_pos={0 0}, upload=74403]: Uploading piece... Aug 11 16:49:19.414154862 (71h23m13.845234993s) [noise=true , address=104.36.82.4:4826 , piece_id=7XVGNAJ5IW2PGT7GOTQLZAGEHDBN6P4WCMYJPSN3FFPB7ZSNBXMA, seg_pos={0 0}, upload=74403]: Uploading piece... Aug 11 16:49:19.414201211 (71h23m13.845281342s) [noise=true , address=104.36.82.62:4416 , piece_id=3U7JT6LG5LGRX4L6FKGNWESD4CJK4666NOTN7XEC6MU27TZVZ64A, seg_pos={0 0}, upload=74403]: Uploading piece... Aug 11 16:49:19.414453503 (71h23m13.845533634s) [noise=true , address=104.36.82.36:4624 , piece_id=DHLJH5KQX2I4Y2BJQB2ZX4DDG3OAKQIKY3NBPJEJLP3WTQ6WH4PA, seg_pos={0 0}, upload=74403]: Uploading piece... Aug 11 16:49:19.414465746 (71h23m13.845545877s) [noise=true , address=104.36.82.39:4734 , piece_id=ME7BVX3VAEBZFIRX6WYGFWVAOS6SVZ6UKV77N23JP4LEMCH5GODQ, seg_pos={0 0}, upload=74403]: Uploading piece... Aug 11 16:49:19.415249597 (71h23m13.846329728s) [noise=true , address=104.36.82.43:4846 , piece_id=ZWLEYGESEJIVJRS4Z55EZ5VAV2DVU7ENHCBRLFSP7ZPREGUV4MLA, seg_pos={0 0}, upload=74403]: Uploading piece... Aug 11 16:49:19.415682846 (71h23m13.846762977s) [noise=true , address=104.36.82.18:4388 , piece_id=2LFQWJTHZMW2NXLYQAMFNFYJS7KH3DJHGHPSFA2RVYDSG7I72CQA, seg_pos={0 0}, upload=74403]: Uploading piece... Aug 11 16:49:19.416173114 (71h23m13.847253245s) [noise=true , address=104.36.82.38:4712 , piece_id=ZG27CPMFX2GCT35YU4A4AUZTQ5ZTC7HMNBK5PTYIHUT3NJJEPQAQ, seg_pos={0 0}, upload=74403]: Uploading piece... Aug 11 16:49:19.416712255 (71h23m13.847792386s) [noise=true , address=104.36.82.58:4272 , piece_id=SIB7YP5BUG5H36PN77DO6U75JUD5MTFAQANHMMZ2RN5KGTIQFEYA, seg_pos={0 0}, upload=74403]: Uploading piece... Aug 11 16:49:20.920556665 (71h23m15.351636796s) [upload=74403]: Next returned nil segment Aug 11 16:49:20.920587855 (71h23m15.351667976s) [upload=74403]: Waiting for error group managing segments... Aug 11 16:49:21.305980179 (71h23m15.73706031s) [noise=true , address=79.127.219.47:4054 , piece_id=PMLML2PLMN4MKR3FQK3F2XGNTNXFVRYDI3TVARBU2K6LSOB6BZAA, seg_pos={0 0}, upload=74403]: Done uploading piece. err: <nil> Aug 11 16:49:21.368620624 (71h23m15.799700755s) [noise=true , address=104.36.82.39:4734 , piece_id=ME7BVX3VAEBZFIRX6WYGFWVAOS6SVZ6UKV77N23JP4LEMCH5GODQ, seg_pos={0 0}, upload=74403]: Done uploading piece. err: <nil> Aug 11 16:49:21.413382250 (71h23m15.844462371s) [noise=true , address=104.36.82.18:4388 , piece_id=2LFQWJTHZMW2NXLYQAMFNFYJS7KH3DJHGHPSFA2RVYDSG7I72CQA, seg_pos={0 0}, upload=74403]: Done uploading piece. err: <nil> Aug 11 16:49:21.414042083 (71h23m15.845122204s) [noise=true , address=104.36.82.38:4712 , piece_id=ZG27CPMFX2GCT35YU4A4AUZTQ5ZTC7HMNBK5PTYIHUT3NJJEPQAQ, seg_pos={0 0}, upload=74403]: Done uploading piece. err: <nil> Aug 11 16:49:21.425564870 (71h23m15.856645041s) [noise=true , address=104.36.82.4:4826 , piece_id=7XVGNAJ5IW2PGT7GOTQLZAGEHDBN6P4WCMYJPSN3FFPB7ZSNBXMA, seg_pos={0 0}, upload=74403]: Done uploading piece. err: <nil> Aug 11 16:49:21.452663190 (71h23m15.883743351s) [noise=true , address=77.90.31.16:4755 , piece_id=37GJASWFAMBEKZZ7DFUFHOBTE4Q3KX6TKM5TD3VAJ4TFSTO2CBPA, seg_pos={0 0}, upload=74403]: Done uploading piece. err: <nil> Aug 11 16:49:21.456150162 (71h23m15.887230293s) [noise=true , address=104.36.82.22:4535 , piece_id=26WEYM4OIWDWC73DJW7YFGNWNWNGWABTUJVW26E2G2P35SCVJ4AA, seg_pos={0 0}, upload=74403]: Done uploading piece. err: <nil> Aug 11 16:49:21.470305246 (71h23m15.901385377s) [noise=true , address=104.36.82.43:4846 , piece_id=ZWLEYGESEJIVJRS4Z55EZ5VAV2DVU7ENHCBRLFSP7ZPREGUV4MLA, seg_pos={0 0}, upload=74403]: Done uploading piece. err: <nil> Aug 11 16:49:21.471577289 (71h23m15.90265742s) [noise=true , address=104.36.82.8:4990 , piece_id=QGJJXDBGZEP2DEWMRXUKIC73VGJEEK4YCWW2LA2OGQBIBR46CL7Q, seg_pos={0 0}, upload=74403]: Done uploading piece. err: <nil> Aug 11 16:49:21.486989349 (71h23m15.91806948s) [noise=true , address=104.36.82.62:4416 , piece_id=3U7JT6LG5LGRX4L6FKGNWESD4CJK4666NOTN7XEC6MU27TZVZ64A, seg_pos={0 0}, upload=74403]: Done uploading piece. err: <nil> Aug 11 16:49:21.520684981 (71h23m15.951765112s) [noise=true , address=104.36.82.58:4272 , piece_id=SIB7YP5BUG5H36PN77DO6U75JUD5MTFAQANHMMZ2RN5KGTIQFEYA, seg_pos={0 0}, upload=74403]: Done uploading piece. err: <nil> Aug 11 16:49:21.523583547 (71h23m15.954663668s) [noise=true , address=104.36.82.36:4624 , piece_id=DHLJH5KQX2I4Y2BJQB2ZX4DDG3OAKQIKY3NBPJEJLP3WTQ6WH4PA, seg_pos={0 0}, upload=74403]: Done uploading piece. err: <nil> Aug 11 16:49:21.547772049 (71h23m15.978852181s) [noise=true , address=104.36.82.23:4467 , piece_id=T2OXSWDKINFO4MYRGPF7SYEQS2MIYFQD2CHD2QXUMEROGAOCENJA, seg_pos={0 0}, upload=74403]: Done uploading piece. err: <nil> Aug 11 16:49:21.601922691 (71h23m16.033002822s) [noise=true , address=104.36.82.17:4353 , piece_id=WI44F7R7JWGMLJZ7DMHNXDXQXY5MWPABRGC6BNSJUUMTL7PMZCGA, seg_pos={0 0}, upload=74403]: Done uploading piece. err: <nil> Aug 11 16:49:21.601948460 (71h23m16.033028591s) [seg_pos={0 0}, upload=74403]: Segment reached optimal threshold of 14 pieces. Aug 11 16:49:21.602053992 (71h23m16.033134123s) [noise=true , address=104.36.82.37:4688 , piece_id=QBMPNTZAYDYFBJVVF625AT5AVPU7GMCTLCB7TAMGSK64PKHPFHUA, seg_pos={0 0}, upload=74403]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XHxPHd22b7s5tj2pYXzUnC6AXMnPnNSB4jw3RYfKtwu6jwaVN): protocol: expected piece hash; context canceled; EOF Aug 11 16:49:21.602085342 (71h23m16.033165473s) [noise=true , address=104.36.82.2:4749 , piece_id=RXSUPO45DQCUATOEC5IBVALVTOEEUAUGON6VDGYHEE5QXECCMWPA, seg_pos={0 0}, upload=74403]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm): protocol: expected piece hash; context canceled; EOF Aug 11 16:49:21.602143503 (71h23m16.033223634s) [noise=true , address=77.90.31.12:4606 , piece_id=WJE5A37TPGJXWKDHVZNQIRMG4YRQQKRMX5FJRL3SEOVBH6GHWJGA, seg_pos={0 0}, upload=74403]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pLKmTja7ttT6vqjq8vHMYR9RLfnpqxY9xm9GDBG8ez9aHujs): protocol: expected piece hash; context canceled; EOF Aug 11 16:49:21.602181275 (71h23m16.033261406s) [noise=true , address=104.36.82.42:4822 , piece_id=YWMOKUGKB57UK33OEYHECUTM5WIP3ILYTBYTTIVL5N7JN6RGLJJA, seg_pos={0 0}, upload=74403]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127uUPZhKGPaiMVxTEH919M1WvLqDM9VLgaBkuaTBuPbdaXKLLG): protocol: write tcp 188.166.225.170:40354->104.36.82.42:4822: use of closed network connection; write tcp 188.166.225.170:40354->104.36.82.42:4822: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40354->104.36.82.42:4822: use of closed network connection Aug 11 16:49:21.602195823 (71h23m16.033275954s) [seg_pos={0 0}, upload=74403]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 16:49:21.602256068 (71h23m16.033336199s) [upload=74403]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 16:49:21.602260126 (71h23m16.033340247s) [upload=74403]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 16:49:21.983977859 (71h23m16.41505799s) [upload=74403]: Done uploading segments... Aug 11 16:49:21.983996234 (71h23m16.415076365s) [upload=74403]: Upload finished. err: <nil> Duration: 5.879428339s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 5.869060679s FAIL (2025-08-11 16:49:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 11 16:20:42.438359750 (70h54m36.869439881s) [upload=73915]: Starting upload Aug 11 16:20:42.438414104 (70h54m36.869494225s) [upload=73915]: Done starting upload Aug 11 16:20:42.438489136 (70h54m36.869569267s) [upload=73915]: Uploading segments... Aug 11 16:20:42.438621770 (70h54m36.869701891s) [upload=73915]: Got next segment. Inline: false Aug 11 16:20:42.438664713 (70h54m36.869744844s) [upload=73915]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 16:20:42.438669001 (70h54m36.869749132s) [upload=73915]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 16:20:42.676790711 (70h54m37.107870842s) [seg_pos={0 0}, upload=73915]: Begin upload segment... Aug 11 16:20:42.676835908 (70h54m37.107916039s) [seg_pos={0 0}, upload=73915]: Done begin upload segment. Aug 11 16:20:42.676853832 (70h54m37.107933964s) [noise=true , address=77.90.31.14:4663 , piece_id=I5W3UOQI6RQFDF2A5NGYG7GUXBP2XE3N6LCTBVHAXPEWBMVSV26Q, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.676866747 (70h54m37.107946878s) [noise=true , address=104.36.82.10:4079 , piece_id=CYHDYCMVCYISFUDJOXGK2RCJVPRBZXXBAX3ICDJTH4OUPTQL6RMA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.676910421 (70h54m37.107990552s) [noise=true , address=77.90.31.11:4555 , piece_id=42V6RDCOSJRZYHIH7AUYX35F7GRXVZRHRUNBTI3ZDDQSVK2IYBAA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.676958241 (70h54m37.108038383s) [noise=true , address=45.91.116.13:4153 , piece_id=6FFUWDJYTJPUBXGHDGREUB4OM4DGX6COJTXHFWHLGW7QK3CO2JDA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.677329863 (70h54m37.108409994s) [noise=true , address=45.91.116.6:4974 , piece_id=GUI4A3KX4FASSTLQDMD4PHG75FQZRZEZCWNIMLWEJBBHQ5IH6SIA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.677368517 (70h54m37.108448648s) [noise=true , address=45.91.116.10:4083 , piece_id=ACEAUOZZCKIA4LTESFID3ZWUKFVTJACUI6VB327RTMHJLTPZBYGQ, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.677671015 (70h54m37.108751146s) [noise=true , address=77.90.31.17:4771 , piece_id=4Y664XUE5YWHPNAWUYSZ4BPISRV5YM5IGV4VK53RCPFZYEEBOKIQ, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678009293 (70h54m37.109089424s) [noise=true , address=45.91.116.7:4010 , piece_id=I5FZKKDZEIJAEBGXVY5E4PSKY2XN6FFB6YJI7CTWGTS63FVWC77A, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678247930 (70h54m37.109328061s) [noise=true , address=77.90.31.19:4843 , piece_id=NZ6GA4W7S4VGYLD5TBIOVCTFSBODMTOQY7SBY5OB2XWE766R2B3A, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678532164 (70h54m37.109612285s) [noise=true , address=45.91.116.12:4227 , piece_id=C5NVQ4KJ4UVIIXGUUXYLYGZ6T3TVKESSRQX7KSYQZ7O5PYUS3XVA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678765730 (70h54m37.109845861s) [noise=true , address=104.36.82.12:4151 , piece_id=QUY4X3H5VQPZXZ4JCHFKXLUETZXOBEN34KO7YZEMVYQEVGKR5ZZA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678993456 (70h54m37.110073587s) [noise=true , address=45.91.116.13:4155 , piece_id=YTXBYJIN6WYX2LBRDYH7YU55DKC7ZLLECK3HI22IKBWFRT6ZHTIA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679139145 (70h54m37.110219266s) [noise=true , address=45.91.116.4:4939 , piece_id=D3TLK6SUW4O7UUZVU6PADTAGQZ6SJHYAXYG2UULS7VZNMZ5YSOIA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679376159 (70h54m37.11045629s) [noise=true , address=45.91.116.5:4298 , piece_id=QYRZXB5RPTYY3Y54CVYQA76YEOHCKIPOMOP36Z2W6PSF35JDULFA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679589166 (70h54m37.110669297s) [noise=true , address=104.36.82.5:4839 , piece_id=56H4YACEHZNRC4IGN6LQ2OHVYAL6DFVJ3E5XKXUMAWHO6UCMICGA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679786334 (70h54m37.110866465s) [noise=true , address=77.90.31.18:4807 , piece_id=JZTPSUJQ7H7AAQC2JQLY37UM2ZPSCFVYDNOG7RSCJ6SPTWCVVPLA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:44.458058779 (70h54m38.88913891s) [upload=73915]: Next returned nil segment Aug 11 16:20:44.458076964 (70h54m38.889157095s) [upload=73915]: Waiting for error group managing segments... Aug 11 16:20:44.762791322 (70h54m39.193871453s) [noise=true , address=45.91.116.7:4010 , piece_id=I5FZKKDZEIJAEBGXVY5E4PSKY2XN6FFB6YJI7CTWGTS63FVWC77A, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.819598246 (70h54m39.250678377s) [noise=true , address=45.91.116.4:4939 , piece_id=D3TLK6SUW4O7UUZVU6PADTAGQZ6SJHYAXYG2UULS7VZNMZ5YSOIA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.877739022 (70h54m39.308819143s) [noise=true , address=77.90.31.11:4555 , piece_id=42V6RDCOSJRZYHIH7AUYX35F7GRXVZRHRUNBTI3ZDDQSVK2IYBAA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.936181786 (70h54m39.367261918s) [noise=true , address=45.91.116.10:4083 , piece_id=ACEAUOZZCKIA4LTESFID3ZWUKFVTJACUI6VB327RTMHJLTPZBYGQ, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.937836643 (70h54m39.368916774s) [noise=true , address=77.90.31.18:4807 , piece_id=JZTPSUJQ7H7AAQC2JQLY37UM2ZPSCFVYDNOG7RSCJ6SPTWCVVPLA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.939510475 (70h54m39.370590596s) [noise=true , address=77.90.31.17:4771 , piece_id=4Y664XUE5YWHPNAWUYSZ4BPISRV5YM5IGV4VK53RCPFZYEEBOKIQ, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.944277246 (70h54m39.375357377s) [noise=true , address=104.36.82.12:4151 , piece_id=QUY4X3H5VQPZXZ4JCHFKXLUETZXOBEN34KO7YZEMVYQEVGKR5ZZA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.945075824 (70h54m39.376155955s) [noise=true , address=45.91.116.13:4155 , piece_id=YTXBYJIN6WYX2LBRDYH7YU55DKC7ZLLECK3HI22IKBWFRT6ZHTIA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.006188045 (70h54m39.437268176s) [noise=true , address=45.91.116.5:4298 , piece_id=QYRZXB5RPTYY3Y54CVYQA76YEOHCKIPOMOP36Z2W6PSF35JDULFA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.042863199 (70h54m39.47394333s) [noise=true , address=77.90.31.14:4663 , piece_id=I5W3UOQI6RQFDF2A5NGYG7GUXBP2XE3N6LCTBVHAXPEWBMVSV26Q, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.048316484 (70h54m39.479396645s) [noise=true , address=77.90.31.19:4843 , piece_id=NZ6GA4W7S4VGYLD5TBIOVCTFSBODMTOQY7SBY5OB2XWE766R2B3A, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.054276718 (70h54m39.485356839s) [noise=true , address=45.91.116.12:4227 , piece_id=C5NVQ4KJ4UVIIXGUUXYLYGZ6T3TVKESSRQX7KSYQZ7O5PYUS3XVA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.056028469 (70h54m39.487108601s) [noise=true , address=45.91.116.13:4153 , piece_id=6FFUWDJYTJPUBXGHDGREUB4OM4DGX6COJTXHFWHLGW7QK3CO2JDA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.056044611 (70h54m39.487124732s) [seg_pos={0 0}, upload=73915]: Segment reached optimal threshold of 13 pieces. Aug 11 16:20:45.056165442 (70h54m39.487245573s) [noise=true , address=45.91.116.6:4974 , piece_id=GUI4A3KX4FASSTLQDMD4PHG75FQZRZEZCWNIMLWEJBBHQ5IH6SIA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Aug 11 16:20:45.056214636 (70h54m39.487294767s) [noise=true , address=104.36.82.10:4079 , piece_id=CYHDYCMVCYISFUDJOXGK2RCJVPRBZXXBAX3ICDJTH4OUPTQL6RMA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 11 16:20:45.056367308 (70h54m39.48744744s) [noise=true , address=104.36.82.5:4839 , piece_id=56H4YACEHZNRC4IGN6LQ2OHVYAL6DFVJ3E5XKXUMAWHO6UCMICGA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:33142->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:33142->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33142->104.36.82.5:4839: use of closed network connection Aug 11 16:20:45.056394020 (70h54m39.487474151s) [seg_pos={0 0}, upload=73915]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 11 16:20:45.056469904 (70h54m39.487550035s) [upload=73915]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 16:20:45.056474313 (70h54m39.487554444s) [upload=73915]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 16:20:45.348914657 (70h54m39.779994788s) [upload=73915]: Done uploading segments... Aug 11 16:20:45.348932771 (70h54m39.780012902s) [upload=73915]: Upload finished. err: <nil> Duration: 5.869087861s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..............X...............................X........X....] duration: 1.856102357s FAIL (2025-08-11 16:49:28 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 7ca3b38f59bef6700c47a71c0ce137786b019861ef4e351f330d4f1e41b86704 != before b8ccbd272fe59726b04686e0542c1e0964e89942b662558e091433dc0e7e3dc5 ======LOGS====== Aug 11 16:46:39.434150567 (71h20m33.865230698s) [upload=74358]: Starting upload Aug 11 16:46:39.434202827 (71h20m33.865282958s) [upload=74358]: Done starting upload Aug 11 16:46:39.434253474 (71h20m33.865333605s) [upload=74358]: Uploading segments... Aug 11 16:46:39.434289643 (71h20m33.865369774s) [upload=74358]: Got next segment. Inline: true Aug 11 16:46:39.434293440 (71h20m33.865373561s) [upload=74358]: Waiting for error group managing segments... Aug 11 16:46:39.434326714 (71h20m33.865406845s) [upload=74358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 16:46:39.434330481 (71h20m33.865410612s) [upload=74358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 16:46:39.434332896 (71h20m33.865413017s) [upload=74358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 16:46:39.727280447 (71h20m34.158360588s) [upload=74358]: Done uploading segments... Aug 11 16:46:39.727301838 (71h20m34.158381969s) [upload=74358]: Upload finished. err: <nil> Duration:* 1.85614097s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........................................X.................X] duration: 4.394173071s FAIL (2025-08-11 16:49:22 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 11 16:49:18.944471487 (71h23m13.375551618s) [upload=74403]: Starting upload Aug 11 16:49:18.944518647 (71h23m13.375598778s) [upload=74403]: Done starting upload Aug 11 16:49:18.944627255 (71h23m13.375707386s) [upload=74403]: Uploading segments... Aug 11 16:49:18.944705966 (71h23m13.375786087s) [upload=74403]: Got next segment. Inline: false Aug 11 16:49:18.944736013 (71h23m13.375816144s) [upload=74403]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 16:49:18.944740451 (71h23m13.375820582s) [upload=74403]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 16:49:19.412483995 (71h23m13.843564126s) [seg_pos={0 0}, upload=74403]: Begin upload segment... Aug 11 16:49:19.412592252 (71h23m13.843672383s) [seg_pos={0 0}, upload=74403]: Done begin upload segment. Aug 11 16:49:19.412616048 (71h23m13.843696179s) [noise=true , address=104.36.82.22:4535 , piece_id=26WEYM4OIWDWC73DJW7YFGNWNWNGWABTUJVW26E2G2P35SCVJ4AA, seg_pos={0 0}, upload=74403]: Uploading piece... Aug 11 16:49:19.412642639 (71h23m13.84372277s) [noise=true , address=104.36.82.2:4749 , piece_id=RXSUPO45DQCUATOEC5IBVALVTOEEUAUGON6VDGYHEE5QXECCMWPA, seg_pos={0 0}, upload=74403]: Uploading piece... Aug 11 16:49:19.412975856 (71h23m13.844055987s) [noise=true , address=104.36.82.17:4353 , piece_id=WI44F7R7JWGMLJZ7DMHNXDXQXY5MWPABRGC6BNSJUUMTL7PMZCGA, seg_pos={0 0}, upload=74403]: Uploading piece... Aug 11 16:49:19.413108280 (71h23m13.844188411s) [noise=true , address=79.127.219.47:4054 , piece_id=PMLML2PLMN4MKR3FQK3F2XGNTNXFVRYDI3TVARBU2K6LSOB6BZAA, seg_pos={0 0}, upload=74403]: Uploading piece... Aug 11 16:49:19.413277503 (71h23m13.844357634s) [noise=true , address=77.90.31.12:4606 , piece_id=WJE5A37TPGJXWKDHVZNQIRMG4YRQQKRMX5FJRL3SEOVBH6GHWJGA, seg_pos={0 0}, upload=74403]: Uploading piece... Aug 11 16:49:19.413397412 (71h23m13.844477543s) [noise=true , address=104.36.82.8:4990 , piece_id=QGJJXDBGZEP2DEWMRXUKIC73VGJEEK4YCWW2LA2OGQBIBR46CL7Q, seg_pos={0 0}, upload=74403]: Uploading piece... Aug 11 16:49:19.413566917 (71h23m13.844647048s) [noise=true , address=77.90.31.16:4755 , piece_id=37GJASWFAMBEKZZ7DFUFHOBTE4Q3KX6TKM5TD3VAJ4TFSTO2CBPA, seg_pos={0 0}, upload=74403]: Uploading piece... Aug 11 16:49:19.413683079 (71h23m13.8447632s) [noise=true , address=104.36.82.42:4822 , piece_id=YWMOKUGKB57UK33OEYHECUTM5WIP3ILYTBYTTIVL5N7JN6RGLJJA, seg_pos={0 0}, upload=74403]: Uploading piece... Aug 11 16:49:19.413866561 (71h23m13.844946692s) [noise=true , address=104.36.82.23:4467 , piece_id=T2OXSWDKINFO4MYRGPF7SYEQS2MIYFQD2CHD2QXUMEROGAOCENJA, seg_pos={0 0}, upload=74403]: Uploading piece... Aug 11 16:49:19.413969918 (71h23m13.845050049s) [noise=true , address=104.36.82.37:4688 , piece_id=QBMPNTZAYDYFBJVVF625AT5AVPU7GMCTLCB7TAMGSK64PKHPFHUA, seg_pos={0 0}, upload=74403]: Uploading piece... Aug 11 16:49:19.414154862 (71h23m13.845234993s) [noise=true , address=104.36.82.4:4826 , piece_id=7XVGNAJ5IW2PGT7GOTQLZAGEHDBN6P4WCMYJPSN3FFPB7ZSNBXMA, seg_pos={0 0}, upload=74403]: Uploading piece... Aug 11 16:49:19.414201211 (71h23m13.845281342s) [noise=true , address=104.36.82.62:4416 , piece_id=3U7JT6LG5LGRX4L6FKGNWESD4CJK4666NOTN7XEC6MU27TZVZ64A, seg_pos={0 0}, upload=74403]: Uploading piece... Aug 11 16:49:19.414453503 (71h23m13.845533634s) [noise=true , address=104.36.82.36:4624 , piece_id=DHLJH5KQX2I4Y2BJQB2ZX4DDG3OAKQIKY3NBPJEJLP3WTQ6WH4PA, seg_pos={0 0}, upload=74403]: Uploading piece... Aug 11 16:49:19.414465746 (71h23m13.845545877s) [noise=true , address=104.36.82.39:4734 , piece_id=ME7BVX3VAEBZFIRX6WYGFWVAOS6SVZ6UKV77N23JP4LEMCH5GODQ, seg_pos={0 0}, upload=74403]: Uploading piece... Aug 11 16:49:19.415249597 (71h23m13.846329728s) [noise=true , address=104.36.82.43:4846 , piece_id=ZWLEYGESEJIVJRS4Z55EZ5VAV2DVU7ENHCBRLFSP7ZPREGUV4MLA, seg_pos={0 0}, upload=74403]: Uploading piece... Aug 11 16:49:19.415682846 (71h23m13.846762977s) [noise=true , address=104.36.82.18:4388 , piece_id=2LFQWJTHZMW2NXLYQAMFNFYJS7KH3DJHGHPSFA2RVYDSG7I72CQA, seg_pos={0 0}, upload=74403]: Uploading piece... Aug 11 16:49:19.416173114 (71h23m13.847253245s) [noise=true , address=104.36.82.38:4712 , piece_id=ZG27CPMFX2GCT35YU4A4AUZTQ5ZTC7HMNBK5PTYIHUT3NJJEPQAQ, seg_pos={0 0}, upload=74403]: Uploading piece... Aug 11 16:49:19.416712255 (71h23m13.847792386s) [noise=true , address=104.36.82.58:4272 , piece_id=SIB7YP5BUG5H36PN77DO6U75JUD5MTFAQANHMMZ2RN5KGTIQFEYA, seg_pos={0 0}, upload=74403]: Uploading piece... Aug 11 16:49:20.920556665 (71h23m15.351636796s) [upload=74403]: Next returned nil segment Aug 11 16:49:20.920587855 (71h23m15.351667976s) [upload=74403]: Waiting for error group managing segments... Aug 11 16:49:21.305980179 (71h23m15.73706031s) [noise=true , address=79.127.219.47:4054 , piece_id=PMLML2PLMN4MKR3FQK3F2XGNTNXFVRYDI3TVARBU2K6LSOB6BZAA, seg_pos={0 0}, upload=74403]: Done uploading piece. err: <nil> Aug 11 16:49:21.368620624 (71h23m15.799700755s) [noise=true , address=104.36.82.39:4734 , piece_id=ME7BVX3VAEBZFIRX6WYGFWVAOS6SVZ6UKV77N23JP4LEMCH5GODQ, seg_pos={0 0}, upload=74403]: Done uploading piece. err: <nil> Aug 11 16:49:21.413382250 (71h23m15.844462371s) [noise=true , address=104.36.82.18:4388 , piece_id=2LFQWJTHZMW2NXLYQAMFNFYJS7KH3DJHGHPSFA2RVYDSG7I72CQA, seg_pos={0 0}, upload=74403]: Done uploading piece. err: <nil> Aug 11 16:49:21.414042083 (71h23m15.845122204s) [noise=true , address=104.36.82.38:4712 , piece_id=ZG27CPMFX2GCT35YU4A4AUZTQ5ZTC7HMNBK5PTYIHUT3NJJEPQAQ, seg_pos={0 0}, upload=74403]: Done uploading piece. err: <nil> Aug 11 16:49:21.425564870 (71h23m15.856645041s) [noise=true , address=104.36.82.4:4826 , piece_id=7XVGNAJ5IW2PGT7GOTQLZAGEHDBN6P4WCMYJPSN3FFPB7ZSNBXMA, seg_pos={0 0}, upload=74403]: Done uploading piece. err: <nil> Aug 11 16:49:21.452663190 (71h23m15.883743351s) [noise=true , address=77.90.31.16:4755 , piece_id=37GJASWFAMBEKZZ7DFUFHOBTE4Q3KX6TKM5TD3VAJ4TFSTO2CBPA, seg_pos={0 0}, upload=74403]: Done uploading piece. err: <nil> Aug 11 16:49:21.456150162 (71h23m15.887230293s) [noise=true , address=104.36.82.22:4535 , piece_id=26WEYM4OIWDWC73DJW7YFGNWNWNGWABTUJVW26E2G2P35SCVJ4AA, seg_pos={0 0}, upload=74403]: Done uploading piece. err: <nil> Aug 11 16:49:21.470305246 (71h23m15.901385377s) [noise=true , address=104.36.82.43:4846 , piece_id=ZWLEYGESEJIVJRS4Z55EZ5VAV2DVU7ENHCBRLFSP7ZPREGUV4MLA, seg_pos={0 0}, upload=74403]: Done uploading piece. err: <nil> Aug 11 16:49:21.471577289 (71h23m15.90265742s) [noise=true , address=104.36.82.8:4990 , piece_id=QGJJXDBGZEP2DEWMRXUKIC73VGJEEK4YCWW2LA2OGQBIBR46CL7Q, seg_pos={0 0}, upload=74403]: Done uploading piece. err: <nil> Aug 11 16:49:21.486989349 (71h23m15.91806948s) [noise=true , address=104.36.82.62:4416 , piece_id=3U7JT6LG5LGRX4L6FKGNWESD4CJK4666NOTN7XEC6MU27TZVZ64A, seg_pos={0 0}, upload=74403]: Done uploading piece. err: <nil> Aug 11 16:49:21.520684981 (71h23m15.951765112s) [noise=true , address=104.36.82.58:4272 , piece_id=SIB7YP5BUG5H36PN77DO6U75JUD5MTFAQANHMMZ2RN5KGTIQFEYA, seg_pos={0 0}, upload=74403]: Done uploading piece. err: <nil> Aug 11 16:49:21.523583547 (71h23m15.954663668s) [noise=true , address=104.36.82.36:4624 , piece_id=DHLJH5KQX2I4Y2BJQB2ZX4DDG3OAKQIKY3NBPJEJLP3WTQ6WH4PA, seg_pos={0 0}, upload=74403]: Done uploading piece. err: <nil> Aug 11 16:49:21.547772049 (71h23m15.978852181s) [noise=true , address=104.36.82.23:4467 , piece_id=T2OXSWDKINFO4MYRGPF7SYEQS2MIYFQD2CHD2QXUMEROGAOCENJA, seg_pos={0 0}, upload=74403]: Done uploading piece. err: <nil> Aug 11 16:49:21.601922691 (71h23m16.033002822s) [noise=true , address=104.36.82.17:4353 , piece_id=WI44F7R7JWGMLJZ7DMHNXDXQXY5MWPABRGC6BNSJUUMTL7PMZCGA, seg_pos={0 0}, upload=74403]: Done uploading piece. err: <nil> Aug 11 16:49:21.601948460 (71h23m16.033028591s) [seg_pos={0 0}, upload=74403]: Segment reached optimal threshold of 14 pieces. Aug 11 16:49:21.602053992 (71h23m16.033134123s) [noise=true , address=104.36.82.37:4688 , piece_id=QBMPNTZAYDYFBJVVF625AT5AVPU7GMCTLCB7TAMGSK64PKHPFHUA, seg_pos={0 0}, upload=74403]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XHxPHd22b7s5tj2pYXzUnC6AXMnPnNSB4jw3RYfKtwu6jwaVN): protocol: expected piece hash; context canceled; EOF Aug 11 16:49:21.602085342 (71h23m16.033165473s) [noise=true , address=104.36.82.2:4749 , piece_id=RXSUPO45DQCUATOEC5IBVALVTOEEUAUGON6VDGYHEE5QXECCMWPA, seg_pos={0 0}, upload=74403]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm): protocol: expected piece hash; context canceled; EOF Aug 11 16:49:21.602143503 (71h23m16.033223634s) [noise=true , address=77.90.31.12:4606 , piece_id=WJE5A37TPGJXWKDHVZNQIRMG4YRQQKRMX5FJRL3SEOVBH6GHWJGA, seg_pos={0 0}, upload=74403]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pLKmTja7ttT6vqjq8vHMYR9RLfnpqxY9xm9GDBG8ez9aHujs): protocol: expected piece hash; context canceled; EOF Aug 11 16:49:21.602181275 (71h23m16.033261406s) [noise=true , address=104.36.82.42:4822 , piece_id=YWMOKUGKB57UK33OEYHECUTM5WIP3ILYTBYTTIVL5N7JN6RGLJJA, seg_pos={0 0}, upload=74403]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127uUPZhKGPaiMVxTEH919M1WvLqDM9VLgaBkuaTBuPbdaXKLLG): protocol: write tcp 188.166.225.170:40354->104.36.82.42:4822: use of closed network connection; write tcp 188.166.225.170:40354->104.36.82.42:4822: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40354->104.36.82.42:4822: use of closed network connection Aug 11 16:49:21.602195823 (71h23m16.033275954s) [seg_pos={0 0}, upload=74403]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 16:49:21.602256068 (71h23m16.033336199s) [upload=74403]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 16:49:21.602260126 (71h23m16.033340247s) [upload=74403]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 16:49:21.983977859 (71h23m16.41505799s) [upload=74403]: Done uploading segments... Aug 11 16:49:21.983996234 (71h23m16.415076365s) [upload=74403]: Upload finished. err: <nil> Duration: 4.394194331s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 6.051708685s FAIL (2025-08-11 16:49:02 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 11 16:20:42.438359750 (70h54m36.869439881s) [upload=73915]: Starting upload Aug 11 16:20:42.438414104 (70h54m36.869494225s) [upload=73915]: Done starting upload Aug 11 16:20:42.438489136 (70h54m36.869569267s) [upload=73915]: Uploading segments... Aug 11 16:20:42.438621770 (70h54m36.869701891s) [upload=73915]: Got next segment. Inline: false Aug 11 16:20:42.438664713 (70h54m36.869744844s) [upload=73915]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 16:20:42.438669001 (70h54m36.869749132s) [upload=73915]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 16:20:42.676790711 (70h54m37.107870842s) [seg_pos={0 0}, upload=73915]: Begin upload segment... Aug 11 16:20:42.676835908 (70h54m37.107916039s) [seg_pos={0 0}, upload=73915]: Done begin upload segment. Aug 11 16:20:42.676853832 (70h54m37.107933964s) [noise=true , address=77.90.31.14:4663 , piece_id=I5W3UOQI6RQFDF2A5NGYG7GUXBP2XE3N6LCTBVHAXPEWBMVSV26Q, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.676866747 (70h54m37.107946878s) [noise=true , address=104.36.82.10:4079 , piece_id=CYHDYCMVCYISFUDJOXGK2RCJVPRBZXXBAX3ICDJTH4OUPTQL6RMA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.676910421 (70h54m37.107990552s) [noise=true , address=77.90.31.11:4555 , piece_id=42V6RDCOSJRZYHIH7AUYX35F7GRXVZRHRUNBTI3ZDDQSVK2IYBAA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.676958241 (70h54m37.108038383s) [noise=true , address=45.91.116.13:4153 , piece_id=6FFUWDJYTJPUBXGHDGREUB4OM4DGX6COJTXHFWHLGW7QK3CO2JDA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.677329863 (70h54m37.108409994s) [noise=true , address=45.91.116.6:4974 , piece_id=GUI4A3KX4FASSTLQDMD4PHG75FQZRZEZCWNIMLWEJBBHQ5IH6SIA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.677368517 (70h54m37.108448648s) [noise=true , address=45.91.116.10:4083 , piece_id=ACEAUOZZCKIA4LTESFID3ZWUKFVTJACUI6VB327RTMHJLTPZBYGQ, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.677671015 (70h54m37.108751146s) [noise=true , address=77.90.31.17:4771 , piece_id=4Y664XUE5YWHPNAWUYSZ4BPISRV5YM5IGV4VK53RCPFZYEEBOKIQ, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678009293 (70h54m37.109089424s) [noise=true , address=45.91.116.7:4010 , piece_id=I5FZKKDZEIJAEBGXVY5E4PSKY2XN6FFB6YJI7CTWGTS63FVWC77A, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678247930 (70h54m37.109328061s) [noise=true , address=77.90.31.19:4843 , piece_id=NZ6GA4W7S4VGYLD5TBIOVCTFSBODMTOQY7SBY5OB2XWE766R2B3A, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678532164 (70h54m37.109612285s) [noise=true , address=45.91.116.12:4227 , piece_id=C5NVQ4KJ4UVIIXGUUXYLYGZ6T3TVKESSRQX7KSYQZ7O5PYUS3XVA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678765730 (70h54m37.109845861s) [noise=true , address=104.36.82.12:4151 , piece_id=QUY4X3H5VQPZXZ4JCHFKXLUETZXOBEN34KO7YZEMVYQEVGKR5ZZA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678993456 (70h54m37.110073587s) [noise=true , address=45.91.116.13:4155 , piece_id=YTXBYJIN6WYX2LBRDYH7YU55DKC7ZLLECK3HI22IKBWFRT6ZHTIA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679139145 (70h54m37.110219266s) [noise=true , address=45.91.116.4:4939 , piece_id=D3TLK6SUW4O7UUZVU6PADTAGQZ6SJHYAXYG2UULS7VZNMZ5YSOIA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679376159 (70h54m37.11045629s) [noise=true , address=45.91.116.5:4298 , piece_id=QYRZXB5RPTYY3Y54CVYQA76YEOHCKIPOMOP36Z2W6PSF35JDULFA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679589166 (70h54m37.110669297s) [noise=true , address=104.36.82.5:4839 , piece_id=56H4YACEHZNRC4IGN6LQ2OHVYAL6DFVJ3E5XKXUMAWHO6UCMICGA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679786334 (70h54m37.110866465s) [noise=true , address=77.90.31.18:4807 , piece_id=JZTPSUJQ7H7AAQC2JQLY37UM2ZPSCFVYDNOG7RSCJ6SPTWCVVPLA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:44.458058779 (70h54m38.88913891s) [upload=73915]: Next returned nil segment Aug 11 16:20:44.458076964 (70h54m38.889157095s) [upload=73915]: Waiting for error group managing segments... Aug 11 16:20:44.762791322 (70h54m39.193871453s) [noise=true , address=45.91.116.7:4010 , piece_id=I5FZKKDZEIJAEBGXVY5E4PSKY2XN6FFB6YJI7CTWGTS63FVWC77A, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.819598246 (70h54m39.250678377s) [noise=true , address=45.91.116.4:4939 , piece_id=D3TLK6SUW4O7UUZVU6PADTAGQZ6SJHYAXYG2UULS7VZNMZ5YSOIA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.877739022 (70h54m39.308819143s) [noise=true , address=77.90.31.11:4555 , piece_id=42V6RDCOSJRZYHIH7AUYX35F7GRXVZRHRUNBTI3ZDDQSVK2IYBAA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.936181786 (70h54m39.367261918s) [noise=true , address=45.91.116.10:4083 , piece_id=ACEAUOZZCKIA4LTESFID3ZWUKFVTJACUI6VB327RTMHJLTPZBYGQ, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.937836643 (70h54m39.368916774s) [noise=true , address=77.90.31.18:4807 , piece_id=JZTPSUJQ7H7AAQC2JQLY37UM2ZPSCFVYDNOG7RSCJ6SPTWCVVPLA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.939510475 (70h54m39.370590596s) [noise=true , address=77.90.31.17:4771 , piece_id=4Y664XUE5YWHPNAWUYSZ4BPISRV5YM5IGV4VK53RCPFZYEEBOKIQ, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.944277246 (70h54m39.375357377s) [noise=true , address=104.36.82.12:4151 , piece_id=QUY4X3H5VQPZXZ4JCHFKXLUETZXOBEN34KO7YZEMVYQEVGKR5ZZA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.945075824 (70h54m39.376155955s) [noise=true , address=45.91.116.13:4155 , piece_id=YTXBYJIN6WYX2LBRDYH7YU55DKC7ZLLECK3HI22IKBWFRT6ZHTIA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.006188045 (70h54m39.437268176s) [noise=true , address=45.91.116.5:4298 , piece_id=QYRZXB5RPTYY3Y54CVYQA76YEOHCKIPOMOP36Z2W6PSF35JDULFA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.042863199 (70h54m39.47394333s) [noise=true , address=77.90.31.14:4663 , piece_id=I5W3UOQI6RQFDF2A5NGYG7GUXBP2XE3N6LCTBVHAXPEWBMVSV26Q, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.048316484 (70h54m39.479396645s) [noise=true , address=77.90.31.19:4843 , piece_id=NZ6GA4W7S4VGYLD5TBIOVCTFSBODMTOQY7SBY5OB2XWE766R2B3A, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.054276718 (70h54m39.485356839s) [noise=true , address=45.91.116.12:4227 , piece_id=C5NVQ4KJ4UVIIXGUUXYLYGZ6T3TVKESSRQX7KSYQZ7O5PYUS3XVA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.056028469 (70h54m39.487108601s) [noise=true , address=45.91.116.13:4153 , piece_id=6FFUWDJYTJPUBXGHDGREUB4OM4DGX6COJTXHFWHLGW7QK3CO2JDA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.056044611 (70h54m39.487124732s) [seg_pos={0 0}, upload=73915]: Segment reached optimal threshold of 13 pieces. Aug 11 16:20:45.056165442 (70h54m39.487245573s) [noise=true , address=45.91.116.6:4974 , piece_id=GUI4A3KX4FASSTLQDMD4PHG75FQZRZEZCWNIMLWEJBBHQ5IH6SIA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Aug 11 16:20:45.056214636 (70h54m39.487294767s) [noise=true , address=104.36.82.10:4079 , piece_id=CYHDYCMVCYISFUDJOXGK2RCJVPRBZXXBAX3ICDJTH4OUPTQL6RMA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 11 16:20:45.056367308 (70h54m39.48744744s) [noise=true , address=104.36.82.5:4839 , piece_id=56H4YACEHZNRC4IGN6LQ2OHVYAL6DFVJ3E5XKXUMAWHO6UCMICGA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:33142->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:33142->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33142->104.36.82.5:4839: use of closed network connection Aug 11 16:20:45.056394020 (70h54m39.487474151s) [seg_pos={0 0}, upload=73915]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 11 16:20:45.056469904 (70h54m39.487550035s) [upload=73915]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 16:20:45.056474313 (70h54m39.487554444s) [upload=73915]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 16:20:45.348914657 (70h54m39.779994788s) [upload=73915]: Done uploading segments... Aug 11 16:20:45.348932771 (70h54m39.780012902s) [upload=73915]: Upload finished. err: <nil> Duration: 6.051736429s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 5.897519643s FAIL (2025-08-11 16:48:25 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 11 16:35:23.944099565 (71h9m18.375179696s) [upload=74174]: Starting upload Aug 11 16:35:23.944142197 (71h9m18.375222328s) [upload=74174]: Done starting upload Aug 11 16:35:23.944290570 (71h9m18.375370701s) [upload=74174]: Uploading segments... Aug 11 16:35:23.944321590 (71h9m18.375401721s) [upload=74174]: Got next segment. Inline: false Aug 11 16:35:23.944344343 (71h9m18.375424474s) [upload=74174]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 16:35:23.944348621 (71h9m18.375428752s) [upload=74174]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 16:35:24.406399722 (71h9m18.837479854s) [seg_pos={0 0}, upload=74174]: Begin upload segment... Aug 11 16:35:24.406449387 (71h9m18.837529518s) [seg_pos={0 0}, upload=74174]: Done begin upload segment. Aug 11 16:35:24.406475717 (71h9m18.837555848s) [noise=true , address=104.36.82.36:4644 , piece_id=KH5S33POXH2SVQRIPVD5ZMPE7BMZWHSFTOPNIGA7M4KHAGI6KHFQ, seg_pos={0 0}, upload=74174]: Uploading piece... Aug 11 16:35:24.406508711 (71h9m18.837588842s) [noise=true , address=77.90.31.13:4642 , piece_id=MQHLEOZWHY4TGHYNVP7F7IDAQ6F63SIIIWHSQKWQ6BN3JKP3AH5A, seg_pos={0 0}, upload=74174]: Uploading piece... Aug 11 16:35:24.406863500 (71h9m18.837943631s) [noise=true , address=104.36.82.22:4510 , piece_id=3Z55FU2VBZ4IZAG524FGN3PBDYZSE6FWUBBK6ZLMJ2TCEL22H6RQ, seg_pos={0 0}, upload=74174]: Uploading piece... Aug 11 16:35:24.407026131 (71h9m18.838106252s) [noise=true , address=104.36.82.39:4746 , piece_id=PBSDZCC7CTPOAH5OLYJFGT6TVCL4TNI3FZL5Z5MXGMQQ65L4GUBA, seg_pos={0 0}, upload=74174]: Uploading piece... Aug 11 16:35:24.407142373 (71h9m18.838222494s) [noise=true , address=104.36.82.60:4367 , piece_id=4EJG3WIGQUYSGEYTZBA4D5I47WRBG2TSTLZYDBA4SKKT7I4SA4SA, seg_pos={0 0}, upload=74174]: Uploading piece... Aug 11 16:35:24.407420415 (71h9m18.838500536s) [noise=true , address=104.36.82.35:4616 , piece_id=GEL377PWHMAUQHL7RB2WV56HXAYEK5WLG2KXPHUCRCU5OIMENGKA, seg_pos={0 0}, upload=74174]: Uploading piece... Aug 11 16:35:24.407683579 (71h9m18.83876371s) [noise=true , address=104.36.82.44:4871 , piece_id=HZBEDUAOIYBUHMOZRDAUF4PEAAZJOA5WRSWALWA7UQIK3JDQSZ4A, seg_pos={0 0}, upload=74174]: Uploading piece... Aug 11 16:35:24.408126587 (71h9m18.839206718s) [noise=true , address=104.36.82.46:4498 , piece_id=HDYMLA2Q3L4CE4C7XSKUBIWZJ5R2KXYCAJUFLMFRSM5QOYD74L6Q, seg_pos={0 0}, upload=74174]: Uploading piece... Aug 11 16:35:24.408354082 (71h9m18.839434213s) [noise=true , address=104.36.82.38:4723 , piece_id=U5FJU52NE43DGAS5ZHCYWRLWURVDVNNDWA4JP4TCTKJGALGVFOGQ, seg_pos={0 0}, upload=74174]: Uploading piece... Aug 11 16:35:24.408694463 (71h9m18.839774584s) [noise=true , address=79.127.219.38:4026 , piece_id=WGDPBLYFFOCOXJQNSAAFALG5WC7YBDMTRYLYYYRD4P7KSR4VOD2Q, seg_pos={0 0}, upload=74174]: Uploading piece... Aug 11 16:35:24.408921638 (71h9m18.840001769s) [noise=true , address=104.36.82.62:4415 , piece_id=TJ2BSMJ5USGM37TLTCTZAJKB5QDUWKPJR3RDRCBO5VD3EHIEAHFA, seg_pos={0 0}, upload=74174]: Uploading piece... Aug 11 16:35:24.409132681 (71h9m18.840212812s) [noise=true , address=104.36.82.23:4445 , piece_id=4FCYSTHXOZDFLCARULPYFWOVENHISGBEIQOVUFEFOWLHVUPGNKTA, seg_pos={0 0}, upload=74174]: Uploading piece... Aug 11 16:35:24.409381237 (71h9m18.840461368s) [noise=true , address=104.36.82.34:4556 , piece_id=KZICWIYBDXN556SX5FUM6OJY3XUPVWJLEURW2CE2HNREGX7LDCGA, seg_pos={0 0}, upload=74174]: Uploading piece... Aug 11 16:35:24.409593192 (71h9m18.840673323s) [noise=true , address=104.36.82.8:4998 , piece_id=WVZVGKXVWPMYLJEF2HS7QHON5ZPNQCNN3ERZZOMGHTNGQHMEHR3Q, seg_pos={0 0}, upload=74174]: Uploading piece... Aug 11 16:35:24.409793966 (71h9m18.840874097s) [noise=true , address=77.90.31.14:4665 , piece_id=CCJO7T4LBP5WC6N77NLSL4HBUH5CFA6G6CSKYINRUE7NKDOP5EJA, seg_pos={0 0}, upload=74174]: Uploading piece... Aug 11 16:35:24.410180757 (71h9m18.841260888s) [noise=true , address=193.149.164.143:4701 , piece_id=CCYW2PQ3QNUB2HNNFXXGS6EZ42OQ6TBUR4VRQ7R56TAS2CQJFLYQ, seg_pos={0 0}, upload=74174]: Uploading piece... Aug 11 16:35:24.410444992 (71h9m18.841525123s) [noise=true , address=104.36.82.61:4407 , piece_id=TFENYQT2DPY4JPFZLRFDOCCHR5FA6HSROYZD3VRB72Z63I7VT5JQ, seg_pos={0 0}, upload=74174]: Uploading piece... Aug 11 16:35:24.410673891 (71h9m18.841754022s) [noise=true , address=104.36.82.23:4446 , piece_id=YNSW7AD2TCFVV34TA2LPNXYJVZ6LMPT5HLD74CKWXWOKJJT6SEJQ, seg_pos={0 0}, upload=74174]: Uploading piece... Aug 11 16:35:25.618646236 (71h9m20.049726367s) [upload=74174]: Next returned nil segment Aug 11 16:35:25.618664400 (71h9m20.049744531s) [upload=74174]: Waiting for error group managing segments... Aug 11 16:35:25.927381945 (71h9m20.358462076s) [noise=true , address=193.149.164.143:4701 , piece_id=CCYW2PQ3QNUB2HNNFXXGS6EZ42OQ6TBUR4VRQ7R56TAS2CQJFLYQ, seg_pos={0 0}, upload=74174]: Done uploading piece. err: <nil> Aug 11 16:35:26.323160953 (71h9m20.754241084s) [noise=true , address=79.127.219.38:4026 , piece_id=WGDPBLYFFOCOXJQNSAAFALG5WC7YBDMTRYLYYYRD4P7KSR4VOD2Q, seg_pos={0 0}, upload=74174]: Done uploading piece. err: <nil> Aug 11 16:35:26.377281556 (71h9m20.808361697s) [noise=true , address=104.36.82.61:4407 , piece_id=TFENYQT2DPY4JPFZLRFDOCCHR5FA6HSROYZD3VRB72Z63I7VT5JQ, seg_pos={0 0}, upload=74174]: Done uploading piece. err: <nil> Aug 11 16:35:26.377550461 (71h9m20.808630592s) [noise=true , address=104.36.82.35:4616 , piece_id=GEL377PWHMAUQHL7RB2WV56HXAYEK5WLG2KXPHUCRCU5OIMENGKA, seg_pos={0 0}, upload=74174]: Done uploading piece. err: <nil> Aug 11 16:35:26.390996899 (71h9m20.82207702s) [noise=true , address=104.36.82.23:4446 , piece_id=YNSW7AD2TCFVV34TA2LPNXYJVZ6LMPT5HLD74CKWXWOKJJT6SEJQ, seg_pos={0 0}, upload=74174]: Done uploading piece. err: <nil> Aug 11 16:35:26.394608920 (71h9m20.825689051s) [noise=true , address=104.36.82.60:4367 , piece_id=4EJG3WIGQUYSGEYTZBA4D5I47WRBG2TSTLZYDBA4SKKT7I4SA4SA, seg_pos={0 0}, upload=74174]: Done uploading piece. err: <nil> Aug 11 16:35:26.423529997 (71h9m20.854610128s) [noise=true , address=104.36.82.23:4445 , piece_id=4FCYSTHXOZDFLCARULPYFWOVENHISGBEIQOVUFEFOWLHVUPGNKTA, seg_pos={0 0}, upload=74174]: Done uploading piece. err: <nil> Aug 11 16:35:26.436418768 (71h9m20.86749891s) [noise=true , address=104.36.82.8:4998 , piece_id=WVZVGKXVWPMYLJEF2HS7QHON5ZPNQCNN3ERZZOMGHTNGQHMEHR3Q, seg_pos={0 0}, upload=74174]: Done uploading piece. err: <nil> Aug 11 16:35:26.438386484 (71h9m20.869466615s) [noise=true , address=104.36.82.36:4644 , piece_id=KH5S33POXH2SVQRIPVD5ZMPE7BMZWHSFTOPNIGA7M4KHAGI6KHFQ, seg_pos={0 0}, upload=74174]: Done uploading piece. err: <nil> Aug 11 16:35:26.451348765 (71h9m20.882428896s) [noise=true , address=104.36.82.62:4415 , piece_id=TJ2BSMJ5USGM37TLTCTZAJKB5QDUWKPJR3RDRCBO5VD3EHIEAHFA, seg_pos={0 0}, upload=74174]: Done uploading piece. err: <nil> Aug 11 16:35:26.487992629 (71h9m20.91907276s) [noise=true , address=104.36.82.46:4498 , piece_id=HDYMLA2Q3L4CE4C7XSKUBIWZJ5R2KXYCAJUFLMFRSM5QOYD74L6Q, seg_pos={0 0}, upload=74174]: Done uploading piece. err: <nil> Aug 11 16:35:26.495221812 (71h9m20.926301943s) [noise=true , address=104.36.82.39:4746 , piece_id=PBSDZCC7CTPOAH5OLYJFGT6TVCL4TNI3FZL5Z5MXGMQQ65L4GUBA, seg_pos={0 0}, upload=74174]: Done uploading piece. err: <nil> Aug 11 16:35:26.506352639 (71h9m20.93743278s) [noise=true , address=104.36.82.34:4556 , piece_id=KZICWIYBDXN556SX5FUM6OJY3XUPVWJLEURW2CE2HNREGX7LDCGA, seg_pos={0 0}, upload=74174]: Done uploading piece. err: <nil> Aug 11 16:35:26.532639084 (71h9m20.963719215s) [noise=true , address=104.36.82.22:4510 , piece_id=3Z55FU2VBZ4IZAG524FGN3PBDYZSE6FWUBBK6ZLMJ2TCEL22H6RQ, seg_pos={0 0}, upload=74174]: Done uploading piece. err: <nil> Aug 11 16:35:26.532664734 (71h9m20.963744865s) [seg_pos={0 0}, upload=74174]: Segment reached optimal threshold of 14 pieces. Aug 11 16:35:26.532772590 (71h9m20.963852711s) [noise=true , address=104.36.82.44:4871 , piece_id=HZBEDUAOIYBUHMOZRDAUF4PEAAZJOA5WRSWALWA7UQIK3JDQSZ4A, seg_pos={0 0}, upload=74174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t3N84zSSMtzRBs1H47Szc2xAHwqmyr9szJahRkxMYDLto8DAx): protocol: expected piece hash; context canceled; EOF Aug 11 16:35:26.532827094 (71h9m20.963907225s) [noise=true , address=77.90.31.13:4642 , piece_id=MQHLEOZWHY4TGHYNVP7F7IDAQ6F63SIIIWHSQKWQ6BN3JKP3AH5A, seg_pos={0 0}, upload=74174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xdfVQUEMLaGgw7hsBtHZVTKL9BTTxPeYve53efw8GPdSQDL9D): protocol: expected piece hash; context canceled; EOF Aug 11 16:35:26.532880677 (71h9m20.963960808s) [noise=true , address=77.90.31.14:4665 , piece_id=CCJO7T4LBP5WC6N77NLSL4HBUH5CFA6G6CSKYINRUE7NKDOP5EJA, seg_pos={0 0}, upload=74174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W4n6uf6azQk1QgeR8Xw7UkpnZm19zdyFKwojCsqZt2GFHrpce): protocol: expected piece hash; context canceled; EOF Aug 11 16:35:26.532982181 (71h9m20.964062312s) [noise=true , address=104.36.82.38:4723 , piece_id=U5FJU52NE43DGAS5ZHCYWRLWURVDVNNDWA4JP4TCTKJGALGVFOGQ, seg_pos={0 0}, upload=74174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SBKU1E8RjvAx3NzWEveNX5cfuQqq4SKgzY15eeJyfMV2DcF9i): protocol: write tcp 188.166.225.170:40914->104.36.82.38:4723: use of closed network connection; write tcp 188.166.225.170:40914->104.36.82.38:4723: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40914->104.36.82.38:4723: use of closed network connection Aug 11 16:35:26.533016367 (71h9m20.964096498s) [seg_pos={0 0}, upload=74174]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 16:35:26.533084618 (71h9m20.964164749s) [upload=74174]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 16:35:26.533088645 (71h9m20.964168776s) [upload=74174]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 16:35:26.852780658 (71h9m21.283860789s) [upload=74174]: Done uploading segments... Aug 11 16:35:26.852799755 (71h9m21.283879886s) [upload=74174]: Upload finished. err: <nil> Duration: 5.897540142s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...............X...............................X........X...] duration: 2.162272249s FAIL (2025-08-11 16:48:16 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 7ca3b38f59bef6700c47a71c0ce137786b019861ef4e351f330d4f1e41b86704 != before b8ccbd272fe59726b04686e0542c1e0964e89942b662558e091433dc0e7e3dc5 ======LOGS====== Aug 11 16:46:39.434150567 (71h20m33.865230698s) [upload=74358]: Starting upload Aug 11 16:46:39.434202827 (71h20m33.865282958s) [upload=74358]: Done starting upload Aug 11 16:46:39.434253474 (71h20m33.865333605s) [upload=74358]: Uploading segments... Aug 11 16:46:39.434289643 (71h20m33.865369774s) [upload=74358]: Got next segment. Inline: true Aug 11 16:46:39.434293440 (71h20m33.865373561s) [upload=74358]: Waiting for error group managing segments... Aug 11 16:46:39.434326714 (71h20m33.865406845s) [upload=74358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 16:46:39.434330481 (71h20m33.865410612s) [upload=74358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 16:46:39.434332896 (71h20m33.865413017s) [upload=74358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 16:46:39.727280447 (71h20m34.158360588s) [upload=74358]: Done uploading segments... Aug 11 16:46:39.727301838 (71h20m34.158381969s) [upload=74358]: Upload finished. err: <nil> Duration:* 2.162297929s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 6.039784749s FAIL (2025-08-11 16:48:14 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 11 16:20:42.438359750 (70h54m36.869439881s) [upload=73915]: Starting upload Aug 11 16:20:42.438414104 (70h54m36.869494225s) [upload=73915]: Done starting upload Aug 11 16:20:42.438489136 (70h54m36.869569267s) [upload=73915]: Uploading segments... Aug 11 16:20:42.438621770 (70h54m36.869701891s) [upload=73915]: Got next segment. Inline: false Aug 11 16:20:42.438664713 (70h54m36.869744844s) [upload=73915]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 16:20:42.438669001 (70h54m36.869749132s) [upload=73915]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 16:20:42.676790711 (70h54m37.107870842s) [seg_pos={0 0}, upload=73915]: Begin upload segment... Aug 11 16:20:42.676835908 (70h54m37.107916039s) [seg_pos={0 0}, upload=73915]: Done begin upload segment. Aug 11 16:20:42.676853832 (70h54m37.107933964s) [noise=true , address=77.90.31.14:4663 , piece_id=I5W3UOQI6RQFDF2A5NGYG7GUXBP2XE3N6LCTBVHAXPEWBMVSV26Q, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.676866747 (70h54m37.107946878s) [noise=true , address=104.36.82.10:4079 , piece_id=CYHDYCMVCYISFUDJOXGK2RCJVPRBZXXBAX3ICDJTH4OUPTQL6RMA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.676910421 (70h54m37.107990552s) [noise=true , address=77.90.31.11:4555 , piece_id=42V6RDCOSJRZYHIH7AUYX35F7GRXVZRHRUNBTI3ZDDQSVK2IYBAA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.676958241 (70h54m37.108038383s) [noise=true , address=45.91.116.13:4153 , piece_id=6FFUWDJYTJPUBXGHDGREUB4OM4DGX6COJTXHFWHLGW7QK3CO2JDA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.677329863 (70h54m37.108409994s) [noise=true , address=45.91.116.6:4974 , piece_id=GUI4A3KX4FASSTLQDMD4PHG75FQZRZEZCWNIMLWEJBBHQ5IH6SIA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.677368517 (70h54m37.108448648s) [noise=true , address=45.91.116.10:4083 , piece_id=ACEAUOZZCKIA4LTESFID3ZWUKFVTJACUI6VB327RTMHJLTPZBYGQ, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.677671015 (70h54m37.108751146s) [noise=true , address=77.90.31.17:4771 , piece_id=4Y664XUE5YWHPNAWUYSZ4BPISRV5YM5IGV4VK53RCPFZYEEBOKIQ, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678009293 (70h54m37.109089424s) [noise=true , address=45.91.116.7:4010 , piece_id=I5FZKKDZEIJAEBGXVY5E4PSKY2XN6FFB6YJI7CTWGTS63FVWC77A, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678247930 (70h54m37.109328061s) [noise=true , address=77.90.31.19:4843 , piece_id=NZ6GA4W7S4VGYLD5TBIOVCTFSBODMTOQY7SBY5OB2XWE766R2B3A, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678532164 (70h54m37.109612285s) [noise=true , address=45.91.116.12:4227 , piece_id=C5NVQ4KJ4UVIIXGUUXYLYGZ6T3TVKESSRQX7KSYQZ7O5PYUS3XVA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678765730 (70h54m37.109845861s) [noise=true , address=104.36.82.12:4151 , piece_id=QUY4X3H5VQPZXZ4JCHFKXLUETZXOBEN34KO7YZEMVYQEVGKR5ZZA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678993456 (70h54m37.110073587s) [noise=true , address=45.91.116.13:4155 , piece_id=YTXBYJIN6WYX2LBRDYH7YU55DKC7ZLLECK3HI22IKBWFRT6ZHTIA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679139145 (70h54m37.110219266s) [noise=true , address=45.91.116.4:4939 , piece_id=D3TLK6SUW4O7UUZVU6PADTAGQZ6SJHYAXYG2UULS7VZNMZ5YSOIA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679376159 (70h54m37.11045629s) [noise=true , address=45.91.116.5:4298 , piece_id=QYRZXB5RPTYY3Y54CVYQA76YEOHCKIPOMOP36Z2W6PSF35JDULFA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679589166 (70h54m37.110669297s) [noise=true , address=104.36.82.5:4839 , piece_id=56H4YACEHZNRC4IGN6LQ2OHVYAL6DFVJ3E5XKXUMAWHO6UCMICGA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679786334 (70h54m37.110866465s) [noise=true , address=77.90.31.18:4807 , piece_id=JZTPSUJQ7H7AAQC2JQLY37UM2ZPSCFVYDNOG7RSCJ6SPTWCVVPLA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:44.458058779 (70h54m38.88913891s) [upload=73915]: Next returned nil segment Aug 11 16:20:44.458076964 (70h54m38.889157095s) [upload=73915]: Waiting for error group managing segments... Aug 11 16:20:44.762791322 (70h54m39.193871453s) [noise=true , address=45.91.116.7:4010 , piece_id=I5FZKKDZEIJAEBGXVY5E4PSKY2XN6FFB6YJI7CTWGTS63FVWC77A, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.819598246 (70h54m39.250678377s) [noise=true , address=45.91.116.4:4939 , piece_id=D3TLK6SUW4O7UUZVU6PADTAGQZ6SJHYAXYG2UULS7VZNMZ5YSOIA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.877739022 (70h54m39.308819143s) [noise=true , address=77.90.31.11:4555 , piece_id=42V6RDCOSJRZYHIH7AUYX35F7GRXVZRHRUNBTI3ZDDQSVK2IYBAA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.936181786 (70h54m39.367261918s) [noise=true , address=45.91.116.10:4083 , piece_id=ACEAUOZZCKIA4LTESFID3ZWUKFVTJACUI6VB327RTMHJLTPZBYGQ, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.937836643 (70h54m39.368916774s) [noise=true , address=77.90.31.18:4807 , piece_id=JZTPSUJQ7H7AAQC2JQLY37UM2ZPSCFVYDNOG7RSCJ6SPTWCVVPLA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.939510475 (70h54m39.370590596s) [noise=true , address=77.90.31.17:4771 , piece_id=4Y664XUE5YWHPNAWUYSZ4BPISRV5YM5IGV4VK53RCPFZYEEBOKIQ, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.944277246 (70h54m39.375357377s) [noise=true , address=104.36.82.12:4151 , piece_id=QUY4X3H5VQPZXZ4JCHFKXLUETZXOBEN34KO7YZEMVYQEVGKR5ZZA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.945075824 (70h54m39.376155955s) [noise=true , address=45.91.116.13:4155 , piece_id=YTXBYJIN6WYX2LBRDYH7YU55DKC7ZLLECK3HI22IKBWFRT6ZHTIA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.006188045 (70h54m39.437268176s) [noise=true , address=45.91.116.5:4298 , piece_id=QYRZXB5RPTYY3Y54CVYQA76YEOHCKIPOMOP36Z2W6PSF35JDULFA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.042863199 (70h54m39.47394333s) [noise=true , address=77.90.31.14:4663 , piece_id=I5W3UOQI6RQFDF2A5NGYG7GUXBP2XE3N6LCTBVHAXPEWBMVSV26Q, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.048316484 (70h54m39.479396645s) [noise=true , address=77.90.31.19:4843 , piece_id=NZ6GA4W7S4VGYLD5TBIOVCTFSBODMTOQY7SBY5OB2XWE766R2B3A, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.054276718 (70h54m39.485356839s) [noise=true , address=45.91.116.12:4227 , piece_id=C5NVQ4KJ4UVIIXGUUXYLYGZ6T3TVKESSRQX7KSYQZ7O5PYUS3XVA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.056028469 (70h54m39.487108601s) [noise=true , address=45.91.116.13:4153 , piece_id=6FFUWDJYTJPUBXGHDGREUB4OM4DGX6COJTXHFWHLGW7QK3CO2JDA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.056044611 (70h54m39.487124732s) [seg_pos={0 0}, upload=73915]: Segment reached optimal threshold of 13 pieces. Aug 11 16:20:45.056165442 (70h54m39.487245573s) [noise=true , address=45.91.116.6:4974 , piece_id=GUI4A3KX4FASSTLQDMD4PHG75FQZRZEZCWNIMLWEJBBHQ5IH6SIA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Aug 11 16:20:45.056214636 (70h54m39.487294767s) [noise=true , address=104.36.82.10:4079 , piece_id=CYHDYCMVCYISFUDJOXGK2RCJVPRBZXXBAX3ICDJTH4OUPTQL6RMA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 11 16:20:45.056367308 (70h54m39.48744744s) [noise=true , address=104.36.82.5:4839 , piece_id=56H4YACEHZNRC4IGN6LQ2OHVYAL6DFVJ3E5XKXUMAWHO6UCMICGA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:33142->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:33142->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33142->104.36.82.5:4839: use of closed network connection Aug 11 16:20:45.056394020 (70h54m39.487474151s) [seg_pos={0 0}, upload=73915]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 11 16:20:45.056469904 (70h54m39.487550035s) [upload=73915]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 16:20:45.056474313 (70h54m39.487554444s) [upload=73915]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 16:20:45.348914657 (70h54m39.779994788s) [upload=73915]: Done uploading segments... Aug 11 16:20:45.348932771 (70h54m39.780012902s) [upload=73915]: Upload finished. err: <nil> Duration: 6.039807001s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 6.107558437s FAIL (2025-08-11 16:47:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Aug 11 16:20:42.438359750 (70h54m36.869439881s) [upload=73915]: Starting upload Aug 11 16:20:42.438414104 (70h54m36.869494225s) [upload=73915]: Done starting upload Aug 11 16:20:42.438489136 (70h54m36.869569267s) [upload=73915]: Uploading segments... Aug 11 16:20:42.438621770 (70h54m36.869701891s) [upload=73915]: Got next segment. Inline: false Aug 11 16:20:42.438664713 (70h54m36.869744844s) [upload=73915]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 16:20:42.438669001 (70h54m36.869749132s) [upload=73915]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 16:20:42.676790711 (70h54m37.107870842s) [seg_pos={0 0}, upload=73915]: Begin upload segment... Aug 11 16:20:42.676835908 (70h54m37.107916039s) [seg_pos={0 0}, upload=73915]: Done begin upload segment. Aug 11 16:20:42.676853832 (70h54m37.107933964s) [noise=true , address=77.90.31.14:4663 , piece_id=I5W3UOQI6RQFDF2A5NGYG7GUXBP2XE3N6LCTBVHAXPEWBMVSV26Q, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.676866747 (70h54m37.107946878s) [noise=true , address=104.36.82.10:4079 , piece_id=CYHDYCMVCYISFUDJOXGK2RCJVPRBZXXBAX3ICDJTH4OUPTQL6RMA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.676910421 (70h54m37.107990552s) [noise=true , address=77.90.31.11:4555 , piece_id=42V6RDCOSJRZYHIH7AUYX35F7GRXVZRHRUNBTI3ZDDQSVK2IYBAA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.676958241 (70h54m37.108038383s) [noise=true , address=45.91.116.13:4153 , piece_id=6FFUWDJYTJPUBXGHDGREUB4OM4DGX6COJTXHFWHLGW7QK3CO2JDA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.677329863 (70h54m37.108409994s) [noise=true , address=45.91.116.6:4974 , piece_id=GUI4A3KX4FASSTLQDMD4PHG75FQZRZEZCWNIMLWEJBBHQ5IH6SIA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.677368517 (70h54m37.108448648s) [noise=true , address=45.91.116.10:4083 , piece_id=ACEAUOZZCKIA4LTESFID3ZWUKFVTJACUI6VB327RTMHJLTPZBYGQ, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.677671015 (70h54m37.108751146s) [noise=true , address=77.90.31.17:4771 , piece_id=4Y664XUE5YWHPNAWUYSZ4BPISRV5YM5IGV4VK53RCPFZYEEBOKIQ, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678009293 (70h54m37.109089424s) [noise=true , address=45.91.116.7:4010 , piece_id=I5FZKKDZEIJAEBGXVY5E4PSKY2XN6FFB6YJI7CTWGTS63FVWC77A, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678247930 (70h54m37.109328061s) [noise=true , address=77.90.31.19:4843 , piece_id=NZ6GA4W7S4VGYLD5TBIOVCTFSBODMTOQY7SBY5OB2XWE766R2B3A, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678532164 (70h54m37.109612285s) [noise=true , address=45.91.116.12:4227 , piece_id=C5NVQ4KJ4UVIIXGUUXYLYGZ6T3TVKESSRQX7KSYQZ7O5PYUS3XVA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678765730 (70h54m37.109845861s) [noise=true , address=104.36.82.12:4151 , piece_id=QUY4X3H5VQPZXZ4JCHFKXLUETZXOBEN34KO7YZEMVYQEVGKR5ZZA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.678993456 (70h54m37.110073587s) [noise=true , address=45.91.116.13:4155 , piece_id=YTXBYJIN6WYX2LBRDYH7YU55DKC7ZLLECK3HI22IKBWFRT6ZHTIA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679139145 (70h54m37.110219266s) [noise=true , address=45.91.116.4:4939 , piece_id=D3TLK6SUW4O7UUZVU6PADTAGQZ6SJHYAXYG2UULS7VZNMZ5YSOIA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679376159 (70h54m37.11045629s) [noise=true , address=45.91.116.5:4298 , piece_id=QYRZXB5RPTYY3Y54CVYQA76YEOHCKIPOMOP36Z2W6PSF35JDULFA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679589166 (70h54m37.110669297s) [noise=true , address=104.36.82.5:4839 , piece_id=56H4YACEHZNRC4IGN6LQ2OHVYAL6DFVJ3E5XKXUMAWHO6UCMICGA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:42.679786334 (70h54m37.110866465s) [noise=true , address=77.90.31.18:4807 , piece_id=JZTPSUJQ7H7AAQC2JQLY37UM2ZPSCFVYDNOG7RSCJ6SPTWCVVPLA, seg_pos={0 0}, upload=73915]: Uploading piece... Aug 11 16:20:44.458058779 (70h54m38.88913891s) [upload=73915]: Next returned nil segment Aug 11 16:20:44.458076964 (70h54m38.889157095s) [upload=73915]: Waiting for error group managing segments... Aug 11 16:20:44.762791322 (70h54m39.193871453s) [noise=true , address=45.91.116.7:4010 , piece_id=I5FZKKDZEIJAEBGXVY5E4PSKY2XN6FFB6YJI7CTWGTS63FVWC77A, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.819598246 (70h54m39.250678377s) [noise=true , address=45.91.116.4:4939 , piece_id=D3TLK6SUW4O7UUZVU6PADTAGQZ6SJHYAXYG2UULS7VZNMZ5YSOIA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.877739022 (70h54m39.308819143s) [noise=true , address=77.90.31.11:4555 , piece_id=42V6RDCOSJRZYHIH7AUYX35F7GRXVZRHRUNBTI3ZDDQSVK2IYBAA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.936181786 (70h54m39.367261918s) [noise=true , address=45.91.116.10:4083 , piece_id=ACEAUOZZCKIA4LTESFID3ZWUKFVTJACUI6VB327RTMHJLTPZBYGQ, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.937836643 (70h54m39.368916774s) [noise=true , address=77.90.31.18:4807 , piece_id=JZTPSUJQ7H7AAQC2JQLY37UM2ZPSCFVYDNOG7RSCJ6SPTWCVVPLA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.939510475 (70h54m39.370590596s) [noise=true , address=77.90.31.17:4771 , piece_id=4Y664XUE5YWHPNAWUYSZ4BPISRV5YM5IGV4VK53RCPFZYEEBOKIQ, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.944277246 (70h54m39.375357377s) [noise=true , address=104.36.82.12:4151 , piece_id=QUY4X3H5VQPZXZ4JCHFKXLUETZXOBEN34KO7YZEMVYQEVGKR5ZZA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:44.945075824 (70h54m39.376155955s) [noise=true , address=45.91.116.13:4155 , piece_id=YTXBYJIN6WYX2LBRDYH7YU55DKC7ZLLECK3HI22IKBWFRT6ZHTIA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.006188045 (70h54m39.437268176s) [noise=true , address=45.91.116.5:4298 , piece_id=QYRZXB5RPTYY3Y54CVYQA76YEOHCKIPOMOP36Z2W6PSF35JDULFA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.042863199 (70h54m39.47394333s) [noise=true , address=77.90.31.14:4663 , piece_id=I5W3UOQI6RQFDF2A5NGYG7GUXBP2XE3N6LCTBVHAXPEWBMVSV26Q, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.048316484 (70h54m39.479396645s) [noise=true , address=77.90.31.19:4843 , piece_id=NZ6GA4W7S4VGYLD5TBIOVCTFSBODMTOQY7SBY5OB2XWE766R2B3A, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.054276718 (70h54m39.485356839s) [noise=true , address=45.91.116.12:4227 , piece_id=C5NVQ4KJ4UVIIXGUUXYLYGZ6T3TVKESSRQX7KSYQZ7O5PYUS3XVA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.056028469 (70h54m39.487108601s) [noise=true , address=45.91.116.13:4153 , piece_id=6FFUWDJYTJPUBXGHDGREUB4OM4DGX6COJTXHFWHLGW7QK3CO2JDA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: <nil> Aug 11 16:20:45.056044611 (70h54m39.487124732s) [seg_pos={0 0}, upload=73915]: Segment reached optimal threshold of 13 pieces. Aug 11 16:20:45.056165442 (70h54m39.487245573s) [noise=true , address=45.91.116.6:4974 , piece_id=GUI4A3KX4FASSTLQDMD4PHG75FQZRZEZCWNIMLWEJBBHQ5IH6SIA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Aug 11 16:20:45.056214636 (70h54m39.487294767s) [noise=true , address=104.36.82.10:4079 , piece_id=CYHDYCMVCYISFUDJOXGK2RCJVPRBZXXBAX3ICDJTH4OUPTQL6RMA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF Aug 11 16:20:45.056367308 (70h54m39.48744744s) [noise=true , address=104.36.82.5:4839 , piece_id=56H4YACEHZNRC4IGN6LQ2OHVYAL6DFVJ3E5XKXUMAWHO6UCMICGA, seg_pos={0 0}, upload=73915]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:33142->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:33142->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33142->104.36.82.5:4839: use of closed network connection Aug 11 16:20:45.056394020 (70h54m39.487474151s) [seg_pos={0 0}, upload=73915]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 11 16:20:45.056469904 (70h54m39.487550035s) [upload=73915]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 16:20:45.056474313 (70h54m39.487554444s) [upload=73915]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 16:20:45.348914657 (70h54m39.779994788s) [upload=73915]: Done uploading segments... Aug 11 16:20:45.348932771 (70h54m39.780012902s) [upload=73915]: Upload finished. err: <nil> Duration: 6.107584455s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [................X...............................X........X..] duration: 1.909277273s FAIL (2025-08-11 16:47:30 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 7ca3b38f59bef6700c47a71c0ce137786b019861ef4e351f330d4f1e41b86704 != before b8ccbd272fe59726b04686e0542c1e0964e89942b662558e091433dc0e7e3dc5 ======LOGS====== Aug 11 16:46:39.434150567 (71h20m33.865230698s) [upload=74358]: Starting upload Aug 11 16:46:39.434202827 (71h20m33.865282958s) [upload=74358]: Done starting upload Aug 11 16:46:39.434253474 (71h20m33.865333605s) [upload=74358]: Uploading segments... Aug 11 16:46:39.434289643 (71h20m33.865369774s) [upload=74358]: Got next segment. Inline: true Aug 11 16:46:39.434293440 (71h20m33.865373561s) [upload=74358]: Waiting for error group managing segments... Aug 11 16:46:39.434326714 (71h20m33.865406845s) [upload=74358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 16:46:39.434330481 (71h20m33.865410612s) [upload=74358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 16:46:39.434332896 (71h20m33.865413017s) [upload=74358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 16:46:39.727280447 (71h20m34.158360588s) [upload=74358]: Done uploading segments... Aug 11 16:46:39.727301838 (71h20m34.158381969s) [upload=74358]: Upload finished. err: <nil> Duration:* 1.909308153s core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)