Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 5.995570108s FAIL (2025-07-27 21:36:00 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== NBYMF2YQ, seg_pos={0 0}, upload=78056]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection; write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection Jul 27 20:55:33.507192913 (81h19m43.229755953s) [seg_pos={0 0}, upload=78056]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 20:55:33.507272095 (81h19m43.229835135s) [upload=78056]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 20:55:33.507278908 (81h19m43.229841948s) [upload=78056]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 20:55:33.873750499 (81h19m43.596313549s) [upload=78056]: Done uploading segments... Jul 27 20:55:33.873771960 (81h19m43.59633502s) [upload=78056]: Upload finished. err: <nil> Jul 27 20:56:44.063819950 (81h20m53.78638298s) [upload=78076]: Starting upload Jul 27 20:56:44.063870106 (81h20m53.786433146s) [upload=78076]: Done starting upload Jul 27 20:56:44.064058887 (81h20m53.786621927s) [upload=78076]: Uploading segments... Jul 27 20:56:44.064105396 (81h20m53.786668436s) [upload=78076]: Got next segment. Inline: false Jul 27 20:56:44.064136426 (81h20m53.786699466s) [upload=78076]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 27 20:56:44.064301271 (81h20m53.786864321s) [upload=78076]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 27 20:56:44.584553631 (81h20m54.307116671s) [seg_pos={0 0}, upload=78076]: Begin upload segment... Jul 27 20:56:44.584612734 (81h20m54.307175784s) [seg_pos={0 0}, upload=78076]: Done begin upload segment. Jul 27 20:56:44.584637962 (81h20m54.307201002s) [noise=true , address=77.90.31.15:4699 , piece_id=AL7HA5TX46M3ZF2BOZGNGGFJ5IHHSDRT4YHUN2XEL2XPEMLISRWQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.584670444 (81h20m54.307233484s) [noise=true , address=45.91.116.14:4190 , piece_id=G4FLK67VLPGRJJUNECETUKGYS3OMQA4CGBKCWPDHVHT632JUHMBQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585060231 (81h20m54.307623271s) [noise=true , address=77.90.31.12:4590 , piece_id=RY3N4AP2KLW2RGQDSYTURIEAW7FJKDRODVBJJ574AGWREXJOIXOA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585139933 (81h20m54.307702963s) [noise=true , address=77.90.31.16:4734 , piece_id=GJJTLE73ATBF2FSCY7QOGWXORADSKXLJXNGDH34DZTSPPTQKSXJA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585361397 (81h20m54.307924437s) [noise=true , address=77.90.31.16:4733 , piece_id=UUS54WDRK744TKZLXXAAPRBPCM2OUGPWCRNV57FUZ4K2KXMVG23Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585453122 (81h20m54.308016162s) [noise=true , address=45.91.116.9:4262 , piece_id=7NM6FTVFO4RO7ZUI2A6ONJSQHSKTBNUJTE4RE2PG73V7SDIDFTLQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585646031 (81h20m54.308209081s) [noise=true , address=77.90.31.14:4663 , piece_id=VXGT4HSKJ6LU4CNLPXVOD64RFMTIXHSOIHP3FYKTJEUREGCXJHPA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585756052 (81h20m54.308319092s) [noise=true , address=45.91.116.10:4081 , piece_id=5OBJPHS7YVSLQ7R25I6B33XXTS5IYKF4RLAUGRORWNVF2VIJZOKA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585991612 (81h20m54.308554652s) [noise=true , address=45.91.116.7:4010 , piece_id=QJCPKYGZ2MJGMIZGDXIDQDZQMEE2HUBWXZ7KRAGIJD564MOQWX2Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586051648 (81h20m54.308614688s) [noise=true , address=77.90.31.13:4628 , piece_id=XMP7M7ILT5U7UXGYSM4UB5VBMWUHIDRGTZPLZRYLK3W2NTM4WEDQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586298259 (81h20m54.30886129s) [noise=true , address=45.91.116.11:4118 , piece_id=WAANSRE3AOQ74X575MUJEMFZVVSGECFE5IXRID6UFB6LMK76G5VQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586318758 (81h20m54.308881798s) [noise=true , address=77.90.31.18:4806 , piece_id=PECBEVTQRQJUPRHUS2FDKQHQF4EAAXW226HVFYM5EGCF72ZKRXEA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586610727 (81h20m54.309173777s) [noise=true , address=77.90.31.15:4697 , piece_id=5DDY52MEVML4BBMTJFPJD3SWD4UYLYQ4WT5DGBPIQWBIXMPTCHRQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586908527 (81h20m54.309471567s) [noise=true , address=77.90.31.10:4520 , piece_id=XECJATSD772ZU45XV2KDWE67C2MQHRH7J2MLTCPWHZLWA7YKF36Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.587209813 (81h20m54.309772853s) [noise=true , address=45.91.116.8:4047 , piece_id=VTO4NXZJKRF4SDOLNBTOUC4T6LD7UGCHJQTJOGGS2LPF7CPZWGIA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.587534054 (81h20m54.310097094s) [noise=true , address=45.91.116.7:4011 , piece_id=4MZ6Y2VDJEYHGHOM7QIO4OB5OF3EYPXCACP5UR7V2BCZN7PN4T4Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:46.339251587 (81h20m56.061814627s) [upload=78076]: Next returned nil segment Jul 27 20:56:46.339268218 (81h20m56.061831248s) [upload=78076]: Waiting for error group managing segments... Jul 27 20:56:46.616169719 (81h20m56.338732749s) [noise=true , address=45.91.116.10:4081 , piece_id=5OBJPHS7YVSLQ7R25I6B33XXTS5IYKF4RLAUGRORWNVF2VIJZOKA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.672944635 (81h20m56.395507676s) [noise=true , address=77.90.31.12:4590 , piece_id=RY3N4AP2KLW2RGQDSYTURIEAW7FJKDRODVBJJ574AGWREXJOIXOA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.679116684 (81h20m56.401679724s) [noise=true , address=77.90.31.14:4663 , piece_id=VXGT4HSKJ6LU4CNLPXVOD64RFMTIXHSOIHP3FYKTJEUREGCXJHPA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.689698961 (81h20m56.412262001s) [noise=true , address=77.90.31.16:4733 , piece_id=UUS54WDRK744TKZLXXAAPRBPCM2OUGPWCRNV57FUZ4K2KXMVG23Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.691556325 (81h20m56.414119365s) [noise=true , address=77.90.31.15:4697 , piece_id=5DDY52MEVML4BBMTJFPJD3SWD4UYLYQ4WT5DGBPIQWBIXMPTCHRQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.696368232 (81h20m56.418931272s) [noise=true , address=45.91.116.9:4262 , piece_id=7NM6FTVFO4RO7ZUI2A6ONJSQHSKTBNUJTE4RE2PG73V7SDIDFTLQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.701404117 (81h20m56.423967157s) [noise=true , address=77.90.31.13:4628 , piece_id=XMP7M7ILT5U7UXGYSM4UB5VBMWUHIDRGTZPLZRYLK3W2NTM4WEDQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.708417285 (81h20m56.430980325s) [noise=true , address=77.90.31.15:4699 , piece_id=AL7HA5TX46M3ZF2BOZGNGGFJ5IHHSDRT4YHUN2XEL2XPEMLISRWQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.711882846 (81h20m56.434445886s) [noise=true , address=45.91.116.14:4190 , piece_id=G4FLK67VLPGRJJUNECETUKGYS3OMQA4CGBKCWPDHVHT632JUHMBQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.730484234 (81h20m56.453047274s) [noise=true , address=45.91.116.8:4047 , piece_id=VTO4NXZJKRF4SDOLNBTOUC4T6LD7UGCHJQTJOGGS2LPF7CPZWGIA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.733559909 (81h20m56.456122949s) [noise=true , address=77.90.31.16:4734 , piece_id=GJJTLE73ATBF2FSCY7QOGWXORADSKXLJXNGDH34DZTSPPTQKSXJA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.761219480 (81h20m56.48378252s) [noise=true , address=45.91.116.11:4118 , piece_id=WAANSRE3AOQ74X575MUJEMFZVVSGECFE5IXRID6UFB6LMK76G5VQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.764041981 (81h20m56.486605021s) [noise=true , address=77.90.31.10:4520 , piece_id=XECJATSD772ZU45XV2KDWE67C2MQHRH7J2MLTCPWHZLWA7YKF36Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.764051749 (81h20m56.486614789s) [seg_pos={0 0}, upload=78076]: Segment reached optimal threshold of 13 pieces. Jul 27 20:56:46.764265288 (81h20m56.486828328s) [noise=true , address=45.91.116.7:4011 , piece_id=4MZ6Y2VDJEYHGHOM7QIO4OB5OF3EYPXCACP5UR7V2BCZN7PN4T4Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764492743 (81h20m56.487055783s) [noise=true , address=45.91.116.7:4010 , piece_id=QJCPKYGZ2MJGMIZGDXIDQDZQMEE2HUBWXZ7KRAGIJD564MOQWX2Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764577445 (81h20m56.487140485s) [noise=true , address=77.90.31.18:4806 , piece_id=PECBEVTQRQJUPRHUS2FDKQHQF4EAAXW226HVFYM5EGCF72ZKRXEA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764592364 (81h20m56.487155404s) [seg_pos={0 0}, upload=78076]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 20:56:46.764671274 (81h20m56.487234314s) [upload=78076]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 20:56:46.764675643 (81h20m56.487238673s) [upload=78076]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 20:56:47.043439135 (81h20m56.766002255s) [upload=78076]: Done uploading segments... Jul 27 20:56:47.043463021 (81h20m56.766026061s) [upload=78076]: Upload finished. err: <nil> Duration: 5.995594104s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..X....................................X.....X..............] duration: 1.828977847s FAIL (2025-07-27 21:35:52 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 1.829003918s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................................X........................X.] duration: 5.804745763s FAIL (2025-07-27 21:35:43 UTC) orbiter warning: uplink: too many requests Duration: 5.804768495s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 5.830076095s FAIL (2025-07-27 21:35:41 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== NBYMF2YQ, seg_pos={0 0}, upload=78056]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection; write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection Jul 27 20:55:33.507192913 (81h19m43.229755953s) [seg_pos={0 0}, upload=78056]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 20:55:33.507272095 (81h19m43.229835135s) [upload=78056]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 20:55:33.507278908 (81h19m43.229841948s) [upload=78056]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 20:55:33.873750499 (81h19m43.596313549s) [upload=78056]: Done uploading segments... Jul 27 20:55:33.873771960 (81h19m43.59633502s) [upload=78056]: Upload finished. err: <nil> Jul 27 20:56:44.063819950 (81h20m53.78638298s) [upload=78076]: Starting upload Jul 27 20:56:44.063870106 (81h20m53.786433146s) [upload=78076]: Done starting upload Jul 27 20:56:44.064058887 (81h20m53.786621927s) [upload=78076]: Uploading segments... Jul 27 20:56:44.064105396 (81h20m53.786668436s) [upload=78076]: Got next segment. Inline: false Jul 27 20:56:44.064136426 (81h20m53.786699466s) [upload=78076]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 27 20:56:44.064301271 (81h20m53.786864321s) [upload=78076]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 27 20:56:44.584553631 (81h20m54.307116671s) [seg_pos={0 0}, upload=78076]: Begin upload segment... Jul 27 20:56:44.584612734 (81h20m54.307175784s) [seg_pos={0 0}, upload=78076]: Done begin upload segment. Jul 27 20:56:44.584637962 (81h20m54.307201002s) [noise=true , address=77.90.31.15:4699 , piece_id=AL7HA5TX46M3ZF2BOZGNGGFJ5IHHSDRT4YHUN2XEL2XPEMLISRWQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.584670444 (81h20m54.307233484s) [noise=true , address=45.91.116.14:4190 , piece_id=G4FLK67VLPGRJJUNECETUKGYS3OMQA4CGBKCWPDHVHT632JUHMBQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585060231 (81h20m54.307623271s) [noise=true , address=77.90.31.12:4590 , piece_id=RY3N4AP2KLW2RGQDSYTURIEAW7FJKDRODVBJJ574AGWREXJOIXOA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585139933 (81h20m54.307702963s) [noise=true , address=77.90.31.16:4734 , piece_id=GJJTLE73ATBF2FSCY7QOGWXORADSKXLJXNGDH34DZTSPPTQKSXJA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585361397 (81h20m54.307924437s) [noise=true , address=77.90.31.16:4733 , piece_id=UUS54WDRK744TKZLXXAAPRBPCM2OUGPWCRNV57FUZ4K2KXMVG23Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585453122 (81h20m54.308016162s) [noise=true , address=45.91.116.9:4262 , piece_id=7NM6FTVFO4RO7ZUI2A6ONJSQHSKTBNUJTE4RE2PG73V7SDIDFTLQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585646031 (81h20m54.308209081s) [noise=true , address=77.90.31.14:4663 , piece_id=VXGT4HSKJ6LU4CNLPXVOD64RFMTIXHSOIHP3FYKTJEUREGCXJHPA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585756052 (81h20m54.308319092s) [noise=true , address=45.91.116.10:4081 , piece_id=5OBJPHS7YVSLQ7R25I6B33XXTS5IYKF4RLAUGRORWNVF2VIJZOKA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585991612 (81h20m54.308554652s) [noise=true , address=45.91.116.7:4010 , piece_id=QJCPKYGZ2MJGMIZGDXIDQDZQMEE2HUBWXZ7KRAGIJD564MOQWX2Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586051648 (81h20m54.308614688s) [noise=true , address=77.90.31.13:4628 , piece_id=XMP7M7ILT5U7UXGYSM4UB5VBMWUHIDRGTZPLZRYLK3W2NTM4WEDQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586298259 (81h20m54.30886129s) [noise=true , address=45.91.116.11:4118 , piece_id=WAANSRE3AOQ74X575MUJEMFZVVSGECFE5IXRID6UFB6LMK76G5VQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586318758 (81h20m54.308881798s) [noise=true , address=77.90.31.18:4806 , piece_id=PECBEVTQRQJUPRHUS2FDKQHQF4EAAXW226HVFYM5EGCF72ZKRXEA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586610727 (81h20m54.309173777s) [noise=true , address=77.90.31.15:4697 , piece_id=5DDY52MEVML4BBMTJFPJD3SWD4UYLYQ4WT5DGBPIQWBIXMPTCHRQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586908527 (81h20m54.309471567s) [noise=true , address=77.90.31.10:4520 , piece_id=XECJATSD772ZU45XV2KDWE67C2MQHRH7J2MLTCPWHZLWA7YKF36Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.587209813 (81h20m54.309772853s) [noise=true , address=45.91.116.8:4047 , piece_id=VTO4NXZJKRF4SDOLNBTOUC4T6LD7UGCHJQTJOGGS2LPF7CPZWGIA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.587534054 (81h20m54.310097094s) [noise=true , address=45.91.116.7:4011 , piece_id=4MZ6Y2VDJEYHGHOM7QIO4OB5OF3EYPXCACP5UR7V2BCZN7PN4T4Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:46.339251587 (81h20m56.061814627s) [upload=78076]: Next returned nil segment Jul 27 20:56:46.339268218 (81h20m56.061831248s) [upload=78076]: Waiting for error group managing segments... Jul 27 20:56:46.616169719 (81h20m56.338732749s) [noise=true , address=45.91.116.10:4081 , piece_id=5OBJPHS7YVSLQ7R25I6B33XXTS5IYKF4RLAUGRORWNVF2VIJZOKA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.672944635 (81h20m56.395507676s) [noise=true , address=77.90.31.12:4590 , piece_id=RY3N4AP2KLW2RGQDSYTURIEAW7FJKDRODVBJJ574AGWREXJOIXOA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.679116684 (81h20m56.401679724s) [noise=true , address=77.90.31.14:4663 , piece_id=VXGT4HSKJ6LU4CNLPXVOD64RFMTIXHSOIHP3FYKTJEUREGCXJHPA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.689698961 (81h20m56.412262001s) [noise=true , address=77.90.31.16:4733 , piece_id=UUS54WDRK744TKZLXXAAPRBPCM2OUGPWCRNV57FUZ4K2KXMVG23Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.691556325 (81h20m56.414119365s) [noise=true , address=77.90.31.15:4697 , piece_id=5DDY52MEVML4BBMTJFPJD3SWD4UYLYQ4WT5DGBPIQWBIXMPTCHRQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.696368232 (81h20m56.418931272s) [noise=true , address=45.91.116.9:4262 , piece_id=7NM6FTVFO4RO7ZUI2A6ONJSQHSKTBNUJTE4RE2PG73V7SDIDFTLQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.701404117 (81h20m56.423967157s) [noise=true , address=77.90.31.13:4628 , piece_id=XMP7M7ILT5U7UXGYSM4UB5VBMWUHIDRGTZPLZRYLK3W2NTM4WEDQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.708417285 (81h20m56.430980325s) [noise=true , address=77.90.31.15:4699 , piece_id=AL7HA5TX46M3ZF2BOZGNGGFJ5IHHSDRT4YHUN2XEL2XPEMLISRWQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.711882846 (81h20m56.434445886s) [noise=true , address=45.91.116.14:4190 , piece_id=G4FLK67VLPGRJJUNECETUKGYS3OMQA4CGBKCWPDHVHT632JUHMBQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.730484234 (81h20m56.453047274s) [noise=true , address=45.91.116.8:4047 , piece_id=VTO4NXZJKRF4SDOLNBTOUC4T6LD7UGCHJQTJOGGS2LPF7CPZWGIA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.733559909 (81h20m56.456122949s) [noise=true , address=77.90.31.16:4734 , piece_id=GJJTLE73ATBF2FSCY7QOGWXORADSKXLJXNGDH34DZTSPPTQKSXJA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.761219480 (81h20m56.48378252s) [noise=true , address=45.91.116.11:4118 , piece_id=WAANSRE3AOQ74X575MUJEMFZVVSGECFE5IXRID6UFB6LMK76G5VQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.764041981 (81h20m56.486605021s) [noise=true , address=77.90.31.10:4520 , piece_id=XECJATSD772ZU45XV2KDWE67C2MQHRH7J2MLTCPWHZLWA7YKF36Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.764051749 (81h20m56.486614789s) [seg_pos={0 0}, upload=78076]: Segment reached optimal threshold of 13 pieces. Jul 27 20:56:46.764265288 (81h20m56.486828328s) [noise=true , address=45.91.116.7:4011 , piece_id=4MZ6Y2VDJEYHGHOM7QIO4OB5OF3EYPXCACP5UR7V2BCZN7PN4T4Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764492743 (81h20m56.487055783s) [noise=true , address=45.91.116.7:4010 , piece_id=QJCPKYGZ2MJGMIZGDXIDQDZQMEE2HUBWXZ7KRAGIJD564MOQWX2Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764577445 (81h20m56.487140485s) [noise=true , address=77.90.31.18:4806 , piece_id=PECBEVTQRQJUPRHUS2FDKQHQF4EAAXW226HVFYM5EGCF72ZKRXEA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764592364 (81h20m56.487155404s) [seg_pos={0 0}, upload=78076]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 20:56:46.764671274 (81h20m56.487234314s) [upload=78076]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 20:56:46.764675643 (81h20m56.487238673s) [upload=78076]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 20:56:47.043439135 (81h20m56.766002255s) [upload=78076]: Done uploading segments... Jul 27 20:56:47.043463021 (81h20m56.766026061s) [upload=78076]: Upload finished. err: <nil> Duration: 5.830095793s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...X....................................X.....X.............] duration: 1.893980006s FAIL (2025-07-27 21:35:28 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 1.894006167s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 5.814582222s FAIL (2025-07-27 21:35:20 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== NBYMF2YQ, seg_pos={0 0}, upload=78056]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection; write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection Jul 27 20:55:33.507192913 (81h19m43.229755953s) [seg_pos={0 0}, upload=78056]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 20:55:33.507272095 (81h19m43.229835135s) [upload=78056]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 20:55:33.507278908 (81h19m43.229841948s) [upload=78056]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 20:55:33.873750499 (81h19m43.596313549s) [upload=78056]: Done uploading segments... Jul 27 20:55:33.873771960 (81h19m43.59633502s) [upload=78056]: Upload finished. err: <nil> Jul 27 20:56:44.063819950 (81h20m53.78638298s) [upload=78076]: Starting upload Jul 27 20:56:44.063870106 (81h20m53.786433146s) [upload=78076]: Done starting upload Jul 27 20:56:44.064058887 (81h20m53.786621927s) [upload=78076]: Uploading segments... Jul 27 20:56:44.064105396 (81h20m53.786668436s) [upload=78076]: Got next segment. Inline: false Jul 27 20:56:44.064136426 (81h20m53.786699466s) [upload=78076]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 27 20:56:44.064301271 (81h20m53.786864321s) [upload=78076]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 27 20:56:44.584553631 (81h20m54.307116671s) [seg_pos={0 0}, upload=78076]: Begin upload segment... Jul 27 20:56:44.584612734 (81h20m54.307175784s) [seg_pos={0 0}, upload=78076]: Done begin upload segment. Jul 27 20:56:44.584637962 (81h20m54.307201002s) [noise=true , address=77.90.31.15:4699 , piece_id=AL7HA5TX46M3ZF2BOZGNGGFJ5IHHSDRT4YHUN2XEL2XPEMLISRWQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.584670444 (81h20m54.307233484s) [noise=true , address=45.91.116.14:4190 , piece_id=G4FLK67VLPGRJJUNECETUKGYS3OMQA4CGBKCWPDHVHT632JUHMBQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585060231 (81h20m54.307623271s) [noise=true , address=77.90.31.12:4590 , piece_id=RY3N4AP2KLW2RGQDSYTURIEAW7FJKDRODVBJJ574AGWREXJOIXOA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585139933 (81h20m54.307702963s) [noise=true , address=77.90.31.16:4734 , piece_id=GJJTLE73ATBF2FSCY7QOGWXORADSKXLJXNGDH34DZTSPPTQKSXJA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585361397 (81h20m54.307924437s) [noise=true , address=77.90.31.16:4733 , piece_id=UUS54WDRK744TKZLXXAAPRBPCM2OUGPWCRNV57FUZ4K2KXMVG23Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585453122 (81h20m54.308016162s) [noise=true , address=45.91.116.9:4262 , piece_id=7NM6FTVFO4RO7ZUI2A6ONJSQHSKTBNUJTE4RE2PG73V7SDIDFTLQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585646031 (81h20m54.308209081s) [noise=true , address=77.90.31.14:4663 , piece_id=VXGT4HSKJ6LU4CNLPXVOD64RFMTIXHSOIHP3FYKTJEUREGCXJHPA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585756052 (81h20m54.308319092s) [noise=true , address=45.91.116.10:4081 , piece_id=5OBJPHS7YVSLQ7R25I6B33XXTS5IYKF4RLAUGRORWNVF2VIJZOKA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585991612 (81h20m54.308554652s) [noise=true , address=45.91.116.7:4010 , piece_id=QJCPKYGZ2MJGMIZGDXIDQDZQMEE2HUBWXZ7KRAGIJD564MOQWX2Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586051648 (81h20m54.308614688s) [noise=true , address=77.90.31.13:4628 , piece_id=XMP7M7ILT5U7UXGYSM4UB5VBMWUHIDRGTZPLZRYLK3W2NTM4WEDQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586298259 (81h20m54.30886129s) [noise=true , address=45.91.116.11:4118 , piece_id=WAANSRE3AOQ74X575MUJEMFZVVSGECFE5IXRID6UFB6LMK76G5VQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586318758 (81h20m54.308881798s) [noise=true , address=77.90.31.18:4806 , piece_id=PECBEVTQRQJUPRHUS2FDKQHQF4EAAXW226HVFYM5EGCF72ZKRXEA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586610727 (81h20m54.309173777s) [noise=true , address=77.90.31.15:4697 , piece_id=5DDY52MEVML4BBMTJFPJD3SWD4UYLYQ4WT5DGBPIQWBIXMPTCHRQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586908527 (81h20m54.309471567s) [noise=true , address=77.90.31.10:4520 , piece_id=XECJATSD772ZU45XV2KDWE67C2MQHRH7J2MLTCPWHZLWA7YKF36Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.587209813 (81h20m54.309772853s) [noise=true , address=45.91.116.8:4047 , piece_id=VTO4NXZJKRF4SDOLNBTOUC4T6LD7UGCHJQTJOGGS2LPF7CPZWGIA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.587534054 (81h20m54.310097094s) [noise=true , address=45.91.116.7:4011 , piece_id=4MZ6Y2VDJEYHGHOM7QIO4OB5OF3EYPXCACP5UR7V2BCZN7PN4T4Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:46.339251587 (81h20m56.061814627s) [upload=78076]: Next returned nil segment Jul 27 20:56:46.339268218 (81h20m56.061831248s) [upload=78076]: Waiting for error group managing segments... Jul 27 20:56:46.616169719 (81h20m56.338732749s) [noise=true , address=45.91.116.10:4081 , piece_id=5OBJPHS7YVSLQ7R25I6B33XXTS5IYKF4RLAUGRORWNVF2VIJZOKA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.672944635 (81h20m56.395507676s) [noise=true , address=77.90.31.12:4590 , piece_id=RY3N4AP2KLW2RGQDSYTURIEAW7FJKDRODVBJJ574AGWREXJOIXOA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.679116684 (81h20m56.401679724s) [noise=true , address=77.90.31.14:4663 , piece_id=VXGT4HSKJ6LU4CNLPXVOD64RFMTIXHSOIHP3FYKTJEUREGCXJHPA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.689698961 (81h20m56.412262001s) [noise=true , address=77.90.31.16:4733 , piece_id=UUS54WDRK744TKZLXXAAPRBPCM2OUGPWCRNV57FUZ4K2KXMVG23Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.691556325 (81h20m56.414119365s) [noise=true , address=77.90.31.15:4697 , piece_id=5DDY52MEVML4BBMTJFPJD3SWD4UYLYQ4WT5DGBPIQWBIXMPTCHRQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.696368232 (81h20m56.418931272s) [noise=true , address=45.91.116.9:4262 , piece_id=7NM6FTVFO4RO7ZUI2A6ONJSQHSKTBNUJTE4RE2PG73V7SDIDFTLQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.701404117 (81h20m56.423967157s) [noise=true , address=77.90.31.13:4628 , piece_id=XMP7M7ILT5U7UXGYSM4UB5VBMWUHIDRGTZPLZRYLK3W2NTM4WEDQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.708417285 (81h20m56.430980325s) [noise=true , address=77.90.31.15:4699 , piece_id=AL7HA5TX46M3ZF2BOZGNGGFJ5IHHSDRT4YHUN2XEL2XPEMLISRWQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.711882846 (81h20m56.434445886s) [noise=true , address=45.91.116.14:4190 , piece_id=G4FLK67VLPGRJJUNECETUKGYS3OMQA4CGBKCWPDHVHT632JUHMBQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.730484234 (81h20m56.453047274s) [noise=true , address=45.91.116.8:4047 , piece_id=VTO4NXZJKRF4SDOLNBTOUC4T6LD7UGCHJQTJOGGS2LPF7CPZWGIA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.733559909 (81h20m56.456122949s) [noise=true , address=77.90.31.16:4734 , piece_id=GJJTLE73ATBF2FSCY7QOGWXORADSKXLJXNGDH34DZTSPPTQKSXJA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.761219480 (81h20m56.48378252s) [noise=true , address=45.91.116.11:4118 , piece_id=WAANSRE3AOQ74X575MUJEMFZVVSGECFE5IXRID6UFB6LMK76G5VQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.764041981 (81h20m56.486605021s) [noise=true , address=77.90.31.10:4520 , piece_id=XECJATSD772ZU45XV2KDWE67C2MQHRH7J2MLTCPWHZLWA7YKF36Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.764051749 (81h20m56.486614789s) [seg_pos={0 0}, upload=78076]: Segment reached optimal threshold of 13 pieces. Jul 27 20:56:46.764265288 (81h20m56.486828328s) [noise=true , address=45.91.116.7:4011 , piece_id=4MZ6Y2VDJEYHGHOM7QIO4OB5OF3EYPXCACP5UR7V2BCZN7PN4T4Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764492743 (81h20m56.487055783s) [noise=true , address=45.91.116.7:4010 , piece_id=QJCPKYGZ2MJGMIZGDXIDQDZQMEE2HUBWXZ7KRAGIJD564MOQWX2Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764577445 (81h20m56.487140485s) [noise=true , address=77.90.31.18:4806 , piece_id=PECBEVTQRQJUPRHUS2FDKQHQF4EAAXW226HVFYM5EGCF72ZKRXEA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764592364 (81h20m56.487155404s) [seg_pos={0 0}, upload=78076]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 20:56:46.764671274 (81h20m56.487234314s) [upload=78076]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 20:56:46.764675643 (81h20m56.487238673s) [upload=78076]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 20:56:47.043439135 (81h20m56.766002255s) [upload=78076]: Done uploading segments... Jul 27 20:56:47.043463021 (81h20m56.766026061s) [upload=78076]: Upload finished. err: <nil> Duration: 5.814610185s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [....X....................................X.....X............] duration: 1.834746374s FAIL (2025-07-27 21:34:47 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 1.834772613s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 5.859907301s FAIL (2025-07-27 21:34:33 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== NBYMF2YQ, seg_pos={0 0}, upload=78056]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection; write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection Jul 27 20:55:33.507192913 (81h19m43.229755953s) [seg_pos={0 0}, upload=78056]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 20:55:33.507272095 (81h19m43.229835135s) [upload=78056]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 20:55:33.507278908 (81h19m43.229841948s) [upload=78056]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 20:55:33.873750499 (81h19m43.596313549s) [upload=78056]: Done uploading segments... Jul 27 20:55:33.873771960 (81h19m43.59633502s) [upload=78056]: Upload finished. err: <nil> Jul 27 20:56:44.063819950 (81h20m53.78638298s) [upload=78076]: Starting upload Jul 27 20:56:44.063870106 (81h20m53.786433146s) [upload=78076]: Done starting upload Jul 27 20:56:44.064058887 (81h20m53.786621927s) [upload=78076]: Uploading segments... Jul 27 20:56:44.064105396 (81h20m53.786668436s) [upload=78076]: Got next segment. Inline: false Jul 27 20:56:44.064136426 (81h20m53.786699466s) [upload=78076]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 27 20:56:44.064301271 (81h20m53.786864321s) [upload=78076]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 27 20:56:44.584553631 (81h20m54.307116671s) [seg_pos={0 0}, upload=78076]: Begin upload segment... Jul 27 20:56:44.584612734 (81h20m54.307175784s) [seg_pos={0 0}, upload=78076]: Done begin upload segment. Jul 27 20:56:44.584637962 (81h20m54.307201002s) [noise=true , address=77.90.31.15:4699 , piece_id=AL7HA5TX46M3ZF2BOZGNGGFJ5IHHSDRT4YHUN2XEL2XPEMLISRWQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.584670444 (81h20m54.307233484s) [noise=true , address=45.91.116.14:4190 , piece_id=G4FLK67VLPGRJJUNECETUKGYS3OMQA4CGBKCWPDHVHT632JUHMBQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585060231 (81h20m54.307623271s) [noise=true , address=77.90.31.12:4590 , piece_id=RY3N4AP2KLW2RGQDSYTURIEAW7FJKDRODVBJJ574AGWREXJOIXOA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585139933 (81h20m54.307702963s) [noise=true , address=77.90.31.16:4734 , piece_id=GJJTLE73ATBF2FSCY7QOGWXORADSKXLJXNGDH34DZTSPPTQKSXJA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585361397 (81h20m54.307924437s) [noise=true , address=77.90.31.16:4733 , piece_id=UUS54WDRK744TKZLXXAAPRBPCM2OUGPWCRNV57FUZ4K2KXMVG23Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585453122 (81h20m54.308016162s) [noise=true , address=45.91.116.9:4262 , piece_id=7NM6FTVFO4RO7ZUI2A6ONJSQHSKTBNUJTE4RE2PG73V7SDIDFTLQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585646031 (81h20m54.308209081s) [noise=true , address=77.90.31.14:4663 , piece_id=VXGT4HSKJ6LU4CNLPXVOD64RFMTIXHSOIHP3FYKTJEUREGCXJHPA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585756052 (81h20m54.308319092s) [noise=true , address=45.91.116.10:4081 , piece_id=5OBJPHS7YVSLQ7R25I6B33XXTS5IYKF4RLAUGRORWNVF2VIJZOKA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585991612 (81h20m54.308554652s) [noise=true , address=45.91.116.7:4010 , piece_id=QJCPKYGZ2MJGMIZGDXIDQDZQMEE2HUBWXZ7KRAGIJD564MOQWX2Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586051648 (81h20m54.308614688s) [noise=true , address=77.90.31.13:4628 , piece_id=XMP7M7ILT5U7UXGYSM4UB5VBMWUHIDRGTZPLZRYLK3W2NTM4WEDQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586298259 (81h20m54.30886129s) [noise=true , address=45.91.116.11:4118 , piece_id=WAANSRE3AOQ74X575MUJEMFZVVSGECFE5IXRID6UFB6LMK76G5VQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586318758 (81h20m54.308881798s) [noise=true , address=77.90.31.18:4806 , piece_id=PECBEVTQRQJUPRHUS2FDKQHQF4EAAXW226HVFYM5EGCF72ZKRXEA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586610727 (81h20m54.309173777s) [noise=true , address=77.90.31.15:4697 , piece_id=5DDY52MEVML4BBMTJFPJD3SWD4UYLYQ4WT5DGBPIQWBIXMPTCHRQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586908527 (81h20m54.309471567s) [noise=true , address=77.90.31.10:4520 , piece_id=XECJATSD772ZU45XV2KDWE67C2MQHRH7J2MLTCPWHZLWA7YKF36Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.587209813 (81h20m54.309772853s) [noise=true , address=45.91.116.8:4047 , piece_id=VTO4NXZJKRF4SDOLNBTOUC4T6LD7UGCHJQTJOGGS2LPF7CPZWGIA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.587534054 (81h20m54.310097094s) [noise=true , address=45.91.116.7:4011 , piece_id=4MZ6Y2VDJEYHGHOM7QIO4OB5OF3EYPXCACP5UR7V2BCZN7PN4T4Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:46.339251587 (81h20m56.061814627s) [upload=78076]: Next returned nil segment Jul 27 20:56:46.339268218 (81h20m56.061831248s) [upload=78076]: Waiting for error group managing segments... Jul 27 20:56:46.616169719 (81h20m56.338732749s) [noise=true , address=45.91.116.10:4081 , piece_id=5OBJPHS7YVSLQ7R25I6B33XXTS5IYKF4RLAUGRORWNVF2VIJZOKA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.672944635 (81h20m56.395507676s) [noise=true , address=77.90.31.12:4590 , piece_id=RY3N4AP2KLW2RGQDSYTURIEAW7FJKDRODVBJJ574AGWREXJOIXOA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.679116684 (81h20m56.401679724s) [noise=true , address=77.90.31.14:4663 , piece_id=VXGT4HSKJ6LU4CNLPXVOD64RFMTIXHSOIHP3FYKTJEUREGCXJHPA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.689698961 (81h20m56.412262001s) [noise=true , address=77.90.31.16:4733 , piece_id=UUS54WDRK744TKZLXXAAPRBPCM2OUGPWCRNV57FUZ4K2KXMVG23Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.691556325 (81h20m56.414119365s) [noise=true , address=77.90.31.15:4697 , piece_id=5DDY52MEVML4BBMTJFPJD3SWD4UYLYQ4WT5DGBPIQWBIXMPTCHRQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.696368232 (81h20m56.418931272s) [noise=true , address=45.91.116.9:4262 , piece_id=7NM6FTVFO4RO7ZUI2A6ONJSQHSKTBNUJTE4RE2PG73V7SDIDFTLQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.701404117 (81h20m56.423967157s) [noise=true , address=77.90.31.13:4628 , piece_id=XMP7M7ILT5U7UXGYSM4UB5VBMWUHIDRGTZPLZRYLK3W2NTM4WEDQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.708417285 (81h20m56.430980325s) [noise=true , address=77.90.31.15:4699 , piece_id=AL7HA5TX46M3ZF2BOZGNGGFJ5IHHSDRT4YHUN2XEL2XPEMLISRWQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.711882846 (81h20m56.434445886s) [noise=true , address=45.91.116.14:4190 , piece_id=G4FLK67VLPGRJJUNECETUKGYS3OMQA4CGBKCWPDHVHT632JUHMBQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.730484234 (81h20m56.453047274s) [noise=true , address=45.91.116.8:4047 , piece_id=VTO4NXZJKRF4SDOLNBTOUC4T6LD7UGCHJQTJOGGS2LPF7CPZWGIA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.733559909 (81h20m56.456122949s) [noise=true , address=77.90.31.16:4734 , piece_id=GJJTLE73ATBF2FSCY7QOGWXORADSKXLJXNGDH34DZTSPPTQKSXJA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.761219480 (81h20m56.48378252s) [noise=true , address=45.91.116.11:4118 , piece_id=WAANSRE3AOQ74X575MUJEMFZVVSGECFE5IXRID6UFB6LMK76G5VQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.764041981 (81h20m56.486605021s) [noise=true , address=77.90.31.10:4520 , piece_id=XECJATSD772ZU45XV2KDWE67C2MQHRH7J2MLTCPWHZLWA7YKF36Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.764051749 (81h20m56.486614789s) [seg_pos={0 0}, upload=78076]: Segment reached optimal threshold of 13 pieces. Jul 27 20:56:46.764265288 (81h20m56.486828328s) [noise=true , address=45.91.116.7:4011 , piece_id=4MZ6Y2VDJEYHGHOM7QIO4OB5OF3EYPXCACP5UR7V2BCZN7PN4T4Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764492743 (81h20m56.487055783s) [noise=true , address=45.91.116.7:4010 , piece_id=QJCPKYGZ2MJGMIZGDXIDQDZQMEE2HUBWXZ7KRAGIJD564MOQWX2Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764577445 (81h20m56.487140485s) [noise=true , address=77.90.31.18:4806 , piece_id=PECBEVTQRQJUPRHUS2FDKQHQF4EAAXW226HVFYM5EGCF72ZKRXEA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764592364 (81h20m56.487155404s) [seg_pos={0 0}, upload=78076]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 20:56:46.764671274 (81h20m56.487234314s) [upload=78076]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 20:56:46.764675643 (81h20m56.487238673s) [upload=78076]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 20:56:47.043439135 (81h20m56.766002255s) [upload=78076]: Done uploading segments... Jul 27 20:56:47.043463021 (81h20m56.766026061s) [upload=78076]: Upload finished. err: <nil> Duration: 5.859934494s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................................X........................X] duration: 850.907938ms FAIL (2025-07-27 21:34:27 UTC) orbiter warning: uplink: too many requests Duration: 850.929622ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 5.808000209s FAIL (2025-07-27 21:34:15 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== NBYMF2YQ, seg_pos={0 0}, upload=78056]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection; write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection Jul 27 20:55:33.507192913 (81h19m43.229755953s) [seg_pos={0 0}, upload=78056]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 20:55:33.507272095 (81h19m43.229835135s) [upload=78056]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 20:55:33.507278908 (81h19m43.229841948s) [upload=78056]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 20:55:33.873750499 (81h19m43.596313549s) [upload=78056]: Done uploading segments... Jul 27 20:55:33.873771960 (81h19m43.59633502s) [upload=78056]: Upload finished. err: <nil> Jul 27 20:56:44.063819950 (81h20m53.78638298s) [upload=78076]: Starting upload Jul 27 20:56:44.063870106 (81h20m53.786433146s) [upload=78076]: Done starting upload Jul 27 20:56:44.064058887 (81h20m53.786621927s) [upload=78076]: Uploading segments... Jul 27 20:56:44.064105396 (81h20m53.786668436s) [upload=78076]: Got next segment. Inline: false Jul 27 20:56:44.064136426 (81h20m53.786699466s) [upload=78076]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 27 20:56:44.064301271 (81h20m53.786864321s) [upload=78076]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 27 20:56:44.584553631 (81h20m54.307116671s) [seg_pos={0 0}, upload=78076]: Begin upload segment... Jul 27 20:56:44.584612734 (81h20m54.307175784s) [seg_pos={0 0}, upload=78076]: Done begin upload segment. Jul 27 20:56:44.584637962 (81h20m54.307201002s) [noise=true , address=77.90.31.15:4699 , piece_id=AL7HA5TX46M3ZF2BOZGNGGFJ5IHHSDRT4YHUN2XEL2XPEMLISRWQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.584670444 (81h20m54.307233484s) [noise=true , address=45.91.116.14:4190 , piece_id=G4FLK67VLPGRJJUNECETUKGYS3OMQA4CGBKCWPDHVHT632JUHMBQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585060231 (81h20m54.307623271s) [noise=true , address=77.90.31.12:4590 , piece_id=RY3N4AP2KLW2RGQDSYTURIEAW7FJKDRODVBJJ574AGWREXJOIXOA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585139933 (81h20m54.307702963s) [noise=true , address=77.90.31.16:4734 , piece_id=GJJTLE73ATBF2FSCY7QOGWXORADSKXLJXNGDH34DZTSPPTQKSXJA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585361397 (81h20m54.307924437s) [noise=true , address=77.90.31.16:4733 , piece_id=UUS54WDRK744TKZLXXAAPRBPCM2OUGPWCRNV57FUZ4K2KXMVG23Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585453122 (81h20m54.308016162s) [noise=true , address=45.91.116.9:4262 , piece_id=7NM6FTVFO4RO7ZUI2A6ONJSQHSKTBNUJTE4RE2PG73V7SDIDFTLQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585646031 (81h20m54.308209081s) [noise=true , address=77.90.31.14:4663 , piece_id=VXGT4HSKJ6LU4CNLPXVOD64RFMTIXHSOIHP3FYKTJEUREGCXJHPA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585756052 (81h20m54.308319092s) [noise=true , address=45.91.116.10:4081 , piece_id=5OBJPHS7YVSLQ7R25I6B33XXTS5IYKF4RLAUGRORWNVF2VIJZOKA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585991612 (81h20m54.308554652s) [noise=true , address=45.91.116.7:4010 , piece_id=QJCPKYGZ2MJGMIZGDXIDQDZQMEE2HUBWXZ7KRAGIJD564MOQWX2Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586051648 (81h20m54.308614688s) [noise=true , address=77.90.31.13:4628 , piece_id=XMP7M7ILT5U7UXGYSM4UB5VBMWUHIDRGTZPLZRYLK3W2NTM4WEDQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586298259 (81h20m54.30886129s) [noise=true , address=45.91.116.11:4118 , piece_id=WAANSRE3AOQ74X575MUJEMFZVVSGECFE5IXRID6UFB6LMK76G5VQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586318758 (81h20m54.308881798s) [noise=true , address=77.90.31.18:4806 , piece_id=PECBEVTQRQJUPRHUS2FDKQHQF4EAAXW226HVFYM5EGCF72ZKRXEA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586610727 (81h20m54.309173777s) [noise=true , address=77.90.31.15:4697 , piece_id=5DDY52MEVML4BBMTJFPJD3SWD4UYLYQ4WT5DGBPIQWBIXMPTCHRQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586908527 (81h20m54.309471567s) [noise=true , address=77.90.31.10:4520 , piece_id=XECJATSD772ZU45XV2KDWE67C2MQHRH7J2MLTCPWHZLWA7YKF36Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.587209813 (81h20m54.309772853s) [noise=true , address=45.91.116.8:4047 , piece_id=VTO4NXZJKRF4SDOLNBTOUC4T6LD7UGCHJQTJOGGS2LPF7CPZWGIA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.587534054 (81h20m54.310097094s) [noise=true , address=45.91.116.7:4011 , piece_id=4MZ6Y2VDJEYHGHOM7QIO4OB5OF3EYPXCACP5UR7V2BCZN7PN4T4Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:46.339251587 (81h20m56.061814627s) [upload=78076]: Next returned nil segment Jul 27 20:56:46.339268218 (81h20m56.061831248s) [upload=78076]: Waiting for error group managing segments... Jul 27 20:56:46.616169719 (81h20m56.338732749s) [noise=true , address=45.91.116.10:4081 , piece_id=5OBJPHS7YVSLQ7R25I6B33XXTS5IYKF4RLAUGRORWNVF2VIJZOKA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.672944635 (81h20m56.395507676s) [noise=true , address=77.90.31.12:4590 , piece_id=RY3N4AP2KLW2RGQDSYTURIEAW7FJKDRODVBJJ574AGWREXJOIXOA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.679116684 (81h20m56.401679724s) [noise=true , address=77.90.31.14:4663 , piece_id=VXGT4HSKJ6LU4CNLPXVOD64RFMTIXHSOIHP3FYKTJEUREGCXJHPA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.689698961 (81h20m56.412262001s) [noise=true , address=77.90.31.16:4733 , piece_id=UUS54WDRK744TKZLXXAAPRBPCM2OUGPWCRNV57FUZ4K2KXMVG23Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.691556325 (81h20m56.414119365s) [noise=true , address=77.90.31.15:4697 , piece_id=5DDY52MEVML4BBMTJFPJD3SWD4UYLYQ4WT5DGBPIQWBIXMPTCHRQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.696368232 (81h20m56.418931272s) [noise=true , address=45.91.116.9:4262 , piece_id=7NM6FTVFO4RO7ZUI2A6ONJSQHSKTBNUJTE4RE2PG73V7SDIDFTLQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.701404117 (81h20m56.423967157s) [noise=true , address=77.90.31.13:4628 , piece_id=XMP7M7ILT5U7UXGYSM4UB5VBMWUHIDRGTZPLZRYLK3W2NTM4WEDQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.708417285 (81h20m56.430980325s) [noise=true , address=77.90.31.15:4699 , piece_id=AL7HA5TX46M3ZF2BOZGNGGFJ5IHHSDRT4YHUN2XEL2XPEMLISRWQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.711882846 (81h20m56.434445886s) [noise=true , address=45.91.116.14:4190 , piece_id=G4FLK67VLPGRJJUNECETUKGYS3OMQA4CGBKCWPDHVHT632JUHMBQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.730484234 (81h20m56.453047274s) [noise=true , address=45.91.116.8:4047 , piece_id=VTO4NXZJKRF4SDOLNBTOUC4T6LD7UGCHJQTJOGGS2LPF7CPZWGIA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.733559909 (81h20m56.456122949s) [noise=true , address=77.90.31.16:4734 , piece_id=GJJTLE73ATBF2FSCY7QOGWXORADSKXLJXNGDH34DZTSPPTQKSXJA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.761219480 (81h20m56.48378252s) [noise=true , address=45.91.116.11:4118 , piece_id=WAANSRE3AOQ74X575MUJEMFZVVSGECFE5IXRID6UFB6LMK76G5VQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.764041981 (81h20m56.486605021s) [noise=true , address=77.90.31.10:4520 , piece_id=XECJATSD772ZU45XV2KDWE67C2MQHRH7J2MLTCPWHZLWA7YKF36Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.764051749 (81h20m56.486614789s) [seg_pos={0 0}, upload=78076]: Segment reached optimal threshold of 13 pieces. Jul 27 20:56:46.764265288 (81h20m56.486828328s) [noise=true , address=45.91.116.7:4011 , piece_id=4MZ6Y2VDJEYHGHOM7QIO4OB5OF3EYPXCACP5UR7V2BCZN7PN4T4Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764492743 (81h20m56.487055783s) [noise=true , address=45.91.116.7:4010 , piece_id=QJCPKYGZ2MJGMIZGDXIDQDZQMEE2HUBWXZ7KRAGIJD564MOQWX2Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764577445 (81h20m56.487140485s) [noise=true , address=77.90.31.18:4806 , piece_id=PECBEVTQRQJUPRHUS2FDKQHQF4EAAXW226HVFYM5EGCF72ZKRXEA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764592364 (81h20m56.487155404s) [seg_pos={0 0}, upload=78076]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 20:56:46.764671274 (81h20m56.487234314s) [upload=78076]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 20:56:46.764675643 (81h20m56.487238673s) [upload=78076]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 20:56:47.043439135 (81h20m56.766002255s) [upload=78076]: Done uploading segments... Jul 27 20:56:47.043463021 (81h20m56.766026061s) [upload=78076]: Upload finished. err: <nil> Duration: 5.808025257s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.....X....................................X.....X...........] duration: 1.835818226s FAIL (2025-07-27 21:34:03 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 1.835841241s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 5.800775984s FAIL (2025-07-27 21:33:57 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 5.800803637s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 5.770805344s FAIL (2025-07-27 21:33:46 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== NBYMF2YQ, seg_pos={0 0}, upload=78056]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection; write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection Jul 27 20:55:33.507192913 (81h19m43.229755953s) [seg_pos={0 0}, upload=78056]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 20:55:33.507272095 (81h19m43.229835135s) [upload=78056]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 20:55:33.507278908 (81h19m43.229841948s) [upload=78056]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 20:55:33.873750499 (81h19m43.596313549s) [upload=78056]: Done uploading segments... Jul 27 20:55:33.873771960 (81h19m43.59633502s) [upload=78056]: Upload finished. err: <nil> Jul 27 20:56:44.063819950 (81h20m53.78638298s) [upload=78076]: Starting upload Jul 27 20:56:44.063870106 (81h20m53.786433146s) [upload=78076]: Done starting upload Jul 27 20:56:44.064058887 (81h20m53.786621927s) [upload=78076]: Uploading segments... Jul 27 20:56:44.064105396 (81h20m53.786668436s) [upload=78076]: Got next segment. Inline: false Jul 27 20:56:44.064136426 (81h20m53.786699466s) [upload=78076]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 27 20:56:44.064301271 (81h20m53.786864321s) [upload=78076]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 27 20:56:44.584553631 (81h20m54.307116671s) [seg_pos={0 0}, upload=78076]: Begin upload segment... Jul 27 20:56:44.584612734 (81h20m54.307175784s) [seg_pos={0 0}, upload=78076]: Done begin upload segment. Jul 27 20:56:44.584637962 (81h20m54.307201002s) [noise=true , address=77.90.31.15:4699 , piece_id=AL7HA5TX46M3ZF2BOZGNGGFJ5IHHSDRT4YHUN2XEL2XPEMLISRWQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.584670444 (81h20m54.307233484s) [noise=true , address=45.91.116.14:4190 , piece_id=G4FLK67VLPGRJJUNECETUKGYS3OMQA4CGBKCWPDHVHT632JUHMBQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585060231 (81h20m54.307623271s) [noise=true , address=77.90.31.12:4590 , piece_id=RY3N4AP2KLW2RGQDSYTURIEAW7FJKDRODVBJJ574AGWREXJOIXOA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585139933 (81h20m54.307702963s) [noise=true , address=77.90.31.16:4734 , piece_id=GJJTLE73ATBF2FSCY7QOGWXORADSKXLJXNGDH34DZTSPPTQKSXJA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585361397 (81h20m54.307924437s) [noise=true , address=77.90.31.16:4733 , piece_id=UUS54WDRK744TKZLXXAAPRBPCM2OUGPWCRNV57FUZ4K2KXMVG23Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585453122 (81h20m54.308016162s) [noise=true , address=45.91.116.9:4262 , piece_id=7NM6FTVFO4RO7ZUI2A6ONJSQHSKTBNUJTE4RE2PG73V7SDIDFTLQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585646031 (81h20m54.308209081s) [noise=true , address=77.90.31.14:4663 , piece_id=VXGT4HSKJ6LU4CNLPXVOD64RFMTIXHSOIHP3FYKTJEUREGCXJHPA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585756052 (81h20m54.308319092s) [noise=true , address=45.91.116.10:4081 , piece_id=5OBJPHS7YVSLQ7R25I6B33XXTS5IYKF4RLAUGRORWNVF2VIJZOKA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585991612 (81h20m54.308554652s) [noise=true , address=45.91.116.7:4010 , piece_id=QJCPKYGZ2MJGMIZGDXIDQDZQMEE2HUBWXZ7KRAGIJD564MOQWX2Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586051648 (81h20m54.308614688s) [noise=true , address=77.90.31.13:4628 , piece_id=XMP7M7ILT5U7UXGYSM4UB5VBMWUHIDRGTZPLZRYLK3W2NTM4WEDQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586298259 (81h20m54.30886129s) [noise=true , address=45.91.116.11:4118 , piece_id=WAANSRE3AOQ74X575MUJEMFZVVSGECFE5IXRID6UFB6LMK76G5VQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586318758 (81h20m54.308881798s) [noise=true , address=77.90.31.18:4806 , piece_id=PECBEVTQRQJUPRHUS2FDKQHQF4EAAXW226HVFYM5EGCF72ZKRXEA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586610727 (81h20m54.309173777s) [noise=true , address=77.90.31.15:4697 , piece_id=5DDY52MEVML4BBMTJFPJD3SWD4UYLYQ4WT5DGBPIQWBIXMPTCHRQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586908527 (81h20m54.309471567s) [noise=true , address=77.90.31.10:4520 , piece_id=XECJATSD772ZU45XV2KDWE67C2MQHRH7J2MLTCPWHZLWA7YKF36Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.587209813 (81h20m54.309772853s) [noise=true , address=45.91.116.8:4047 , piece_id=VTO4NXZJKRF4SDOLNBTOUC4T6LD7UGCHJQTJOGGS2LPF7CPZWGIA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.587534054 (81h20m54.310097094s) [noise=true , address=45.91.116.7:4011 , piece_id=4MZ6Y2VDJEYHGHOM7QIO4OB5OF3EYPXCACP5UR7V2BCZN7PN4T4Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:46.339251587 (81h20m56.061814627s) [upload=78076]: Next returned nil segment Jul 27 20:56:46.339268218 (81h20m56.061831248s) [upload=78076]: Waiting for error group managing segments... Jul 27 20:56:46.616169719 (81h20m56.338732749s) [noise=true , address=45.91.116.10:4081 , piece_id=5OBJPHS7YVSLQ7R25I6B33XXTS5IYKF4RLAUGRORWNVF2VIJZOKA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.672944635 (81h20m56.395507676s) [noise=true , address=77.90.31.12:4590 , piece_id=RY3N4AP2KLW2RGQDSYTURIEAW7FJKDRODVBJJ574AGWREXJOIXOA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.679116684 (81h20m56.401679724s) [noise=true , address=77.90.31.14:4663 , piece_id=VXGT4HSKJ6LU4CNLPXVOD64RFMTIXHSOIHP3FYKTJEUREGCXJHPA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.689698961 (81h20m56.412262001s) [noise=true , address=77.90.31.16:4733 , piece_id=UUS54WDRK744TKZLXXAAPRBPCM2OUGPWCRNV57FUZ4K2KXMVG23Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.691556325 (81h20m56.414119365s) [noise=true , address=77.90.31.15:4697 , piece_id=5DDY52MEVML4BBMTJFPJD3SWD4UYLYQ4WT5DGBPIQWBIXMPTCHRQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.696368232 (81h20m56.418931272s) [noise=true , address=45.91.116.9:4262 , piece_id=7NM6FTVFO4RO7ZUI2A6ONJSQHSKTBNUJTE4RE2PG73V7SDIDFTLQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.701404117 (81h20m56.423967157s) [noise=true , address=77.90.31.13:4628 , piece_id=XMP7M7ILT5U7UXGYSM4UB5VBMWUHIDRGTZPLZRYLK3W2NTM4WEDQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.708417285 (81h20m56.430980325s) [noise=true , address=77.90.31.15:4699 , piece_id=AL7HA5TX46M3ZF2BOZGNGGFJ5IHHSDRT4YHUN2XEL2XPEMLISRWQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.711882846 (81h20m56.434445886s) [noise=true , address=45.91.116.14:4190 , piece_id=G4FLK67VLPGRJJUNECETUKGYS3OMQA4CGBKCWPDHVHT632JUHMBQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.730484234 (81h20m56.453047274s) [noise=true , address=45.91.116.8:4047 , piece_id=VTO4NXZJKRF4SDOLNBTOUC4T6LD7UGCHJQTJOGGS2LPF7CPZWGIA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.733559909 (81h20m56.456122949s) [noise=true , address=77.90.31.16:4734 , piece_id=GJJTLE73ATBF2FSCY7QOGWXORADSKXLJXNGDH34DZTSPPTQKSXJA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.761219480 (81h20m56.48378252s) [noise=true , address=45.91.116.11:4118 , piece_id=WAANSRE3AOQ74X575MUJEMFZVVSGECFE5IXRID6UFB6LMK76G5VQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.764041981 (81h20m56.486605021s) [noise=true , address=77.90.31.10:4520 , piece_id=XECJATSD772ZU45XV2KDWE67C2MQHRH7J2MLTCPWHZLWA7YKF36Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.764051749 (81h20m56.486614789s) [seg_pos={0 0}, upload=78076]: Segment reached optimal threshold of 13 pieces. Jul 27 20:56:46.764265288 (81h20m56.486828328s) [noise=true , address=45.91.116.7:4011 , piece_id=4MZ6Y2VDJEYHGHOM7QIO4OB5OF3EYPXCACP5UR7V2BCZN7PN4T4Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764492743 (81h20m56.487055783s) [noise=true , address=45.91.116.7:4010 , piece_id=QJCPKYGZ2MJGMIZGDXIDQDZQMEE2HUBWXZ7KRAGIJD564MOQWX2Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764577445 (81h20m56.487140485s) [noise=true , address=77.90.31.18:4806 , piece_id=PECBEVTQRQJUPRHUS2FDKQHQF4EAAXW226HVFYM5EGCF72ZKRXEA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764592364 (81h20m56.487155404s) [seg_pos={0 0}, upload=78076]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 20:56:46.764671274 (81h20m56.487234314s) [upload=78076]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 20:56:46.764675643 (81h20m56.487238673s) [upload=78076]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 20:56:47.043439135 (81h20m56.766002255s) [upload=78076]: Done uploading segments... Jul 27 20:56:47.043463021 (81h20m56.766026061s) [upload=78076]: Upload finished. err: <nil> Duration: 5.770832536s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 5.730126822s FAIL (2025-07-27 21:33:42 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 5.730154717s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [......X....................................X.....X..........] duration: 1.943020144s FAIL (2025-07-27 21:33:30 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 1.943045593s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 5.817788525s FAIL (2025-07-27 21:33:22 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== NBYMF2YQ, seg_pos={0 0}, upload=78056]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection; write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection Jul 27 20:55:33.507192913 (81h19m43.229755953s) [seg_pos={0 0}, upload=78056]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 20:55:33.507272095 (81h19m43.229835135s) [upload=78056]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 20:55:33.507278908 (81h19m43.229841948s) [upload=78056]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 20:55:33.873750499 (81h19m43.596313549s) [upload=78056]: Done uploading segments... Jul 27 20:55:33.873771960 (81h19m43.59633502s) [upload=78056]: Upload finished. err: <nil> Jul 27 20:56:44.063819950 (81h20m53.78638298s) [upload=78076]: Starting upload Jul 27 20:56:44.063870106 (81h20m53.786433146s) [upload=78076]: Done starting upload Jul 27 20:56:44.064058887 (81h20m53.786621927s) [upload=78076]: Uploading segments... Jul 27 20:56:44.064105396 (81h20m53.786668436s) [upload=78076]: Got next segment. Inline: false Jul 27 20:56:44.064136426 (81h20m53.786699466s) [upload=78076]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 27 20:56:44.064301271 (81h20m53.786864321s) [upload=78076]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 27 20:56:44.584553631 (81h20m54.307116671s) [seg_pos={0 0}, upload=78076]: Begin upload segment... Jul 27 20:56:44.584612734 (81h20m54.307175784s) [seg_pos={0 0}, upload=78076]: Done begin upload segment. Jul 27 20:56:44.584637962 (81h20m54.307201002s) [noise=true , address=77.90.31.15:4699 , piece_id=AL7HA5TX46M3ZF2BOZGNGGFJ5IHHSDRT4YHUN2XEL2XPEMLISRWQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.584670444 (81h20m54.307233484s) [noise=true , address=45.91.116.14:4190 , piece_id=G4FLK67VLPGRJJUNECETUKGYS3OMQA4CGBKCWPDHVHT632JUHMBQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585060231 (81h20m54.307623271s) [noise=true , address=77.90.31.12:4590 , piece_id=RY3N4AP2KLW2RGQDSYTURIEAW7FJKDRODVBJJ574AGWREXJOIXOA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585139933 (81h20m54.307702963s) [noise=true , address=77.90.31.16:4734 , piece_id=GJJTLE73ATBF2FSCY7QOGWXORADSKXLJXNGDH34DZTSPPTQKSXJA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585361397 (81h20m54.307924437s) [noise=true , address=77.90.31.16:4733 , piece_id=UUS54WDRK744TKZLXXAAPRBPCM2OUGPWCRNV57FUZ4K2KXMVG23Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585453122 (81h20m54.308016162s) [noise=true , address=45.91.116.9:4262 , piece_id=7NM6FTVFO4RO7ZUI2A6ONJSQHSKTBNUJTE4RE2PG73V7SDIDFTLQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585646031 (81h20m54.308209081s) [noise=true , address=77.90.31.14:4663 , piece_id=VXGT4HSKJ6LU4CNLPXVOD64RFMTIXHSOIHP3FYKTJEUREGCXJHPA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585756052 (81h20m54.308319092s) [noise=true , address=45.91.116.10:4081 , piece_id=5OBJPHS7YVSLQ7R25I6B33XXTS5IYKF4RLAUGRORWNVF2VIJZOKA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585991612 (81h20m54.308554652s) [noise=true , address=45.91.116.7:4010 , piece_id=QJCPKYGZ2MJGMIZGDXIDQDZQMEE2HUBWXZ7KRAGIJD564MOQWX2Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586051648 (81h20m54.308614688s) [noise=true , address=77.90.31.13:4628 , piece_id=XMP7M7ILT5U7UXGYSM4UB5VBMWUHIDRGTZPLZRYLK3W2NTM4WEDQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586298259 (81h20m54.30886129s) [noise=true , address=45.91.116.11:4118 , piece_id=WAANSRE3AOQ74X575MUJEMFZVVSGECFE5IXRID6UFB6LMK76G5VQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586318758 (81h20m54.308881798s) [noise=true , address=77.90.31.18:4806 , piece_id=PECBEVTQRQJUPRHUS2FDKQHQF4EAAXW226HVFYM5EGCF72ZKRXEA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586610727 (81h20m54.309173777s) [noise=true , address=77.90.31.15:4697 , piece_id=5DDY52MEVML4BBMTJFPJD3SWD4UYLYQ4WT5DGBPIQWBIXMPTCHRQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586908527 (81h20m54.309471567s) [noise=true , address=77.90.31.10:4520 , piece_id=XECJATSD772ZU45XV2KDWE67C2MQHRH7J2MLTCPWHZLWA7YKF36Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.587209813 (81h20m54.309772853s) [noise=true , address=45.91.116.8:4047 , piece_id=VTO4NXZJKRF4SDOLNBTOUC4T6LD7UGCHJQTJOGGS2LPF7CPZWGIA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.587534054 (81h20m54.310097094s) [noise=true , address=45.91.116.7:4011 , piece_id=4MZ6Y2VDJEYHGHOM7QIO4OB5OF3EYPXCACP5UR7V2BCZN7PN4T4Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:46.339251587 (81h20m56.061814627s) [upload=78076]: Next returned nil segment Jul 27 20:56:46.339268218 (81h20m56.061831248s) [upload=78076]: Waiting for error group managing segments... Jul 27 20:56:46.616169719 (81h20m56.338732749s) [noise=true , address=45.91.116.10:4081 , piece_id=5OBJPHS7YVSLQ7R25I6B33XXTS5IYKF4RLAUGRORWNVF2VIJZOKA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.672944635 (81h20m56.395507676s) [noise=true , address=77.90.31.12:4590 , piece_id=RY3N4AP2KLW2RGQDSYTURIEAW7FJKDRODVBJJ574AGWREXJOIXOA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.679116684 (81h20m56.401679724s) [noise=true , address=77.90.31.14:4663 , piece_id=VXGT4HSKJ6LU4CNLPXVOD64RFMTIXHSOIHP3FYKTJEUREGCXJHPA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.689698961 (81h20m56.412262001s) [noise=true , address=77.90.31.16:4733 , piece_id=UUS54WDRK744TKZLXXAAPRBPCM2OUGPWCRNV57FUZ4K2KXMVG23Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.691556325 (81h20m56.414119365s) [noise=true , address=77.90.31.15:4697 , piece_id=5DDY52MEVML4BBMTJFPJD3SWD4UYLYQ4WT5DGBPIQWBIXMPTCHRQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.696368232 (81h20m56.418931272s) [noise=true , address=45.91.116.9:4262 , piece_id=7NM6FTVFO4RO7ZUI2A6ONJSQHSKTBNUJTE4RE2PG73V7SDIDFTLQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.701404117 (81h20m56.423967157s) [noise=true , address=77.90.31.13:4628 , piece_id=XMP7M7ILT5U7UXGYSM4UB5VBMWUHIDRGTZPLZRYLK3W2NTM4WEDQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.708417285 (81h20m56.430980325s) [noise=true , address=77.90.31.15:4699 , piece_id=AL7HA5TX46M3ZF2BOZGNGGFJ5IHHSDRT4YHUN2XEL2XPEMLISRWQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.711882846 (81h20m56.434445886s) [noise=true , address=45.91.116.14:4190 , piece_id=G4FLK67VLPGRJJUNECETUKGYS3OMQA4CGBKCWPDHVHT632JUHMBQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.730484234 (81h20m56.453047274s) [noise=true , address=45.91.116.8:4047 , piece_id=VTO4NXZJKRF4SDOLNBTOUC4T6LD7UGCHJQTJOGGS2LPF7CPZWGIA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.733559909 (81h20m56.456122949s) [noise=true , address=77.90.31.16:4734 , piece_id=GJJTLE73ATBF2FSCY7QOGWXORADSKXLJXNGDH34DZTSPPTQKSXJA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.761219480 (81h20m56.48378252s) [noise=true , address=45.91.116.11:4118 , piece_id=WAANSRE3AOQ74X575MUJEMFZVVSGECFE5IXRID6UFB6LMK76G5VQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.764041981 (81h20m56.486605021s) [noise=true , address=77.90.31.10:4520 , piece_id=XECJATSD772ZU45XV2KDWE67C2MQHRH7J2MLTCPWHZLWA7YKF36Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.764051749 (81h20m56.486614789s) [seg_pos={0 0}, upload=78076]: Segment reached optimal threshold of 13 pieces. Jul 27 20:56:46.764265288 (81h20m56.486828328s) [noise=true , address=45.91.116.7:4011 , piece_id=4MZ6Y2VDJEYHGHOM7QIO4OB5OF3EYPXCACP5UR7V2BCZN7PN4T4Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764492743 (81h20m56.487055783s) [noise=true , address=45.91.116.7:4010 , piece_id=QJCPKYGZ2MJGMIZGDXIDQDZQMEE2HUBWXZ7KRAGIJD564MOQWX2Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764577445 (81h20m56.487140485s) [noise=true , address=77.90.31.18:4806 , piece_id=PECBEVTQRQJUPRHUS2FDKQHQF4EAAXW226HVFYM5EGCF72ZKRXEA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764592364 (81h20m56.487155404s) [seg_pos={0 0}, upload=78076]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 20:56:46.764671274 (81h20m56.487234314s) [upload=78076]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 20:56:46.764675643 (81h20m56.487238673s) [upload=78076]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 20:56:47.043439135 (81h20m56.766002255s) [upload=78076]: Done uploading segments... Jul 27 20:56:47.043463021 (81h20m56.766026061s) [upload=78076]: Upload finished. err: <nil> Duration: 5.817821009s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 5.742803086s FAIL (2025-07-27 21:32:51 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== NBYMF2YQ, seg_pos={0 0}, upload=78056]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection; write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection Jul 27 20:55:33.507192913 (81h19m43.229755953s) [seg_pos={0 0}, upload=78056]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 20:55:33.507272095 (81h19m43.229835135s) [upload=78056]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 20:55:33.507278908 (81h19m43.229841948s) [upload=78056]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 20:55:33.873750499 (81h19m43.596313549s) [upload=78056]: Done uploading segments... Jul 27 20:55:33.873771960 (81h19m43.59633502s) [upload=78056]: Upload finished. err: <nil> Jul 27 20:56:44.063819950 (81h20m53.78638298s) [upload=78076]: Starting upload Jul 27 20:56:44.063870106 (81h20m53.786433146s) [upload=78076]: Done starting upload Jul 27 20:56:44.064058887 (81h20m53.786621927s) [upload=78076]: Uploading segments... Jul 27 20:56:44.064105396 (81h20m53.786668436s) [upload=78076]: Got next segment. Inline: false Jul 27 20:56:44.064136426 (81h20m53.786699466s) [upload=78076]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 27 20:56:44.064301271 (81h20m53.786864321s) [upload=78076]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 27 20:56:44.584553631 (81h20m54.307116671s) [seg_pos={0 0}, upload=78076]: Begin upload segment... Jul 27 20:56:44.584612734 (81h20m54.307175784s) [seg_pos={0 0}, upload=78076]: Done begin upload segment. Jul 27 20:56:44.584637962 (81h20m54.307201002s) [noise=true , address=77.90.31.15:4699 , piece_id=AL7HA5TX46M3ZF2BOZGNGGFJ5IHHSDRT4YHUN2XEL2XPEMLISRWQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.584670444 (81h20m54.307233484s) [noise=true , address=45.91.116.14:4190 , piece_id=G4FLK67VLPGRJJUNECETUKGYS3OMQA4CGBKCWPDHVHT632JUHMBQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585060231 (81h20m54.307623271s) [noise=true , address=77.90.31.12:4590 , piece_id=RY3N4AP2KLW2RGQDSYTURIEAW7FJKDRODVBJJ574AGWREXJOIXOA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585139933 (81h20m54.307702963s) [noise=true , address=77.90.31.16:4734 , piece_id=GJJTLE73ATBF2FSCY7QOGWXORADSKXLJXNGDH34DZTSPPTQKSXJA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585361397 (81h20m54.307924437s) [noise=true , address=77.90.31.16:4733 , piece_id=UUS54WDRK744TKZLXXAAPRBPCM2OUGPWCRNV57FUZ4K2KXMVG23Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585453122 (81h20m54.308016162s) [noise=true , address=45.91.116.9:4262 , piece_id=7NM6FTVFO4RO7ZUI2A6ONJSQHSKTBNUJTE4RE2PG73V7SDIDFTLQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585646031 (81h20m54.308209081s) [noise=true , address=77.90.31.14:4663 , piece_id=VXGT4HSKJ6LU4CNLPXVOD64RFMTIXHSOIHP3FYKTJEUREGCXJHPA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585756052 (81h20m54.308319092s) [noise=true , address=45.91.116.10:4081 , piece_id=5OBJPHS7YVSLQ7R25I6B33XXTS5IYKF4RLAUGRORWNVF2VIJZOKA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585991612 (81h20m54.308554652s) [noise=true , address=45.91.116.7:4010 , piece_id=QJCPKYGZ2MJGMIZGDXIDQDZQMEE2HUBWXZ7KRAGIJD564MOQWX2Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586051648 (81h20m54.308614688s) [noise=true , address=77.90.31.13:4628 , piece_id=XMP7M7ILT5U7UXGYSM4UB5VBMWUHIDRGTZPLZRYLK3W2NTM4WEDQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586298259 (81h20m54.30886129s) [noise=true , address=45.91.116.11:4118 , piece_id=WAANSRE3AOQ74X575MUJEMFZVVSGECFE5IXRID6UFB6LMK76G5VQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586318758 (81h20m54.308881798s) [noise=true , address=77.90.31.18:4806 , piece_id=PECBEVTQRQJUPRHUS2FDKQHQF4EAAXW226HVFYM5EGCF72ZKRXEA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586610727 (81h20m54.309173777s) [noise=true , address=77.90.31.15:4697 , piece_id=5DDY52MEVML4BBMTJFPJD3SWD4UYLYQ4WT5DGBPIQWBIXMPTCHRQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586908527 (81h20m54.309471567s) [noise=true , address=77.90.31.10:4520 , piece_id=XECJATSD772ZU45XV2KDWE67C2MQHRH7J2MLTCPWHZLWA7YKF36Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.587209813 (81h20m54.309772853s) [noise=true , address=45.91.116.8:4047 , piece_id=VTO4NXZJKRF4SDOLNBTOUC4T6LD7UGCHJQTJOGGS2LPF7CPZWGIA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.587534054 (81h20m54.310097094s) [noise=true , address=45.91.116.7:4011 , piece_id=4MZ6Y2VDJEYHGHOM7QIO4OB5OF3EYPXCACP5UR7V2BCZN7PN4T4Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:46.339251587 (81h20m56.061814627s) [upload=78076]: Next returned nil segment Jul 27 20:56:46.339268218 (81h20m56.061831248s) [upload=78076]: Waiting for error group managing segments... Jul 27 20:56:46.616169719 (81h20m56.338732749s) [noise=true , address=45.91.116.10:4081 , piece_id=5OBJPHS7YVSLQ7R25I6B33XXTS5IYKF4RLAUGRORWNVF2VIJZOKA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.672944635 (81h20m56.395507676s) [noise=true , address=77.90.31.12:4590 , piece_id=RY3N4AP2KLW2RGQDSYTURIEAW7FJKDRODVBJJ574AGWREXJOIXOA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.679116684 (81h20m56.401679724s) [noise=true , address=77.90.31.14:4663 , piece_id=VXGT4HSKJ6LU4CNLPXVOD64RFMTIXHSOIHP3FYKTJEUREGCXJHPA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.689698961 (81h20m56.412262001s) [noise=true , address=77.90.31.16:4733 , piece_id=UUS54WDRK744TKZLXXAAPRBPCM2OUGPWCRNV57FUZ4K2KXMVG23Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.691556325 (81h20m56.414119365s) [noise=true , address=77.90.31.15:4697 , piece_id=5DDY52MEVML4BBMTJFPJD3SWD4UYLYQ4WT5DGBPIQWBIXMPTCHRQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.696368232 (81h20m56.418931272s) [noise=true , address=45.91.116.9:4262 , piece_id=7NM6FTVFO4RO7ZUI2A6ONJSQHSKTBNUJTE4RE2PG73V7SDIDFTLQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.701404117 (81h20m56.423967157s) [noise=true , address=77.90.31.13:4628 , piece_id=XMP7M7ILT5U7UXGYSM4UB5VBMWUHIDRGTZPLZRYLK3W2NTM4WEDQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.708417285 (81h20m56.430980325s) [noise=true , address=77.90.31.15:4699 , piece_id=AL7HA5TX46M3ZF2BOZGNGGFJ5IHHSDRT4YHUN2XEL2XPEMLISRWQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.711882846 (81h20m56.434445886s) [noise=true , address=45.91.116.14:4190 , piece_id=G4FLK67VLPGRJJUNECETUKGYS3OMQA4CGBKCWPDHVHT632JUHMBQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.730484234 (81h20m56.453047274s) [noise=true , address=45.91.116.8:4047 , piece_id=VTO4NXZJKRF4SDOLNBTOUC4T6LD7UGCHJQTJOGGS2LPF7CPZWGIA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.733559909 (81h20m56.456122949s) [noise=true , address=77.90.31.16:4734 , piece_id=GJJTLE73ATBF2FSCY7QOGWXORADSKXLJXNGDH34DZTSPPTQKSXJA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.761219480 (81h20m56.48378252s) [noise=true , address=45.91.116.11:4118 , piece_id=WAANSRE3AOQ74X575MUJEMFZVVSGECFE5IXRID6UFB6LMK76G5VQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.764041981 (81h20m56.486605021s) [noise=true , address=77.90.31.10:4520 , piece_id=XECJATSD772ZU45XV2KDWE67C2MQHRH7J2MLTCPWHZLWA7YKF36Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.764051749 (81h20m56.486614789s) [seg_pos={0 0}, upload=78076]: Segment reached optimal threshold of 13 pieces. Jul 27 20:56:46.764265288 (81h20m56.486828328s) [noise=true , address=45.91.116.7:4011 , piece_id=4MZ6Y2VDJEYHGHOM7QIO4OB5OF3EYPXCACP5UR7V2BCZN7PN4T4Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764492743 (81h20m56.487055783s) [noise=true , address=45.91.116.7:4010 , piece_id=QJCPKYGZ2MJGMIZGDXIDQDZQMEE2HUBWXZ7KRAGIJD564MOQWX2Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764577445 (81h20m56.487140485s) [noise=true , address=77.90.31.18:4806 , piece_id=PECBEVTQRQJUPRHUS2FDKQHQF4EAAXW226HVFYM5EGCF72ZKRXEA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764592364 (81h20m56.487155404s) [seg_pos={0 0}, upload=78076]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 20:56:46.764671274 (81h20m56.487234314s) [upload=78076]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 20:56:46.764675643 (81h20m56.487238673s) [upload=78076]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 20:56:47.043439135 (81h20m56.766002255s) [upload=78076]: Done uploading segments... Jul 27 20:56:47.043463021 (81h20m56.766026061s) [upload=78076]: Upload finished. err: <nil> Duration: 5.742837922s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.......X....................................X.....X.........] duration: 1.874162548s FAIL (2025-07-27 21:32:45 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 1.874187707s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 5.740004904s FAIL (2025-07-27 21:32:30 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 5.740032467s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 6.147158209s FAIL (2025-07-27 21:32:12 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== NBYMF2YQ, seg_pos={0 0}, upload=78056]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection; write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection Jul 27 20:55:33.507192913 (81h19m43.229755953s) [seg_pos={0 0}, upload=78056]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 20:55:33.507272095 (81h19m43.229835135s) [upload=78056]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 20:55:33.507278908 (81h19m43.229841948s) [upload=78056]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 20:55:33.873750499 (81h19m43.596313549s) [upload=78056]: Done uploading segments... Jul 27 20:55:33.873771960 (81h19m43.59633502s) [upload=78056]: Upload finished. err: <nil> Jul 27 20:56:44.063819950 (81h20m53.78638298s) [upload=78076]: Starting upload Jul 27 20:56:44.063870106 (81h20m53.786433146s) [upload=78076]: Done starting upload Jul 27 20:56:44.064058887 (81h20m53.786621927s) [upload=78076]: Uploading segments... Jul 27 20:56:44.064105396 (81h20m53.786668436s) [upload=78076]: Got next segment. Inline: false Jul 27 20:56:44.064136426 (81h20m53.786699466s) [upload=78076]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 27 20:56:44.064301271 (81h20m53.786864321s) [upload=78076]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 27 20:56:44.584553631 (81h20m54.307116671s) [seg_pos={0 0}, upload=78076]: Begin upload segment... Jul 27 20:56:44.584612734 (81h20m54.307175784s) [seg_pos={0 0}, upload=78076]: Done begin upload segment. Jul 27 20:56:44.584637962 (81h20m54.307201002s) [noise=true , address=77.90.31.15:4699 , piece_id=AL7HA5TX46M3ZF2BOZGNGGFJ5IHHSDRT4YHUN2XEL2XPEMLISRWQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.584670444 (81h20m54.307233484s) [noise=true , address=45.91.116.14:4190 , piece_id=G4FLK67VLPGRJJUNECETUKGYS3OMQA4CGBKCWPDHVHT632JUHMBQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585060231 (81h20m54.307623271s) [noise=true , address=77.90.31.12:4590 , piece_id=RY3N4AP2KLW2RGQDSYTURIEAW7FJKDRODVBJJ574AGWREXJOIXOA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585139933 (81h20m54.307702963s) [noise=true , address=77.90.31.16:4734 , piece_id=GJJTLE73ATBF2FSCY7QOGWXORADSKXLJXNGDH34DZTSPPTQKSXJA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585361397 (81h20m54.307924437s) [noise=true , address=77.90.31.16:4733 , piece_id=UUS54WDRK744TKZLXXAAPRBPCM2OUGPWCRNV57FUZ4K2KXMVG23Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585453122 (81h20m54.308016162s) [noise=true , address=45.91.116.9:4262 , piece_id=7NM6FTVFO4RO7ZUI2A6ONJSQHSKTBNUJTE4RE2PG73V7SDIDFTLQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585646031 (81h20m54.308209081s) [noise=true , address=77.90.31.14:4663 , piece_id=VXGT4HSKJ6LU4CNLPXVOD64RFMTIXHSOIHP3FYKTJEUREGCXJHPA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585756052 (81h20m54.308319092s) [noise=true , address=45.91.116.10:4081 , piece_id=5OBJPHS7YVSLQ7R25I6B33XXTS5IYKF4RLAUGRORWNVF2VIJZOKA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585991612 (81h20m54.308554652s) [noise=true , address=45.91.116.7:4010 , piece_id=QJCPKYGZ2MJGMIZGDXIDQDZQMEE2HUBWXZ7KRAGIJD564MOQWX2Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586051648 (81h20m54.308614688s) [noise=true , address=77.90.31.13:4628 , piece_id=XMP7M7ILT5U7UXGYSM4UB5VBMWUHIDRGTZPLZRYLK3W2NTM4WEDQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586298259 (81h20m54.30886129s) [noise=true , address=45.91.116.11:4118 , piece_id=WAANSRE3AOQ74X575MUJEMFZVVSGECFE5IXRID6UFB6LMK76G5VQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586318758 (81h20m54.308881798s) [noise=true , address=77.90.31.18:4806 , piece_id=PECBEVTQRQJUPRHUS2FDKQHQF4EAAXW226HVFYM5EGCF72ZKRXEA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586610727 (81h20m54.309173777s) [noise=true , address=77.90.31.15:4697 , piece_id=5DDY52MEVML4BBMTJFPJD3SWD4UYLYQ4WT5DGBPIQWBIXMPTCHRQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586908527 (81h20m54.309471567s) [noise=true , address=77.90.31.10:4520 , piece_id=XECJATSD772ZU45XV2KDWE67C2MQHRH7J2MLTCPWHZLWA7YKF36Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.587209813 (81h20m54.309772853s) [noise=true , address=45.91.116.8:4047 , piece_id=VTO4NXZJKRF4SDOLNBTOUC4T6LD7UGCHJQTJOGGS2LPF7CPZWGIA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.587534054 (81h20m54.310097094s) [noise=true , address=45.91.116.7:4011 , piece_id=4MZ6Y2VDJEYHGHOM7QIO4OB5OF3EYPXCACP5UR7V2BCZN7PN4T4Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:46.339251587 (81h20m56.061814627s) [upload=78076]: Next returned nil segment Jul 27 20:56:46.339268218 (81h20m56.061831248s) [upload=78076]: Waiting for error group managing segments... Jul 27 20:56:46.616169719 (81h20m56.338732749s) [noise=true , address=45.91.116.10:4081 , piece_id=5OBJPHS7YVSLQ7R25I6B33XXTS5IYKF4RLAUGRORWNVF2VIJZOKA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.672944635 (81h20m56.395507676s) [noise=true , address=77.90.31.12:4590 , piece_id=RY3N4AP2KLW2RGQDSYTURIEAW7FJKDRODVBJJ574AGWREXJOIXOA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.679116684 (81h20m56.401679724s) [noise=true , address=77.90.31.14:4663 , piece_id=VXGT4HSKJ6LU4CNLPXVOD64RFMTIXHSOIHP3FYKTJEUREGCXJHPA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.689698961 (81h20m56.412262001s) [noise=true , address=77.90.31.16:4733 , piece_id=UUS54WDRK744TKZLXXAAPRBPCM2OUGPWCRNV57FUZ4K2KXMVG23Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.691556325 (81h20m56.414119365s) [noise=true , address=77.90.31.15:4697 , piece_id=5DDY52MEVML4BBMTJFPJD3SWD4UYLYQ4WT5DGBPIQWBIXMPTCHRQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.696368232 (81h20m56.418931272s) [noise=true , address=45.91.116.9:4262 , piece_id=7NM6FTVFO4RO7ZUI2A6ONJSQHSKTBNUJTE4RE2PG73V7SDIDFTLQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.701404117 (81h20m56.423967157s) [noise=true , address=77.90.31.13:4628 , piece_id=XMP7M7ILT5U7UXGYSM4UB5VBMWUHIDRGTZPLZRYLK3W2NTM4WEDQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.708417285 (81h20m56.430980325s) [noise=true , address=77.90.31.15:4699 , piece_id=AL7HA5TX46M3ZF2BOZGNGGFJ5IHHSDRT4YHUN2XEL2XPEMLISRWQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.711882846 (81h20m56.434445886s) [noise=true , address=45.91.116.14:4190 , piece_id=G4FLK67VLPGRJJUNECETUKGYS3OMQA4CGBKCWPDHVHT632JUHMBQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.730484234 (81h20m56.453047274s) [noise=true , address=45.91.116.8:4047 , piece_id=VTO4NXZJKRF4SDOLNBTOUC4T6LD7UGCHJQTJOGGS2LPF7CPZWGIA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.733559909 (81h20m56.456122949s) [noise=true , address=77.90.31.16:4734 , piece_id=GJJTLE73ATBF2FSCY7QOGWXORADSKXLJXNGDH34DZTSPPTQKSXJA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.761219480 (81h20m56.48378252s) [noise=true , address=45.91.116.11:4118 , piece_id=WAANSRE3AOQ74X575MUJEMFZVVSGECFE5IXRID6UFB6LMK76G5VQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.764041981 (81h20m56.486605021s) [noise=true , address=77.90.31.10:4520 , piece_id=XECJATSD772ZU45XV2KDWE67C2MQHRH7J2MLTCPWHZLWA7YKF36Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.764051749 (81h20m56.486614789s) [seg_pos={0 0}, upload=78076]: Segment reached optimal threshold of 13 pieces. Jul 27 20:56:46.764265288 (81h20m56.486828328s) [noise=true , address=45.91.116.7:4011 , piece_id=4MZ6Y2VDJEYHGHOM7QIO4OB5OF3EYPXCACP5UR7V2BCZN7PN4T4Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764492743 (81h20m56.487055783s) [noise=true , address=45.91.116.7:4010 , piece_id=QJCPKYGZ2MJGMIZGDXIDQDZQMEE2HUBWXZ7KRAGIJD564MOQWX2Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764577445 (81h20m56.487140485s) [noise=true , address=77.90.31.18:4806 , piece_id=PECBEVTQRQJUPRHUS2FDKQHQF4EAAXW226HVFYM5EGCF72ZKRXEA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764592364 (81h20m56.487155404s) [seg_pos={0 0}, upload=78076]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 20:56:46.764671274 (81h20m56.487234314s) [upload=78076]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 20:56:46.764675643 (81h20m56.487238673s) [upload=78076]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 20:56:47.043439135 (81h20m56.766002255s) [upload=78076]: Done uploading segments... Jul 27 20:56:47.043463021 (81h20m56.766026061s) [upload=78076]: Upload finished. err: <nil> Duration: 6.147186092s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 6.063717489s FAIL (2025-07-27 21:31:37 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== NBYMF2YQ, seg_pos={0 0}, upload=78056]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection; write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection Jul 27 20:55:33.507192913 (81h19m43.229755953s) [seg_pos={0 0}, upload=78056]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 20:55:33.507272095 (81h19m43.229835135s) [upload=78056]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 20:55:33.507278908 (81h19m43.229841948s) [upload=78056]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 20:55:33.873750499 (81h19m43.596313549s) [upload=78056]: Done uploading segments... Jul 27 20:55:33.873771960 (81h19m43.59633502s) [upload=78056]: Upload finished. err: <nil> Jul 27 20:56:44.063819950 (81h20m53.78638298s) [upload=78076]: Starting upload Jul 27 20:56:44.063870106 (81h20m53.786433146s) [upload=78076]: Done starting upload Jul 27 20:56:44.064058887 (81h20m53.786621927s) [upload=78076]: Uploading segments... Jul 27 20:56:44.064105396 (81h20m53.786668436s) [upload=78076]: Got next segment. Inline: false Jul 27 20:56:44.064136426 (81h20m53.786699466s) [upload=78076]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 27 20:56:44.064301271 (81h20m53.786864321s) [upload=78076]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 27 20:56:44.584553631 (81h20m54.307116671s) [seg_pos={0 0}, upload=78076]: Begin upload segment... Jul 27 20:56:44.584612734 (81h20m54.307175784s) [seg_pos={0 0}, upload=78076]: Done begin upload segment. Jul 27 20:56:44.584637962 (81h20m54.307201002s) [noise=true , address=77.90.31.15:4699 , piece_id=AL7HA5TX46M3ZF2BOZGNGGFJ5IHHSDRT4YHUN2XEL2XPEMLISRWQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.584670444 (81h20m54.307233484s) [noise=true , address=45.91.116.14:4190 , piece_id=G4FLK67VLPGRJJUNECETUKGYS3OMQA4CGBKCWPDHVHT632JUHMBQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585060231 (81h20m54.307623271s) [noise=true , address=77.90.31.12:4590 , piece_id=RY3N4AP2KLW2RGQDSYTURIEAW7FJKDRODVBJJ574AGWREXJOIXOA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585139933 (81h20m54.307702963s) [noise=true , address=77.90.31.16:4734 , piece_id=GJJTLE73ATBF2FSCY7QOGWXORADSKXLJXNGDH34DZTSPPTQKSXJA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585361397 (81h20m54.307924437s) [noise=true , address=77.90.31.16:4733 , piece_id=UUS54WDRK744TKZLXXAAPRBPCM2OUGPWCRNV57FUZ4K2KXMVG23Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585453122 (81h20m54.308016162s) [noise=true , address=45.91.116.9:4262 , piece_id=7NM6FTVFO4RO7ZUI2A6ONJSQHSKTBNUJTE4RE2PG73V7SDIDFTLQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585646031 (81h20m54.308209081s) [noise=true , address=77.90.31.14:4663 , piece_id=VXGT4HSKJ6LU4CNLPXVOD64RFMTIXHSOIHP3FYKTJEUREGCXJHPA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585756052 (81h20m54.308319092s) [noise=true , address=45.91.116.10:4081 , piece_id=5OBJPHS7YVSLQ7R25I6B33XXTS5IYKF4RLAUGRORWNVF2VIJZOKA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585991612 (81h20m54.308554652s) [noise=true , address=45.91.116.7:4010 , piece_id=QJCPKYGZ2MJGMIZGDXIDQDZQMEE2HUBWXZ7KRAGIJD564MOQWX2Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586051648 (81h20m54.308614688s) [noise=true , address=77.90.31.13:4628 , piece_id=XMP7M7ILT5U7UXGYSM4UB5VBMWUHIDRGTZPLZRYLK3W2NTM4WEDQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586298259 (81h20m54.30886129s) [noise=true , address=45.91.116.11:4118 , piece_id=WAANSRE3AOQ74X575MUJEMFZVVSGECFE5IXRID6UFB6LMK76G5VQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586318758 (81h20m54.308881798s) [noise=true , address=77.90.31.18:4806 , piece_id=PECBEVTQRQJUPRHUS2FDKQHQF4EAAXW226HVFYM5EGCF72ZKRXEA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586610727 (81h20m54.309173777s) [noise=true , address=77.90.31.15:4697 , piece_id=5DDY52MEVML4BBMTJFPJD3SWD4UYLYQ4WT5DGBPIQWBIXMPTCHRQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586908527 (81h20m54.309471567s) [noise=true , address=77.90.31.10:4520 , piece_id=XECJATSD772ZU45XV2KDWE67C2MQHRH7J2MLTCPWHZLWA7YKF36Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.587209813 (81h20m54.309772853s) [noise=true , address=45.91.116.8:4047 , piece_id=VTO4NXZJKRF4SDOLNBTOUC4T6LD7UGCHJQTJOGGS2LPF7CPZWGIA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.587534054 (81h20m54.310097094s) [noise=true , address=45.91.116.7:4011 , piece_id=4MZ6Y2VDJEYHGHOM7QIO4OB5OF3EYPXCACP5UR7V2BCZN7PN4T4Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:46.339251587 (81h20m56.061814627s) [upload=78076]: Next returned nil segment Jul 27 20:56:46.339268218 (81h20m56.061831248s) [upload=78076]: Waiting for error group managing segments... Jul 27 20:56:46.616169719 (81h20m56.338732749s) [noise=true , address=45.91.116.10:4081 , piece_id=5OBJPHS7YVSLQ7R25I6B33XXTS5IYKF4RLAUGRORWNVF2VIJZOKA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.672944635 (81h20m56.395507676s) [noise=true , address=77.90.31.12:4590 , piece_id=RY3N4AP2KLW2RGQDSYTURIEAW7FJKDRODVBJJ574AGWREXJOIXOA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.679116684 (81h20m56.401679724s) [noise=true , address=77.90.31.14:4663 , piece_id=VXGT4HSKJ6LU4CNLPXVOD64RFMTIXHSOIHP3FYKTJEUREGCXJHPA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.689698961 (81h20m56.412262001s) [noise=true , address=77.90.31.16:4733 , piece_id=UUS54WDRK744TKZLXXAAPRBPCM2OUGPWCRNV57FUZ4K2KXMVG23Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.691556325 (81h20m56.414119365s) [noise=true , address=77.90.31.15:4697 , piece_id=5DDY52MEVML4BBMTJFPJD3SWD4UYLYQ4WT5DGBPIQWBIXMPTCHRQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.696368232 (81h20m56.418931272s) [noise=true , address=45.91.116.9:4262 , piece_id=7NM6FTVFO4RO7ZUI2A6ONJSQHSKTBNUJTE4RE2PG73V7SDIDFTLQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.701404117 (81h20m56.423967157s) [noise=true , address=77.90.31.13:4628 , piece_id=XMP7M7ILT5U7UXGYSM4UB5VBMWUHIDRGTZPLZRYLK3W2NTM4WEDQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.708417285 (81h20m56.430980325s) [noise=true , address=77.90.31.15:4699 , piece_id=AL7HA5TX46M3ZF2BOZGNGGFJ5IHHSDRT4YHUN2XEL2XPEMLISRWQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.711882846 (81h20m56.434445886s) [noise=true , address=45.91.116.14:4190 , piece_id=G4FLK67VLPGRJJUNECETUKGYS3OMQA4CGBKCWPDHVHT632JUHMBQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.730484234 (81h20m56.453047274s) [noise=true , address=45.91.116.8:4047 , piece_id=VTO4NXZJKRF4SDOLNBTOUC4T6LD7UGCHJQTJOGGS2LPF7CPZWGIA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.733559909 (81h20m56.456122949s) [noise=true , address=77.90.31.16:4734 , piece_id=GJJTLE73ATBF2FSCY7QOGWXORADSKXLJXNGDH34DZTSPPTQKSXJA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.761219480 (81h20m56.48378252s) [noise=true , address=45.91.116.11:4118 , piece_id=WAANSRE3AOQ74X575MUJEMFZVVSGECFE5IXRID6UFB6LMK76G5VQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.764041981 (81h20m56.486605021s) [noise=true , address=77.90.31.10:4520 , piece_id=XECJATSD772ZU45XV2KDWE67C2MQHRH7J2MLTCPWHZLWA7YKF36Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.764051749 (81h20m56.486614789s) [seg_pos={0 0}, upload=78076]: Segment reached optimal threshold of 13 pieces. Jul 27 20:56:46.764265288 (81h20m56.486828328s) [noise=true , address=45.91.116.7:4011 , piece_id=4MZ6Y2VDJEYHGHOM7QIO4OB5OF3EYPXCACP5UR7V2BCZN7PN4T4Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764492743 (81h20m56.487055783s) [noise=true , address=45.91.116.7:4010 , piece_id=QJCPKYGZ2MJGMIZGDXIDQDZQMEE2HUBWXZ7KRAGIJD564MOQWX2Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764577445 (81h20m56.487140485s) [noise=true , address=77.90.31.18:4806 , piece_id=PECBEVTQRQJUPRHUS2FDKQHQF4EAAXW226HVFYM5EGCF72ZKRXEA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764592364 (81h20m56.487155404s) [seg_pos={0 0}, upload=78076]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 20:56:46.764671274 (81h20m56.487234314s) [upload=78076]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 20:56:46.764675643 (81h20m56.487238673s) [upload=78076]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 20:56:47.043439135 (81h20m56.766002255s) [upload=78076]: Done uploading segments... Jul 27 20:56:47.043463021 (81h20m56.766026061s) [upload=78076]: Upload finished. err: <nil> Duration: 6.063747226s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [........X....................................X.....X........] duration: 1.848739497s FAIL (2025-07-27 21:31:36 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 1.848768594s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 5.882047101s FAIL (2025-07-27 21:31:17 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 5.882086466s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.........X....................................X.....X.......] duration: 2.038865822s FAIL (2025-07-27 21:30:55 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 2.03893266s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 5.803167964s FAIL (2025-07-27 21:30:30 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== NBYMF2YQ, seg_pos={0 0}, upload=78056]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection; write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection Jul 27 20:55:33.507192913 (81h19m43.229755953s) [seg_pos={0 0}, upload=78056]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 20:55:33.507272095 (81h19m43.229835135s) [upload=78056]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 20:55:33.507278908 (81h19m43.229841948s) [upload=78056]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 20:55:33.873750499 (81h19m43.596313549s) [upload=78056]: Done uploading segments... Jul 27 20:55:33.873771960 (81h19m43.59633502s) [upload=78056]: Upload finished. err: <nil> Jul 27 20:56:44.063819950 (81h20m53.78638298s) [upload=78076]: Starting upload Jul 27 20:56:44.063870106 (81h20m53.786433146s) [upload=78076]: Done starting upload Jul 27 20:56:44.064058887 (81h20m53.786621927s) [upload=78076]: Uploading segments... Jul 27 20:56:44.064105396 (81h20m53.786668436s) [upload=78076]: Got next segment. Inline: false Jul 27 20:56:44.064136426 (81h20m53.786699466s) [upload=78076]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 27 20:56:44.064301271 (81h20m53.786864321s) [upload=78076]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 27 20:56:44.584553631 (81h20m54.307116671s) [seg_pos={0 0}, upload=78076]: Begin upload segment... Jul 27 20:56:44.584612734 (81h20m54.307175784s) [seg_pos={0 0}, upload=78076]: Done begin upload segment. Jul 27 20:56:44.584637962 (81h20m54.307201002s) [noise=true , address=77.90.31.15:4699 , piece_id=AL7HA5TX46M3ZF2BOZGNGGFJ5IHHSDRT4YHUN2XEL2XPEMLISRWQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.584670444 (81h20m54.307233484s) [noise=true , address=45.91.116.14:4190 , piece_id=G4FLK67VLPGRJJUNECETUKGYS3OMQA4CGBKCWPDHVHT632JUHMBQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585060231 (81h20m54.307623271s) [noise=true , address=77.90.31.12:4590 , piece_id=RY3N4AP2KLW2RGQDSYTURIEAW7FJKDRODVBJJ574AGWREXJOIXOA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585139933 (81h20m54.307702963s) [noise=true , address=77.90.31.16:4734 , piece_id=GJJTLE73ATBF2FSCY7QOGWXORADSKXLJXNGDH34DZTSPPTQKSXJA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585361397 (81h20m54.307924437s) [noise=true , address=77.90.31.16:4733 , piece_id=UUS54WDRK744TKZLXXAAPRBPCM2OUGPWCRNV57FUZ4K2KXMVG23Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585453122 (81h20m54.308016162s) [noise=true , address=45.91.116.9:4262 , piece_id=7NM6FTVFO4RO7ZUI2A6ONJSQHSKTBNUJTE4RE2PG73V7SDIDFTLQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585646031 (81h20m54.308209081s) [noise=true , address=77.90.31.14:4663 , piece_id=VXGT4HSKJ6LU4CNLPXVOD64RFMTIXHSOIHP3FYKTJEUREGCXJHPA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585756052 (81h20m54.308319092s) [noise=true , address=45.91.116.10:4081 , piece_id=5OBJPHS7YVSLQ7R25I6B33XXTS5IYKF4RLAUGRORWNVF2VIJZOKA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585991612 (81h20m54.308554652s) [noise=true , address=45.91.116.7:4010 , piece_id=QJCPKYGZ2MJGMIZGDXIDQDZQMEE2HUBWXZ7KRAGIJD564MOQWX2Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586051648 (81h20m54.308614688s) [noise=true , address=77.90.31.13:4628 , piece_id=XMP7M7ILT5U7UXGYSM4UB5VBMWUHIDRGTZPLZRYLK3W2NTM4WEDQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586298259 (81h20m54.30886129s) [noise=true , address=45.91.116.11:4118 , piece_id=WAANSRE3AOQ74X575MUJEMFZVVSGECFE5IXRID6UFB6LMK76G5VQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586318758 (81h20m54.308881798s) [noise=true , address=77.90.31.18:4806 , piece_id=PECBEVTQRQJUPRHUS2FDKQHQF4EAAXW226HVFYM5EGCF72ZKRXEA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586610727 (81h20m54.309173777s) [noise=true , address=77.90.31.15:4697 , piece_id=5DDY52MEVML4BBMTJFPJD3SWD4UYLYQ4WT5DGBPIQWBIXMPTCHRQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586908527 (81h20m54.309471567s) [noise=true , address=77.90.31.10:4520 , piece_id=XECJATSD772ZU45XV2KDWE67C2MQHRH7J2MLTCPWHZLWA7YKF36Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.587209813 (81h20m54.309772853s) [noise=true , address=45.91.116.8:4047 , piece_id=VTO4NXZJKRF4SDOLNBTOUC4T6LD7UGCHJQTJOGGS2LPF7CPZWGIA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.587534054 (81h20m54.310097094s) [noise=true , address=45.91.116.7:4011 , piece_id=4MZ6Y2VDJEYHGHOM7QIO4OB5OF3EYPXCACP5UR7V2BCZN7PN4T4Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:46.339251587 (81h20m56.061814627s) [upload=78076]: Next returned nil segment Jul 27 20:56:46.339268218 (81h20m56.061831248s) [upload=78076]: Waiting for error group managing segments... Jul 27 20:56:46.616169719 (81h20m56.338732749s) [noise=true , address=45.91.116.10:4081 , piece_id=5OBJPHS7YVSLQ7R25I6B33XXTS5IYKF4RLAUGRORWNVF2VIJZOKA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.672944635 (81h20m56.395507676s) [noise=true , address=77.90.31.12:4590 , piece_id=RY3N4AP2KLW2RGQDSYTURIEAW7FJKDRODVBJJ574AGWREXJOIXOA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.679116684 (81h20m56.401679724s) [noise=true , address=77.90.31.14:4663 , piece_id=VXGT4HSKJ6LU4CNLPXVOD64RFMTIXHSOIHP3FYKTJEUREGCXJHPA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.689698961 (81h20m56.412262001s) [noise=true , address=77.90.31.16:4733 , piece_id=UUS54WDRK744TKZLXXAAPRBPCM2OUGPWCRNV57FUZ4K2KXMVG23Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.691556325 (81h20m56.414119365s) [noise=true , address=77.90.31.15:4697 , piece_id=5DDY52MEVML4BBMTJFPJD3SWD4UYLYQ4WT5DGBPIQWBIXMPTCHRQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.696368232 (81h20m56.418931272s) [noise=true , address=45.91.116.9:4262 , piece_id=7NM6FTVFO4RO7ZUI2A6ONJSQHSKTBNUJTE4RE2PG73V7SDIDFTLQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.701404117 (81h20m56.423967157s) [noise=true , address=77.90.31.13:4628 , piece_id=XMP7M7ILT5U7UXGYSM4UB5VBMWUHIDRGTZPLZRYLK3W2NTM4WEDQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.708417285 (81h20m56.430980325s) [noise=true , address=77.90.31.15:4699 , piece_id=AL7HA5TX46M3ZF2BOZGNGGFJ5IHHSDRT4YHUN2XEL2XPEMLISRWQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.711882846 (81h20m56.434445886s) [noise=true , address=45.91.116.14:4190 , piece_id=G4FLK67VLPGRJJUNECETUKGYS3OMQA4CGBKCWPDHVHT632JUHMBQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.730484234 (81h20m56.453047274s) [noise=true , address=45.91.116.8:4047 , piece_id=VTO4NXZJKRF4SDOLNBTOUC4T6LD7UGCHJQTJOGGS2LPF7CPZWGIA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.733559909 (81h20m56.456122949s) [noise=true , address=77.90.31.16:4734 , piece_id=GJJTLE73ATBF2FSCY7QOGWXORADSKXLJXNGDH34DZTSPPTQKSXJA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.761219480 (81h20m56.48378252s) [noise=true , address=45.91.116.11:4118 , piece_id=WAANSRE3AOQ74X575MUJEMFZVVSGECFE5IXRID6UFB6LMK76G5VQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.764041981 (81h20m56.486605021s) [noise=true , address=77.90.31.10:4520 , piece_id=XECJATSD772ZU45XV2KDWE67C2MQHRH7J2MLTCPWHZLWA7YKF36Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.764051749 (81h20m56.486614789s) [seg_pos={0 0}, upload=78076]: Segment reached optimal threshold of 13 pieces. Jul 27 20:56:46.764265288 (81h20m56.486828328s) [noise=true , address=45.91.116.7:4011 , piece_id=4MZ6Y2VDJEYHGHOM7QIO4OB5OF3EYPXCACP5UR7V2BCZN7PN4T4Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764492743 (81h20m56.487055783s) [noise=true , address=45.91.116.7:4010 , piece_id=QJCPKYGZ2MJGMIZGDXIDQDZQMEE2HUBWXZ7KRAGIJD564MOQWX2Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764577445 (81h20m56.487140485s) [noise=true , address=77.90.31.18:4806 , piece_id=PECBEVTQRQJUPRHUS2FDKQHQF4EAAXW226HVFYM5EGCF72ZKRXEA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764592364 (81h20m56.487155404s) [seg_pos={0 0}, upload=78076]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 20:56:46.764671274 (81h20m56.487234314s) [upload=78076]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 20:56:46.764675643 (81h20m56.487238673s) [upload=78076]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 20:56:47.043439135 (81h20m56.766002255s) [upload=78076]: Done uploading segments... Jul 27 20:56:47.043463021 (81h20m56.766026061s) [upload=78076]: Upload finished. err: <nil> Duration: 5.80319662s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 5.924375198s FAIL (2025-07-27 21:30:19 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 5.924398663s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..........X....................................X.....X......] duration: 1.834418708s FAIL (2025-07-27 21:30:06 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 1.83444677s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 5.945361743s FAIL (2025-07-27 21:29:50 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== NBYMF2YQ, seg_pos={0 0}, upload=78056]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection; write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection Jul 27 20:55:33.507192913 (81h19m43.229755953s) [seg_pos={0 0}, upload=78056]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 20:55:33.507272095 (81h19m43.229835135s) [upload=78056]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 20:55:33.507278908 (81h19m43.229841948s) [upload=78056]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 20:55:33.873750499 (81h19m43.596313549s) [upload=78056]: Done uploading segments... Jul 27 20:55:33.873771960 (81h19m43.59633502s) [upload=78056]: Upload finished. err: <nil> Jul 27 20:56:44.063819950 (81h20m53.78638298s) [upload=78076]: Starting upload Jul 27 20:56:44.063870106 (81h20m53.786433146s) [upload=78076]: Done starting upload Jul 27 20:56:44.064058887 (81h20m53.786621927s) [upload=78076]: Uploading segments... Jul 27 20:56:44.064105396 (81h20m53.786668436s) [upload=78076]: Got next segment. Inline: false Jul 27 20:56:44.064136426 (81h20m53.786699466s) [upload=78076]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 27 20:56:44.064301271 (81h20m53.786864321s) [upload=78076]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 27 20:56:44.584553631 (81h20m54.307116671s) [seg_pos={0 0}, upload=78076]: Begin upload segment... Jul 27 20:56:44.584612734 (81h20m54.307175784s) [seg_pos={0 0}, upload=78076]: Done begin upload segment. Jul 27 20:56:44.584637962 (81h20m54.307201002s) [noise=true , address=77.90.31.15:4699 , piece_id=AL7HA5TX46M3ZF2BOZGNGGFJ5IHHSDRT4YHUN2XEL2XPEMLISRWQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.584670444 (81h20m54.307233484s) [noise=true , address=45.91.116.14:4190 , piece_id=G4FLK67VLPGRJJUNECETUKGYS3OMQA4CGBKCWPDHVHT632JUHMBQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585060231 (81h20m54.307623271s) [noise=true , address=77.90.31.12:4590 , piece_id=RY3N4AP2KLW2RGQDSYTURIEAW7FJKDRODVBJJ574AGWREXJOIXOA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585139933 (81h20m54.307702963s) [noise=true , address=77.90.31.16:4734 , piece_id=GJJTLE73ATBF2FSCY7QOGWXORADSKXLJXNGDH34DZTSPPTQKSXJA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585361397 (81h20m54.307924437s) [noise=true , address=77.90.31.16:4733 , piece_id=UUS54WDRK744TKZLXXAAPRBPCM2OUGPWCRNV57FUZ4K2KXMVG23Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585453122 (81h20m54.308016162s) [noise=true , address=45.91.116.9:4262 , piece_id=7NM6FTVFO4RO7ZUI2A6ONJSQHSKTBNUJTE4RE2PG73V7SDIDFTLQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585646031 (81h20m54.308209081s) [noise=true , address=77.90.31.14:4663 , piece_id=VXGT4HSKJ6LU4CNLPXVOD64RFMTIXHSOIHP3FYKTJEUREGCXJHPA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585756052 (81h20m54.308319092s) [noise=true , address=45.91.116.10:4081 , piece_id=5OBJPHS7YVSLQ7R25I6B33XXTS5IYKF4RLAUGRORWNVF2VIJZOKA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585991612 (81h20m54.308554652s) [noise=true , address=45.91.116.7:4010 , piece_id=QJCPKYGZ2MJGMIZGDXIDQDZQMEE2HUBWXZ7KRAGIJD564MOQWX2Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586051648 (81h20m54.308614688s) [noise=true , address=77.90.31.13:4628 , piece_id=XMP7M7ILT5U7UXGYSM4UB5VBMWUHIDRGTZPLZRYLK3W2NTM4WEDQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586298259 (81h20m54.30886129s) [noise=true , address=45.91.116.11:4118 , piece_id=WAANSRE3AOQ74X575MUJEMFZVVSGECFE5IXRID6UFB6LMK76G5VQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586318758 (81h20m54.308881798s) [noise=true , address=77.90.31.18:4806 , piece_id=PECBEVTQRQJUPRHUS2FDKQHQF4EAAXW226HVFYM5EGCF72ZKRXEA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586610727 (81h20m54.309173777s) [noise=true , address=77.90.31.15:4697 , piece_id=5DDY52MEVML4BBMTJFPJD3SWD4UYLYQ4WT5DGBPIQWBIXMPTCHRQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586908527 (81h20m54.309471567s) [noise=true , address=77.90.31.10:4520 , piece_id=XECJATSD772ZU45XV2KDWE67C2MQHRH7J2MLTCPWHZLWA7YKF36Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.587209813 (81h20m54.309772853s) [noise=true , address=45.91.116.8:4047 , piece_id=VTO4NXZJKRF4SDOLNBTOUC4T6LD7UGCHJQTJOGGS2LPF7CPZWGIA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.587534054 (81h20m54.310097094s) [noise=true , address=45.91.116.7:4011 , piece_id=4MZ6Y2VDJEYHGHOM7QIO4OB5OF3EYPXCACP5UR7V2BCZN7PN4T4Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:46.339251587 (81h20m56.061814627s) [upload=78076]: Next returned nil segment Jul 27 20:56:46.339268218 (81h20m56.061831248s) [upload=78076]: Waiting for error group managing segments... Jul 27 20:56:46.616169719 (81h20m56.338732749s) [noise=true , address=45.91.116.10:4081 , piece_id=5OBJPHS7YVSLQ7R25I6B33XXTS5IYKF4RLAUGRORWNVF2VIJZOKA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.672944635 (81h20m56.395507676s) [noise=true , address=77.90.31.12:4590 , piece_id=RY3N4AP2KLW2RGQDSYTURIEAW7FJKDRODVBJJ574AGWREXJOIXOA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.679116684 (81h20m56.401679724s) [noise=true , address=77.90.31.14:4663 , piece_id=VXGT4HSKJ6LU4CNLPXVOD64RFMTIXHSOIHP3FYKTJEUREGCXJHPA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.689698961 (81h20m56.412262001s) [noise=true , address=77.90.31.16:4733 , piece_id=UUS54WDRK744TKZLXXAAPRBPCM2OUGPWCRNV57FUZ4K2KXMVG23Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.691556325 (81h20m56.414119365s) [noise=true , address=77.90.31.15:4697 , piece_id=5DDY52MEVML4BBMTJFPJD3SWD4UYLYQ4WT5DGBPIQWBIXMPTCHRQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.696368232 (81h20m56.418931272s) [noise=true , address=45.91.116.9:4262 , piece_id=7NM6FTVFO4RO7ZUI2A6ONJSQHSKTBNUJTE4RE2PG73V7SDIDFTLQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.701404117 (81h20m56.423967157s) [noise=true , address=77.90.31.13:4628 , piece_id=XMP7M7ILT5U7UXGYSM4UB5VBMWUHIDRGTZPLZRYLK3W2NTM4WEDQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.708417285 (81h20m56.430980325s) [noise=true , address=77.90.31.15:4699 , piece_id=AL7HA5TX46M3ZF2BOZGNGGFJ5IHHSDRT4YHUN2XEL2XPEMLISRWQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.711882846 (81h20m56.434445886s) [noise=true , address=45.91.116.14:4190 , piece_id=G4FLK67VLPGRJJUNECETUKGYS3OMQA4CGBKCWPDHVHT632JUHMBQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.730484234 (81h20m56.453047274s) [noise=true , address=45.91.116.8:4047 , piece_id=VTO4NXZJKRF4SDOLNBTOUC4T6LD7UGCHJQTJOGGS2LPF7CPZWGIA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.733559909 (81h20m56.456122949s) [noise=true , address=77.90.31.16:4734 , piece_id=GJJTLE73ATBF2FSCY7QOGWXORADSKXLJXNGDH34DZTSPPTQKSXJA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.761219480 (81h20m56.48378252s) [noise=true , address=45.91.116.11:4118 , piece_id=WAANSRE3AOQ74X575MUJEMFZVVSGECFE5IXRID6UFB6LMK76G5VQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.764041981 (81h20m56.486605021s) [noise=true , address=77.90.31.10:4520 , piece_id=XECJATSD772ZU45XV2KDWE67C2MQHRH7J2MLTCPWHZLWA7YKF36Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.764051749 (81h20m56.486614789s) [seg_pos={0 0}, upload=78076]: Segment reached optimal threshold of 13 pieces. Jul 27 20:56:46.764265288 (81h20m56.486828328s) [noise=true , address=45.91.116.7:4011 , piece_id=4MZ6Y2VDJEYHGHOM7QIO4OB5OF3EYPXCACP5UR7V2BCZN7PN4T4Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764492743 (81h20m56.487055783s) [noise=true , address=45.91.116.7:4010 , piece_id=QJCPKYGZ2MJGMIZGDXIDQDZQMEE2HUBWXZ7KRAGIJD564MOQWX2Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764577445 (81h20m56.487140485s) [noise=true , address=77.90.31.18:4806 , piece_id=PECBEVTQRQJUPRHUS2FDKQHQF4EAAXW226HVFYM5EGCF72ZKRXEA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764592364 (81h20m56.487155404s) [seg_pos={0 0}, upload=78076]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 20:56:46.764671274 (81h20m56.487234314s) [upload=78076]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 20:56:46.764675643 (81h20m56.487238673s) [upload=78076]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 20:56:47.043439135 (81h20m56.766002255s) [upload=78076]: Done uploading segments... Jul 27 20:56:47.043463021 (81h20m56.766026061s) [upload=78076]: Upload finished. err: <nil> Duration: 5.945389647s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 5.773902122s FAIL (2025-07-27 21:29:47 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 5.773924065s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...........X....................................X.....X.....] duration: 1.892361247s FAIL (2025-07-27 21:28:56 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 1.892385173s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 5.883801863s FAIL (2025-07-27 21:28:55 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== NBYMF2YQ, seg_pos={0 0}, upload=78056]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection; write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection Jul 27 20:55:33.507192913 (81h19m43.229755953s) [seg_pos={0 0}, upload=78056]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 20:55:33.507272095 (81h19m43.229835135s) [upload=78056]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 20:55:33.507278908 (81h19m43.229841948s) [upload=78056]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 20:55:33.873750499 (81h19m43.596313549s) [upload=78056]: Done uploading segments... Jul 27 20:55:33.873771960 (81h19m43.59633502s) [upload=78056]: Upload finished. err: <nil> Jul 27 20:56:44.063819950 (81h20m53.78638298s) [upload=78076]: Starting upload Jul 27 20:56:44.063870106 (81h20m53.786433146s) [upload=78076]: Done starting upload Jul 27 20:56:44.064058887 (81h20m53.786621927s) [upload=78076]: Uploading segments... Jul 27 20:56:44.064105396 (81h20m53.786668436s) [upload=78076]: Got next segment. Inline: false Jul 27 20:56:44.064136426 (81h20m53.786699466s) [upload=78076]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 27 20:56:44.064301271 (81h20m53.786864321s) [upload=78076]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 27 20:56:44.584553631 (81h20m54.307116671s) [seg_pos={0 0}, upload=78076]: Begin upload segment... Jul 27 20:56:44.584612734 (81h20m54.307175784s) [seg_pos={0 0}, upload=78076]: Done begin upload segment. Jul 27 20:56:44.584637962 (81h20m54.307201002s) [noise=true , address=77.90.31.15:4699 , piece_id=AL7HA5TX46M3ZF2BOZGNGGFJ5IHHSDRT4YHUN2XEL2XPEMLISRWQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.584670444 (81h20m54.307233484s) [noise=true , address=45.91.116.14:4190 , piece_id=G4FLK67VLPGRJJUNECETUKGYS3OMQA4CGBKCWPDHVHT632JUHMBQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585060231 (81h20m54.307623271s) [noise=true , address=77.90.31.12:4590 , piece_id=RY3N4AP2KLW2RGQDSYTURIEAW7FJKDRODVBJJ574AGWREXJOIXOA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585139933 (81h20m54.307702963s) [noise=true , address=77.90.31.16:4734 , piece_id=GJJTLE73ATBF2FSCY7QOGWXORADSKXLJXNGDH34DZTSPPTQKSXJA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585361397 (81h20m54.307924437s) [noise=true , address=77.90.31.16:4733 , piece_id=UUS54WDRK744TKZLXXAAPRBPCM2OUGPWCRNV57FUZ4K2KXMVG23Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585453122 (81h20m54.308016162s) [noise=true , address=45.91.116.9:4262 , piece_id=7NM6FTVFO4RO7ZUI2A6ONJSQHSKTBNUJTE4RE2PG73V7SDIDFTLQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585646031 (81h20m54.308209081s) [noise=true , address=77.90.31.14:4663 , piece_id=VXGT4HSKJ6LU4CNLPXVOD64RFMTIXHSOIHP3FYKTJEUREGCXJHPA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585756052 (81h20m54.308319092s) [noise=true , address=45.91.116.10:4081 , piece_id=5OBJPHS7YVSLQ7R25I6B33XXTS5IYKF4RLAUGRORWNVF2VIJZOKA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585991612 (81h20m54.308554652s) [noise=true , address=45.91.116.7:4010 , piece_id=QJCPKYGZ2MJGMIZGDXIDQDZQMEE2HUBWXZ7KRAGIJD564MOQWX2Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586051648 (81h20m54.308614688s) [noise=true , address=77.90.31.13:4628 , piece_id=XMP7M7ILT5U7UXGYSM4UB5VBMWUHIDRGTZPLZRYLK3W2NTM4WEDQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586298259 (81h20m54.30886129s) [noise=true , address=45.91.116.11:4118 , piece_id=WAANSRE3AOQ74X575MUJEMFZVVSGECFE5IXRID6UFB6LMK76G5VQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586318758 (81h20m54.308881798s) [noise=true , address=77.90.31.18:4806 , piece_id=PECBEVTQRQJUPRHUS2FDKQHQF4EAAXW226HVFYM5EGCF72ZKRXEA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586610727 (81h20m54.309173777s) [noise=true , address=77.90.31.15:4697 , piece_id=5DDY52MEVML4BBMTJFPJD3SWD4UYLYQ4WT5DGBPIQWBIXMPTCHRQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586908527 (81h20m54.309471567s) [noise=true , address=77.90.31.10:4520 , piece_id=XECJATSD772ZU45XV2KDWE67C2MQHRH7J2MLTCPWHZLWA7YKF36Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.587209813 (81h20m54.309772853s) [noise=true , address=45.91.116.8:4047 , piece_id=VTO4NXZJKRF4SDOLNBTOUC4T6LD7UGCHJQTJOGGS2LPF7CPZWGIA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.587534054 (81h20m54.310097094s) [noise=true , address=45.91.116.7:4011 , piece_id=4MZ6Y2VDJEYHGHOM7QIO4OB5OF3EYPXCACP5UR7V2BCZN7PN4T4Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:46.339251587 (81h20m56.061814627s) [upload=78076]: Next returned nil segment Jul 27 20:56:46.339268218 (81h20m56.061831248s) [upload=78076]: Waiting for error group managing segments... Jul 27 20:56:46.616169719 (81h20m56.338732749s) [noise=true , address=45.91.116.10:4081 , piece_id=5OBJPHS7YVSLQ7R25I6B33XXTS5IYKF4RLAUGRORWNVF2VIJZOKA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.672944635 (81h20m56.395507676s) [noise=true , address=77.90.31.12:4590 , piece_id=RY3N4AP2KLW2RGQDSYTURIEAW7FJKDRODVBJJ574AGWREXJOIXOA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.679116684 (81h20m56.401679724s) [noise=true , address=77.90.31.14:4663 , piece_id=VXGT4HSKJ6LU4CNLPXVOD64RFMTIXHSOIHP3FYKTJEUREGCXJHPA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.689698961 (81h20m56.412262001s) [noise=true , address=77.90.31.16:4733 , piece_id=UUS54WDRK744TKZLXXAAPRBPCM2OUGPWCRNV57FUZ4K2KXMVG23Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.691556325 (81h20m56.414119365s) [noise=true , address=77.90.31.15:4697 , piece_id=5DDY52MEVML4BBMTJFPJD3SWD4UYLYQ4WT5DGBPIQWBIXMPTCHRQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.696368232 (81h20m56.418931272s) [noise=true , address=45.91.116.9:4262 , piece_id=7NM6FTVFO4RO7ZUI2A6ONJSQHSKTBNUJTE4RE2PG73V7SDIDFTLQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.701404117 (81h20m56.423967157s) [noise=true , address=77.90.31.13:4628 , piece_id=XMP7M7ILT5U7UXGYSM4UB5VBMWUHIDRGTZPLZRYLK3W2NTM4WEDQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.708417285 (81h20m56.430980325s) [noise=true , address=77.90.31.15:4699 , piece_id=AL7HA5TX46M3ZF2BOZGNGGFJ5IHHSDRT4YHUN2XEL2XPEMLISRWQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.711882846 (81h20m56.434445886s) [noise=true , address=45.91.116.14:4190 , piece_id=G4FLK67VLPGRJJUNECETUKGYS3OMQA4CGBKCWPDHVHT632JUHMBQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.730484234 (81h20m56.453047274s) [noise=true , address=45.91.116.8:4047 , piece_id=VTO4NXZJKRF4SDOLNBTOUC4T6LD7UGCHJQTJOGGS2LPF7CPZWGIA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.733559909 (81h20m56.456122949s) [noise=true , address=77.90.31.16:4734 , piece_id=GJJTLE73ATBF2FSCY7QOGWXORADSKXLJXNGDH34DZTSPPTQKSXJA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.761219480 (81h20m56.48378252s) [noise=true , address=45.91.116.11:4118 , piece_id=WAANSRE3AOQ74X575MUJEMFZVVSGECFE5IXRID6UFB6LMK76G5VQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.764041981 (81h20m56.486605021s) [noise=true , address=77.90.31.10:4520 , piece_id=XECJATSD772ZU45XV2KDWE67C2MQHRH7J2MLTCPWHZLWA7YKF36Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.764051749 (81h20m56.486614789s) [seg_pos={0 0}, upload=78076]: Segment reached optimal threshold of 13 pieces. Jul 27 20:56:46.764265288 (81h20m56.486828328s) [noise=true , address=45.91.116.7:4011 , piece_id=4MZ6Y2VDJEYHGHOM7QIO4OB5OF3EYPXCACP5UR7V2BCZN7PN4T4Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764492743 (81h20m56.487055783s) [noise=true , address=45.91.116.7:4010 , piece_id=QJCPKYGZ2MJGMIZGDXIDQDZQMEE2HUBWXZ7KRAGIJD564MOQWX2Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764577445 (81h20m56.487140485s) [noise=true , address=77.90.31.18:4806 , piece_id=PECBEVTQRQJUPRHUS2FDKQHQF4EAAXW226HVFYM5EGCF72ZKRXEA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764592364 (81h20m56.487155404s) [seg_pos={0 0}, upload=78076]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 20:56:46.764671274 (81h20m56.487234314s) [upload=78076]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 20:56:46.764675643 (81h20m56.487238673s) [upload=78076]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 20:56:47.043439135 (81h20m56.766002255s) [upload=78076]: Done uploading segments... Jul 27 20:56:47.043463021 (81h20m56.766026061s) [upload=78076]: Upload finished. err: <nil> Duration: 5.883830237s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 6.437347804s FAIL (2025-07-27 21:28:38 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== NBYMF2YQ, seg_pos={0 0}, upload=78056]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection; write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection Jul 27 20:55:33.507192913 (81h19m43.229755953s) [seg_pos={0 0}, upload=78056]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 20:55:33.507272095 (81h19m43.229835135s) [upload=78056]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 20:55:33.507278908 (81h19m43.229841948s) [upload=78056]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 20:55:33.873750499 (81h19m43.596313549s) [upload=78056]: Done uploading segments... Jul 27 20:55:33.873771960 (81h19m43.59633502s) [upload=78056]: Upload finished. err: <nil> Jul 27 20:56:44.063819950 (81h20m53.78638298s) [upload=78076]: Starting upload Jul 27 20:56:44.063870106 (81h20m53.786433146s) [upload=78076]: Done starting upload Jul 27 20:56:44.064058887 (81h20m53.786621927s) [upload=78076]: Uploading segments... Jul 27 20:56:44.064105396 (81h20m53.786668436s) [upload=78076]: Got next segment. Inline: false Jul 27 20:56:44.064136426 (81h20m53.786699466s) [upload=78076]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 27 20:56:44.064301271 (81h20m53.786864321s) [upload=78076]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 27 20:56:44.584553631 (81h20m54.307116671s) [seg_pos={0 0}, upload=78076]: Begin upload segment... Jul 27 20:56:44.584612734 (81h20m54.307175784s) [seg_pos={0 0}, upload=78076]: Done begin upload segment. Jul 27 20:56:44.584637962 (81h20m54.307201002s) [noise=true , address=77.90.31.15:4699 , piece_id=AL7HA5TX46M3ZF2BOZGNGGFJ5IHHSDRT4YHUN2XEL2XPEMLISRWQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.584670444 (81h20m54.307233484s) [noise=true , address=45.91.116.14:4190 , piece_id=G4FLK67VLPGRJJUNECETUKGYS3OMQA4CGBKCWPDHVHT632JUHMBQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585060231 (81h20m54.307623271s) [noise=true , address=77.90.31.12:4590 , piece_id=RY3N4AP2KLW2RGQDSYTURIEAW7FJKDRODVBJJ574AGWREXJOIXOA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585139933 (81h20m54.307702963s) [noise=true , address=77.90.31.16:4734 , piece_id=GJJTLE73ATBF2FSCY7QOGWXORADSKXLJXNGDH34DZTSPPTQKSXJA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585361397 (81h20m54.307924437s) [noise=true , address=77.90.31.16:4733 , piece_id=UUS54WDRK744TKZLXXAAPRBPCM2OUGPWCRNV57FUZ4K2KXMVG23Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585453122 (81h20m54.308016162s) [noise=true , address=45.91.116.9:4262 , piece_id=7NM6FTVFO4RO7ZUI2A6ONJSQHSKTBNUJTE4RE2PG73V7SDIDFTLQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585646031 (81h20m54.308209081s) [noise=true , address=77.90.31.14:4663 , piece_id=VXGT4HSKJ6LU4CNLPXVOD64RFMTIXHSOIHP3FYKTJEUREGCXJHPA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585756052 (81h20m54.308319092s) [noise=true , address=45.91.116.10:4081 , piece_id=5OBJPHS7YVSLQ7R25I6B33XXTS5IYKF4RLAUGRORWNVF2VIJZOKA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585991612 (81h20m54.308554652s) [noise=true , address=45.91.116.7:4010 , piece_id=QJCPKYGZ2MJGMIZGDXIDQDZQMEE2HUBWXZ7KRAGIJD564MOQWX2Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586051648 (81h20m54.308614688s) [noise=true , address=77.90.31.13:4628 , piece_id=XMP7M7ILT5U7UXGYSM4UB5VBMWUHIDRGTZPLZRYLK3W2NTM4WEDQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586298259 (81h20m54.30886129s) [noise=true , address=45.91.116.11:4118 , piece_id=WAANSRE3AOQ74X575MUJEMFZVVSGECFE5IXRID6UFB6LMK76G5VQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586318758 (81h20m54.308881798s) [noise=true , address=77.90.31.18:4806 , piece_id=PECBEVTQRQJUPRHUS2FDKQHQF4EAAXW226HVFYM5EGCF72ZKRXEA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586610727 (81h20m54.309173777s) [noise=true , address=77.90.31.15:4697 , piece_id=5DDY52MEVML4BBMTJFPJD3SWD4UYLYQ4WT5DGBPIQWBIXMPTCHRQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586908527 (81h20m54.309471567s) [noise=true , address=77.90.31.10:4520 , piece_id=XECJATSD772ZU45XV2KDWE67C2MQHRH7J2MLTCPWHZLWA7YKF36Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.587209813 (81h20m54.309772853s) [noise=true , address=45.91.116.8:4047 , piece_id=VTO4NXZJKRF4SDOLNBTOUC4T6LD7UGCHJQTJOGGS2LPF7CPZWGIA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.587534054 (81h20m54.310097094s) [noise=true , address=45.91.116.7:4011 , piece_id=4MZ6Y2VDJEYHGHOM7QIO4OB5OF3EYPXCACP5UR7V2BCZN7PN4T4Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:46.339251587 (81h20m56.061814627s) [upload=78076]: Next returned nil segment Jul 27 20:56:46.339268218 (81h20m56.061831248s) [upload=78076]: Waiting for error group managing segments... Jul 27 20:56:46.616169719 (81h20m56.338732749s) [noise=true , address=45.91.116.10:4081 , piece_id=5OBJPHS7YVSLQ7R25I6B33XXTS5IYKF4RLAUGRORWNVF2VIJZOKA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.672944635 (81h20m56.395507676s) [noise=true , address=77.90.31.12:4590 , piece_id=RY3N4AP2KLW2RGQDSYTURIEAW7FJKDRODVBJJ574AGWREXJOIXOA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.679116684 (81h20m56.401679724s) [noise=true , address=77.90.31.14:4663 , piece_id=VXGT4HSKJ6LU4CNLPXVOD64RFMTIXHSOIHP3FYKTJEUREGCXJHPA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.689698961 (81h20m56.412262001s) [noise=true , address=77.90.31.16:4733 , piece_id=UUS54WDRK744TKZLXXAAPRBPCM2OUGPWCRNV57FUZ4K2KXMVG23Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.691556325 (81h20m56.414119365s) [noise=true , address=77.90.31.15:4697 , piece_id=5DDY52MEVML4BBMTJFPJD3SWD4UYLYQ4WT5DGBPIQWBIXMPTCHRQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.696368232 (81h20m56.418931272s) [noise=true , address=45.91.116.9:4262 , piece_id=7NM6FTVFO4RO7ZUI2A6ONJSQHSKTBNUJTE4RE2PG73V7SDIDFTLQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.701404117 (81h20m56.423967157s) [noise=true , address=77.90.31.13:4628 , piece_id=XMP7M7ILT5U7UXGYSM4UB5VBMWUHIDRGTZPLZRYLK3W2NTM4WEDQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.708417285 (81h20m56.430980325s) [noise=true , address=77.90.31.15:4699 , piece_id=AL7HA5TX46M3ZF2BOZGNGGFJ5IHHSDRT4YHUN2XEL2XPEMLISRWQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.711882846 (81h20m56.434445886s) [noise=true , address=45.91.116.14:4190 , piece_id=G4FLK67VLPGRJJUNECETUKGYS3OMQA4CGBKCWPDHVHT632JUHMBQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.730484234 (81h20m56.453047274s) [noise=true , address=45.91.116.8:4047 , piece_id=VTO4NXZJKRF4SDOLNBTOUC4T6LD7UGCHJQTJOGGS2LPF7CPZWGIA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.733559909 (81h20m56.456122949s) [noise=true , address=77.90.31.16:4734 , piece_id=GJJTLE73ATBF2FSCY7QOGWXORADSKXLJXNGDH34DZTSPPTQKSXJA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.761219480 (81h20m56.48378252s) [noise=true , address=45.91.116.11:4118 , piece_id=WAANSRE3AOQ74X575MUJEMFZVVSGECFE5IXRID6UFB6LMK76G5VQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.764041981 (81h20m56.486605021s) [noise=true , address=77.90.31.10:4520 , piece_id=XECJATSD772ZU45XV2KDWE67C2MQHRH7J2MLTCPWHZLWA7YKF36Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.764051749 (81h20m56.486614789s) [seg_pos={0 0}, upload=78076]: Segment reached optimal threshold of 13 pieces. Jul 27 20:56:46.764265288 (81h20m56.486828328s) [noise=true , address=45.91.116.7:4011 , piece_id=4MZ6Y2VDJEYHGHOM7QIO4OB5OF3EYPXCACP5UR7V2BCZN7PN4T4Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764492743 (81h20m56.487055783s) [noise=true , address=45.91.116.7:4010 , piece_id=QJCPKYGZ2MJGMIZGDXIDQDZQMEE2HUBWXZ7KRAGIJD564MOQWX2Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764577445 (81h20m56.487140485s) [noise=true , address=77.90.31.18:4806 , piece_id=PECBEVTQRQJUPRHUS2FDKQHQF4EAAXW226HVFYM5EGCF72ZKRXEA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764592364 (81h20m56.487155404s) [seg_pos={0 0}, upload=78076]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 20:56:46.764671274 (81h20m56.487234314s) [upload=78076]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 20:56:46.764675643 (81h20m56.487238673s) [upload=78076]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 20:56:47.043439135 (81h20m56.766002255s) [upload=78076]: Done uploading segments... Jul 27 20:56:47.043463021 (81h20m56.766026061s) [upload=78076]: Upload finished. err: <nil> Duration: 6.437384983s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 5.859251269s FAIL (2025-07-27 21:28:38 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 5.859275386s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [............X....................................X.....X....] duration: 2.142533266s FAIL (2025-07-27 21:28:30 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 2.142561391s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 5.78778747s FAIL (2025-07-27 21:28:09 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 5.787812358s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 5.976597466s FAIL (2025-07-27 21:27:53 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== NBYMF2YQ, seg_pos={0 0}, upload=78056]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection; write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection Jul 27 20:55:33.507192913 (81h19m43.229755953s) [seg_pos={0 0}, upload=78056]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 20:55:33.507272095 (81h19m43.229835135s) [upload=78056]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 20:55:33.507278908 (81h19m43.229841948s) [upload=78056]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 20:55:33.873750499 (81h19m43.596313549s) [upload=78056]: Done uploading segments... Jul 27 20:55:33.873771960 (81h19m43.59633502s) [upload=78056]: Upload finished. err: <nil> Jul 27 20:56:44.063819950 (81h20m53.78638298s) [upload=78076]: Starting upload Jul 27 20:56:44.063870106 (81h20m53.786433146s) [upload=78076]: Done starting upload Jul 27 20:56:44.064058887 (81h20m53.786621927s) [upload=78076]: Uploading segments... Jul 27 20:56:44.064105396 (81h20m53.786668436s) [upload=78076]: Got next segment. Inline: false Jul 27 20:56:44.064136426 (81h20m53.786699466s) [upload=78076]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 27 20:56:44.064301271 (81h20m53.786864321s) [upload=78076]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 27 20:56:44.584553631 (81h20m54.307116671s) [seg_pos={0 0}, upload=78076]: Begin upload segment... Jul 27 20:56:44.584612734 (81h20m54.307175784s) [seg_pos={0 0}, upload=78076]: Done begin upload segment. Jul 27 20:56:44.584637962 (81h20m54.307201002s) [noise=true , address=77.90.31.15:4699 , piece_id=AL7HA5TX46M3ZF2BOZGNGGFJ5IHHSDRT4YHUN2XEL2XPEMLISRWQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.584670444 (81h20m54.307233484s) [noise=true , address=45.91.116.14:4190 , piece_id=G4FLK67VLPGRJJUNECETUKGYS3OMQA4CGBKCWPDHVHT632JUHMBQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585060231 (81h20m54.307623271s) [noise=true , address=77.90.31.12:4590 , piece_id=RY3N4AP2KLW2RGQDSYTURIEAW7FJKDRODVBJJ574AGWREXJOIXOA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585139933 (81h20m54.307702963s) [noise=true , address=77.90.31.16:4734 , piece_id=GJJTLE73ATBF2FSCY7QOGWXORADSKXLJXNGDH34DZTSPPTQKSXJA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585361397 (81h20m54.307924437s) [noise=true , address=77.90.31.16:4733 , piece_id=UUS54WDRK744TKZLXXAAPRBPCM2OUGPWCRNV57FUZ4K2KXMVG23Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585453122 (81h20m54.308016162s) [noise=true , address=45.91.116.9:4262 , piece_id=7NM6FTVFO4RO7ZUI2A6ONJSQHSKTBNUJTE4RE2PG73V7SDIDFTLQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585646031 (81h20m54.308209081s) [noise=true , address=77.90.31.14:4663 , piece_id=VXGT4HSKJ6LU4CNLPXVOD64RFMTIXHSOIHP3FYKTJEUREGCXJHPA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585756052 (81h20m54.308319092s) [noise=true , address=45.91.116.10:4081 , piece_id=5OBJPHS7YVSLQ7R25I6B33XXTS5IYKF4RLAUGRORWNVF2VIJZOKA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585991612 (81h20m54.308554652s) [noise=true , address=45.91.116.7:4010 , piece_id=QJCPKYGZ2MJGMIZGDXIDQDZQMEE2HUBWXZ7KRAGIJD564MOQWX2Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586051648 (81h20m54.308614688s) [noise=true , address=77.90.31.13:4628 , piece_id=XMP7M7ILT5U7UXGYSM4UB5VBMWUHIDRGTZPLZRYLK3W2NTM4WEDQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586298259 (81h20m54.30886129s) [noise=true , address=45.91.116.11:4118 , piece_id=WAANSRE3AOQ74X575MUJEMFZVVSGECFE5IXRID6UFB6LMK76G5VQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586318758 (81h20m54.308881798s) [noise=true , address=77.90.31.18:4806 , piece_id=PECBEVTQRQJUPRHUS2FDKQHQF4EAAXW226HVFYM5EGCF72ZKRXEA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586610727 (81h20m54.309173777s) [noise=true , address=77.90.31.15:4697 , piece_id=5DDY52MEVML4BBMTJFPJD3SWD4UYLYQ4WT5DGBPIQWBIXMPTCHRQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586908527 (81h20m54.309471567s) [noise=true , address=77.90.31.10:4520 , piece_id=XECJATSD772ZU45XV2KDWE67C2MQHRH7J2MLTCPWHZLWA7YKF36Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.587209813 (81h20m54.309772853s) [noise=true , address=45.91.116.8:4047 , piece_id=VTO4NXZJKRF4SDOLNBTOUC4T6LD7UGCHJQTJOGGS2LPF7CPZWGIA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.587534054 (81h20m54.310097094s) [noise=true , address=45.91.116.7:4011 , piece_id=4MZ6Y2VDJEYHGHOM7QIO4OB5OF3EYPXCACP5UR7V2BCZN7PN4T4Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:46.339251587 (81h20m56.061814627s) [upload=78076]: Next returned nil segment Jul 27 20:56:46.339268218 (81h20m56.061831248s) [upload=78076]: Waiting for error group managing segments... Jul 27 20:56:46.616169719 (81h20m56.338732749s) [noise=true , address=45.91.116.10:4081 , piece_id=5OBJPHS7YVSLQ7R25I6B33XXTS5IYKF4RLAUGRORWNVF2VIJZOKA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.672944635 (81h20m56.395507676s) [noise=true , address=77.90.31.12:4590 , piece_id=RY3N4AP2KLW2RGQDSYTURIEAW7FJKDRODVBJJ574AGWREXJOIXOA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.679116684 (81h20m56.401679724s) [noise=true , address=77.90.31.14:4663 , piece_id=VXGT4HSKJ6LU4CNLPXVOD64RFMTIXHSOIHP3FYKTJEUREGCXJHPA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.689698961 (81h20m56.412262001s) [noise=true , address=77.90.31.16:4733 , piece_id=UUS54WDRK744TKZLXXAAPRBPCM2OUGPWCRNV57FUZ4K2KXMVG23Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.691556325 (81h20m56.414119365s) [noise=true , address=77.90.31.15:4697 , piece_id=5DDY52MEVML4BBMTJFPJD3SWD4UYLYQ4WT5DGBPIQWBIXMPTCHRQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.696368232 (81h20m56.418931272s) [noise=true , address=45.91.116.9:4262 , piece_id=7NM6FTVFO4RO7ZUI2A6ONJSQHSKTBNUJTE4RE2PG73V7SDIDFTLQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.701404117 (81h20m56.423967157s) [noise=true , address=77.90.31.13:4628 , piece_id=XMP7M7ILT5U7UXGYSM4UB5VBMWUHIDRGTZPLZRYLK3W2NTM4WEDQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.708417285 (81h20m56.430980325s) [noise=true , address=77.90.31.15:4699 , piece_id=AL7HA5TX46M3ZF2BOZGNGGFJ5IHHSDRT4YHUN2XEL2XPEMLISRWQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.711882846 (81h20m56.434445886s) [noise=true , address=45.91.116.14:4190 , piece_id=G4FLK67VLPGRJJUNECETUKGYS3OMQA4CGBKCWPDHVHT632JUHMBQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.730484234 (81h20m56.453047274s) [noise=true , address=45.91.116.8:4047 , piece_id=VTO4NXZJKRF4SDOLNBTOUC4T6LD7UGCHJQTJOGGS2LPF7CPZWGIA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.733559909 (81h20m56.456122949s) [noise=true , address=77.90.31.16:4734 , piece_id=GJJTLE73ATBF2FSCY7QOGWXORADSKXLJXNGDH34DZTSPPTQKSXJA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.761219480 (81h20m56.48378252s) [noise=true , address=45.91.116.11:4118 , piece_id=WAANSRE3AOQ74X575MUJEMFZVVSGECFE5IXRID6UFB6LMK76G5VQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.764041981 (81h20m56.486605021s) [noise=true , address=77.90.31.10:4520 , piece_id=XECJATSD772ZU45XV2KDWE67C2MQHRH7J2MLTCPWHZLWA7YKF36Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.764051749 (81h20m56.486614789s) [seg_pos={0 0}, upload=78076]: Segment reached optimal threshold of 13 pieces. Jul 27 20:56:46.764265288 (81h20m56.486828328s) [noise=true , address=45.91.116.7:4011 , piece_id=4MZ6Y2VDJEYHGHOM7QIO4OB5OF3EYPXCACP5UR7V2BCZN7PN4T4Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764492743 (81h20m56.487055783s) [noise=true , address=45.91.116.7:4010 , piece_id=QJCPKYGZ2MJGMIZGDXIDQDZQMEE2HUBWXZ7KRAGIJD564MOQWX2Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764577445 (81h20m56.487140485s) [noise=true , address=77.90.31.18:4806 , piece_id=PECBEVTQRQJUPRHUS2FDKQHQF4EAAXW226HVFYM5EGCF72ZKRXEA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764592364 (81h20m56.487155404s) [seg_pos={0 0}, upload=78076]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 20:56:46.764671274 (81h20m56.487234314s) [upload=78076]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 20:56:46.764675643 (81h20m56.487238673s) [upload=78076]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 20:56:47.043439135 (81h20m56.766002255s) [upload=78076]: Done uploading segments... Jul 27 20:56:47.043463021 (81h20m56.766026061s) [upload=78076]: Upload finished. err: <nil> Duration: 5.976622233s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 5.874091853s FAIL (2025-07-27 21:27:51 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 5.874122292s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.............X....................................X.....X...] duration: 1.867600843s FAIL (2025-07-27 21:27:47 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 1.867625921s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 5.82823119s FAIL (2025-07-27 21:26:47 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== NBYMF2YQ, seg_pos={0 0}, upload=78056]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection; write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection Jul 27 20:55:33.507192913 (81h19m43.229755953s) [seg_pos={0 0}, upload=78056]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 20:55:33.507272095 (81h19m43.229835135s) [upload=78056]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 20:55:33.507278908 (81h19m43.229841948s) [upload=78056]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 20:55:33.873750499 (81h19m43.596313549s) [upload=78056]: Done uploading segments... Jul 27 20:55:33.873771960 (81h19m43.59633502s) [upload=78056]: Upload finished. err: <nil> Jul 27 20:56:44.063819950 (81h20m53.78638298s) [upload=78076]: Starting upload Jul 27 20:56:44.063870106 (81h20m53.786433146s) [upload=78076]: Done starting upload Jul 27 20:56:44.064058887 (81h20m53.786621927s) [upload=78076]: Uploading segments... Jul 27 20:56:44.064105396 (81h20m53.786668436s) [upload=78076]: Got next segment. Inline: false Jul 27 20:56:44.064136426 (81h20m53.786699466s) [upload=78076]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 27 20:56:44.064301271 (81h20m53.786864321s) [upload=78076]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 27 20:56:44.584553631 (81h20m54.307116671s) [seg_pos={0 0}, upload=78076]: Begin upload segment... Jul 27 20:56:44.584612734 (81h20m54.307175784s) [seg_pos={0 0}, upload=78076]: Done begin upload segment. Jul 27 20:56:44.584637962 (81h20m54.307201002s) [noise=true , address=77.90.31.15:4699 , piece_id=AL7HA5TX46M3ZF2BOZGNGGFJ5IHHSDRT4YHUN2XEL2XPEMLISRWQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.584670444 (81h20m54.307233484s) [noise=true , address=45.91.116.14:4190 , piece_id=G4FLK67VLPGRJJUNECETUKGYS3OMQA4CGBKCWPDHVHT632JUHMBQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585060231 (81h20m54.307623271s) [noise=true , address=77.90.31.12:4590 , piece_id=RY3N4AP2KLW2RGQDSYTURIEAW7FJKDRODVBJJ574AGWREXJOIXOA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585139933 (81h20m54.307702963s) [noise=true , address=77.90.31.16:4734 , piece_id=GJJTLE73ATBF2FSCY7QOGWXORADSKXLJXNGDH34DZTSPPTQKSXJA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585361397 (81h20m54.307924437s) [noise=true , address=77.90.31.16:4733 , piece_id=UUS54WDRK744TKZLXXAAPRBPCM2OUGPWCRNV57FUZ4K2KXMVG23Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585453122 (81h20m54.308016162s) [noise=true , address=45.91.116.9:4262 , piece_id=7NM6FTVFO4RO7ZUI2A6ONJSQHSKTBNUJTE4RE2PG73V7SDIDFTLQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585646031 (81h20m54.308209081s) [noise=true , address=77.90.31.14:4663 , piece_id=VXGT4HSKJ6LU4CNLPXVOD64RFMTIXHSOIHP3FYKTJEUREGCXJHPA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585756052 (81h20m54.308319092s) [noise=true , address=45.91.116.10:4081 , piece_id=5OBJPHS7YVSLQ7R25I6B33XXTS5IYKF4RLAUGRORWNVF2VIJZOKA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585991612 (81h20m54.308554652s) [noise=true , address=45.91.116.7:4010 , piece_id=QJCPKYGZ2MJGMIZGDXIDQDZQMEE2HUBWXZ7KRAGIJD564MOQWX2Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586051648 (81h20m54.308614688s) [noise=true , address=77.90.31.13:4628 , piece_id=XMP7M7ILT5U7UXGYSM4UB5VBMWUHIDRGTZPLZRYLK3W2NTM4WEDQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586298259 (81h20m54.30886129s) [noise=true , address=45.91.116.11:4118 , piece_id=WAANSRE3AOQ74X575MUJEMFZVVSGECFE5IXRID6UFB6LMK76G5VQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586318758 (81h20m54.308881798s) [noise=true , address=77.90.31.18:4806 , piece_id=PECBEVTQRQJUPRHUS2FDKQHQF4EAAXW226HVFYM5EGCF72ZKRXEA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586610727 (81h20m54.309173777s) [noise=true , address=77.90.31.15:4697 , piece_id=5DDY52MEVML4BBMTJFPJD3SWD4UYLYQ4WT5DGBPIQWBIXMPTCHRQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586908527 (81h20m54.309471567s) [noise=true , address=77.90.31.10:4520 , piece_id=XECJATSD772ZU45XV2KDWE67C2MQHRH7J2MLTCPWHZLWA7YKF36Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.587209813 (81h20m54.309772853s) [noise=true , address=45.91.116.8:4047 , piece_id=VTO4NXZJKRF4SDOLNBTOUC4T6LD7UGCHJQTJOGGS2LPF7CPZWGIA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.587534054 (81h20m54.310097094s) [noise=true , address=45.91.116.7:4011 , piece_id=4MZ6Y2VDJEYHGHOM7QIO4OB5OF3EYPXCACP5UR7V2BCZN7PN4T4Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:46.339251587 (81h20m56.061814627s) [upload=78076]: Next returned nil segment Jul 27 20:56:46.339268218 (81h20m56.061831248s) [upload=78076]: Waiting for error group managing segments... Jul 27 20:56:46.616169719 (81h20m56.338732749s) [noise=true , address=45.91.116.10:4081 , piece_id=5OBJPHS7YVSLQ7R25I6B33XXTS5IYKF4RLAUGRORWNVF2VIJZOKA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.672944635 (81h20m56.395507676s) [noise=true , address=77.90.31.12:4590 , piece_id=RY3N4AP2KLW2RGQDSYTURIEAW7FJKDRODVBJJ574AGWREXJOIXOA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.679116684 (81h20m56.401679724s) [noise=true , address=77.90.31.14:4663 , piece_id=VXGT4HSKJ6LU4CNLPXVOD64RFMTIXHSOIHP3FYKTJEUREGCXJHPA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.689698961 (81h20m56.412262001s) [noise=true , address=77.90.31.16:4733 , piece_id=UUS54WDRK744TKZLXXAAPRBPCM2OUGPWCRNV57FUZ4K2KXMVG23Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.691556325 (81h20m56.414119365s) [noise=true , address=77.90.31.15:4697 , piece_id=5DDY52MEVML4BBMTJFPJD3SWD4UYLYQ4WT5DGBPIQWBIXMPTCHRQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.696368232 (81h20m56.418931272s) [noise=true , address=45.91.116.9:4262 , piece_id=7NM6FTVFO4RO7ZUI2A6ONJSQHSKTBNUJTE4RE2PG73V7SDIDFTLQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.701404117 (81h20m56.423967157s) [noise=true , address=77.90.31.13:4628 , piece_id=XMP7M7ILT5U7UXGYSM4UB5VBMWUHIDRGTZPLZRYLK3W2NTM4WEDQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.708417285 (81h20m56.430980325s) [noise=true , address=77.90.31.15:4699 , piece_id=AL7HA5TX46M3ZF2BOZGNGGFJ5IHHSDRT4YHUN2XEL2XPEMLISRWQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.711882846 (81h20m56.434445886s) [noise=true , address=45.91.116.14:4190 , piece_id=G4FLK67VLPGRJJUNECETUKGYS3OMQA4CGBKCWPDHVHT632JUHMBQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.730484234 (81h20m56.453047274s) [noise=true , address=45.91.116.8:4047 , piece_id=VTO4NXZJKRF4SDOLNBTOUC4T6LD7UGCHJQTJOGGS2LPF7CPZWGIA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.733559909 (81h20m56.456122949s) [noise=true , address=77.90.31.16:4734 , piece_id=GJJTLE73ATBF2FSCY7QOGWXORADSKXLJXNGDH34DZTSPPTQKSXJA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.761219480 (81h20m56.48378252s) [noise=true , address=45.91.116.11:4118 , piece_id=WAANSRE3AOQ74X575MUJEMFZVVSGECFE5IXRID6UFB6LMK76G5VQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.764041981 (81h20m56.486605021s) [noise=true , address=77.90.31.10:4520 , piece_id=XECJATSD772ZU45XV2KDWE67C2MQHRH7J2MLTCPWHZLWA7YKF36Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.764051749 (81h20m56.486614789s) [seg_pos={0 0}, upload=78076]: Segment reached optimal threshold of 13 pieces. Jul 27 20:56:46.764265288 (81h20m56.486828328s) [noise=true , address=45.91.116.7:4011 , piece_id=4MZ6Y2VDJEYHGHOM7QIO4OB5OF3EYPXCACP5UR7V2BCZN7PN4T4Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764492743 (81h20m56.487055783s) [noise=true , address=45.91.116.7:4010 , piece_id=QJCPKYGZ2MJGMIZGDXIDQDZQMEE2HUBWXZ7KRAGIJD564MOQWX2Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764577445 (81h20m56.487140485s) [noise=true , address=77.90.31.18:4806 , piece_id=PECBEVTQRQJUPRHUS2FDKQHQF4EAAXW226HVFYM5EGCF72ZKRXEA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764592364 (81h20m56.487155404s) [seg_pos={0 0}, upload=78076]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 20:56:46.764671274 (81h20m56.487234314s) [upload=78076]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 20:56:46.764675643 (81h20m56.487238673s) [upload=78076]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 20:56:47.043439135 (81h20m56.766002255s) [upload=78076]: Done uploading segments... Jul 27 20:56:47.043463021 (81h20m56.766026061s) [upload=78076]: Upload finished. err: <nil> Duration: 5.828258901s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [X.............X....................................X.....X..] duration: 1.959657122s FAIL (2025-07-27 21:26:45 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 1.959682281s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 5.776231098s FAIL (2025-07-27 21:26:39 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 5.776259484s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 5.95272975s FAIL (2025-07-27 21:26:16 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 5.952756001s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.X.............X....................................X.....X.] duration: 1.899495837s FAIL (2025-07-27 21:26:10 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 1.899522309s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 5.795054234s FAIL (2025-07-27 21:25:45 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== NBYMF2YQ, seg_pos={0 0}, upload=78056]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection; write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection Jul 27 20:55:33.507192913 (81h19m43.229755953s) [seg_pos={0 0}, upload=78056]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 20:55:33.507272095 (81h19m43.229835135s) [upload=78056]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 20:55:33.507278908 (81h19m43.229841948s) [upload=78056]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 20:55:33.873750499 (81h19m43.596313549s) [upload=78056]: Done uploading segments... Jul 27 20:55:33.873771960 (81h19m43.59633502s) [upload=78056]: Upload finished. err: <nil> Jul 27 20:56:44.063819950 (81h20m53.78638298s) [upload=78076]: Starting upload Jul 27 20:56:44.063870106 (81h20m53.786433146s) [upload=78076]: Done starting upload Jul 27 20:56:44.064058887 (81h20m53.786621927s) [upload=78076]: Uploading segments... Jul 27 20:56:44.064105396 (81h20m53.786668436s) [upload=78076]: Got next segment. Inline: false Jul 27 20:56:44.064136426 (81h20m53.786699466s) [upload=78076]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 27 20:56:44.064301271 (81h20m53.786864321s) [upload=78076]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 27 20:56:44.584553631 (81h20m54.307116671s) [seg_pos={0 0}, upload=78076]: Begin upload segment... Jul 27 20:56:44.584612734 (81h20m54.307175784s) [seg_pos={0 0}, upload=78076]: Done begin upload segment. Jul 27 20:56:44.584637962 (81h20m54.307201002s) [noise=true , address=77.90.31.15:4699 , piece_id=AL7HA5TX46M3ZF2BOZGNGGFJ5IHHSDRT4YHUN2XEL2XPEMLISRWQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.584670444 (81h20m54.307233484s) [noise=true , address=45.91.116.14:4190 , piece_id=G4FLK67VLPGRJJUNECETUKGYS3OMQA4CGBKCWPDHVHT632JUHMBQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585060231 (81h20m54.307623271s) [noise=true , address=77.90.31.12:4590 , piece_id=RY3N4AP2KLW2RGQDSYTURIEAW7FJKDRODVBJJ574AGWREXJOIXOA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585139933 (81h20m54.307702963s) [noise=true , address=77.90.31.16:4734 , piece_id=GJJTLE73ATBF2FSCY7QOGWXORADSKXLJXNGDH34DZTSPPTQKSXJA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585361397 (81h20m54.307924437s) [noise=true , address=77.90.31.16:4733 , piece_id=UUS54WDRK744TKZLXXAAPRBPCM2OUGPWCRNV57FUZ4K2KXMVG23Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585453122 (81h20m54.308016162s) [noise=true , address=45.91.116.9:4262 , piece_id=7NM6FTVFO4RO7ZUI2A6ONJSQHSKTBNUJTE4RE2PG73V7SDIDFTLQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585646031 (81h20m54.308209081s) [noise=true , address=77.90.31.14:4663 , piece_id=VXGT4HSKJ6LU4CNLPXVOD64RFMTIXHSOIHP3FYKTJEUREGCXJHPA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585756052 (81h20m54.308319092s) [noise=true , address=45.91.116.10:4081 , piece_id=5OBJPHS7YVSLQ7R25I6B33XXTS5IYKF4RLAUGRORWNVF2VIJZOKA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585991612 (81h20m54.308554652s) [noise=true , address=45.91.116.7:4010 , piece_id=QJCPKYGZ2MJGMIZGDXIDQDZQMEE2HUBWXZ7KRAGIJD564MOQWX2Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586051648 (81h20m54.308614688s) [noise=true , address=77.90.31.13:4628 , piece_id=XMP7M7ILT5U7UXGYSM4UB5VBMWUHIDRGTZPLZRYLK3W2NTM4WEDQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586298259 (81h20m54.30886129s) [noise=true , address=45.91.116.11:4118 , piece_id=WAANSRE3AOQ74X575MUJEMFZVVSGECFE5IXRID6UFB6LMK76G5VQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586318758 (81h20m54.308881798s) [noise=true , address=77.90.31.18:4806 , piece_id=PECBEVTQRQJUPRHUS2FDKQHQF4EAAXW226HVFYM5EGCF72ZKRXEA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586610727 (81h20m54.309173777s) [noise=true , address=77.90.31.15:4697 , piece_id=5DDY52MEVML4BBMTJFPJD3SWD4UYLYQ4WT5DGBPIQWBIXMPTCHRQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586908527 (81h20m54.309471567s) [noise=true , address=77.90.31.10:4520 , piece_id=XECJATSD772ZU45XV2KDWE67C2MQHRH7J2MLTCPWHZLWA7YKF36Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.587209813 (81h20m54.309772853s) [noise=true , address=45.91.116.8:4047 , piece_id=VTO4NXZJKRF4SDOLNBTOUC4T6LD7UGCHJQTJOGGS2LPF7CPZWGIA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.587534054 (81h20m54.310097094s) [noise=true , address=45.91.116.7:4011 , piece_id=4MZ6Y2VDJEYHGHOM7QIO4OB5OF3EYPXCACP5UR7V2BCZN7PN4T4Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:46.339251587 (81h20m56.061814627s) [upload=78076]: Next returned nil segment Jul 27 20:56:46.339268218 (81h20m56.061831248s) [upload=78076]: Waiting for error group managing segments... Jul 27 20:56:46.616169719 (81h20m56.338732749s) [noise=true , address=45.91.116.10:4081 , piece_id=5OBJPHS7YVSLQ7R25I6B33XXTS5IYKF4RLAUGRORWNVF2VIJZOKA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.672944635 (81h20m56.395507676s) [noise=true , address=77.90.31.12:4590 , piece_id=RY3N4AP2KLW2RGQDSYTURIEAW7FJKDRODVBJJ574AGWREXJOIXOA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.679116684 (81h20m56.401679724s) [noise=true , address=77.90.31.14:4663 , piece_id=VXGT4HSKJ6LU4CNLPXVOD64RFMTIXHSOIHP3FYKTJEUREGCXJHPA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.689698961 (81h20m56.412262001s) [noise=true , address=77.90.31.16:4733 , piece_id=UUS54WDRK744TKZLXXAAPRBPCM2OUGPWCRNV57FUZ4K2KXMVG23Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.691556325 (81h20m56.414119365s) [noise=true , address=77.90.31.15:4697 , piece_id=5DDY52MEVML4BBMTJFPJD3SWD4UYLYQ4WT5DGBPIQWBIXMPTCHRQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.696368232 (81h20m56.418931272s) [noise=true , address=45.91.116.9:4262 , piece_id=7NM6FTVFO4RO7ZUI2A6ONJSQHSKTBNUJTE4RE2PG73V7SDIDFTLQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.701404117 (81h20m56.423967157s) [noise=true , address=77.90.31.13:4628 , piece_id=XMP7M7ILT5U7UXGYSM4UB5VBMWUHIDRGTZPLZRYLK3W2NTM4WEDQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.708417285 (81h20m56.430980325s) [noise=true , address=77.90.31.15:4699 , piece_id=AL7HA5TX46M3ZF2BOZGNGGFJ5IHHSDRT4YHUN2XEL2XPEMLISRWQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.711882846 (81h20m56.434445886s) [noise=true , address=45.91.116.14:4190 , piece_id=G4FLK67VLPGRJJUNECETUKGYS3OMQA4CGBKCWPDHVHT632JUHMBQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.730484234 (81h20m56.453047274s) [noise=true , address=45.91.116.8:4047 , piece_id=VTO4NXZJKRF4SDOLNBTOUC4T6LD7UGCHJQTJOGGS2LPF7CPZWGIA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.733559909 (81h20m56.456122949s) [noise=true , address=77.90.31.16:4734 , piece_id=GJJTLE73ATBF2FSCY7QOGWXORADSKXLJXNGDH34DZTSPPTQKSXJA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.761219480 (81h20m56.48378252s) [noise=true , address=45.91.116.11:4118 , piece_id=WAANSRE3AOQ74X575MUJEMFZVVSGECFE5IXRID6UFB6LMK76G5VQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.764041981 (81h20m56.486605021s) [noise=true , address=77.90.31.10:4520 , piece_id=XECJATSD772ZU45XV2KDWE67C2MQHRH7J2MLTCPWHZLWA7YKF36Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.764051749 (81h20m56.486614789s) [seg_pos={0 0}, upload=78076]: Segment reached optimal threshold of 13 pieces. Jul 27 20:56:46.764265288 (81h20m56.486828328s) [noise=true , address=45.91.116.7:4011 , piece_id=4MZ6Y2VDJEYHGHOM7QIO4OB5OF3EYPXCACP5UR7V2BCZN7PN4T4Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764492743 (81h20m56.487055783s) [noise=true , address=45.91.116.7:4010 , piece_id=QJCPKYGZ2MJGMIZGDXIDQDZQMEE2HUBWXZ7KRAGIJD564MOQWX2Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764577445 (81h20m56.487140485s) [noise=true , address=77.90.31.18:4806 , piece_id=PECBEVTQRQJUPRHUS2FDKQHQF4EAAXW226HVFYM5EGCF72ZKRXEA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764592364 (81h20m56.487155404s) [seg_pos={0 0}, upload=78076]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 20:56:46.764671274 (81h20m56.487234314s) [upload=78076]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 20:56:46.764675643 (81h20m56.487238673s) [upload=78076]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 20:56:47.043439135 (81h20m56.766002255s) [upload=78076]: Done uploading segments... Jul 27 20:56:47.043463021 (81h20m56.766026061s) [upload=78076]: Upload finished. err: <nil> Duration: 5.795086186s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 5.805317608s FAIL (2025-07-27 21:25:29 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== NBYMF2YQ, seg_pos={0 0}, upload=78056]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection; write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection Jul 27 20:55:33.507192913 (81h19m43.229755953s) [seg_pos={0 0}, upload=78056]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 20:55:33.507272095 (81h19m43.229835135s) [upload=78056]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 20:55:33.507278908 (81h19m43.229841948s) [upload=78056]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 20:55:33.873750499 (81h19m43.596313549s) [upload=78056]: Done uploading segments... Jul 27 20:55:33.873771960 (81h19m43.59633502s) [upload=78056]: Upload finished. err: <nil> Jul 27 20:56:44.063819950 (81h20m53.78638298s) [upload=78076]: Starting upload Jul 27 20:56:44.063870106 (81h20m53.786433146s) [upload=78076]: Done starting upload Jul 27 20:56:44.064058887 (81h20m53.786621927s) [upload=78076]: Uploading segments... Jul 27 20:56:44.064105396 (81h20m53.786668436s) [upload=78076]: Got next segment. Inline: false Jul 27 20:56:44.064136426 (81h20m53.786699466s) [upload=78076]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 27 20:56:44.064301271 (81h20m53.786864321s) [upload=78076]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 27 20:56:44.584553631 (81h20m54.307116671s) [seg_pos={0 0}, upload=78076]: Begin upload segment... Jul 27 20:56:44.584612734 (81h20m54.307175784s) [seg_pos={0 0}, upload=78076]: Done begin upload segment. Jul 27 20:56:44.584637962 (81h20m54.307201002s) [noise=true , address=77.90.31.15:4699 , piece_id=AL7HA5TX46M3ZF2BOZGNGGFJ5IHHSDRT4YHUN2XEL2XPEMLISRWQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.584670444 (81h20m54.307233484s) [noise=true , address=45.91.116.14:4190 , piece_id=G4FLK67VLPGRJJUNECETUKGYS3OMQA4CGBKCWPDHVHT632JUHMBQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585060231 (81h20m54.307623271s) [noise=true , address=77.90.31.12:4590 , piece_id=RY3N4AP2KLW2RGQDSYTURIEAW7FJKDRODVBJJ574AGWREXJOIXOA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585139933 (81h20m54.307702963s) [noise=true , address=77.90.31.16:4734 , piece_id=GJJTLE73ATBF2FSCY7QOGWXORADSKXLJXNGDH34DZTSPPTQKSXJA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585361397 (81h20m54.307924437s) [noise=true , address=77.90.31.16:4733 , piece_id=UUS54WDRK744TKZLXXAAPRBPCM2OUGPWCRNV57FUZ4K2KXMVG23Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585453122 (81h20m54.308016162s) [noise=true , address=45.91.116.9:4262 , piece_id=7NM6FTVFO4RO7ZUI2A6ONJSQHSKTBNUJTE4RE2PG73V7SDIDFTLQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585646031 (81h20m54.308209081s) [noise=true , address=77.90.31.14:4663 , piece_id=VXGT4HSKJ6LU4CNLPXVOD64RFMTIXHSOIHP3FYKTJEUREGCXJHPA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585756052 (81h20m54.308319092s) [noise=true , address=45.91.116.10:4081 , piece_id=5OBJPHS7YVSLQ7R25I6B33XXTS5IYKF4RLAUGRORWNVF2VIJZOKA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585991612 (81h20m54.308554652s) [noise=true , address=45.91.116.7:4010 , piece_id=QJCPKYGZ2MJGMIZGDXIDQDZQMEE2HUBWXZ7KRAGIJD564MOQWX2Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586051648 (81h20m54.308614688s) [noise=true , address=77.90.31.13:4628 , piece_id=XMP7M7ILT5U7UXGYSM4UB5VBMWUHIDRGTZPLZRYLK3W2NTM4WEDQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586298259 (81h20m54.30886129s) [noise=true , address=45.91.116.11:4118 , piece_id=WAANSRE3AOQ74X575MUJEMFZVVSGECFE5IXRID6UFB6LMK76G5VQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586318758 (81h20m54.308881798s) [noise=true , address=77.90.31.18:4806 , piece_id=PECBEVTQRQJUPRHUS2FDKQHQF4EAAXW226HVFYM5EGCF72ZKRXEA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586610727 (81h20m54.309173777s) [noise=true , address=77.90.31.15:4697 , piece_id=5DDY52MEVML4BBMTJFPJD3SWD4UYLYQ4WT5DGBPIQWBIXMPTCHRQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586908527 (81h20m54.309471567s) [noise=true , address=77.90.31.10:4520 , piece_id=XECJATSD772ZU45XV2KDWE67C2MQHRH7J2MLTCPWHZLWA7YKF36Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.587209813 (81h20m54.309772853s) [noise=true , address=45.91.116.8:4047 , piece_id=VTO4NXZJKRF4SDOLNBTOUC4T6LD7UGCHJQTJOGGS2LPF7CPZWGIA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.587534054 (81h20m54.310097094s) [noise=true , address=45.91.116.7:4011 , piece_id=4MZ6Y2VDJEYHGHOM7QIO4OB5OF3EYPXCACP5UR7V2BCZN7PN4T4Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:46.339251587 (81h20m56.061814627s) [upload=78076]: Next returned nil segment Jul 27 20:56:46.339268218 (81h20m56.061831248s) [upload=78076]: Waiting for error group managing segments... Jul 27 20:56:46.616169719 (81h20m56.338732749s) [noise=true , address=45.91.116.10:4081 , piece_id=5OBJPHS7YVSLQ7R25I6B33XXTS5IYKF4RLAUGRORWNVF2VIJZOKA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.672944635 (81h20m56.395507676s) [noise=true , address=77.90.31.12:4590 , piece_id=RY3N4AP2KLW2RGQDSYTURIEAW7FJKDRODVBJJ574AGWREXJOIXOA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.679116684 (81h20m56.401679724s) [noise=true , address=77.90.31.14:4663 , piece_id=VXGT4HSKJ6LU4CNLPXVOD64RFMTIXHSOIHP3FYKTJEUREGCXJHPA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.689698961 (81h20m56.412262001s) [noise=true , address=77.90.31.16:4733 , piece_id=UUS54WDRK744TKZLXXAAPRBPCM2OUGPWCRNV57FUZ4K2KXMVG23Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.691556325 (81h20m56.414119365s) [noise=true , address=77.90.31.15:4697 , piece_id=5DDY52MEVML4BBMTJFPJD3SWD4UYLYQ4WT5DGBPIQWBIXMPTCHRQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.696368232 (81h20m56.418931272s) [noise=true , address=45.91.116.9:4262 , piece_id=7NM6FTVFO4RO7ZUI2A6ONJSQHSKTBNUJTE4RE2PG73V7SDIDFTLQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.701404117 (81h20m56.423967157s) [noise=true , address=77.90.31.13:4628 , piece_id=XMP7M7ILT5U7UXGYSM4UB5VBMWUHIDRGTZPLZRYLK3W2NTM4WEDQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.708417285 (81h20m56.430980325s) [noise=true , address=77.90.31.15:4699 , piece_id=AL7HA5TX46M3ZF2BOZGNGGFJ5IHHSDRT4YHUN2XEL2XPEMLISRWQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.711882846 (81h20m56.434445886s) [noise=true , address=45.91.116.14:4190 , piece_id=G4FLK67VLPGRJJUNECETUKGYS3OMQA4CGBKCWPDHVHT632JUHMBQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.730484234 (81h20m56.453047274s) [noise=true , address=45.91.116.8:4047 , piece_id=VTO4NXZJKRF4SDOLNBTOUC4T6LD7UGCHJQTJOGGS2LPF7CPZWGIA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.733559909 (81h20m56.456122949s) [noise=true , address=77.90.31.16:4734 , piece_id=GJJTLE73ATBF2FSCY7QOGWXORADSKXLJXNGDH34DZTSPPTQKSXJA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.761219480 (81h20m56.48378252s) [noise=true , address=45.91.116.11:4118 , piece_id=WAANSRE3AOQ74X575MUJEMFZVVSGECFE5IXRID6UFB6LMK76G5VQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.764041981 (81h20m56.486605021s) [noise=true , address=77.90.31.10:4520 , piece_id=XECJATSD772ZU45XV2KDWE67C2MQHRH7J2MLTCPWHZLWA7YKF36Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.764051749 (81h20m56.486614789s) [seg_pos={0 0}, upload=78076]: Segment reached optimal threshold of 13 pieces. Jul 27 20:56:46.764265288 (81h20m56.486828328s) [noise=true , address=45.91.116.7:4011 , piece_id=4MZ6Y2VDJEYHGHOM7QIO4OB5OF3EYPXCACP5UR7V2BCZN7PN4T4Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764492743 (81h20m56.487055783s) [noise=true , address=45.91.116.7:4010 , piece_id=QJCPKYGZ2MJGMIZGDXIDQDZQMEE2HUBWXZ7KRAGIJD564MOQWX2Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764577445 (81h20m56.487140485s) [noise=true , address=77.90.31.18:4806 , piece_id=PECBEVTQRQJUPRHUS2FDKQHQF4EAAXW226HVFYM5EGCF72ZKRXEA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764592364 (81h20m56.487155404s) [seg_pos={0 0}, upload=78076]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 20:56:46.764671274 (81h20m56.487234314s) [upload=78076]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 20:56:46.764675643 (81h20m56.487238673s) [upload=78076]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 20:56:47.043439135 (81h20m56.766002255s) [upload=78076]: Done uploading segments... Jul 27 20:56:47.043463021 (81h20m56.766026061s) [upload=78076]: Upload finished. err: <nil> Duration: 5.805345293s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 5.844098839s FAIL (2025-07-27 21:25:18 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 5.844133125s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [..X.............X....................................X.....X] duration: 3.092702032s FAIL (2025-07-27 21:25:11 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 3.092734033s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 5.887554503s FAIL (2025-07-27 21:24:45 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 5.887580953s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...X.............X....................................X.....] duration: 1.846082392s FAIL (2025-07-27 21:24:23 UTC) orbiter warning: uplink: too many requests Duration: 1.84610675s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 5.757457058s FAIL (2025-07-27 21:24:17 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== NBYMF2YQ, seg_pos={0 0}, upload=78056]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection; write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34898->104.36.82.7:4909: use of closed network connection Jul 27 20:55:33.507192913 (81h19m43.229755953s) [seg_pos={0 0}, upload=78056]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 20:55:33.507272095 (81h19m43.229835135s) [upload=78056]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 20:55:33.507278908 (81h19m43.229841948s) [upload=78056]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 20:55:33.873750499 (81h19m43.596313549s) [upload=78056]: Done uploading segments... Jul 27 20:55:33.873771960 (81h19m43.59633502s) [upload=78056]: Upload finished. err: <nil> Jul 27 20:56:44.063819950 (81h20m53.78638298s) [upload=78076]: Starting upload Jul 27 20:56:44.063870106 (81h20m53.786433146s) [upload=78076]: Done starting upload Jul 27 20:56:44.064058887 (81h20m53.786621927s) [upload=78076]: Uploading segments... Jul 27 20:56:44.064105396 (81h20m53.786668436s) [upload=78076]: Got next segment. Inline: false Jul 27 20:56:44.064136426 (81h20m53.786699466s) [upload=78076]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 27 20:56:44.064301271 (81h20m53.786864321s) [upload=78076]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 27 20:56:44.584553631 (81h20m54.307116671s) [seg_pos={0 0}, upload=78076]: Begin upload segment... Jul 27 20:56:44.584612734 (81h20m54.307175784s) [seg_pos={0 0}, upload=78076]: Done begin upload segment. Jul 27 20:56:44.584637962 (81h20m54.307201002s) [noise=true , address=77.90.31.15:4699 , piece_id=AL7HA5TX46M3ZF2BOZGNGGFJ5IHHSDRT4YHUN2XEL2XPEMLISRWQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.584670444 (81h20m54.307233484s) [noise=true , address=45.91.116.14:4190 , piece_id=G4FLK67VLPGRJJUNECETUKGYS3OMQA4CGBKCWPDHVHT632JUHMBQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585060231 (81h20m54.307623271s) [noise=true , address=77.90.31.12:4590 , piece_id=RY3N4AP2KLW2RGQDSYTURIEAW7FJKDRODVBJJ574AGWREXJOIXOA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585139933 (81h20m54.307702963s) [noise=true , address=77.90.31.16:4734 , piece_id=GJJTLE73ATBF2FSCY7QOGWXORADSKXLJXNGDH34DZTSPPTQKSXJA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585361397 (81h20m54.307924437s) [noise=true , address=77.90.31.16:4733 , piece_id=UUS54WDRK744TKZLXXAAPRBPCM2OUGPWCRNV57FUZ4K2KXMVG23Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585453122 (81h20m54.308016162s) [noise=true , address=45.91.116.9:4262 , piece_id=7NM6FTVFO4RO7ZUI2A6ONJSQHSKTBNUJTE4RE2PG73V7SDIDFTLQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585646031 (81h20m54.308209081s) [noise=true , address=77.90.31.14:4663 , piece_id=VXGT4HSKJ6LU4CNLPXVOD64RFMTIXHSOIHP3FYKTJEUREGCXJHPA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585756052 (81h20m54.308319092s) [noise=true , address=45.91.116.10:4081 , piece_id=5OBJPHS7YVSLQ7R25I6B33XXTS5IYKF4RLAUGRORWNVF2VIJZOKA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.585991612 (81h20m54.308554652s) [noise=true , address=45.91.116.7:4010 , piece_id=QJCPKYGZ2MJGMIZGDXIDQDZQMEE2HUBWXZ7KRAGIJD564MOQWX2Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586051648 (81h20m54.308614688s) [noise=true , address=77.90.31.13:4628 , piece_id=XMP7M7ILT5U7UXGYSM4UB5VBMWUHIDRGTZPLZRYLK3W2NTM4WEDQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586298259 (81h20m54.30886129s) [noise=true , address=45.91.116.11:4118 , piece_id=WAANSRE3AOQ74X575MUJEMFZVVSGECFE5IXRID6UFB6LMK76G5VQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586318758 (81h20m54.308881798s) [noise=true , address=77.90.31.18:4806 , piece_id=PECBEVTQRQJUPRHUS2FDKQHQF4EAAXW226HVFYM5EGCF72ZKRXEA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586610727 (81h20m54.309173777s) [noise=true , address=77.90.31.15:4697 , piece_id=5DDY52MEVML4BBMTJFPJD3SWD4UYLYQ4WT5DGBPIQWBIXMPTCHRQ, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.586908527 (81h20m54.309471567s) [noise=true , address=77.90.31.10:4520 , piece_id=XECJATSD772ZU45XV2KDWE67C2MQHRH7J2MLTCPWHZLWA7YKF36Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.587209813 (81h20m54.309772853s) [noise=true , address=45.91.116.8:4047 , piece_id=VTO4NXZJKRF4SDOLNBTOUC4T6LD7UGCHJQTJOGGS2LPF7CPZWGIA, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:44.587534054 (81h20m54.310097094s) [noise=true , address=45.91.116.7:4011 , piece_id=4MZ6Y2VDJEYHGHOM7QIO4OB5OF3EYPXCACP5UR7V2BCZN7PN4T4Q, seg_pos={0 0}, upload=78076]: Uploading piece... Jul 27 20:56:46.339251587 (81h20m56.061814627s) [upload=78076]: Next returned nil segment Jul 27 20:56:46.339268218 (81h20m56.061831248s) [upload=78076]: Waiting for error group managing segments... Jul 27 20:56:46.616169719 (81h20m56.338732749s) [noise=true , address=45.91.116.10:4081 , piece_id=5OBJPHS7YVSLQ7R25I6B33XXTS5IYKF4RLAUGRORWNVF2VIJZOKA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.672944635 (81h20m56.395507676s) [noise=true , address=77.90.31.12:4590 , piece_id=RY3N4AP2KLW2RGQDSYTURIEAW7FJKDRODVBJJ574AGWREXJOIXOA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.679116684 (81h20m56.401679724s) [noise=true , address=77.90.31.14:4663 , piece_id=VXGT4HSKJ6LU4CNLPXVOD64RFMTIXHSOIHP3FYKTJEUREGCXJHPA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.689698961 (81h20m56.412262001s) [noise=true , address=77.90.31.16:4733 , piece_id=UUS54WDRK744TKZLXXAAPRBPCM2OUGPWCRNV57FUZ4K2KXMVG23Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.691556325 (81h20m56.414119365s) [noise=true , address=77.90.31.15:4697 , piece_id=5DDY52MEVML4BBMTJFPJD3SWD4UYLYQ4WT5DGBPIQWBIXMPTCHRQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.696368232 (81h20m56.418931272s) [noise=true , address=45.91.116.9:4262 , piece_id=7NM6FTVFO4RO7ZUI2A6ONJSQHSKTBNUJTE4RE2PG73V7SDIDFTLQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.701404117 (81h20m56.423967157s) [noise=true , address=77.90.31.13:4628 , piece_id=XMP7M7ILT5U7UXGYSM4UB5VBMWUHIDRGTZPLZRYLK3W2NTM4WEDQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.708417285 (81h20m56.430980325s) [noise=true , address=77.90.31.15:4699 , piece_id=AL7HA5TX46M3ZF2BOZGNGGFJ5IHHSDRT4YHUN2XEL2XPEMLISRWQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.711882846 (81h20m56.434445886s) [noise=true , address=45.91.116.14:4190 , piece_id=G4FLK67VLPGRJJUNECETUKGYS3OMQA4CGBKCWPDHVHT632JUHMBQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.730484234 (81h20m56.453047274s) [noise=true , address=45.91.116.8:4047 , piece_id=VTO4NXZJKRF4SDOLNBTOUC4T6LD7UGCHJQTJOGGS2LPF7CPZWGIA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.733559909 (81h20m56.456122949s) [noise=true , address=77.90.31.16:4734 , piece_id=GJJTLE73ATBF2FSCY7QOGWXORADSKXLJXNGDH34DZTSPPTQKSXJA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.761219480 (81h20m56.48378252s) [noise=true , address=45.91.116.11:4118 , piece_id=WAANSRE3AOQ74X575MUJEMFZVVSGECFE5IXRID6UFB6LMK76G5VQ, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.764041981 (81h20m56.486605021s) [noise=true , address=77.90.31.10:4520 , piece_id=XECJATSD772ZU45XV2KDWE67C2MQHRH7J2MLTCPWHZLWA7YKF36Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: <nil> Jul 27 20:56:46.764051749 (81h20m56.486614789s) [seg_pos={0 0}, upload=78076]: Segment reached optimal threshold of 13 pieces. Jul 27 20:56:46.764265288 (81h20m56.486828328s) [noise=true , address=45.91.116.7:4011 , piece_id=4MZ6Y2VDJEYHGHOM7QIO4OB5OF3EYPXCACP5UR7V2BCZN7PN4T4Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764492743 (81h20m56.487055783s) [noise=true , address=45.91.116.7:4010 , piece_id=QJCPKYGZ2MJGMIZGDXIDQDZQMEE2HUBWXZ7KRAGIJD564MOQWX2Q, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764577445 (81h20m56.487140485s) [noise=true , address=77.90.31.18:4806 , piece_id=PECBEVTQRQJUPRHUS2FDKQHQF4EAAXW226HVFYM5EGCF72ZKRXEA, seg_pos={0 0}, upload=78076]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF Jul 27 20:56:46.764592364 (81h20m56.487155404s) [seg_pos={0 0}, upload=78076]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 20:56:46.764671274 (81h20m56.487234314s) [upload=78076]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 20:56:46.764675643 (81h20m56.487238673s) [upload=78076]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 20:56:47.043439135 (81h20m56.766002255s) [upload=78076]: Done uploading segments... Jul 27 20:56:47.043463021 (81h20m56.766026061s) [upload=78076]: Upload finished. err: <nil> Duration: 5.757477808s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)