Orbiter History

checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 6.010258023s FAIL (2025-07-01 13:31:02 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.010290997s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 5.744696691s FAIL (2025-07-01 13:30:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.744728372s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 5.891542089s FAIL (2025-07-01 13:30:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.892045964s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 5.620878564s FAIL (2025-07-01 13:30:02 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF Jul 1 13:23:32.267561192 (196h13m7.038202527s) [seg_pos={0 0}, upload=156954]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 13:23:32.267626126 (196h13m7.038267511s) [upload=156954]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 13:23:32.267633580 (196h13m7.038274955s) [upload=156954]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 13:23:32.564479871 (196h13m7.335121206s) [upload=156954]: Done uploading segments... Jul 1 13:23:32.564498377 (196h13m7.335139702s) [upload=156954]: Upload finished. err: <nil> Jul 1 13:24:29.560888309 (196h14m4.331529644s) [upload=156965]: Starting upload Jul 1 13:24:29.560940799 (196h14m4.331582124s) [upload=156965]: Done starting upload Jul 1 13:24:29.561122977 (196h14m4.331764312s) [upload=156965]: Uploading segments... Jul 1 13:24:29.561173023 (196h14m4.331814358s) [upload=156965]: Got next segment. Inline: false Jul 1 13:24:29.561201949 (196h14m4.331843284s) [upload=156965]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 1 13:24:29.561206607 (196h14m4.331847942s) [upload=156965]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 1 13:24:29.805112380 (196h14m4.575753715s) [seg_pos={0 0}, upload=156965]: Begin upload segment... Jul 1 13:24:29.805161915 (196h14m4.57580324s) [seg_pos={0 0}, upload=156965]: Done begin upload segment. Jul 1 13:24:29.805196952 (196h14m4.575838287s) [noise=true , address=45.91.116.5:5297 , piece_id=HL3OFARGL3745TS3HQF6A52ILFP2NKN4U57TQIJXGSCFWQ3ZM5IQ, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.805367638 (196h14m4.576008973s) [noise=true , address=104.36.82.7:4911 , piece_id=7H7L7EW63TFAOURC55GSD7ZXHCH23VU575QU4FFROILFBTC52ANA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.805862585 (196h14m4.57650392s) [noise=true , address=77.90.31.10:4518 , piece_id=DRWBG6EFBMV5LBR4WE3RTFSABHVVQW47KWQH7I3J5EUBZLI3RMSQ, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.806151198 (196h14m4.576792533s) [noise=true , address=77.90.31.17:4770 , piece_id=ODZ5ZLOHG5LMNKZLZKKEUNSADF6OREA564L3WMGUTXAIG4CK46QA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.806405574 (196h14m4.577046909s) [noise=true , address=104.36.82.13:4187 , piece_id=KX55KOFMDJ2GJ5R3T75VZCELDRCJBZ6L4TZFPOVEX2JPPNOAB66A, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.806538769 (196h14m4.577180114s) [noise=true , address=45.91.116.4:4938 , piece_id=KVH7H24CFUSL3763MANE4ASNVTNR7PBQSNNKFNRNB754XYH5GQXA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.806644702 (196h14m4.577286037s) [noise=true , address=77.90.31.15:4699 , piece_id=O7BT75G4Y2Y453MSKTDXQXGHTJW7MK4JHNRNAHHGBXWQIQ4BMMVQ, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.806872938 (196h14m4.577514273s) [noise=true , address=104.36.82.6:4875 , piece_id=634PATJDQZFE5SPLJKHMJ6RFF6HEXMCM6EZF6CR5AXQJVV3UZVNA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.807087589 (196h14m4.577728924s) [noise=true , address=45.91.116.6:4975 , piece_id=4JEPXGYVKTWUGZBT6JZWJFYVO4GSKEKWYJEBIFW3K7ORCPFARGQA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.807106134 (196h14m4.577747469s) [noise=true , address=45.91.116.4:4940 , piece_id=H5GRLBRIHR5O5PURBAQ4YOBHBZK7SLUVOQWJD6ZY3MCHUATJEDQQ, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.807323490 (196h14m4.577964825s) [noise=true , address=104.36.82.2:4731 , piece_id=SUVIT3Q2373VGKIRIRHSE5A5HW4MICHKXDY6DTF47KQNQ4YHMGRA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.807552468 (196h14m4.578193803s) [noise=true , address=104.36.82.8:4970 , piece_id=23YGAZWYSDY4UM2MVMBXOEY4PRQPTND3ZOAYD4XXOC5IDIJPNVDA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.808051863 (196h14m4.578693198s) [noise=true , address=45.91.116.14:4189 , piece_id=4B6UKVAS4NSIESCQ3VSVJWZSZVZSSPD6CP3TU4QHYPGZSWZ4WN7A, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.808466777 (196h14m4.579108122s) [noise=true , address=104.36.82.15:4259 , piece_id=KRLCC26TFIA2HHHICUFWW4JEUWMUUDZCS7JIBMAATXZTTXDUNLTA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.809998528 (196h14m4.580639853s) [noise=true , address=104.36.82.14:4222 , piece_id=BRRPFTGE4VQE7FAVBCCFSSOC5SVJ3MAZAYMX4FW2SWEGJNXY4O6A, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.810327147 (196h14m4.580968482s) [noise=true , address=104.36.82.10:4078 , piece_id=IKGLBYC7NJXPNXHVOAJCZKUAOU4DVLZMG3E3W2FOCTYTI2QW2MLQ, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:31.567215995 (196h14m6.33785733s) [upload=156965]: Next returned nil segment Jul 1 13:24:31.567238518 (196h14m6.337879853s) [upload=156965]: Waiting for error group managing segments... Jul 1 13:24:31.849330083 (196h14m6.619971418s) [noise=true , address=45.91.116.5:5297 , piece_id=HL3OFARGL3745TS3HQF6A52ILFP2NKN4U57TQIJXGSCFWQ3ZM5IQ, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:31.868737580 (196h14m6.639378915s) [noise=true , address=45.91.116.4:4940 , piece_id=H5GRLBRIHR5O5PURBAQ4YOBHBZK7SLUVOQWJD6ZY3MCHUATJEDQQ, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:31.870984328 (196h14m6.641625663s) [noise=true , address=45.91.116.6:4975 , piece_id=4JEPXGYVKTWUGZBT6JZWJFYVO4GSKEKWYJEBIFW3K7ORCPFARGQA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:31.890536413 (196h14m6.661177738s) [noise=true , address=45.91.116.14:4189 , piece_id=4B6UKVAS4NSIESCQ3VSVJWZSZVZSSPD6CP3TU4QHYPGZSWZ4WN7A, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:31.904306657 (196h14m6.674947992s) [noise=true , address=77.90.31.10:4518 , piece_id=DRWBG6EFBMV5LBR4WE3RTFSABHVVQW47KWQH7I3J5EUBZLI3RMSQ, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:31.941272175 (196h14m6.7119135s) [noise=true , address=45.91.116.4:4938 , piece_id=KVH7H24CFUSL3763MANE4ASNVTNR7PBQSNNKFNRNB754XYH5GQXA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:31.943798498 (196h14m6.714439833s) [noise=true , address=77.90.31.17:4770 , piece_id=ODZ5ZLOHG5LMNKZLZKKEUNSADF6OREA564L3WMGUTXAIG4CK46QA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:32.011600759 (196h14m6.782242094s) [noise=true , address=77.90.31.15:4699 , piece_id=O7BT75G4Y2Y453MSKTDXQXGHTJW7MK4JHNRNAHHGBXWQIQ4BMMVQ, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:32.130468763 (196h14m6.901110098s) [noise=true , address=104.36.82.15:4259 , piece_id=KRLCC26TFIA2HHHICUFWW4JEUWMUUDZCS7JIBMAATXZTTXDUNLTA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:32.284626620 (196h14m7.055267955s) [noise=true , address=104.36.82.14:4222 , piece_id=BRRPFTGE4VQE7FAVBCCFSSOC5SVJ3MAZAYMX4FW2SWEGJNXY4O6A, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:32.608427086 (196h14m7.379068421s) [noise=true , address=104.36.82.8:4970 , piece_id=23YGAZWYSDY4UM2MVMBXOEY4PRQPTND3ZOAYD4XXOC5IDIJPNVDA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:32.619299124 (196h14m7.389940449s) [noise=true , address=104.36.82.7:4911 , piece_id=7H7L7EW63TFAOURC55GSD7ZXHCH23VU575QU4FFROILFBTC52ANA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:32.624723432 (196h14m7.395364767s) [noise=true , address=104.36.82.13:4187 , piece_id=KX55KOFMDJ2GJ5R3T75VZCELDRCJBZ6L4TZFPOVEX2JPPNOAB66A, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:32.624745435 (196h14m7.39538677s) [seg_pos={0 0}, upload=156965]: Segment reached optimal threshold of 13 pieces. Jul 1 13:24:32.624861536 (196h14m7.395502872s) [noise=true , address=104.36.82.10:4078 , piece_id=IKGLBYC7NJXPNXHVOAJCZKUAOU4DVLZMG3E3W2FOCTYTI2QW2MLQ, seg_pos={0 0}, upload=156965]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 1 13:24:32.624920279 (196h14m7.395561614s) [noise=true , address=104.36.82.6:4875 , piece_id=634PATJDQZFE5SPLJKHMJ6RFF6HEXMCM6EZF6CR5AXQJVV3UZVNA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Jul 1 13:24:32.624980784 (196h14m7.395622119s) [noise=true , address=104.36.82.2:4731 , piece_id=SUVIT3Q2373VGKIRIRHSE5A5HW4MICHKXDY6DTF47KQNQ4YHMGRA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9): protocol: write tcp 188.166.225.170:44914->104.36.82.2:4731: use of closed network connection; write tcp 188.166.225.170:44914->104.36.82.2:4731: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44914->104.36.82.2:4731: use of closed network connection Jul 1 13:24:32.624996214 (196h14m7.395637549s) [seg_pos={0 0}, upload=156965]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 13:24:32.625055297 (196h14m7.395696622s) [upload=156965]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 13:24:32.625059255 (196h14m7.39570059s) [upload=156965]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 13:24:32.928530190 (196h14m7.699171545s) [upload=156965]: Done uploading segments... Jul 1 13:24:32.928576809 (196h14m7.699218184s) [upload=156965]: Upload finished. err: <nil> Duration: 5.620911859s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 6.443621356s FAIL (2025-07-01 13:29:54 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.44364422s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 5.802085365s FAIL (2025-07-01 13:29:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.802105954s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 5.799141211s FAIL (2025-07-01 13:29:18 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF Jul 1 13:23:32.267561192 (196h13m7.038202527s) [seg_pos={0 0}, upload=156954]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 13:23:32.267626126 (196h13m7.038267511s) [upload=156954]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 13:23:32.267633580 (196h13m7.038274955s) [upload=156954]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 13:23:32.564479871 (196h13m7.335121206s) [upload=156954]: Done uploading segments... Jul 1 13:23:32.564498377 (196h13m7.335139702s) [upload=156954]: Upload finished. err: <nil> Jul 1 13:24:29.560888309 (196h14m4.331529644s) [upload=156965]: Starting upload Jul 1 13:24:29.560940799 (196h14m4.331582124s) [upload=156965]: Done starting upload Jul 1 13:24:29.561122977 (196h14m4.331764312s) [upload=156965]: Uploading segments... Jul 1 13:24:29.561173023 (196h14m4.331814358s) [upload=156965]: Got next segment. Inline: false Jul 1 13:24:29.561201949 (196h14m4.331843284s) [upload=156965]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 1 13:24:29.561206607 (196h14m4.331847942s) [upload=156965]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 1 13:24:29.805112380 (196h14m4.575753715s) [seg_pos={0 0}, upload=156965]: Begin upload segment... Jul 1 13:24:29.805161915 (196h14m4.57580324s) [seg_pos={0 0}, upload=156965]: Done begin upload segment. Jul 1 13:24:29.805196952 (196h14m4.575838287s) [noise=true , address=45.91.116.5:5297 , piece_id=HL3OFARGL3745TS3HQF6A52ILFP2NKN4U57TQIJXGSCFWQ3ZM5IQ, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.805367638 (196h14m4.576008973s) [noise=true , address=104.36.82.7:4911 , piece_id=7H7L7EW63TFAOURC55GSD7ZXHCH23VU575QU4FFROILFBTC52ANA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.805862585 (196h14m4.57650392s) [noise=true , address=77.90.31.10:4518 , piece_id=DRWBG6EFBMV5LBR4WE3RTFSABHVVQW47KWQH7I3J5EUBZLI3RMSQ, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.806151198 (196h14m4.576792533s) [noise=true , address=77.90.31.17:4770 , piece_id=ODZ5ZLOHG5LMNKZLZKKEUNSADF6OREA564L3WMGUTXAIG4CK46QA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.806405574 (196h14m4.577046909s) [noise=true , address=104.36.82.13:4187 , piece_id=KX55KOFMDJ2GJ5R3T75VZCELDRCJBZ6L4TZFPOVEX2JPPNOAB66A, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.806538769 (196h14m4.577180114s) [noise=true , address=45.91.116.4:4938 , piece_id=KVH7H24CFUSL3763MANE4ASNVTNR7PBQSNNKFNRNB754XYH5GQXA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.806644702 (196h14m4.577286037s) [noise=true , address=77.90.31.15:4699 , piece_id=O7BT75G4Y2Y453MSKTDXQXGHTJW7MK4JHNRNAHHGBXWQIQ4BMMVQ, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.806872938 (196h14m4.577514273s) [noise=true , address=104.36.82.6:4875 , piece_id=634PATJDQZFE5SPLJKHMJ6RFF6HEXMCM6EZF6CR5AXQJVV3UZVNA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.807087589 (196h14m4.577728924s) [noise=true , address=45.91.116.6:4975 , piece_id=4JEPXGYVKTWUGZBT6JZWJFYVO4GSKEKWYJEBIFW3K7ORCPFARGQA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.807106134 (196h14m4.577747469s) [noise=true , address=45.91.116.4:4940 , piece_id=H5GRLBRIHR5O5PURBAQ4YOBHBZK7SLUVOQWJD6ZY3MCHUATJEDQQ, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.807323490 (196h14m4.577964825s) [noise=true , address=104.36.82.2:4731 , piece_id=SUVIT3Q2373VGKIRIRHSE5A5HW4MICHKXDY6DTF47KQNQ4YHMGRA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.807552468 (196h14m4.578193803s) [noise=true , address=104.36.82.8:4970 , piece_id=23YGAZWYSDY4UM2MVMBXOEY4PRQPTND3ZOAYD4XXOC5IDIJPNVDA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.808051863 (196h14m4.578693198s) [noise=true , address=45.91.116.14:4189 , piece_id=4B6UKVAS4NSIESCQ3VSVJWZSZVZSSPD6CP3TU4QHYPGZSWZ4WN7A, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.808466777 (196h14m4.579108122s) [noise=true , address=104.36.82.15:4259 , piece_id=KRLCC26TFIA2HHHICUFWW4JEUWMUUDZCS7JIBMAATXZTTXDUNLTA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.809998528 (196h14m4.580639853s) [noise=true , address=104.36.82.14:4222 , piece_id=BRRPFTGE4VQE7FAVBCCFSSOC5SVJ3MAZAYMX4FW2SWEGJNXY4O6A, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.810327147 (196h14m4.580968482s) [noise=true , address=104.36.82.10:4078 , piece_id=IKGLBYC7NJXPNXHVOAJCZKUAOU4DVLZMG3E3W2FOCTYTI2QW2MLQ, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:31.567215995 (196h14m6.33785733s) [upload=156965]: Next returned nil segment Jul 1 13:24:31.567238518 (196h14m6.337879853s) [upload=156965]: Waiting for error group managing segments... Jul 1 13:24:31.849330083 (196h14m6.619971418s) [noise=true , address=45.91.116.5:5297 , piece_id=HL3OFARGL3745TS3HQF6A52ILFP2NKN4U57TQIJXGSCFWQ3ZM5IQ, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:31.868737580 (196h14m6.639378915s) [noise=true , address=45.91.116.4:4940 , piece_id=H5GRLBRIHR5O5PURBAQ4YOBHBZK7SLUVOQWJD6ZY3MCHUATJEDQQ, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:31.870984328 (196h14m6.641625663s) [noise=true , address=45.91.116.6:4975 , piece_id=4JEPXGYVKTWUGZBT6JZWJFYVO4GSKEKWYJEBIFW3K7ORCPFARGQA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:31.890536413 (196h14m6.661177738s) [noise=true , address=45.91.116.14:4189 , piece_id=4B6UKVAS4NSIESCQ3VSVJWZSZVZSSPD6CP3TU4QHYPGZSWZ4WN7A, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:31.904306657 (196h14m6.674947992s) [noise=true , address=77.90.31.10:4518 , piece_id=DRWBG6EFBMV5LBR4WE3RTFSABHVVQW47KWQH7I3J5EUBZLI3RMSQ, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:31.941272175 (196h14m6.7119135s) [noise=true , address=45.91.116.4:4938 , piece_id=KVH7H24CFUSL3763MANE4ASNVTNR7PBQSNNKFNRNB754XYH5GQXA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:31.943798498 (196h14m6.714439833s) [noise=true , address=77.90.31.17:4770 , piece_id=ODZ5ZLOHG5LMNKZLZKKEUNSADF6OREA564L3WMGUTXAIG4CK46QA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:32.011600759 (196h14m6.782242094s) [noise=true , address=77.90.31.15:4699 , piece_id=O7BT75G4Y2Y453MSKTDXQXGHTJW7MK4JHNRNAHHGBXWQIQ4BMMVQ, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:32.130468763 (196h14m6.901110098s) [noise=true , address=104.36.82.15:4259 , piece_id=KRLCC26TFIA2HHHICUFWW4JEUWMUUDZCS7JIBMAATXZTTXDUNLTA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:32.284626620 (196h14m7.055267955s) [noise=true , address=104.36.82.14:4222 , piece_id=BRRPFTGE4VQE7FAVBCCFSSOC5SVJ3MAZAYMX4FW2SWEGJNXY4O6A, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:32.608427086 (196h14m7.379068421s) [noise=true , address=104.36.82.8:4970 , piece_id=23YGAZWYSDY4UM2MVMBXOEY4PRQPTND3ZOAYD4XXOC5IDIJPNVDA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:32.619299124 (196h14m7.389940449s) [noise=true , address=104.36.82.7:4911 , piece_id=7H7L7EW63TFAOURC55GSD7ZXHCH23VU575QU4FFROILFBTC52ANA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:32.624723432 (196h14m7.395364767s) [noise=true , address=104.36.82.13:4187 , piece_id=KX55KOFMDJ2GJ5R3T75VZCELDRCJBZ6L4TZFPOVEX2JPPNOAB66A, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:32.624745435 (196h14m7.39538677s) [seg_pos={0 0}, upload=156965]: Segment reached optimal threshold of 13 pieces. Jul 1 13:24:32.624861536 (196h14m7.395502872s) [noise=true , address=104.36.82.10:4078 , piece_id=IKGLBYC7NJXPNXHVOAJCZKUAOU4DVLZMG3E3W2FOCTYTI2QW2MLQ, seg_pos={0 0}, upload=156965]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 1 13:24:32.624920279 (196h14m7.395561614s) [noise=true , address=104.36.82.6:4875 , piece_id=634PATJDQZFE5SPLJKHMJ6RFF6HEXMCM6EZF6CR5AXQJVV3UZVNA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Jul 1 13:24:32.624980784 (196h14m7.395622119s) [noise=true , address=104.36.82.2:4731 , piece_id=SUVIT3Q2373VGKIRIRHSE5A5HW4MICHKXDY6DTF47KQNQ4YHMGRA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9): protocol: write tcp 188.166.225.170:44914->104.36.82.2:4731: use of closed network connection; write tcp 188.166.225.170:44914->104.36.82.2:4731: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44914->104.36.82.2:4731: use of closed network connection Jul 1 13:24:32.624996214 (196h14m7.395637549s) [seg_pos={0 0}, upload=156965]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 13:24:32.625055297 (196h14m7.395696622s) [upload=156965]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 13:24:32.625059255 (196h14m7.39570059s) [upload=156965]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 13:24:32.928530190 (196h14m7.699171545s) [upload=156965]: Done uploading segments... Jul 1 13:24:32.928576809 (196h14m7.699218184s) [upload=156965]: Upload finished. err: <nil> Duration: 5.79917693s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 5.721328044s FAIL (2025-07-01 13:28:59 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF Jul 1 13:23:32.267561192 (196h13m7.038202527s) [seg_pos={0 0}, upload=156954]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 13:23:32.267626126 (196h13m7.038267511s) [upload=156954]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 13:23:32.267633580 (196h13m7.038274955s) [upload=156954]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 13:23:32.564479871 (196h13m7.335121206s) [upload=156954]: Done uploading segments... Jul 1 13:23:32.564498377 (196h13m7.335139702s) [upload=156954]: Upload finished. err: <nil> Jul 1 13:24:29.560888309 (196h14m4.331529644s) [upload=156965]: Starting upload Jul 1 13:24:29.560940799 (196h14m4.331582124s) [upload=156965]: Done starting upload Jul 1 13:24:29.561122977 (196h14m4.331764312s) [upload=156965]: Uploading segments... Jul 1 13:24:29.561173023 (196h14m4.331814358s) [upload=156965]: Got next segment. Inline: false Jul 1 13:24:29.561201949 (196h14m4.331843284s) [upload=156965]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 1 13:24:29.561206607 (196h14m4.331847942s) [upload=156965]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 1 13:24:29.805112380 (196h14m4.575753715s) [seg_pos={0 0}, upload=156965]: Begin upload segment... Jul 1 13:24:29.805161915 (196h14m4.57580324s) [seg_pos={0 0}, upload=156965]: Done begin upload segment. Jul 1 13:24:29.805196952 (196h14m4.575838287s) [noise=true , address=45.91.116.5:5297 , piece_id=HL3OFARGL3745TS3HQF6A52ILFP2NKN4U57TQIJXGSCFWQ3ZM5IQ, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.805367638 (196h14m4.576008973s) [noise=true , address=104.36.82.7:4911 , piece_id=7H7L7EW63TFAOURC55GSD7ZXHCH23VU575QU4FFROILFBTC52ANA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.805862585 (196h14m4.57650392s) [noise=true , address=77.90.31.10:4518 , piece_id=DRWBG6EFBMV5LBR4WE3RTFSABHVVQW47KWQH7I3J5EUBZLI3RMSQ, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.806151198 (196h14m4.576792533s) [noise=true , address=77.90.31.17:4770 , piece_id=ODZ5ZLOHG5LMNKZLZKKEUNSADF6OREA564L3WMGUTXAIG4CK46QA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.806405574 (196h14m4.577046909s) [noise=true , address=104.36.82.13:4187 , piece_id=KX55KOFMDJ2GJ5R3T75VZCELDRCJBZ6L4TZFPOVEX2JPPNOAB66A, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.806538769 (196h14m4.577180114s) [noise=true , address=45.91.116.4:4938 , piece_id=KVH7H24CFUSL3763MANE4ASNVTNR7PBQSNNKFNRNB754XYH5GQXA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.806644702 (196h14m4.577286037s) [noise=true , address=77.90.31.15:4699 , piece_id=O7BT75G4Y2Y453MSKTDXQXGHTJW7MK4JHNRNAHHGBXWQIQ4BMMVQ, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.806872938 (196h14m4.577514273s) [noise=true , address=104.36.82.6:4875 , piece_id=634PATJDQZFE5SPLJKHMJ6RFF6HEXMCM6EZF6CR5AXQJVV3UZVNA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.807087589 (196h14m4.577728924s) [noise=true , address=45.91.116.6:4975 , piece_id=4JEPXGYVKTWUGZBT6JZWJFYVO4GSKEKWYJEBIFW3K7ORCPFARGQA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.807106134 (196h14m4.577747469s) [noise=true , address=45.91.116.4:4940 , piece_id=H5GRLBRIHR5O5PURBAQ4YOBHBZK7SLUVOQWJD6ZY3MCHUATJEDQQ, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.807323490 (196h14m4.577964825s) [noise=true , address=104.36.82.2:4731 , piece_id=SUVIT3Q2373VGKIRIRHSE5A5HW4MICHKXDY6DTF47KQNQ4YHMGRA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.807552468 (196h14m4.578193803s) [noise=true , address=104.36.82.8:4970 , piece_id=23YGAZWYSDY4UM2MVMBXOEY4PRQPTND3ZOAYD4XXOC5IDIJPNVDA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.808051863 (196h14m4.578693198s) [noise=true , address=45.91.116.14:4189 , piece_id=4B6UKVAS4NSIESCQ3VSVJWZSZVZSSPD6CP3TU4QHYPGZSWZ4WN7A, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.808466777 (196h14m4.579108122s) [noise=true , address=104.36.82.15:4259 , piece_id=KRLCC26TFIA2HHHICUFWW4JEUWMUUDZCS7JIBMAATXZTTXDUNLTA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.809998528 (196h14m4.580639853s) [noise=true , address=104.36.82.14:4222 , piece_id=BRRPFTGE4VQE7FAVBCCFSSOC5SVJ3MAZAYMX4FW2SWEGJNXY4O6A, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.810327147 (196h14m4.580968482s) [noise=true , address=104.36.82.10:4078 , piece_id=IKGLBYC7NJXPNXHVOAJCZKUAOU4DVLZMG3E3W2FOCTYTI2QW2MLQ, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:31.567215995 (196h14m6.33785733s) [upload=156965]: Next returned nil segment Jul 1 13:24:31.567238518 (196h14m6.337879853s) [upload=156965]: Waiting for error group managing segments... Jul 1 13:24:31.849330083 (196h14m6.619971418s) [noise=true , address=45.91.116.5:5297 , piece_id=HL3OFARGL3745TS3HQF6A52ILFP2NKN4U57TQIJXGSCFWQ3ZM5IQ, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:31.868737580 (196h14m6.639378915s) [noise=true , address=45.91.116.4:4940 , piece_id=H5GRLBRIHR5O5PURBAQ4YOBHBZK7SLUVOQWJD6ZY3MCHUATJEDQQ, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:31.870984328 (196h14m6.641625663s) [noise=true , address=45.91.116.6:4975 , piece_id=4JEPXGYVKTWUGZBT6JZWJFYVO4GSKEKWYJEBIFW3K7ORCPFARGQA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:31.890536413 (196h14m6.661177738s) [noise=true , address=45.91.116.14:4189 , piece_id=4B6UKVAS4NSIESCQ3VSVJWZSZVZSSPD6CP3TU4QHYPGZSWZ4WN7A, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:31.904306657 (196h14m6.674947992s) [noise=true , address=77.90.31.10:4518 , piece_id=DRWBG6EFBMV5LBR4WE3RTFSABHVVQW47KWQH7I3J5EUBZLI3RMSQ, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:31.941272175 (196h14m6.7119135s) [noise=true , address=45.91.116.4:4938 , piece_id=KVH7H24CFUSL3763MANE4ASNVTNR7PBQSNNKFNRNB754XYH5GQXA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:31.943798498 (196h14m6.714439833s) [noise=true , address=77.90.31.17:4770 , piece_id=ODZ5ZLOHG5LMNKZLZKKEUNSADF6OREA564L3WMGUTXAIG4CK46QA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:32.011600759 (196h14m6.782242094s) [noise=true , address=77.90.31.15:4699 , piece_id=O7BT75G4Y2Y453MSKTDXQXGHTJW7MK4JHNRNAHHGBXWQIQ4BMMVQ, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:32.130468763 (196h14m6.901110098s) [noise=true , address=104.36.82.15:4259 , piece_id=KRLCC26TFIA2HHHICUFWW4JEUWMUUDZCS7JIBMAATXZTTXDUNLTA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:32.284626620 (196h14m7.055267955s) [noise=true , address=104.36.82.14:4222 , piece_id=BRRPFTGE4VQE7FAVBCCFSSOC5SVJ3MAZAYMX4FW2SWEGJNXY4O6A, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:32.608427086 (196h14m7.379068421s) [noise=true , address=104.36.82.8:4970 , piece_id=23YGAZWYSDY4UM2MVMBXOEY4PRQPTND3ZOAYD4XXOC5IDIJPNVDA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:32.619299124 (196h14m7.389940449s) [noise=true , address=104.36.82.7:4911 , piece_id=7H7L7EW63TFAOURC55GSD7ZXHCH23VU575QU4FFROILFBTC52ANA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:32.624723432 (196h14m7.395364767s) [noise=true , address=104.36.82.13:4187 , piece_id=KX55KOFMDJ2GJ5R3T75VZCELDRCJBZ6L4TZFPOVEX2JPPNOAB66A, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:32.624745435 (196h14m7.39538677s) [seg_pos={0 0}, upload=156965]: Segment reached optimal threshold of 13 pieces. Jul 1 13:24:32.624861536 (196h14m7.395502872s) [noise=true , address=104.36.82.10:4078 , piece_id=IKGLBYC7NJXPNXHVOAJCZKUAOU4DVLZMG3E3W2FOCTYTI2QW2MLQ, seg_pos={0 0}, upload=156965]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 1 13:24:32.624920279 (196h14m7.395561614s) [noise=true , address=104.36.82.6:4875 , piece_id=634PATJDQZFE5SPLJKHMJ6RFF6HEXMCM6EZF6CR5AXQJVV3UZVNA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Jul 1 13:24:32.624980784 (196h14m7.395622119s) [noise=true , address=104.36.82.2:4731 , piece_id=SUVIT3Q2373VGKIRIRHSE5A5HW4MICHKXDY6DTF47KQNQ4YHMGRA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9): protocol: write tcp 188.166.225.170:44914->104.36.82.2:4731: use of closed network connection; write tcp 188.166.225.170:44914->104.36.82.2:4731: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44914->104.36.82.2:4731: use of closed network connection Jul 1 13:24:32.624996214 (196h14m7.395637549s) [seg_pos={0 0}, upload=156965]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 13:24:32.625055297 (196h14m7.395696622s) [upload=156965]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 13:24:32.625059255 (196h14m7.39570059s) [upload=156965]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 13:24:32.928530190 (196h14m7.699171545s) [upload=156965]: Done uploading segments... Jul 1 13:24:32.928576809 (196h14m7.699218184s) [upload=156965]: Upload finished. err: <nil> Duration: 5.721359675s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 6.332670349s FAIL (2025-07-01 13:28:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.33269124s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 5.518456508s FAIL (2025-07-01 13:28:43 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.518669736s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 5.68903977s FAIL (2025-07-01 13:28:17 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF Jul 1 13:23:32.267561192 (196h13m7.038202527s) [seg_pos={0 0}, upload=156954]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 13:23:32.267626126 (196h13m7.038267511s) [upload=156954]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 13:23:32.267633580 (196h13m7.038274955s) [upload=156954]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 13:23:32.564479871 (196h13m7.335121206s) [upload=156954]: Done uploading segments... Jul 1 13:23:32.564498377 (196h13m7.335139702s) [upload=156954]: Upload finished. err: <nil> Jul 1 13:24:29.560888309 (196h14m4.331529644s) [upload=156965]: Starting upload Jul 1 13:24:29.560940799 (196h14m4.331582124s) [upload=156965]: Done starting upload Jul 1 13:24:29.561122977 (196h14m4.331764312s) [upload=156965]: Uploading segments... Jul 1 13:24:29.561173023 (196h14m4.331814358s) [upload=156965]: Got next segment. Inline: false Jul 1 13:24:29.561201949 (196h14m4.331843284s) [upload=156965]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 1 13:24:29.561206607 (196h14m4.331847942s) [upload=156965]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 1 13:24:29.805112380 (196h14m4.575753715s) [seg_pos={0 0}, upload=156965]: Begin upload segment... Jul 1 13:24:29.805161915 (196h14m4.57580324s) [seg_pos={0 0}, upload=156965]: Done begin upload segment. Jul 1 13:24:29.805196952 (196h14m4.575838287s) [noise=true , address=45.91.116.5:5297 , piece_id=HL3OFARGL3745TS3HQF6A52ILFP2NKN4U57TQIJXGSCFWQ3ZM5IQ, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.805367638 (196h14m4.576008973s) [noise=true , address=104.36.82.7:4911 , piece_id=7H7L7EW63TFAOURC55GSD7ZXHCH23VU575QU4FFROILFBTC52ANA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.805862585 (196h14m4.57650392s) [noise=true , address=77.90.31.10:4518 , piece_id=DRWBG6EFBMV5LBR4WE3RTFSABHVVQW47KWQH7I3J5EUBZLI3RMSQ, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.806151198 (196h14m4.576792533s) [noise=true , address=77.90.31.17:4770 , piece_id=ODZ5ZLOHG5LMNKZLZKKEUNSADF6OREA564L3WMGUTXAIG4CK46QA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.806405574 (196h14m4.577046909s) [noise=true , address=104.36.82.13:4187 , piece_id=KX55KOFMDJ2GJ5R3T75VZCELDRCJBZ6L4TZFPOVEX2JPPNOAB66A, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.806538769 (196h14m4.577180114s) [noise=true , address=45.91.116.4:4938 , piece_id=KVH7H24CFUSL3763MANE4ASNVTNR7PBQSNNKFNRNB754XYH5GQXA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.806644702 (196h14m4.577286037s) [noise=true , address=77.90.31.15:4699 , piece_id=O7BT75G4Y2Y453MSKTDXQXGHTJW7MK4JHNRNAHHGBXWQIQ4BMMVQ, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.806872938 (196h14m4.577514273s) [noise=true , address=104.36.82.6:4875 , piece_id=634PATJDQZFE5SPLJKHMJ6RFF6HEXMCM6EZF6CR5AXQJVV3UZVNA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.807087589 (196h14m4.577728924s) [noise=true , address=45.91.116.6:4975 , piece_id=4JEPXGYVKTWUGZBT6JZWJFYVO4GSKEKWYJEBIFW3K7ORCPFARGQA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.807106134 (196h14m4.577747469s) [noise=true , address=45.91.116.4:4940 , piece_id=H5GRLBRIHR5O5PURBAQ4YOBHBZK7SLUVOQWJD6ZY3MCHUATJEDQQ, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.807323490 (196h14m4.577964825s) [noise=true , address=104.36.82.2:4731 , piece_id=SUVIT3Q2373VGKIRIRHSE5A5HW4MICHKXDY6DTF47KQNQ4YHMGRA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.807552468 (196h14m4.578193803s) [noise=true , address=104.36.82.8:4970 , piece_id=23YGAZWYSDY4UM2MVMBXOEY4PRQPTND3ZOAYD4XXOC5IDIJPNVDA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.808051863 (196h14m4.578693198s) [noise=true , address=45.91.116.14:4189 , piece_id=4B6UKVAS4NSIESCQ3VSVJWZSZVZSSPD6CP3TU4QHYPGZSWZ4WN7A, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.808466777 (196h14m4.579108122s) [noise=true , address=104.36.82.15:4259 , piece_id=KRLCC26TFIA2HHHICUFWW4JEUWMUUDZCS7JIBMAATXZTTXDUNLTA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.809998528 (196h14m4.580639853s) [noise=true , address=104.36.82.14:4222 , piece_id=BRRPFTGE4VQE7FAVBCCFSSOC5SVJ3MAZAYMX4FW2SWEGJNXY4O6A, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.810327147 (196h14m4.580968482s) [noise=true , address=104.36.82.10:4078 , piece_id=IKGLBYC7NJXPNXHVOAJCZKUAOU4DVLZMG3E3W2FOCTYTI2QW2MLQ, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:31.567215995 (196h14m6.33785733s) [upload=156965]: Next returned nil segment Jul 1 13:24:31.567238518 (196h14m6.337879853s) [upload=156965]: Waiting for error group managing segments... Jul 1 13:24:31.849330083 (196h14m6.619971418s) [noise=true , address=45.91.116.5:5297 , piece_id=HL3OFARGL3745TS3HQF6A52ILFP2NKN4U57TQIJXGSCFWQ3ZM5IQ, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:31.868737580 (196h14m6.639378915s) [noise=true , address=45.91.116.4:4940 , piece_id=H5GRLBRIHR5O5PURBAQ4YOBHBZK7SLUVOQWJD6ZY3MCHUATJEDQQ, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:31.870984328 (196h14m6.641625663s) [noise=true , address=45.91.116.6:4975 , piece_id=4JEPXGYVKTWUGZBT6JZWJFYVO4GSKEKWYJEBIFW3K7ORCPFARGQA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:31.890536413 (196h14m6.661177738s) [noise=true , address=45.91.116.14:4189 , piece_id=4B6UKVAS4NSIESCQ3VSVJWZSZVZSSPD6CP3TU4QHYPGZSWZ4WN7A, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:31.904306657 (196h14m6.674947992s) [noise=true , address=77.90.31.10:4518 , piece_id=DRWBG6EFBMV5LBR4WE3RTFSABHVVQW47KWQH7I3J5EUBZLI3RMSQ, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:31.941272175 (196h14m6.7119135s) [noise=true , address=45.91.116.4:4938 , piece_id=KVH7H24CFUSL3763MANE4ASNVTNR7PBQSNNKFNRNB754XYH5GQXA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:31.943798498 (196h14m6.714439833s) [noise=true , address=77.90.31.17:4770 , piece_id=ODZ5ZLOHG5LMNKZLZKKEUNSADF6OREA564L3WMGUTXAIG4CK46QA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:32.011600759 (196h14m6.782242094s) [noise=true , address=77.90.31.15:4699 , piece_id=O7BT75G4Y2Y453MSKTDXQXGHTJW7MK4JHNRNAHHGBXWQIQ4BMMVQ, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:32.130468763 (196h14m6.901110098s) [noise=true , address=104.36.82.15:4259 , piece_id=KRLCC26TFIA2HHHICUFWW4JEUWMUUDZCS7JIBMAATXZTTXDUNLTA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:32.284626620 (196h14m7.055267955s) [noise=true , address=104.36.82.14:4222 , piece_id=BRRPFTGE4VQE7FAVBCCFSSOC5SVJ3MAZAYMX4FW2SWEGJNXY4O6A, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:32.608427086 (196h14m7.379068421s) [noise=true , address=104.36.82.8:4970 , piece_id=23YGAZWYSDY4UM2MVMBXOEY4PRQPTND3ZOAYD4XXOC5IDIJPNVDA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:32.619299124 (196h14m7.389940449s) [noise=true , address=104.36.82.7:4911 , piece_id=7H7L7EW63TFAOURC55GSD7ZXHCH23VU575QU4FFROILFBTC52ANA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:32.624723432 (196h14m7.395364767s) [noise=true , address=104.36.82.13:4187 , piece_id=KX55KOFMDJ2GJ5R3T75VZCELDRCJBZ6L4TZFPOVEX2JPPNOAB66A, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:32.624745435 (196h14m7.39538677s) [seg_pos={0 0}, upload=156965]: Segment reached optimal threshold of 13 pieces. Jul 1 13:24:32.624861536 (196h14m7.395502872s) [noise=true , address=104.36.82.10:4078 , piece_id=IKGLBYC7NJXPNXHVOAJCZKUAOU4DVLZMG3E3W2FOCTYTI2QW2MLQ, seg_pos={0 0}, upload=156965]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 1 13:24:32.624920279 (196h14m7.395561614s) [noise=true , address=104.36.82.6:4875 , piece_id=634PATJDQZFE5SPLJKHMJ6RFF6HEXMCM6EZF6CR5AXQJVV3UZVNA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Jul 1 13:24:32.624980784 (196h14m7.395622119s) [noise=true , address=104.36.82.2:4731 , piece_id=SUVIT3Q2373VGKIRIRHSE5A5HW4MICHKXDY6DTF47KQNQ4YHMGRA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9): protocol: write tcp 188.166.225.170:44914->104.36.82.2:4731: use of closed network connection; write tcp 188.166.225.170:44914->104.36.82.2:4731: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44914->104.36.82.2:4731: use of closed network connection Jul 1 13:24:32.624996214 (196h14m7.395637549s) [seg_pos={0 0}, upload=156965]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 13:24:32.625055297 (196h14m7.395696622s) [upload=156965]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 13:24:32.625059255 (196h14m7.39570059s) [upload=156965]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 13:24:32.928530190 (196h14m7.699171545s) [upload=156965]: Done uploading segments... Jul 1 13:24:32.928576809 (196h14m7.699218184s) [upload=156965]: Upload finished. err: <nil> Duration: 5.689064417s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 5.881177457s FAIL (2025-07-01 13:28:05 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.881201464s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 5.661770837s FAIL (2025-07-01 13:27:35 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF Jul 1 13:23:32.267561192 (196h13m7.038202527s) [seg_pos={0 0}, upload=156954]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 13:23:32.267626126 (196h13m7.038267511s) [upload=156954]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 13:23:32.267633580 (196h13m7.038274955s) [upload=156954]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 13:23:32.564479871 (196h13m7.335121206s) [upload=156954]: Done uploading segments... Jul 1 13:23:32.564498377 (196h13m7.335139702s) [upload=156954]: Upload finished. err: <nil> Jul 1 13:24:29.560888309 (196h14m4.331529644s) [upload=156965]: Starting upload Jul 1 13:24:29.560940799 (196h14m4.331582124s) [upload=156965]: Done starting upload Jul 1 13:24:29.561122977 (196h14m4.331764312s) [upload=156965]: Uploading segments... Jul 1 13:24:29.561173023 (196h14m4.331814358s) [upload=156965]: Got next segment. Inline: false Jul 1 13:24:29.561201949 (196h14m4.331843284s) [upload=156965]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 1 13:24:29.561206607 (196h14m4.331847942s) [upload=156965]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 1 13:24:29.805112380 (196h14m4.575753715s) [seg_pos={0 0}, upload=156965]: Begin upload segment... Jul 1 13:24:29.805161915 (196h14m4.57580324s) [seg_pos={0 0}, upload=156965]: Done begin upload segment. Jul 1 13:24:29.805196952 (196h14m4.575838287s) [noise=true , address=45.91.116.5:5297 , piece_id=HL3OFARGL3745TS3HQF6A52ILFP2NKN4U57TQIJXGSCFWQ3ZM5IQ, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.805367638 (196h14m4.576008973s) [noise=true , address=104.36.82.7:4911 , piece_id=7H7L7EW63TFAOURC55GSD7ZXHCH23VU575QU4FFROILFBTC52ANA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.805862585 (196h14m4.57650392s) [noise=true , address=77.90.31.10:4518 , piece_id=DRWBG6EFBMV5LBR4WE3RTFSABHVVQW47KWQH7I3J5EUBZLI3RMSQ, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.806151198 (196h14m4.576792533s) [noise=true , address=77.90.31.17:4770 , piece_id=ODZ5ZLOHG5LMNKZLZKKEUNSADF6OREA564L3WMGUTXAIG4CK46QA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.806405574 (196h14m4.577046909s) [noise=true , address=104.36.82.13:4187 , piece_id=KX55KOFMDJ2GJ5R3T75VZCELDRCJBZ6L4TZFPOVEX2JPPNOAB66A, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.806538769 (196h14m4.577180114s) [noise=true , address=45.91.116.4:4938 , piece_id=KVH7H24CFUSL3763MANE4ASNVTNR7PBQSNNKFNRNB754XYH5GQXA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.806644702 (196h14m4.577286037s) [noise=true , address=77.90.31.15:4699 , piece_id=O7BT75G4Y2Y453MSKTDXQXGHTJW7MK4JHNRNAHHGBXWQIQ4BMMVQ, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.806872938 (196h14m4.577514273s) [noise=true , address=104.36.82.6:4875 , piece_id=634PATJDQZFE5SPLJKHMJ6RFF6HEXMCM6EZF6CR5AXQJVV3UZVNA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.807087589 (196h14m4.577728924s) [noise=true , address=45.91.116.6:4975 , piece_id=4JEPXGYVKTWUGZBT6JZWJFYVO4GSKEKWYJEBIFW3K7ORCPFARGQA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.807106134 (196h14m4.577747469s) [noise=true , address=45.91.116.4:4940 , piece_id=H5GRLBRIHR5O5PURBAQ4YOBHBZK7SLUVOQWJD6ZY3MCHUATJEDQQ, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.807323490 (196h14m4.577964825s) [noise=true , address=104.36.82.2:4731 , piece_id=SUVIT3Q2373VGKIRIRHSE5A5HW4MICHKXDY6DTF47KQNQ4YHMGRA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.807552468 (196h14m4.578193803s) [noise=true , address=104.36.82.8:4970 , piece_id=23YGAZWYSDY4UM2MVMBXOEY4PRQPTND3ZOAYD4XXOC5IDIJPNVDA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.808051863 (196h14m4.578693198s) [noise=true , address=45.91.116.14:4189 , piece_id=4B6UKVAS4NSIESCQ3VSVJWZSZVZSSPD6CP3TU4QHYPGZSWZ4WN7A, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.808466777 (196h14m4.579108122s) [noise=true , address=104.36.82.15:4259 , piece_id=KRLCC26TFIA2HHHICUFWW4JEUWMUUDZCS7JIBMAATXZTTXDUNLTA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.809998528 (196h14m4.580639853s) [noise=true , address=104.36.82.14:4222 , piece_id=BRRPFTGE4VQE7FAVBCCFSSOC5SVJ3MAZAYMX4FW2SWEGJNXY4O6A, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.810327147 (196h14m4.580968482s) [noise=true , address=104.36.82.10:4078 , piece_id=IKGLBYC7NJXPNXHVOAJCZKUAOU4DVLZMG3E3W2FOCTYTI2QW2MLQ, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:31.567215995 (196h14m6.33785733s) [upload=156965]: Next returned nil segment Jul 1 13:24:31.567238518 (196h14m6.337879853s) [upload=156965]: Waiting for error group managing segments... Jul 1 13:24:31.849330083 (196h14m6.619971418s) [noise=true , address=45.91.116.5:5297 , piece_id=HL3OFARGL3745TS3HQF6A52ILFP2NKN4U57TQIJXGSCFWQ3ZM5IQ, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:31.868737580 (196h14m6.639378915s) [noise=true , address=45.91.116.4:4940 , piece_id=H5GRLBRIHR5O5PURBAQ4YOBHBZK7SLUVOQWJD6ZY3MCHUATJEDQQ, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:31.870984328 (196h14m6.641625663s) [noise=true , address=45.91.116.6:4975 , piece_id=4JEPXGYVKTWUGZBT6JZWJFYVO4GSKEKWYJEBIFW3K7ORCPFARGQA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:31.890536413 (196h14m6.661177738s) [noise=true , address=45.91.116.14:4189 , piece_id=4B6UKVAS4NSIESCQ3VSVJWZSZVZSSPD6CP3TU4QHYPGZSWZ4WN7A, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:31.904306657 (196h14m6.674947992s) [noise=true , address=77.90.31.10:4518 , piece_id=DRWBG6EFBMV5LBR4WE3RTFSABHVVQW47KWQH7I3J5EUBZLI3RMSQ, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:31.941272175 (196h14m6.7119135s) [noise=true , address=45.91.116.4:4938 , piece_id=KVH7H24CFUSL3763MANE4ASNVTNR7PBQSNNKFNRNB754XYH5GQXA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:31.943798498 (196h14m6.714439833s) [noise=true , address=77.90.31.17:4770 , piece_id=ODZ5ZLOHG5LMNKZLZKKEUNSADF6OREA564L3WMGUTXAIG4CK46QA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:32.011600759 (196h14m6.782242094s) [noise=true , address=77.90.31.15:4699 , piece_id=O7BT75G4Y2Y453MSKTDXQXGHTJW7MK4JHNRNAHHGBXWQIQ4BMMVQ, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:32.130468763 (196h14m6.901110098s) [noise=true , address=104.36.82.15:4259 , piece_id=KRLCC26TFIA2HHHICUFWW4JEUWMUUDZCS7JIBMAATXZTTXDUNLTA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:32.284626620 (196h14m7.055267955s) [noise=true , address=104.36.82.14:4222 , piece_id=BRRPFTGE4VQE7FAVBCCFSSOC5SVJ3MAZAYMX4FW2SWEGJNXY4O6A, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:32.608427086 (196h14m7.379068421s) [noise=true , address=104.36.82.8:4970 , piece_id=23YGAZWYSDY4UM2MVMBXOEY4PRQPTND3ZOAYD4XXOC5IDIJPNVDA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:32.619299124 (196h14m7.389940449s) [noise=true , address=104.36.82.7:4911 , piece_id=7H7L7EW63TFAOURC55GSD7ZXHCH23VU575QU4FFROILFBTC52ANA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:32.624723432 (196h14m7.395364767s) [noise=true , address=104.36.82.13:4187 , piece_id=KX55KOFMDJ2GJ5R3T75VZCELDRCJBZ6L4TZFPOVEX2JPPNOAB66A, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:32.624745435 (196h14m7.39538677s) [seg_pos={0 0}, upload=156965]: Segment reached optimal threshold of 13 pieces. Jul 1 13:24:32.624861536 (196h14m7.395502872s) [noise=true , address=104.36.82.10:4078 , piece_id=IKGLBYC7NJXPNXHVOAJCZKUAOU4DVLZMG3E3W2FOCTYTI2QW2MLQ, seg_pos={0 0}, upload=156965]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 1 13:24:32.624920279 (196h14m7.395561614s) [noise=true , address=104.36.82.6:4875 , piece_id=634PATJDQZFE5SPLJKHMJ6RFF6HEXMCM6EZF6CR5AXQJVV3UZVNA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Jul 1 13:24:32.624980784 (196h14m7.395622119s) [noise=true , address=104.36.82.2:4731 , piece_id=SUVIT3Q2373VGKIRIRHSE5A5HW4MICHKXDY6DTF47KQNQ4YHMGRA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9): protocol: write tcp 188.166.225.170:44914->104.36.82.2:4731: use of closed network connection; write tcp 188.166.225.170:44914->104.36.82.2:4731: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44914->104.36.82.2:4731: use of closed network connection Jul 1 13:24:32.624996214 (196h14m7.395637549s) [seg_pos={0 0}, upload=156965]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 13:24:32.625055297 (196h14m7.395696622s) [upload=156965]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 13:24:32.625059255 (196h14m7.39570059s) [upload=156965]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 13:24:32.928530190 (196h14m7.699171545s) [upload=156965]: Done uploading segments... Jul 1 13:24:32.928576809 (196h14m7.699218184s) [upload=156965]: Upload finished. err: <nil> Duration: 5.66179306s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 5.530235688s FAIL (2025-07-01 13:27:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.530259774s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 5.941846412s FAIL (2025-07-01 13:27:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.941870207s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 5.569022707s FAIL (2025-07-01 13:26:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.56904478s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 5.56558875s FAIL (2025-07-01 13:26:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.565615483s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 5.64023739s FAIL (2025-07-01 13:26:20 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF Jul 1 13:23:32.267561192 (196h13m7.038202527s) [seg_pos={0 0}, upload=156954]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 13:23:32.267626126 (196h13m7.038267511s) [upload=156954]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 13:23:32.267633580 (196h13m7.038274955s) [upload=156954]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 13:23:32.564479871 (196h13m7.335121206s) [upload=156954]: Done uploading segments... Jul 1 13:23:32.564498377 (196h13m7.335139702s) [upload=156954]: Upload finished. err: <nil> Jul 1 13:24:29.560888309 (196h14m4.331529644s) [upload=156965]: Starting upload Jul 1 13:24:29.560940799 (196h14m4.331582124s) [upload=156965]: Done starting upload Jul 1 13:24:29.561122977 (196h14m4.331764312s) [upload=156965]: Uploading segments... Jul 1 13:24:29.561173023 (196h14m4.331814358s) [upload=156965]: Got next segment. Inline: false Jul 1 13:24:29.561201949 (196h14m4.331843284s) [upload=156965]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 1 13:24:29.561206607 (196h14m4.331847942s) [upload=156965]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 1 13:24:29.805112380 (196h14m4.575753715s) [seg_pos={0 0}, upload=156965]: Begin upload segment... Jul 1 13:24:29.805161915 (196h14m4.57580324s) [seg_pos={0 0}, upload=156965]: Done begin upload segment. Jul 1 13:24:29.805196952 (196h14m4.575838287s) [noise=true , address=45.91.116.5:5297 , piece_id=HL3OFARGL3745TS3HQF6A52ILFP2NKN4U57TQIJXGSCFWQ3ZM5IQ, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.805367638 (196h14m4.576008973s) [noise=true , address=104.36.82.7:4911 , piece_id=7H7L7EW63TFAOURC55GSD7ZXHCH23VU575QU4FFROILFBTC52ANA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.805862585 (196h14m4.57650392s) [noise=true , address=77.90.31.10:4518 , piece_id=DRWBG6EFBMV5LBR4WE3RTFSABHVVQW47KWQH7I3J5EUBZLI3RMSQ, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.806151198 (196h14m4.576792533s) [noise=true , address=77.90.31.17:4770 , piece_id=ODZ5ZLOHG5LMNKZLZKKEUNSADF6OREA564L3WMGUTXAIG4CK46QA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.806405574 (196h14m4.577046909s) [noise=true , address=104.36.82.13:4187 , piece_id=KX55KOFMDJ2GJ5R3T75VZCELDRCJBZ6L4TZFPOVEX2JPPNOAB66A, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.806538769 (196h14m4.577180114s) [noise=true , address=45.91.116.4:4938 , piece_id=KVH7H24CFUSL3763MANE4ASNVTNR7PBQSNNKFNRNB754XYH5GQXA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.806644702 (196h14m4.577286037s) [noise=true , address=77.90.31.15:4699 , piece_id=O7BT75G4Y2Y453MSKTDXQXGHTJW7MK4JHNRNAHHGBXWQIQ4BMMVQ, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.806872938 (196h14m4.577514273s) [noise=true , address=104.36.82.6:4875 , piece_id=634PATJDQZFE5SPLJKHMJ6RFF6HEXMCM6EZF6CR5AXQJVV3UZVNA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.807087589 (196h14m4.577728924s) [noise=true , address=45.91.116.6:4975 , piece_id=4JEPXGYVKTWUGZBT6JZWJFYVO4GSKEKWYJEBIFW3K7ORCPFARGQA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.807106134 (196h14m4.577747469s) [noise=true , address=45.91.116.4:4940 , piece_id=H5GRLBRIHR5O5PURBAQ4YOBHBZK7SLUVOQWJD6ZY3MCHUATJEDQQ, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.807323490 (196h14m4.577964825s) [noise=true , address=104.36.82.2:4731 , piece_id=SUVIT3Q2373VGKIRIRHSE5A5HW4MICHKXDY6DTF47KQNQ4YHMGRA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.807552468 (196h14m4.578193803s) [noise=true , address=104.36.82.8:4970 , piece_id=23YGAZWYSDY4UM2MVMBXOEY4PRQPTND3ZOAYD4XXOC5IDIJPNVDA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.808051863 (196h14m4.578693198s) [noise=true , address=45.91.116.14:4189 , piece_id=4B6UKVAS4NSIESCQ3VSVJWZSZVZSSPD6CP3TU4QHYPGZSWZ4WN7A, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.808466777 (196h14m4.579108122s) [noise=true , address=104.36.82.15:4259 , piece_id=KRLCC26TFIA2HHHICUFWW4JEUWMUUDZCS7JIBMAATXZTTXDUNLTA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.809998528 (196h14m4.580639853s) [noise=true , address=104.36.82.14:4222 , piece_id=BRRPFTGE4VQE7FAVBCCFSSOC5SVJ3MAZAYMX4FW2SWEGJNXY4O6A, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.810327147 (196h14m4.580968482s) [noise=true , address=104.36.82.10:4078 , piece_id=IKGLBYC7NJXPNXHVOAJCZKUAOU4DVLZMG3E3W2FOCTYTI2QW2MLQ, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:31.567215995 (196h14m6.33785733s) [upload=156965]: Next returned nil segment Jul 1 13:24:31.567238518 (196h14m6.337879853s) [upload=156965]: Waiting for error group managing segments... Jul 1 13:24:31.849330083 (196h14m6.619971418s) [noise=true , address=45.91.116.5:5297 , piece_id=HL3OFARGL3745TS3HQF6A52ILFP2NKN4U57TQIJXGSCFWQ3ZM5IQ, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:31.868737580 (196h14m6.639378915s) [noise=true , address=45.91.116.4:4940 , piece_id=H5GRLBRIHR5O5PURBAQ4YOBHBZK7SLUVOQWJD6ZY3MCHUATJEDQQ, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:31.870984328 (196h14m6.641625663s) [noise=true , address=45.91.116.6:4975 , piece_id=4JEPXGYVKTWUGZBT6JZWJFYVO4GSKEKWYJEBIFW3K7ORCPFARGQA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:31.890536413 (196h14m6.661177738s) [noise=true , address=45.91.116.14:4189 , piece_id=4B6UKVAS4NSIESCQ3VSVJWZSZVZSSPD6CP3TU4QHYPGZSWZ4WN7A, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:31.904306657 (196h14m6.674947992s) [noise=true , address=77.90.31.10:4518 , piece_id=DRWBG6EFBMV5LBR4WE3RTFSABHVVQW47KWQH7I3J5EUBZLI3RMSQ, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:31.941272175 (196h14m6.7119135s) [noise=true , address=45.91.116.4:4938 , piece_id=KVH7H24CFUSL3763MANE4ASNVTNR7PBQSNNKFNRNB754XYH5GQXA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:31.943798498 (196h14m6.714439833s) [noise=true , address=77.90.31.17:4770 , piece_id=ODZ5ZLOHG5LMNKZLZKKEUNSADF6OREA564L3WMGUTXAIG4CK46QA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:32.011600759 (196h14m6.782242094s) [noise=true , address=77.90.31.15:4699 , piece_id=O7BT75G4Y2Y453MSKTDXQXGHTJW7MK4JHNRNAHHGBXWQIQ4BMMVQ, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:32.130468763 (196h14m6.901110098s) [noise=true , address=104.36.82.15:4259 , piece_id=KRLCC26TFIA2HHHICUFWW4JEUWMUUDZCS7JIBMAATXZTTXDUNLTA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:32.284626620 (196h14m7.055267955s) [noise=true , address=104.36.82.14:4222 , piece_id=BRRPFTGE4VQE7FAVBCCFSSOC5SVJ3MAZAYMX4FW2SWEGJNXY4O6A, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:32.608427086 (196h14m7.379068421s) [noise=true , address=104.36.82.8:4970 , piece_id=23YGAZWYSDY4UM2MVMBXOEY4PRQPTND3ZOAYD4XXOC5IDIJPNVDA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:32.619299124 (196h14m7.389940449s) [noise=true , address=104.36.82.7:4911 , piece_id=7H7L7EW63TFAOURC55GSD7ZXHCH23VU575QU4FFROILFBTC52ANA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:32.624723432 (196h14m7.395364767s) [noise=true , address=104.36.82.13:4187 , piece_id=KX55KOFMDJ2GJ5R3T75VZCELDRCJBZ6L4TZFPOVEX2JPPNOAB66A, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:32.624745435 (196h14m7.39538677s) [seg_pos={0 0}, upload=156965]: Segment reached optimal threshold of 13 pieces. Jul 1 13:24:32.624861536 (196h14m7.395502872s) [noise=true , address=104.36.82.10:4078 , piece_id=IKGLBYC7NJXPNXHVOAJCZKUAOU4DVLZMG3E3W2FOCTYTI2QW2MLQ, seg_pos={0 0}, upload=156965]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 1 13:24:32.624920279 (196h14m7.395561614s) [noise=true , address=104.36.82.6:4875 , piece_id=634PATJDQZFE5SPLJKHMJ6RFF6HEXMCM6EZF6CR5AXQJVV3UZVNA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Jul 1 13:24:32.624980784 (196h14m7.395622119s) [noise=true , address=104.36.82.2:4731 , piece_id=SUVIT3Q2373VGKIRIRHSE5A5HW4MICHKXDY6DTF47KQNQ4YHMGRA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9): protocol: write tcp 188.166.225.170:44914->104.36.82.2:4731: use of closed network connection; write tcp 188.166.225.170:44914->104.36.82.2:4731: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44914->104.36.82.2:4731: use of closed network connection Jul 1 13:24:32.624996214 (196h14m7.395637549s) [seg_pos={0 0}, upload=156965]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 13:24:32.625055297 (196h14m7.395696622s) [upload=156965]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 13:24:32.625059255 (196h14m7.39570059s) [upload=156965]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 13:24:32.928530190 (196h14m7.699171545s) [upload=156965]: Done uploading segments... Jul 1 13:24:32.928576809 (196h14m7.699218184s) [upload=156965]: Upload finished. err: <nil> Duration: 5.64026372s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 6.216829928s FAIL (2025-07-01 13:26:08 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.216848694s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 5.513703036s FAIL (2025-07-01 13:25:50 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.513723745s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 5.890448954s FAIL (2025-07-01 13:25:40 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF Jul 1 13:23:32.267561192 (196h13m7.038202527s) [seg_pos={0 0}, upload=156954]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 13:23:32.267626126 (196h13m7.038267511s) [upload=156954]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 13:23:32.267633580 (196h13m7.038274955s) [upload=156954]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 13:23:32.564479871 (196h13m7.335121206s) [upload=156954]: Done uploading segments... Jul 1 13:23:32.564498377 (196h13m7.335139702s) [upload=156954]: Upload finished. err: <nil> Jul 1 13:24:29.560888309 (196h14m4.331529644s) [upload=156965]: Starting upload Jul 1 13:24:29.560940799 (196h14m4.331582124s) [upload=156965]: Done starting upload Jul 1 13:24:29.561122977 (196h14m4.331764312s) [upload=156965]: Uploading segments... Jul 1 13:24:29.561173023 (196h14m4.331814358s) [upload=156965]: Got next segment. Inline: false Jul 1 13:24:29.561201949 (196h14m4.331843284s) [upload=156965]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 1 13:24:29.561206607 (196h14m4.331847942s) [upload=156965]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 1 13:24:29.805112380 (196h14m4.575753715s) [seg_pos={0 0}, upload=156965]: Begin upload segment... Jul 1 13:24:29.805161915 (196h14m4.57580324s) [seg_pos={0 0}, upload=156965]: Done begin upload segment. Jul 1 13:24:29.805196952 (196h14m4.575838287s) [noise=true , address=45.91.116.5:5297 , piece_id=HL3OFARGL3745TS3HQF6A52ILFP2NKN4U57TQIJXGSCFWQ3ZM5IQ, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.805367638 (196h14m4.576008973s) [noise=true , address=104.36.82.7:4911 , piece_id=7H7L7EW63TFAOURC55GSD7ZXHCH23VU575QU4FFROILFBTC52ANA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.805862585 (196h14m4.57650392s) [noise=true , address=77.90.31.10:4518 , piece_id=DRWBG6EFBMV5LBR4WE3RTFSABHVVQW47KWQH7I3J5EUBZLI3RMSQ, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.806151198 (196h14m4.576792533s) [noise=true , address=77.90.31.17:4770 , piece_id=ODZ5ZLOHG5LMNKZLZKKEUNSADF6OREA564L3WMGUTXAIG4CK46QA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.806405574 (196h14m4.577046909s) [noise=true , address=104.36.82.13:4187 , piece_id=KX55KOFMDJ2GJ5R3T75VZCELDRCJBZ6L4TZFPOVEX2JPPNOAB66A, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.806538769 (196h14m4.577180114s) [noise=true , address=45.91.116.4:4938 , piece_id=KVH7H24CFUSL3763MANE4ASNVTNR7PBQSNNKFNRNB754XYH5GQXA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.806644702 (196h14m4.577286037s) [noise=true , address=77.90.31.15:4699 , piece_id=O7BT75G4Y2Y453MSKTDXQXGHTJW7MK4JHNRNAHHGBXWQIQ4BMMVQ, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.806872938 (196h14m4.577514273s) [noise=true , address=104.36.82.6:4875 , piece_id=634PATJDQZFE5SPLJKHMJ6RFF6HEXMCM6EZF6CR5AXQJVV3UZVNA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.807087589 (196h14m4.577728924s) [noise=true , address=45.91.116.6:4975 , piece_id=4JEPXGYVKTWUGZBT6JZWJFYVO4GSKEKWYJEBIFW3K7ORCPFARGQA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.807106134 (196h14m4.577747469s) [noise=true , address=45.91.116.4:4940 , piece_id=H5GRLBRIHR5O5PURBAQ4YOBHBZK7SLUVOQWJD6ZY3MCHUATJEDQQ, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.807323490 (196h14m4.577964825s) [noise=true , address=104.36.82.2:4731 , piece_id=SUVIT3Q2373VGKIRIRHSE5A5HW4MICHKXDY6DTF47KQNQ4YHMGRA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.807552468 (196h14m4.578193803s) [noise=true , address=104.36.82.8:4970 , piece_id=23YGAZWYSDY4UM2MVMBXOEY4PRQPTND3ZOAYD4XXOC5IDIJPNVDA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.808051863 (196h14m4.578693198s) [noise=true , address=45.91.116.14:4189 , piece_id=4B6UKVAS4NSIESCQ3VSVJWZSZVZSSPD6CP3TU4QHYPGZSWZ4WN7A, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.808466777 (196h14m4.579108122s) [noise=true , address=104.36.82.15:4259 , piece_id=KRLCC26TFIA2HHHICUFWW4JEUWMUUDZCS7JIBMAATXZTTXDUNLTA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.809998528 (196h14m4.580639853s) [noise=true , address=104.36.82.14:4222 , piece_id=BRRPFTGE4VQE7FAVBCCFSSOC5SVJ3MAZAYMX4FW2SWEGJNXY4O6A, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.810327147 (196h14m4.580968482s) [noise=true , address=104.36.82.10:4078 , piece_id=IKGLBYC7NJXPNXHVOAJCZKUAOU4DVLZMG3E3W2FOCTYTI2QW2MLQ, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:31.567215995 (196h14m6.33785733s) [upload=156965]: Next returned nil segment Jul 1 13:24:31.567238518 (196h14m6.337879853s) [upload=156965]: Waiting for error group managing segments... Jul 1 13:24:31.849330083 (196h14m6.619971418s) [noise=true , address=45.91.116.5:5297 , piece_id=HL3OFARGL3745TS3HQF6A52ILFP2NKN4U57TQIJXGSCFWQ3ZM5IQ, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:31.868737580 (196h14m6.639378915s) [noise=true , address=45.91.116.4:4940 , piece_id=H5GRLBRIHR5O5PURBAQ4YOBHBZK7SLUVOQWJD6ZY3MCHUATJEDQQ, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:31.870984328 (196h14m6.641625663s) [noise=true , address=45.91.116.6:4975 , piece_id=4JEPXGYVKTWUGZBT6JZWJFYVO4GSKEKWYJEBIFW3K7ORCPFARGQA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:31.890536413 (196h14m6.661177738s) [noise=true , address=45.91.116.14:4189 , piece_id=4B6UKVAS4NSIESCQ3VSVJWZSZVZSSPD6CP3TU4QHYPGZSWZ4WN7A, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:31.904306657 (196h14m6.674947992s) [noise=true , address=77.90.31.10:4518 , piece_id=DRWBG6EFBMV5LBR4WE3RTFSABHVVQW47KWQH7I3J5EUBZLI3RMSQ, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:31.941272175 (196h14m6.7119135s) [noise=true , address=45.91.116.4:4938 , piece_id=KVH7H24CFUSL3763MANE4ASNVTNR7PBQSNNKFNRNB754XYH5GQXA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:31.943798498 (196h14m6.714439833s) [noise=true , address=77.90.31.17:4770 , piece_id=ODZ5ZLOHG5LMNKZLZKKEUNSADF6OREA564L3WMGUTXAIG4CK46QA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:32.011600759 (196h14m6.782242094s) [noise=true , address=77.90.31.15:4699 , piece_id=O7BT75G4Y2Y453MSKTDXQXGHTJW7MK4JHNRNAHHGBXWQIQ4BMMVQ, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:32.130468763 (196h14m6.901110098s) [noise=true , address=104.36.82.15:4259 , piece_id=KRLCC26TFIA2HHHICUFWW4JEUWMUUDZCS7JIBMAATXZTTXDUNLTA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:32.284626620 (196h14m7.055267955s) [noise=true , address=104.36.82.14:4222 , piece_id=BRRPFTGE4VQE7FAVBCCFSSOC5SVJ3MAZAYMX4FW2SWEGJNXY4O6A, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:32.608427086 (196h14m7.379068421s) [noise=true , address=104.36.82.8:4970 , piece_id=23YGAZWYSDY4UM2MVMBXOEY4PRQPTND3ZOAYD4XXOC5IDIJPNVDA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:32.619299124 (196h14m7.389940449s) [noise=true , address=104.36.82.7:4911 , piece_id=7H7L7EW63TFAOURC55GSD7ZXHCH23VU575QU4FFROILFBTC52ANA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:32.624723432 (196h14m7.395364767s) [noise=true , address=104.36.82.13:4187 , piece_id=KX55KOFMDJ2GJ5R3T75VZCELDRCJBZ6L4TZFPOVEX2JPPNOAB66A, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:32.624745435 (196h14m7.39538677s) [seg_pos={0 0}, upload=156965]: Segment reached optimal threshold of 13 pieces. Jul 1 13:24:32.624861536 (196h14m7.395502872s) [noise=true , address=104.36.82.10:4078 , piece_id=IKGLBYC7NJXPNXHVOAJCZKUAOU4DVLZMG3E3W2FOCTYTI2QW2MLQ, seg_pos={0 0}, upload=156965]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 1 13:24:32.624920279 (196h14m7.395561614s) [noise=true , address=104.36.82.6:4875 , piece_id=634PATJDQZFE5SPLJKHMJ6RFF6HEXMCM6EZF6CR5AXQJVV3UZVNA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Jul 1 13:24:32.624980784 (196h14m7.395622119s) [noise=true , address=104.36.82.2:4731 , piece_id=SUVIT3Q2373VGKIRIRHSE5A5HW4MICHKXDY6DTF47KQNQ4YHMGRA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9): protocol: write tcp 188.166.225.170:44914->104.36.82.2:4731: use of closed network connection; write tcp 188.166.225.170:44914->104.36.82.2:4731: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44914->104.36.82.2:4731: use of closed network connection Jul 1 13:24:32.624996214 (196h14m7.395637549s) [seg_pos={0 0}, upload=156965]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 13:24:32.625055297 (196h14m7.395696622s) [upload=156965]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 13:24:32.625059255 (196h14m7.39570059s) [upload=156965]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 13:24:32.928530190 (196h14m7.699171545s) [upload=156965]: Done uploading segments... Jul 1 13:24:32.928576809 (196h14m7.699218184s) [upload=156965]: Upload finished. err: <nil> Duration: 5.890482068s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 5.830664566s FAIL (2025-07-01 13:25:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.830689211s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 5.661658744s FAIL (2025-07-01 13:25:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.661684122s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 5.676655445s FAIL (2025-07-01 13:25:13 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.676677597s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.003318884s FAIL (2025-07-01 13:24:58 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF Jul 1 13:23:32.267561192 (196h13m7.038202527s) [seg_pos={0 0}, upload=156954]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 13:23:32.267626126 (196h13m7.038267511s) [upload=156954]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 13:23:32.267633580 (196h13m7.038274955s) [upload=156954]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 13:23:32.564479871 (196h13m7.335121206s) [upload=156954]: Done uploading segments... Jul 1 13:23:32.564498377 (196h13m7.335139702s) [upload=156954]: Upload finished. err: <nil> Jul 1 13:24:29.560888309 (196h14m4.331529644s) [upload=156965]: Starting upload Jul 1 13:24:29.560940799 (196h14m4.331582124s) [upload=156965]: Done starting upload Jul 1 13:24:29.561122977 (196h14m4.331764312s) [upload=156965]: Uploading segments... Jul 1 13:24:29.561173023 (196h14m4.331814358s) [upload=156965]: Got next segment. Inline: false Jul 1 13:24:29.561201949 (196h14m4.331843284s) [upload=156965]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 1 13:24:29.561206607 (196h14m4.331847942s) [upload=156965]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 1 13:24:29.805112380 (196h14m4.575753715s) [seg_pos={0 0}, upload=156965]: Begin upload segment... Jul 1 13:24:29.805161915 (196h14m4.57580324s) [seg_pos={0 0}, upload=156965]: Done begin upload segment. Jul 1 13:24:29.805196952 (196h14m4.575838287s) [noise=true , address=45.91.116.5:5297 , piece_id=HL3OFARGL3745TS3HQF6A52ILFP2NKN4U57TQIJXGSCFWQ3ZM5IQ, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.805367638 (196h14m4.576008973s) [noise=true , address=104.36.82.7:4911 , piece_id=7H7L7EW63TFAOURC55GSD7ZXHCH23VU575QU4FFROILFBTC52ANA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.805862585 (196h14m4.57650392s) [noise=true , address=77.90.31.10:4518 , piece_id=DRWBG6EFBMV5LBR4WE3RTFSABHVVQW47KWQH7I3J5EUBZLI3RMSQ, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.806151198 (196h14m4.576792533s) [noise=true , address=77.90.31.17:4770 , piece_id=ODZ5ZLOHG5LMNKZLZKKEUNSADF6OREA564L3WMGUTXAIG4CK46QA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.806405574 (196h14m4.577046909s) [noise=true , address=104.36.82.13:4187 , piece_id=KX55KOFMDJ2GJ5R3T75VZCELDRCJBZ6L4TZFPOVEX2JPPNOAB66A, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.806538769 (196h14m4.577180114s) [noise=true , address=45.91.116.4:4938 , piece_id=KVH7H24CFUSL3763MANE4ASNVTNR7PBQSNNKFNRNB754XYH5GQXA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.806644702 (196h14m4.577286037s) [noise=true , address=77.90.31.15:4699 , piece_id=O7BT75G4Y2Y453MSKTDXQXGHTJW7MK4JHNRNAHHGBXWQIQ4BMMVQ, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.806872938 (196h14m4.577514273s) [noise=true , address=104.36.82.6:4875 , piece_id=634PATJDQZFE5SPLJKHMJ6RFF6HEXMCM6EZF6CR5AXQJVV3UZVNA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.807087589 (196h14m4.577728924s) [noise=true , address=45.91.116.6:4975 , piece_id=4JEPXGYVKTWUGZBT6JZWJFYVO4GSKEKWYJEBIFW3K7ORCPFARGQA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.807106134 (196h14m4.577747469s) [noise=true , address=45.91.116.4:4940 , piece_id=H5GRLBRIHR5O5PURBAQ4YOBHBZK7SLUVOQWJD6ZY3MCHUATJEDQQ, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.807323490 (196h14m4.577964825s) [noise=true , address=104.36.82.2:4731 , piece_id=SUVIT3Q2373VGKIRIRHSE5A5HW4MICHKXDY6DTF47KQNQ4YHMGRA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.807552468 (196h14m4.578193803s) [noise=true , address=104.36.82.8:4970 , piece_id=23YGAZWYSDY4UM2MVMBXOEY4PRQPTND3ZOAYD4XXOC5IDIJPNVDA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.808051863 (196h14m4.578693198s) [noise=true , address=45.91.116.14:4189 , piece_id=4B6UKVAS4NSIESCQ3VSVJWZSZVZSSPD6CP3TU4QHYPGZSWZ4WN7A, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.808466777 (196h14m4.579108122s) [noise=true , address=104.36.82.15:4259 , piece_id=KRLCC26TFIA2HHHICUFWW4JEUWMUUDZCS7JIBMAATXZTTXDUNLTA, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.809998528 (196h14m4.580639853s) [noise=true , address=104.36.82.14:4222 , piece_id=BRRPFTGE4VQE7FAVBCCFSSOC5SVJ3MAZAYMX4FW2SWEGJNXY4O6A, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:29.810327147 (196h14m4.580968482s) [noise=true , address=104.36.82.10:4078 , piece_id=IKGLBYC7NJXPNXHVOAJCZKUAOU4DVLZMG3E3W2FOCTYTI2QW2MLQ, seg_pos={0 0}, upload=156965]: Uploading piece... Jul 1 13:24:31.567215995 (196h14m6.33785733s) [upload=156965]: Next returned nil segment Jul 1 13:24:31.567238518 (196h14m6.337879853s) [upload=156965]: Waiting for error group managing segments... Jul 1 13:24:31.849330083 (196h14m6.619971418s) [noise=true , address=45.91.116.5:5297 , piece_id=HL3OFARGL3745TS3HQF6A52ILFP2NKN4U57TQIJXGSCFWQ3ZM5IQ, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:31.868737580 (196h14m6.639378915s) [noise=true , address=45.91.116.4:4940 , piece_id=H5GRLBRIHR5O5PURBAQ4YOBHBZK7SLUVOQWJD6ZY3MCHUATJEDQQ, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:31.870984328 (196h14m6.641625663s) [noise=true , address=45.91.116.6:4975 , piece_id=4JEPXGYVKTWUGZBT6JZWJFYVO4GSKEKWYJEBIFW3K7ORCPFARGQA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:31.890536413 (196h14m6.661177738s) [noise=true , address=45.91.116.14:4189 , piece_id=4B6UKVAS4NSIESCQ3VSVJWZSZVZSSPD6CP3TU4QHYPGZSWZ4WN7A, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:31.904306657 (196h14m6.674947992s) [noise=true , address=77.90.31.10:4518 , piece_id=DRWBG6EFBMV5LBR4WE3RTFSABHVVQW47KWQH7I3J5EUBZLI3RMSQ, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:31.941272175 (196h14m6.7119135s) [noise=true , address=45.91.116.4:4938 , piece_id=KVH7H24CFUSL3763MANE4ASNVTNR7PBQSNNKFNRNB754XYH5GQXA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:31.943798498 (196h14m6.714439833s) [noise=true , address=77.90.31.17:4770 , piece_id=ODZ5ZLOHG5LMNKZLZKKEUNSADF6OREA564L3WMGUTXAIG4CK46QA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:32.011600759 (196h14m6.782242094s) [noise=true , address=77.90.31.15:4699 , piece_id=O7BT75G4Y2Y453MSKTDXQXGHTJW7MK4JHNRNAHHGBXWQIQ4BMMVQ, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:32.130468763 (196h14m6.901110098s) [noise=true , address=104.36.82.15:4259 , piece_id=KRLCC26TFIA2HHHICUFWW4JEUWMUUDZCS7JIBMAATXZTTXDUNLTA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:32.284626620 (196h14m7.055267955s) [noise=true , address=104.36.82.14:4222 , piece_id=BRRPFTGE4VQE7FAVBCCFSSOC5SVJ3MAZAYMX4FW2SWEGJNXY4O6A, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:32.608427086 (196h14m7.379068421s) [noise=true , address=104.36.82.8:4970 , piece_id=23YGAZWYSDY4UM2MVMBXOEY4PRQPTND3ZOAYD4XXOC5IDIJPNVDA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:32.619299124 (196h14m7.389940449s) [noise=true , address=104.36.82.7:4911 , piece_id=7H7L7EW63TFAOURC55GSD7ZXHCH23VU575QU4FFROILFBTC52ANA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:32.624723432 (196h14m7.395364767s) [noise=true , address=104.36.82.13:4187 , piece_id=KX55KOFMDJ2GJ5R3T75VZCELDRCJBZ6L4TZFPOVEX2JPPNOAB66A, seg_pos={0 0}, upload=156965]: Done uploading piece. err: <nil> Jul 1 13:24:32.624745435 (196h14m7.39538677s) [seg_pos={0 0}, upload=156965]: Segment reached optimal threshold of 13 pieces. Jul 1 13:24:32.624861536 (196h14m7.395502872s) [noise=true , address=104.36.82.10:4078 , piece_id=IKGLBYC7NJXPNXHVOAJCZKUAOU4DVLZMG3E3W2FOCTYTI2QW2MLQ, seg_pos={0 0}, upload=156965]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF Jul 1 13:24:32.624920279 (196h14m7.395561614s) [noise=true , address=104.36.82.6:4875 , piece_id=634PATJDQZFE5SPLJKHMJ6RFF6HEXMCM6EZF6CR5AXQJVV3UZVNA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Jul 1 13:24:32.624980784 (196h14m7.395622119s) [noise=true , address=104.36.82.2:4731 , piece_id=SUVIT3Q2373VGKIRIRHSE5A5HW4MICHKXDY6DTF47KQNQ4YHMGRA, seg_pos={0 0}, upload=156965]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9): protocol: write tcp 188.166.225.170:44914->104.36.82.2:4731: use of closed network connection; write tcp 188.166.225.170:44914->104.36.82.2:4731: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44914->104.36.82.2:4731: use of closed network connection Jul 1 13:24:32.624996214 (196h14m7.395637549s) [seg_pos={0 0}, upload=156965]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 13:24:32.625055297 (196h14m7.395696622s) [upload=156965]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 13:24:32.625059255 (196h14m7.39570059s) [upload=156965]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 13:24:32.928530190 (196h14m7.699171545s) [upload=156965]: Done uploading segments... Jul 1 13:24:32.928576809 (196h14m7.699218184s) [upload=156965]: Upload finished. err: <nil> Duration: 30.003344973s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 6.776173626s FAIL (2025-07-01 13:24:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.776214142s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 6.589998215s FAIL (2025-07-01 13:24:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.590018815s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 5.552214194s FAIL (2025-07-01 13:24:12 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.552235995s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 6.183326072s FAIL (2025-07-01 13:24:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.183347353s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 5.563568429s FAIL (2025-07-01 13:23:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.563593627s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 6.240765238s FAIL (2025-07-01 13:22:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.24078775s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 6.295111477s FAIL (2025-07-01 13:22:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.295464071s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 5.542926897s FAIL (2025-07-01 13:22:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.542951934s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 6.230218885s FAIL (2025-07-01 13:21:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.230235818s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 6.122019547s FAIL (2025-07-01 13:21:41 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.1220474s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 6.696901393s FAIL (2025-07-01 13:21:10 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.69692662s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 6.14924891s FAIL (2025-07-01 13:20:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.149276293s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 5.68008559s FAIL (2025-07-01 13:20:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.680106579s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 5.964688134s FAIL (2025-07-01 13:19:54 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.964730967s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 5.625375968s FAIL (2025-07-01 13:19:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.625403852s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 5.875685468s FAIL (2025-07-01 13:19:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.875710317s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 6.580711472s FAIL (2025-07-01 13:18:50 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.580727023s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 5.669905406s FAIL (2025-07-01 13:18:34 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.669967896s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 9.015521423s FAIL (2025-07-01 13:18:10 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 9.015546742s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 6.209493689s FAIL (2025-07-01 13:17:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.209522294s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 5.531296883s FAIL (2025-07-01 13:17:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.531321211s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 9.078784246s FAIL (2025-07-01 13:17:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 9.078807341s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 5.952447423s FAIL (2025-07-01 13:16:46 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.952466821s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 5.462547125s FAIL (2025-07-01 13:16:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.462569106s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 5.481642045s FAIL (2025-07-01 13:15:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.48166109s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)