Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.....X...................................X..................] duration: 1.851678187s FAIL (2025-08-13 04:46:18 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after c82f41086c10e8e784630232b68e0f7cf143b56088b414b7953f1ff8ef739d6a != before 9bf6ec9994ca7c4766b5318f204568e254175c351cfe104bdd6795e4366e1a5b ======LOGS====== Aug 13 04:31:56.429417659 (107h5m50.860497791s) [upload=111466]: Starting upload Aug 13 04:31:56.429489978 (107h5m50.860570109s) [upload=111466]: Done starting upload Aug 13 04:31:56.429575071 (107h5m50.860655202s) [upload=111466]: Uploading segments... Aug 13 04:31:56.429639935 (107h5m50.860720076s) [upload=111466]: Got next segment. Inline: true Aug 13 04:31:56.429646136 (107h5m50.860726267s) [upload=111466]: Waiting for error group managing segments... Aug 13 04:31:56.429701133 (107h5m50.860781264s) [upload=111466]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:31:56.429707254 (107h5m50.860787405s) [upload=111466]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 04:31:56.429711382 (107h5m50.860791533s) [upload=111466]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:31:56.721959480 (107h5m51.153039611s) [upload=111466]: Done uploading segments... Aug 13 04:31:56.721978156 (107h5m51.153058277s) [upload=111466]: Upload finished. err: <nil> Duration:* 1.851706882s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....X..........................................X...........] duration: 5.717603412s FAIL (2025-08-13 04:46:00 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 04:35:54.793148420 (107h9m49.224228561s) [upload=111532]: Starting upload Aug 13 04:35:54.793209617 (107h9m49.224289748s) [upload=111532]: Done starting upload Aug 13 04:35:54.793316461 (107h9m49.224396593s) [upload=111532]: Uploading segments... Aug 13 04:35:54.793430610 (107h9m49.224510731s) [upload=111532]: Got next segment. Inline: false Aug 13 04:35:54.793554506 (107h9m49.224634637s) [upload=111532]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:35:54.793560358 (107h9m49.224640489s) [upload=111532]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 04:35:55.251500973 (107h9m49.682581114s) [seg_pos={0 0}, upload=111532]: Begin upload segment... Aug 13 04:35:55.251562933 (107h9m49.682643064s) [seg_pos={0 0}, upload=111532]: Done begin upload segment. Aug 13 04:35:55.251592850 (107h9m49.682672981s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.251640200 (107h9m49.682720331s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252129516 (107h9m49.683209657s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252263212 (107h9m49.683343343s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252446683 (107h9m49.683526814s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252674649 (107h9m49.68375478s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252723483 (107h9m49.683803614s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252973952 (107h9m49.684054083s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.253217899 (107h9m49.68429803s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.253493757 (107h9m49.684573888s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.253729076 (107h9m49.684809207s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.253951341 (107h9m49.685031473s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254152948 (107h9m49.685233079s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254353331 (107h9m49.685433462s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254560177 (107h9m49.685640308s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254753066 (107h9m49.685833197s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254998255 (107h9m49.686078387s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.255202205 (107h9m49.686282336s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:56.355719157 (107h9m50.786799288s) [upload=111532]: Next returned nil segment Aug 13 04:35:56.355734617 (107h9m50.786814748s) [upload=111532]: Waiting for error group managing segments... Aug 13 04:35:56.681540013 (107h9m51.112620144s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:56.771566774 (107h9m51.202646895s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.205665703 (107h9m51.636745834s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.212355693 (107h9m51.643435824s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.234601727 (107h9m51.665681858s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.235604687 (107h9m51.666684818s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.243559847 (107h9m51.674639998s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.245581856 (107h9m51.676661987s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.250633902 (107h9m51.681714033s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.312164180 (107h9m51.743244362s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.325353556 (107h9m51.756433687s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.345025115 (107h9m51.776105246s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.349504736 (107h9m51.780584877s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.371997913 (107h9m51.803078064s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.372029183 (107h9m51.803109324s) [seg_pos={0 0}, upload=111532]: Segment reached optimal threshold of 14 pieces. Aug 13 04:35:57.372262870 (107h9m51.803343001s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF Aug 13 04:35:57.372357411 (107h9m51.803437542s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF Aug 13 04:35:57.372371227 (107h9m51.803451358s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF Aug 13 04:35:57.372379634 (107h9m51.803459765s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KTMqMAjUKJ6NFK3tKvnpcKzdSxfnXTBC1hvWce28g3nP3Rhnv): protocol: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection Aug 13 04:35:57.372397417 (107h9m51.803477548s) [seg_pos={0 0}, upload=111532]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 04:35:57.372479404 (107h9m51.803559535s) [upload=111532]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 04:35:57.372509822 (107h9m51.803589963s) [upload=111532]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:35:57.681213717 (107h9m52.112293848s) [upload=111532]: Done uploading segments... Aug 13 04:35:57.681234457 (107h9m52.112314588s) [upload=111532]: Upload finished. err: <nil> Duration: 5.717624172s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 7.837218414s FAIL (2025-08-13 04:45:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.837246818s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [......X...................................X.................] duration: 1.841642737s FAIL (2025-08-13 04:45:13 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after c82f41086c10e8e784630232b68e0f7cf143b56088b414b7953f1ff8ef739d6a != before 9bf6ec9994ca7c4766b5318f204568e254175c351cfe104bdd6795e4366e1a5b ======LOGS====== Aug 13 04:31:56.429417659 (107h5m50.860497791s) [upload=111466]: Starting upload Aug 13 04:31:56.429489978 (107h5m50.860570109s) [upload=111466]: Done starting upload Aug 13 04:31:56.429575071 (107h5m50.860655202s) [upload=111466]: Uploading segments... Aug 13 04:31:56.429639935 (107h5m50.860720076s) [upload=111466]: Got next segment. Inline: true Aug 13 04:31:56.429646136 (107h5m50.860726267s) [upload=111466]: Waiting for error group managing segments... Aug 13 04:31:56.429701133 (107h5m50.860781264s) [upload=111466]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:31:56.429707254 (107h5m50.860787405s) [upload=111466]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 04:31:56.429711382 (107h5m50.860791533s) [upload=111466]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:31:56.721959480 (107h5m51.153039611s) [upload=111466]: Done uploading segments... Aug 13 04:31:56.721978156 (107h5m51.153058277s) [upload=111466]: Upload finished. err: <nil> Duration:* 1.841673986s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 8.240119607s FAIL (2025-08-13 04:44:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 8.240141779s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......X...................................X................] duration: 1.832773678s FAIL (2025-08-13 04:44:48 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after c82f41086c10e8e784630232b68e0f7cf143b56088b414b7953f1ff8ef739d6a != before 9bf6ec9994ca7c4766b5318f204568e254175c351cfe104bdd6795e4366e1a5b ======LOGS====== Aug 13 04:31:56.429417659 (107h5m50.860497791s) [upload=111466]: Starting upload Aug 13 04:31:56.429489978 (107h5m50.860570109s) [upload=111466]: Done starting upload Aug 13 04:31:56.429575071 (107h5m50.860655202s) [upload=111466]: Uploading segments... Aug 13 04:31:56.429639935 (107h5m50.860720076s) [upload=111466]: Got next segment. Inline: true Aug 13 04:31:56.429646136 (107h5m50.860726267s) [upload=111466]: Waiting for error group managing segments... Aug 13 04:31:56.429701133 (107h5m50.860781264s) [upload=111466]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:31:56.429707254 (107h5m50.860787405s) [upload=111466]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 04:31:56.429711382 (107h5m50.860791533s) [upload=111466]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:31:56.721959480 (107h5m51.153039611s) [upload=111466]: Done uploading segments... Aug 13 04:31:56.721978156 (107h5m51.153058277s) [upload=111466]: Upload finished. err: <nil> Duration:* 1.832798536s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [......X..........................................X..........] duration: 5.655953846s FAIL (2025-08-13 04:44:45 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 04:35:54.793148420 (107h9m49.224228561s) [upload=111532]: Starting upload Aug 13 04:35:54.793209617 (107h9m49.224289748s) [upload=111532]: Done starting upload Aug 13 04:35:54.793316461 (107h9m49.224396593s) [upload=111532]: Uploading segments... Aug 13 04:35:54.793430610 (107h9m49.224510731s) [upload=111532]: Got next segment. Inline: false Aug 13 04:35:54.793554506 (107h9m49.224634637s) [upload=111532]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:35:54.793560358 (107h9m49.224640489s) [upload=111532]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 04:35:55.251500973 (107h9m49.682581114s) [seg_pos={0 0}, upload=111532]: Begin upload segment... Aug 13 04:35:55.251562933 (107h9m49.682643064s) [seg_pos={0 0}, upload=111532]: Done begin upload segment. Aug 13 04:35:55.251592850 (107h9m49.682672981s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.251640200 (107h9m49.682720331s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252129516 (107h9m49.683209657s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252263212 (107h9m49.683343343s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252446683 (107h9m49.683526814s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252674649 (107h9m49.68375478s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252723483 (107h9m49.683803614s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252973952 (107h9m49.684054083s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.253217899 (107h9m49.68429803s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.253493757 (107h9m49.684573888s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.253729076 (107h9m49.684809207s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.253951341 (107h9m49.685031473s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254152948 (107h9m49.685233079s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254353331 (107h9m49.685433462s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254560177 (107h9m49.685640308s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254753066 (107h9m49.685833197s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254998255 (107h9m49.686078387s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.255202205 (107h9m49.686282336s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:56.355719157 (107h9m50.786799288s) [upload=111532]: Next returned nil segment Aug 13 04:35:56.355734617 (107h9m50.786814748s) [upload=111532]: Waiting for error group managing segments... Aug 13 04:35:56.681540013 (107h9m51.112620144s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:56.771566774 (107h9m51.202646895s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.205665703 (107h9m51.636745834s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.212355693 (107h9m51.643435824s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.234601727 (107h9m51.665681858s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.235604687 (107h9m51.666684818s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.243559847 (107h9m51.674639998s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.245581856 (107h9m51.676661987s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.250633902 (107h9m51.681714033s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.312164180 (107h9m51.743244362s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.325353556 (107h9m51.756433687s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.345025115 (107h9m51.776105246s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.349504736 (107h9m51.780584877s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.371997913 (107h9m51.803078064s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.372029183 (107h9m51.803109324s) [seg_pos={0 0}, upload=111532]: Segment reached optimal threshold of 14 pieces. Aug 13 04:35:57.372262870 (107h9m51.803343001s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF Aug 13 04:35:57.372357411 (107h9m51.803437542s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF Aug 13 04:35:57.372371227 (107h9m51.803451358s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF Aug 13 04:35:57.372379634 (107h9m51.803459765s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KTMqMAjUKJ6NFK3tKvnpcKzdSxfnXTBC1hvWce28g3nP3Rhnv): protocol: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection Aug 13 04:35:57.372397417 (107h9m51.803477548s) [seg_pos={0 0}, upload=111532]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 04:35:57.372479404 (107h9m51.803559535s) [upload=111532]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 04:35:57.372509822 (107h9m51.803589963s) [upload=111532]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:35:57.681213717 (107h9m52.112293848s) [upload=111532]: Done uploading segments... Aug 13 04:35:57.681234457 (107h9m52.112314588s) [upload=111532]: Upload finished. err: <nil> Duration: 5.655981127s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 8.028462269s FAIL (2025-08-13 04:44:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 8.02848357s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......X..........................................X.........] duration: 5.819238668s FAIL (2025-08-13 04:43:52 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 04:35:54.793148420 (107h9m49.224228561s) [upload=111532]: Starting upload Aug 13 04:35:54.793209617 (107h9m49.224289748s) [upload=111532]: Done starting upload Aug 13 04:35:54.793316461 (107h9m49.224396593s) [upload=111532]: Uploading segments... Aug 13 04:35:54.793430610 (107h9m49.224510731s) [upload=111532]: Got next segment. Inline: false Aug 13 04:35:54.793554506 (107h9m49.224634637s) [upload=111532]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:35:54.793560358 (107h9m49.224640489s) [upload=111532]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 04:35:55.251500973 (107h9m49.682581114s) [seg_pos={0 0}, upload=111532]: Begin upload segment... Aug 13 04:35:55.251562933 (107h9m49.682643064s) [seg_pos={0 0}, upload=111532]: Done begin upload segment. Aug 13 04:35:55.251592850 (107h9m49.682672981s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.251640200 (107h9m49.682720331s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252129516 (107h9m49.683209657s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252263212 (107h9m49.683343343s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252446683 (107h9m49.683526814s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252674649 (107h9m49.68375478s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252723483 (107h9m49.683803614s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252973952 (107h9m49.684054083s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.253217899 (107h9m49.68429803s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.253493757 (107h9m49.684573888s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.253729076 (107h9m49.684809207s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.253951341 (107h9m49.685031473s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254152948 (107h9m49.685233079s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254353331 (107h9m49.685433462s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254560177 (107h9m49.685640308s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254753066 (107h9m49.685833197s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254998255 (107h9m49.686078387s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.255202205 (107h9m49.686282336s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:56.355719157 (107h9m50.786799288s) [upload=111532]: Next returned nil segment Aug 13 04:35:56.355734617 (107h9m50.786814748s) [upload=111532]: Waiting for error group managing segments... Aug 13 04:35:56.681540013 (107h9m51.112620144s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:56.771566774 (107h9m51.202646895s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.205665703 (107h9m51.636745834s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.212355693 (107h9m51.643435824s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.234601727 (107h9m51.665681858s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.235604687 (107h9m51.666684818s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.243559847 (107h9m51.674639998s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.245581856 (107h9m51.676661987s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.250633902 (107h9m51.681714033s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.312164180 (107h9m51.743244362s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.325353556 (107h9m51.756433687s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.345025115 (107h9m51.776105246s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.349504736 (107h9m51.780584877s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.371997913 (107h9m51.803078064s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.372029183 (107h9m51.803109324s) [seg_pos={0 0}, upload=111532]: Segment reached optimal threshold of 14 pieces. Aug 13 04:35:57.372262870 (107h9m51.803343001s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF Aug 13 04:35:57.372357411 (107h9m51.803437542s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF Aug 13 04:35:57.372371227 (107h9m51.803451358s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF Aug 13 04:35:57.372379634 (107h9m51.803459765s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KTMqMAjUKJ6NFK3tKvnpcKzdSxfnXTBC1hvWce28g3nP3Rhnv): protocol: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection Aug 13 04:35:57.372397417 (107h9m51.803477548s) [seg_pos={0 0}, upload=111532]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 04:35:57.372479404 (107h9m51.803559535s) [upload=111532]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 04:35:57.372509822 (107h9m51.803589963s) [upload=111532]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:35:57.681213717 (107h9m52.112293848s) [upload=111532]: Done uploading segments... Aug 13 04:35:57.681234457 (107h9m52.112314588s) [upload=111532]: Upload finished. err: <nil> Duration: 5.819266543s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [........X...................................X...............] duration: 1.835455291s FAIL (2025-08-13 04:43:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after c82f41086c10e8e784630232b68e0f7cf143b56088b414b7953f1ff8ef739d6a != before 9bf6ec9994ca7c4766b5318f204568e254175c351cfe104bdd6795e4366e1a5b ======LOGS====== Aug 13 04:31:56.429417659 (107h5m50.860497791s) [upload=111466]: Starting upload Aug 13 04:31:56.429489978 (107h5m50.860570109s) [upload=111466]: Done starting upload Aug 13 04:31:56.429575071 (107h5m50.860655202s) [upload=111466]: Uploading segments... Aug 13 04:31:56.429639935 (107h5m50.860720076s) [upload=111466]: Got next segment. Inline: true Aug 13 04:31:56.429646136 (107h5m50.860726267s) [upload=111466]: Waiting for error group managing segments... Aug 13 04:31:56.429701133 (107h5m50.860781264s) [upload=111466]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:31:56.429707254 (107h5m50.860787405s) [upload=111466]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 04:31:56.429711382 (107h5m50.860791533s) [upload=111466]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:31:56.721959480 (107h5m51.153039611s) [upload=111466]: Done uploading segments... Aug 13 04:31:56.721978156 (107h5m51.153058277s) [upload=111466]: Upload finished. err: <nil> Duration:* 1.835485968s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 8.2832479s FAIL (2025-08-13 04:43:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 8.283298889s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........X...................................X..............] duration: 1.842507278s FAIL (2025-08-13 04:43:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after c82f41086c10e8e784630232b68e0f7cf143b56088b414b7953f1ff8ef739d6a != before 9bf6ec9994ca7c4766b5318f204568e254175c351cfe104bdd6795e4366e1a5b ======LOGS====== Aug 13 04:31:56.429417659 (107h5m50.860497791s) [upload=111466]: Starting upload Aug 13 04:31:56.429489978 (107h5m50.860570109s) [upload=111466]: Done starting upload Aug 13 04:31:56.429575071 (107h5m50.860655202s) [upload=111466]: Uploading segments... Aug 13 04:31:56.429639935 (107h5m50.860720076s) [upload=111466]: Got next segment. Inline: true Aug 13 04:31:56.429646136 (107h5m50.860726267s) [upload=111466]: Waiting for error group managing segments... Aug 13 04:31:56.429701133 (107h5m50.860781264s) [upload=111466]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:31:56.429707254 (107h5m50.860787405s) [upload=111466]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 04:31:56.429711382 (107h5m50.860791533s) [upload=111466]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:31:56.721959480 (107h5m51.153039611s) [upload=111466]: Done uploading segments... Aug 13 04:31:56.721978156 (107h5m51.153058277s) [upload=111466]: Upload finished. err: <nil> Duration:* 1.842532968s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [........X..........................................X........] duration: 5.652590665s FAIL (2025-08-13 04:43:31 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 04:35:54.793148420 (107h9m49.224228561s) [upload=111532]: Starting upload Aug 13 04:35:54.793209617 (107h9m49.224289748s) [upload=111532]: Done starting upload Aug 13 04:35:54.793316461 (107h9m49.224396593s) [upload=111532]: Uploading segments... Aug 13 04:35:54.793430610 (107h9m49.224510731s) [upload=111532]: Got next segment. Inline: false Aug 13 04:35:54.793554506 (107h9m49.224634637s) [upload=111532]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:35:54.793560358 (107h9m49.224640489s) [upload=111532]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 04:35:55.251500973 (107h9m49.682581114s) [seg_pos={0 0}, upload=111532]: Begin upload segment... Aug 13 04:35:55.251562933 (107h9m49.682643064s) [seg_pos={0 0}, upload=111532]: Done begin upload segment. Aug 13 04:35:55.251592850 (107h9m49.682672981s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.251640200 (107h9m49.682720331s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252129516 (107h9m49.683209657s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252263212 (107h9m49.683343343s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252446683 (107h9m49.683526814s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252674649 (107h9m49.68375478s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252723483 (107h9m49.683803614s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252973952 (107h9m49.684054083s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.253217899 (107h9m49.68429803s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.253493757 (107h9m49.684573888s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.253729076 (107h9m49.684809207s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.253951341 (107h9m49.685031473s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254152948 (107h9m49.685233079s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254353331 (107h9m49.685433462s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254560177 (107h9m49.685640308s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254753066 (107h9m49.685833197s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254998255 (107h9m49.686078387s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.255202205 (107h9m49.686282336s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:56.355719157 (107h9m50.786799288s) [upload=111532]: Next returned nil segment Aug 13 04:35:56.355734617 (107h9m50.786814748s) [upload=111532]: Waiting for error group managing segments... Aug 13 04:35:56.681540013 (107h9m51.112620144s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:56.771566774 (107h9m51.202646895s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.205665703 (107h9m51.636745834s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.212355693 (107h9m51.643435824s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.234601727 (107h9m51.665681858s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.235604687 (107h9m51.666684818s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.243559847 (107h9m51.674639998s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.245581856 (107h9m51.676661987s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.250633902 (107h9m51.681714033s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.312164180 (107h9m51.743244362s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.325353556 (107h9m51.756433687s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.345025115 (107h9m51.776105246s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.349504736 (107h9m51.780584877s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.371997913 (107h9m51.803078064s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.372029183 (107h9m51.803109324s) [seg_pos={0 0}, upload=111532]: Segment reached optimal threshold of 14 pieces. Aug 13 04:35:57.372262870 (107h9m51.803343001s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF Aug 13 04:35:57.372357411 (107h9m51.803437542s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF Aug 13 04:35:57.372371227 (107h9m51.803451358s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF Aug 13 04:35:57.372379634 (107h9m51.803459765s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KTMqMAjUKJ6NFK3tKvnpcKzdSxfnXTBC1hvWce28g3nP3Rhnv): protocol: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection Aug 13 04:35:57.372397417 (107h9m51.803477548s) [seg_pos={0 0}, upload=111532]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 04:35:57.372479404 (107h9m51.803559535s) [upload=111532]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 04:35:57.372509822 (107h9m51.803589963s) [upload=111532]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:35:57.681213717 (107h9m52.112293848s) [upload=111532]: Done uploading segments... Aug 13 04:35:57.681234457 (107h9m52.112314588s) [upload=111532]: Upload finished. err: <nil> Duration: 5.65262028s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 8.30683875s FAIL (2025-08-13 04:42:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 8.306861964s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........X...................................X.............] duration: 1.835499472s FAIL (2025-08-13 04:42:53 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after c82f41086c10e8e784630232b68e0f7cf143b56088b414b7953f1ff8ef739d6a != before 9bf6ec9994ca7c4766b5318f204568e254175c351cfe104bdd6795e4366e1a5b ======LOGS====== Aug 13 04:31:56.429417659 (107h5m50.860497791s) [upload=111466]: Starting upload Aug 13 04:31:56.429489978 (107h5m50.860570109s) [upload=111466]: Done starting upload Aug 13 04:31:56.429575071 (107h5m50.860655202s) [upload=111466]: Uploading segments... Aug 13 04:31:56.429639935 (107h5m50.860720076s) [upload=111466]: Got next segment. Inline: true Aug 13 04:31:56.429646136 (107h5m50.860726267s) [upload=111466]: Waiting for error group managing segments... Aug 13 04:31:56.429701133 (107h5m50.860781264s) [upload=111466]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:31:56.429707254 (107h5m50.860787405s) [upload=111466]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 04:31:56.429711382 (107h5m50.860791533s) [upload=111466]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:31:56.721959480 (107h5m51.153039611s) [upload=111466]: Done uploading segments... Aug 13 04:31:56.721978156 (107h5m51.153058277s) [upload=111466]: Upload finished. err: <nil> Duration:* 1.835527677s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 8.84161126s FAIL (2025-08-13 04:42:34 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 8.841675062s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........X..........................................X.......] duration: 6.265031649s FAIL (2025-08-13 04:42:32 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 04:35:54.793148420 (107h9m49.224228561s) [upload=111532]: Starting upload Aug 13 04:35:54.793209617 (107h9m49.224289748s) [upload=111532]: Done starting upload Aug 13 04:35:54.793316461 (107h9m49.224396593s) [upload=111532]: Uploading segments... Aug 13 04:35:54.793430610 (107h9m49.224510731s) [upload=111532]: Got next segment. Inline: false Aug 13 04:35:54.793554506 (107h9m49.224634637s) [upload=111532]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:35:54.793560358 (107h9m49.224640489s) [upload=111532]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 04:35:55.251500973 (107h9m49.682581114s) [seg_pos={0 0}, upload=111532]: Begin upload segment... Aug 13 04:35:55.251562933 (107h9m49.682643064s) [seg_pos={0 0}, upload=111532]: Done begin upload segment. Aug 13 04:35:55.251592850 (107h9m49.682672981s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.251640200 (107h9m49.682720331s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252129516 (107h9m49.683209657s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252263212 (107h9m49.683343343s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252446683 (107h9m49.683526814s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252674649 (107h9m49.68375478s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252723483 (107h9m49.683803614s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252973952 (107h9m49.684054083s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.253217899 (107h9m49.68429803s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.253493757 (107h9m49.684573888s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.253729076 (107h9m49.684809207s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.253951341 (107h9m49.685031473s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254152948 (107h9m49.685233079s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254353331 (107h9m49.685433462s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254560177 (107h9m49.685640308s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254753066 (107h9m49.685833197s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254998255 (107h9m49.686078387s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.255202205 (107h9m49.686282336s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:56.355719157 (107h9m50.786799288s) [upload=111532]: Next returned nil segment Aug 13 04:35:56.355734617 (107h9m50.786814748s) [upload=111532]: Waiting for error group managing segments... Aug 13 04:35:56.681540013 (107h9m51.112620144s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:56.771566774 (107h9m51.202646895s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.205665703 (107h9m51.636745834s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.212355693 (107h9m51.643435824s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.234601727 (107h9m51.665681858s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.235604687 (107h9m51.666684818s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.243559847 (107h9m51.674639998s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.245581856 (107h9m51.676661987s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.250633902 (107h9m51.681714033s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.312164180 (107h9m51.743244362s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.325353556 (107h9m51.756433687s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.345025115 (107h9m51.776105246s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.349504736 (107h9m51.780584877s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.371997913 (107h9m51.803078064s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.372029183 (107h9m51.803109324s) [seg_pos={0 0}, upload=111532]: Segment reached optimal threshold of 14 pieces. Aug 13 04:35:57.372262870 (107h9m51.803343001s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF Aug 13 04:35:57.372357411 (107h9m51.803437542s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF Aug 13 04:35:57.372371227 (107h9m51.803451358s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF Aug 13 04:35:57.372379634 (107h9m51.803459765s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KTMqMAjUKJ6NFK3tKvnpcKzdSxfnXTBC1hvWce28g3nP3Rhnv): protocol: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection Aug 13 04:35:57.372397417 (107h9m51.803477548s) [seg_pos={0 0}, upload=111532]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 04:35:57.372479404 (107h9m51.803559535s) [upload=111532]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 04:35:57.372509822 (107h9m51.803589963s) [upload=111532]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:35:57.681213717 (107h9m52.112293848s) [upload=111532]: Done uploading segments... Aug 13 04:35:57.681234457 (107h9m52.112314588s) [upload=111532]: Upload finished. err: <nil> Duration: 6.265061187s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...........X...................................X............] duration: 1.823240507s FAIL (2025-08-13 04:42:20 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after c82f41086c10e8e784630232b68e0f7cf143b56088b414b7953f1ff8ef739d6a != before 9bf6ec9994ca7c4766b5318f204568e254175c351cfe104bdd6795e4366e1a5b ======LOGS====== Aug 13 04:31:56.429417659 (107h5m50.860497791s) [upload=111466]: Starting upload Aug 13 04:31:56.429489978 (107h5m50.860570109s) [upload=111466]: Done starting upload Aug 13 04:31:56.429575071 (107h5m50.860655202s) [upload=111466]: Uploading segments... Aug 13 04:31:56.429639935 (107h5m50.860720076s) [upload=111466]: Got next segment. Inline: true Aug 13 04:31:56.429646136 (107h5m50.860726267s) [upload=111466]: Waiting for error group managing segments... Aug 13 04:31:56.429701133 (107h5m50.860781264s) [upload=111466]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:31:56.429707254 (107h5m50.860787405s) [upload=111466]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 04:31:56.429711382 (107h5m50.860791533s) [upload=111466]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:31:56.721959480 (107h5m51.153039611s) [upload=111466]: Done uploading segments... Aug 13 04:31:56.721978156 (107h5m51.153058277s) [upload=111466]: Upload finished. err: <nil> Duration:* 1.823268119s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [............X...................................X...........] duration: 1.833908649s FAIL (2025-08-13 04:41:54 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after c82f41086c10e8e784630232b68e0f7cf143b56088b414b7953f1ff8ef739d6a != before 9bf6ec9994ca7c4766b5318f204568e254175c351cfe104bdd6795e4366e1a5b ======LOGS====== Aug 13 04:31:56.429417659 (107h5m50.860497791s) [upload=111466]: Starting upload Aug 13 04:31:56.429489978 (107h5m50.860570109s) [upload=111466]: Done starting upload Aug 13 04:31:56.429575071 (107h5m50.860655202s) [upload=111466]: Uploading segments... Aug 13 04:31:56.429639935 (107h5m50.860720076s) [upload=111466]: Got next segment. Inline: true Aug 13 04:31:56.429646136 (107h5m50.860726267s) [upload=111466]: Waiting for error group managing segments... Aug 13 04:31:56.429701133 (107h5m50.860781264s) [upload=111466]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:31:56.429707254 (107h5m50.860787405s) [upload=111466]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 04:31:56.429711382 (107h5m50.860791533s) [upload=111466]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:31:56.721959480 (107h5m51.153039611s) [upload=111466]: Done uploading segments... Aug 13 04:31:56.721978156 (107h5m51.153058277s) [upload=111466]: Upload finished. err: <nil> Duration:* 1.833930281s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 9.144425924s FAIL (2025-08-13 04:41:25 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 9.144449389s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........X..........................................X......] duration: 6.562565899s FAIL (2025-08-13 04:41:22 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 04:35:54.793148420 (107h9m49.224228561s) [upload=111532]: Starting upload Aug 13 04:35:54.793209617 (107h9m49.224289748s) [upload=111532]: Done starting upload Aug 13 04:35:54.793316461 (107h9m49.224396593s) [upload=111532]: Uploading segments... Aug 13 04:35:54.793430610 (107h9m49.224510731s) [upload=111532]: Got next segment. Inline: false Aug 13 04:35:54.793554506 (107h9m49.224634637s) [upload=111532]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:35:54.793560358 (107h9m49.224640489s) [upload=111532]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 04:35:55.251500973 (107h9m49.682581114s) [seg_pos={0 0}, upload=111532]: Begin upload segment... Aug 13 04:35:55.251562933 (107h9m49.682643064s) [seg_pos={0 0}, upload=111532]: Done begin upload segment. Aug 13 04:35:55.251592850 (107h9m49.682672981s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.251640200 (107h9m49.682720331s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252129516 (107h9m49.683209657s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252263212 (107h9m49.683343343s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252446683 (107h9m49.683526814s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252674649 (107h9m49.68375478s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252723483 (107h9m49.683803614s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252973952 (107h9m49.684054083s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.253217899 (107h9m49.68429803s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.253493757 (107h9m49.684573888s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.253729076 (107h9m49.684809207s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.253951341 (107h9m49.685031473s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254152948 (107h9m49.685233079s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254353331 (107h9m49.685433462s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254560177 (107h9m49.685640308s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254753066 (107h9m49.685833197s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254998255 (107h9m49.686078387s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.255202205 (107h9m49.686282336s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:56.355719157 (107h9m50.786799288s) [upload=111532]: Next returned nil segment Aug 13 04:35:56.355734617 (107h9m50.786814748s) [upload=111532]: Waiting for error group managing segments... Aug 13 04:35:56.681540013 (107h9m51.112620144s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:56.771566774 (107h9m51.202646895s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.205665703 (107h9m51.636745834s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.212355693 (107h9m51.643435824s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.234601727 (107h9m51.665681858s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.235604687 (107h9m51.666684818s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.243559847 (107h9m51.674639998s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.245581856 (107h9m51.676661987s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.250633902 (107h9m51.681714033s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.312164180 (107h9m51.743244362s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.325353556 (107h9m51.756433687s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.345025115 (107h9m51.776105246s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.349504736 (107h9m51.780584877s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.371997913 (107h9m51.803078064s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.372029183 (107h9m51.803109324s) [seg_pos={0 0}, upload=111532]: Segment reached optimal threshold of 14 pieces. Aug 13 04:35:57.372262870 (107h9m51.803343001s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF Aug 13 04:35:57.372357411 (107h9m51.803437542s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF Aug 13 04:35:57.372371227 (107h9m51.803451358s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF Aug 13 04:35:57.372379634 (107h9m51.803459765s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KTMqMAjUKJ6NFK3tKvnpcKzdSxfnXTBC1hvWce28g3nP3Rhnv): protocol: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection Aug 13 04:35:57.372397417 (107h9m51.803477548s) [seg_pos={0 0}, upload=111532]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 04:35:57.372479404 (107h9m51.803559535s) [upload=111532]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 04:35:57.372509822 (107h9m51.803589963s) [upload=111532]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:35:57.681213717 (107h9m52.112293848s) [upload=111532]: Done uploading segments... Aug 13 04:35:57.681234457 (107h9m52.112314588s) [upload=111532]: Upload finished. err: <nil> Duration: 6.562590056s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.............X...................................X..........] duration: 2.072570039s FAIL (2025-08-13 04:41:12 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after c82f41086c10e8e784630232b68e0f7cf143b56088b414b7953f1ff8ef739d6a != before 9bf6ec9994ca7c4766b5318f204568e254175c351cfe104bdd6795e4366e1a5b ======LOGS====== Aug 13 04:31:56.429417659 (107h5m50.860497791s) [upload=111466]: Starting upload Aug 13 04:31:56.429489978 (107h5m50.860570109s) [upload=111466]: Done starting upload Aug 13 04:31:56.429575071 (107h5m50.860655202s) [upload=111466]: Uploading segments... Aug 13 04:31:56.429639935 (107h5m50.860720076s) [upload=111466]: Got next segment. Inline: true Aug 13 04:31:56.429646136 (107h5m50.860726267s) [upload=111466]: Waiting for error group managing segments... Aug 13 04:31:56.429701133 (107h5m50.860781264s) [upload=111466]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:31:56.429707254 (107h5m50.860787405s) [upload=111466]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 04:31:56.429711382 (107h5m50.860791533s) [upload=111466]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:31:56.721959480 (107h5m51.153039611s) [upload=111466]: Done uploading segments... Aug 13 04:31:56.721978156 (107h5m51.153058277s) [upload=111466]: Upload finished. err: <nil> Duration:* 2.072599556s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..............X...................................X.........] duration: 1.88270379s FAIL (2025-08-13 04:40:54 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after c82f41086c10e8e784630232b68e0f7cf143b56088b414b7953f1ff8ef739d6a != before 9bf6ec9994ca7c4766b5318f204568e254175c351cfe104bdd6795e4366e1a5b ======LOGS====== Aug 13 04:31:56.429417659 (107h5m50.860497791s) [upload=111466]: Starting upload Aug 13 04:31:56.429489978 (107h5m50.860570109s) [upload=111466]: Done starting upload Aug 13 04:31:56.429575071 (107h5m50.860655202s) [upload=111466]: Uploading segments... Aug 13 04:31:56.429639935 (107h5m50.860720076s) [upload=111466]: Got next segment. Inline: true Aug 13 04:31:56.429646136 (107h5m50.860726267s) [upload=111466]: Waiting for error group managing segments... Aug 13 04:31:56.429701133 (107h5m50.860781264s) [upload=111466]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:31:56.429707254 (107h5m50.860787405s) [upload=111466]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 04:31:56.429711382 (107h5m50.860791533s) [upload=111466]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:31:56.721959480 (107h5m51.153039611s) [upload=111466]: Done uploading segments... Aug 13 04:31:56.721978156 (107h5m51.153058277s) [upload=111466]: Upload finished. err: <nil> Duration:* 1.882731102s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 10.96553513s FAIL (2025-08-13 04:40:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 10.965555358s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........X..........................................X.....] duration: 5.978752211s FAIL (2025-08-13 04:40:11 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 04:35:54.793148420 (107h9m49.224228561s) [upload=111532]: Starting upload Aug 13 04:35:54.793209617 (107h9m49.224289748s) [upload=111532]: Done starting upload Aug 13 04:35:54.793316461 (107h9m49.224396593s) [upload=111532]: Uploading segments... Aug 13 04:35:54.793430610 (107h9m49.224510731s) [upload=111532]: Got next segment. Inline: false Aug 13 04:35:54.793554506 (107h9m49.224634637s) [upload=111532]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:35:54.793560358 (107h9m49.224640489s) [upload=111532]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 04:35:55.251500973 (107h9m49.682581114s) [seg_pos={0 0}, upload=111532]: Begin upload segment... Aug 13 04:35:55.251562933 (107h9m49.682643064s) [seg_pos={0 0}, upload=111532]: Done begin upload segment. Aug 13 04:35:55.251592850 (107h9m49.682672981s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.251640200 (107h9m49.682720331s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252129516 (107h9m49.683209657s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252263212 (107h9m49.683343343s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252446683 (107h9m49.683526814s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252674649 (107h9m49.68375478s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252723483 (107h9m49.683803614s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252973952 (107h9m49.684054083s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.253217899 (107h9m49.68429803s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.253493757 (107h9m49.684573888s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.253729076 (107h9m49.684809207s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.253951341 (107h9m49.685031473s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254152948 (107h9m49.685233079s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254353331 (107h9m49.685433462s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254560177 (107h9m49.685640308s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254753066 (107h9m49.685833197s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254998255 (107h9m49.686078387s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.255202205 (107h9m49.686282336s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:56.355719157 (107h9m50.786799288s) [upload=111532]: Next returned nil segment Aug 13 04:35:56.355734617 (107h9m50.786814748s) [upload=111532]: Waiting for error group managing segments... Aug 13 04:35:56.681540013 (107h9m51.112620144s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:56.771566774 (107h9m51.202646895s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.205665703 (107h9m51.636745834s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.212355693 (107h9m51.643435824s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.234601727 (107h9m51.665681858s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.235604687 (107h9m51.666684818s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.243559847 (107h9m51.674639998s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.245581856 (107h9m51.676661987s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.250633902 (107h9m51.681714033s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.312164180 (107h9m51.743244362s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.325353556 (107h9m51.756433687s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.345025115 (107h9m51.776105246s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.349504736 (107h9m51.780584877s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.371997913 (107h9m51.803078064s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.372029183 (107h9m51.803109324s) [seg_pos={0 0}, upload=111532]: Segment reached optimal threshold of 14 pieces. Aug 13 04:35:57.372262870 (107h9m51.803343001s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF Aug 13 04:35:57.372357411 (107h9m51.803437542s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF Aug 13 04:35:57.372371227 (107h9m51.803451358s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF Aug 13 04:35:57.372379634 (107h9m51.803459765s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KTMqMAjUKJ6NFK3tKvnpcKzdSxfnXTBC1hvWce28g3nP3Rhnv): protocol: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection Aug 13 04:35:57.372397417 (107h9m51.803477548s) [seg_pos={0 0}, upload=111532]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 04:35:57.372479404 (107h9m51.803559535s) [upload=111532]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 04:35:57.372509822 (107h9m51.803589963s) [upload=111532]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:35:57.681213717 (107h9m52.112293848s) [upload=111532]: Done uploading segments... Aug 13 04:35:57.681234457 (107h9m52.112314588s) [upload=111532]: Upload finished. err: <nil> Duration: 5.978778621s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...............X...................................X........] duration: 2.267226415s FAIL (2025-08-13 04:39:42 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after c82f41086c10e8e784630232b68e0f7cf143b56088b414b7953f1ff8ef739d6a != before 9bf6ec9994ca7c4766b5318f204568e254175c351cfe104bdd6795e4366e1a5b ======LOGS====== Aug 13 04:31:56.429417659 (107h5m50.860497791s) [upload=111466]: Starting upload Aug 13 04:31:56.429489978 (107h5m50.860570109s) [upload=111466]: Done starting upload Aug 13 04:31:56.429575071 (107h5m50.860655202s) [upload=111466]: Uploading segments... Aug 13 04:31:56.429639935 (107h5m50.860720076s) [upload=111466]: Got next segment. Inline: true Aug 13 04:31:56.429646136 (107h5m50.860726267s) [upload=111466]: Waiting for error group managing segments... Aug 13 04:31:56.429701133 (107h5m50.860781264s) [upload=111466]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:31:56.429707254 (107h5m50.860787405s) [upload=111466]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 04:31:56.429711382 (107h5m50.860791533s) [upload=111466]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:31:56.721959480 (107h5m51.153039611s) [upload=111466]: Done uploading segments... Aug 13 04:31:56.721978156 (107h5m51.153058277s) [upload=111466]: Upload finished. err: <nil> Duration:* 2.267251765s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 7.40633683s FAIL (2025-08-13 04:39:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.406362861s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [............X..........................................X....] duration: 5.853422142s FAIL (2025-08-13 04:38:57 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 04:35:54.793148420 (107h9m49.224228561s) [upload=111532]: Starting upload Aug 13 04:35:54.793209617 (107h9m49.224289748s) [upload=111532]: Done starting upload Aug 13 04:35:54.793316461 (107h9m49.224396593s) [upload=111532]: Uploading segments... Aug 13 04:35:54.793430610 (107h9m49.224510731s) [upload=111532]: Got next segment. Inline: false Aug 13 04:35:54.793554506 (107h9m49.224634637s) [upload=111532]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:35:54.793560358 (107h9m49.224640489s) [upload=111532]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 04:35:55.251500973 (107h9m49.682581114s) [seg_pos={0 0}, upload=111532]: Begin upload segment... Aug 13 04:35:55.251562933 (107h9m49.682643064s) [seg_pos={0 0}, upload=111532]: Done begin upload segment. Aug 13 04:35:55.251592850 (107h9m49.682672981s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.251640200 (107h9m49.682720331s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252129516 (107h9m49.683209657s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252263212 (107h9m49.683343343s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252446683 (107h9m49.683526814s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252674649 (107h9m49.68375478s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252723483 (107h9m49.683803614s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252973952 (107h9m49.684054083s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.253217899 (107h9m49.68429803s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.253493757 (107h9m49.684573888s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.253729076 (107h9m49.684809207s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.253951341 (107h9m49.685031473s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254152948 (107h9m49.685233079s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254353331 (107h9m49.685433462s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254560177 (107h9m49.685640308s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254753066 (107h9m49.685833197s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254998255 (107h9m49.686078387s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.255202205 (107h9m49.686282336s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:56.355719157 (107h9m50.786799288s) [upload=111532]: Next returned nil segment Aug 13 04:35:56.355734617 (107h9m50.786814748s) [upload=111532]: Waiting for error group managing segments... Aug 13 04:35:56.681540013 (107h9m51.112620144s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:56.771566774 (107h9m51.202646895s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.205665703 (107h9m51.636745834s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.212355693 (107h9m51.643435824s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.234601727 (107h9m51.665681858s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.235604687 (107h9m51.666684818s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.243559847 (107h9m51.674639998s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.245581856 (107h9m51.676661987s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.250633902 (107h9m51.681714033s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.312164180 (107h9m51.743244362s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.325353556 (107h9m51.756433687s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.345025115 (107h9m51.776105246s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.349504736 (107h9m51.780584877s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.371997913 (107h9m51.803078064s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.372029183 (107h9m51.803109324s) [seg_pos={0 0}, upload=111532]: Segment reached optimal threshold of 14 pieces. Aug 13 04:35:57.372262870 (107h9m51.803343001s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF Aug 13 04:35:57.372357411 (107h9m51.803437542s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF Aug 13 04:35:57.372371227 (107h9m51.803451358s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF Aug 13 04:35:57.372379634 (107h9m51.803459765s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KTMqMAjUKJ6NFK3tKvnpcKzdSxfnXTBC1hvWce28g3nP3Rhnv): protocol: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection Aug 13 04:35:57.372397417 (107h9m51.803477548s) [seg_pos={0 0}, upload=111532]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 04:35:57.372479404 (107h9m51.803559535s) [upload=111532]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 04:35:57.372509822 (107h9m51.803589963s) [upload=111532]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:35:57.681213717 (107h9m52.112293848s) [upload=111532]: Done uploading segments... Aug 13 04:35:57.681234457 (107h9m52.112314588s) [upload=111532]: Upload finished. err: <nil> Duration: 5.853444564s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 8.380813927s FAIL (2025-08-13 04:38:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 8.380840789s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............X..........................................X...] duration: 6.396507858s FAIL (2025-08-13 04:38:39 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 04:35:54.793148420 (107h9m49.224228561s) [upload=111532]: Starting upload Aug 13 04:35:54.793209617 (107h9m49.224289748s) [upload=111532]: Done starting upload Aug 13 04:35:54.793316461 (107h9m49.224396593s) [upload=111532]: Uploading segments... Aug 13 04:35:54.793430610 (107h9m49.224510731s) [upload=111532]: Got next segment. Inline: false Aug 13 04:35:54.793554506 (107h9m49.224634637s) [upload=111532]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:35:54.793560358 (107h9m49.224640489s) [upload=111532]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 04:35:55.251500973 (107h9m49.682581114s) [seg_pos={0 0}, upload=111532]: Begin upload segment... Aug 13 04:35:55.251562933 (107h9m49.682643064s) [seg_pos={0 0}, upload=111532]: Done begin upload segment. Aug 13 04:35:55.251592850 (107h9m49.682672981s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.251640200 (107h9m49.682720331s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252129516 (107h9m49.683209657s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252263212 (107h9m49.683343343s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252446683 (107h9m49.683526814s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252674649 (107h9m49.68375478s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252723483 (107h9m49.683803614s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252973952 (107h9m49.684054083s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.253217899 (107h9m49.68429803s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.253493757 (107h9m49.684573888s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.253729076 (107h9m49.684809207s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.253951341 (107h9m49.685031473s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254152948 (107h9m49.685233079s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254353331 (107h9m49.685433462s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254560177 (107h9m49.685640308s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254753066 (107h9m49.685833197s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254998255 (107h9m49.686078387s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.255202205 (107h9m49.686282336s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:56.355719157 (107h9m50.786799288s) [upload=111532]: Next returned nil segment Aug 13 04:35:56.355734617 (107h9m50.786814748s) [upload=111532]: Waiting for error group managing segments... Aug 13 04:35:56.681540013 (107h9m51.112620144s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:56.771566774 (107h9m51.202646895s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.205665703 (107h9m51.636745834s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.212355693 (107h9m51.643435824s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.234601727 (107h9m51.665681858s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.235604687 (107h9m51.666684818s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.243559847 (107h9m51.674639998s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.245581856 (107h9m51.676661987s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.250633902 (107h9m51.681714033s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.312164180 (107h9m51.743244362s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.325353556 (107h9m51.756433687s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.345025115 (107h9m51.776105246s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.349504736 (107h9m51.780584877s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.371997913 (107h9m51.803078064s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.372029183 (107h9m51.803109324s) [seg_pos={0 0}, upload=111532]: Segment reached optimal threshold of 14 pieces. Aug 13 04:35:57.372262870 (107h9m51.803343001s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF Aug 13 04:35:57.372357411 (107h9m51.803437542s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF Aug 13 04:35:57.372371227 (107h9m51.803451358s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF Aug 13 04:35:57.372379634 (107h9m51.803459765s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KTMqMAjUKJ6NFK3tKvnpcKzdSxfnXTBC1hvWce28g3nP3Rhnv): protocol: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection Aug 13 04:35:57.372397417 (107h9m51.803477548s) [seg_pos={0 0}, upload=111532]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 04:35:57.372479404 (107h9m51.803559535s) [upload=111532]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 04:35:57.372509822 (107h9m51.803589963s) [upload=111532]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:35:57.681213717 (107h9m52.112293848s) [upload=111532]: Done uploading segments... Aug 13 04:35:57.681234457 (107h9m52.112314588s) [upload=111532]: Upload finished. err: <nil> Duration: 6.396556541s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [................X...................................X.......] duration: 1.925698754s FAIL (2025-08-13 04:38:37 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after c82f41086c10e8e784630232b68e0f7cf143b56088b414b7953f1ff8ef739d6a != before 9bf6ec9994ca7c4766b5318f204568e254175c351cfe104bdd6795e4366e1a5b ======LOGS====== Aug 13 04:31:56.429417659 (107h5m50.860497791s) [upload=111466]: Starting upload Aug 13 04:31:56.429489978 (107h5m50.860570109s) [upload=111466]: Done starting upload Aug 13 04:31:56.429575071 (107h5m50.860655202s) [upload=111466]: Uploading segments... Aug 13 04:31:56.429639935 (107h5m50.860720076s) [upload=111466]: Got next segment. Inline: true Aug 13 04:31:56.429646136 (107h5m50.860726267s) [upload=111466]: Waiting for error group managing segments... Aug 13 04:31:56.429701133 (107h5m50.860781264s) [upload=111466]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:31:56.429707254 (107h5m50.860787405s) [upload=111466]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 04:31:56.429711382 (107h5m50.860791533s) [upload=111466]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:31:56.721959480 (107h5m51.153039611s) [upload=111466]: Done uploading segments... Aug 13 04:31:56.721978156 (107h5m51.153058277s) [upload=111466]: Upload finished. err: <nil> Duration:* 1.925750533s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............X..........................................X..] duration: 5.894589731s FAIL (2025-08-13 04:37:45 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 04:35:54.793148420 (107h9m49.224228561s) [upload=111532]: Starting upload Aug 13 04:35:54.793209617 (107h9m49.224289748s) [upload=111532]: Done starting upload Aug 13 04:35:54.793316461 (107h9m49.224396593s) [upload=111532]: Uploading segments... Aug 13 04:35:54.793430610 (107h9m49.224510731s) [upload=111532]: Got next segment. Inline: false Aug 13 04:35:54.793554506 (107h9m49.224634637s) [upload=111532]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:35:54.793560358 (107h9m49.224640489s) [upload=111532]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 04:35:55.251500973 (107h9m49.682581114s) [seg_pos={0 0}, upload=111532]: Begin upload segment... Aug 13 04:35:55.251562933 (107h9m49.682643064s) [seg_pos={0 0}, upload=111532]: Done begin upload segment. Aug 13 04:35:55.251592850 (107h9m49.682672981s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.251640200 (107h9m49.682720331s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252129516 (107h9m49.683209657s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252263212 (107h9m49.683343343s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252446683 (107h9m49.683526814s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252674649 (107h9m49.68375478s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252723483 (107h9m49.683803614s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252973952 (107h9m49.684054083s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.253217899 (107h9m49.68429803s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.253493757 (107h9m49.684573888s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.253729076 (107h9m49.684809207s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.253951341 (107h9m49.685031473s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254152948 (107h9m49.685233079s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254353331 (107h9m49.685433462s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254560177 (107h9m49.685640308s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254753066 (107h9m49.685833197s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254998255 (107h9m49.686078387s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.255202205 (107h9m49.686282336s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:56.355719157 (107h9m50.786799288s) [upload=111532]: Next returned nil segment Aug 13 04:35:56.355734617 (107h9m50.786814748s) [upload=111532]: Waiting for error group managing segments... Aug 13 04:35:56.681540013 (107h9m51.112620144s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:56.771566774 (107h9m51.202646895s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.205665703 (107h9m51.636745834s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.212355693 (107h9m51.643435824s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.234601727 (107h9m51.665681858s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.235604687 (107h9m51.666684818s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.243559847 (107h9m51.674639998s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.245581856 (107h9m51.676661987s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.250633902 (107h9m51.681714033s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.312164180 (107h9m51.743244362s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.325353556 (107h9m51.756433687s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.345025115 (107h9m51.776105246s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.349504736 (107h9m51.780584877s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.371997913 (107h9m51.803078064s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.372029183 (107h9m51.803109324s) [seg_pos={0 0}, upload=111532]: Segment reached optimal threshold of 14 pieces. Aug 13 04:35:57.372262870 (107h9m51.803343001s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF Aug 13 04:35:57.372357411 (107h9m51.803437542s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF Aug 13 04:35:57.372371227 (107h9m51.803451358s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF Aug 13 04:35:57.372379634 (107h9m51.803459765s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KTMqMAjUKJ6NFK3tKvnpcKzdSxfnXTBC1hvWce28g3nP3Rhnv): protocol: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection Aug 13 04:35:57.372397417 (107h9m51.803477548s) [seg_pos={0 0}, upload=111532]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 04:35:57.372479404 (107h9m51.803559535s) [upload=111532]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 04:35:57.372509822 (107h9m51.803589963s) [upload=111532]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:35:57.681213717 (107h9m52.112293848s) [upload=111532]: Done uploading segments... Aug 13 04:35:57.681234457 (107h9m52.112314588s) [upload=111532]: Upload finished. err: <nil> Duration: 5.894685525s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 7.740407855s FAIL (2025-08-13 04:37:45 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.740430139s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.................X...................................X......] duration: 1.829946057s FAIL (2025-08-13 04:37:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after c82f41086c10e8e784630232b68e0f7cf143b56088b414b7953f1ff8ef739d6a != before 9bf6ec9994ca7c4766b5318f204568e254175c351cfe104bdd6795e4366e1a5b ======LOGS====== Aug 13 04:31:56.429417659 (107h5m50.860497791s) [upload=111466]: Starting upload Aug 13 04:31:56.429489978 (107h5m50.860570109s) [upload=111466]: Done starting upload Aug 13 04:31:56.429575071 (107h5m50.860655202s) [upload=111466]: Uploading segments... Aug 13 04:31:56.429639935 (107h5m50.860720076s) [upload=111466]: Got next segment. Inline: true Aug 13 04:31:56.429646136 (107h5m50.860726267s) [upload=111466]: Waiting for error group managing segments... Aug 13 04:31:56.429701133 (107h5m50.860781264s) [upload=111466]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:31:56.429707254 (107h5m50.860787405s) [upload=111466]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 04:31:56.429711382 (107h5m50.860791533s) [upload=111466]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:31:56.721959480 (107h5m51.153039611s) [upload=111466]: Done uploading segments... Aug 13 04:31:56.721978156 (107h5m51.153058277s) [upload=111466]: Upload finished. err: <nil> Duration:* 1.829974803s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 10.311770602s FAIL (2025-08-13 04:37:14 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 10.311810689s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............X..........................................X.] duration: 5.972513947s FAIL (2025-08-13 04:36:31 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 04:35:54.793148420 (107h9m49.224228561s) [upload=111532]: Starting upload Aug 13 04:35:54.793209617 (107h9m49.224289748s) [upload=111532]: Done starting upload Aug 13 04:35:54.793316461 (107h9m49.224396593s) [upload=111532]: Uploading segments... Aug 13 04:35:54.793430610 (107h9m49.224510731s) [upload=111532]: Got next segment. Inline: false Aug 13 04:35:54.793554506 (107h9m49.224634637s) [upload=111532]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:35:54.793560358 (107h9m49.224640489s) [upload=111532]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 04:35:55.251500973 (107h9m49.682581114s) [seg_pos={0 0}, upload=111532]: Begin upload segment... Aug 13 04:35:55.251562933 (107h9m49.682643064s) [seg_pos={0 0}, upload=111532]: Done begin upload segment. Aug 13 04:35:55.251592850 (107h9m49.682672981s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.251640200 (107h9m49.682720331s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252129516 (107h9m49.683209657s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252263212 (107h9m49.683343343s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252446683 (107h9m49.683526814s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252674649 (107h9m49.68375478s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252723483 (107h9m49.683803614s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252973952 (107h9m49.684054083s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.253217899 (107h9m49.68429803s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.253493757 (107h9m49.684573888s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.253729076 (107h9m49.684809207s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.253951341 (107h9m49.685031473s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254152948 (107h9m49.685233079s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254353331 (107h9m49.685433462s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254560177 (107h9m49.685640308s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254753066 (107h9m49.685833197s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254998255 (107h9m49.686078387s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.255202205 (107h9m49.686282336s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:56.355719157 (107h9m50.786799288s) [upload=111532]: Next returned nil segment Aug 13 04:35:56.355734617 (107h9m50.786814748s) [upload=111532]: Waiting for error group managing segments... Aug 13 04:35:56.681540013 (107h9m51.112620144s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:56.771566774 (107h9m51.202646895s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.205665703 (107h9m51.636745834s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.212355693 (107h9m51.643435824s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.234601727 (107h9m51.665681858s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.235604687 (107h9m51.666684818s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.243559847 (107h9m51.674639998s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.245581856 (107h9m51.676661987s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.250633902 (107h9m51.681714033s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.312164180 (107h9m51.743244362s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.325353556 (107h9m51.756433687s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.345025115 (107h9m51.776105246s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.349504736 (107h9m51.780584877s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.371997913 (107h9m51.803078064s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.372029183 (107h9m51.803109324s) [seg_pos={0 0}, upload=111532]: Segment reached optimal threshold of 14 pieces. Aug 13 04:35:57.372262870 (107h9m51.803343001s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF Aug 13 04:35:57.372357411 (107h9m51.803437542s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF Aug 13 04:35:57.372371227 (107h9m51.803451358s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF Aug 13 04:35:57.372379634 (107h9m51.803459765s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KTMqMAjUKJ6NFK3tKvnpcKzdSxfnXTBC1hvWce28g3nP3Rhnv): protocol: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection Aug 13 04:35:57.372397417 (107h9m51.803477548s) [seg_pos={0 0}, upload=111532]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 04:35:57.372479404 (107h9m51.803559535s) [upload=111532]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 04:35:57.372509822 (107h9m51.803589963s) [upload=111532]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:35:57.681213717 (107h9m52.112293848s) [upload=111532]: Done uploading segments... Aug 13 04:35:57.681234457 (107h9m52.112314588s) [upload=111532]: Upload finished. err: <nil> Duration: 5.972540928s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 7.661929457s FAIL (2025-08-13 04:36:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.661965515s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..................X...................................X.....] duration: 1.853729173s FAIL (2025-08-13 04:36:23 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after c82f41086c10e8e784630232b68e0f7cf143b56088b414b7953f1ff8ef739d6a != before 9bf6ec9994ca7c4766b5318f204568e254175c351cfe104bdd6795e4366e1a5b ======LOGS====== Aug 13 04:31:56.429417659 (107h5m50.860497791s) [upload=111466]: Starting upload Aug 13 04:31:56.429489978 (107h5m50.860570109s) [upload=111466]: Done starting upload Aug 13 04:31:56.429575071 (107h5m50.860655202s) [upload=111466]: Uploading segments... Aug 13 04:31:56.429639935 (107h5m50.860720076s) [upload=111466]: Got next segment. Inline: true Aug 13 04:31:56.429646136 (107h5m50.860726267s) [upload=111466]: Waiting for error group managing segments... Aug 13 04:31:56.429701133 (107h5m50.860781264s) [upload=111466]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:31:56.429707254 (107h5m50.860787405s) [upload=111466]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 04:31:56.429711382 (107h5m50.860791533s) [upload=111466]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:31:56.721959480 (107h5m51.153039611s) [upload=111466]: Done uploading segments... Aug 13 04:31:56.721978156 (107h5m51.153058277s) [upload=111466]: Upload finished. err: <nil> Duration:* 1.853766995s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [................X..........................................X] duration: 4.230677449s FAIL (2025-08-13 04:35:58 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 04:35:54.793148420 (107h9m49.224228561s) [upload=111532]: Starting upload Aug 13 04:35:54.793209617 (107h9m49.224289748s) [upload=111532]: Done starting upload Aug 13 04:35:54.793316461 (107h9m49.224396593s) [upload=111532]: Uploading segments... Aug 13 04:35:54.793430610 (107h9m49.224510731s) [upload=111532]: Got next segment. Inline: false Aug 13 04:35:54.793554506 (107h9m49.224634637s) [upload=111532]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:35:54.793560358 (107h9m49.224640489s) [upload=111532]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 04:35:55.251500973 (107h9m49.682581114s) [seg_pos={0 0}, upload=111532]: Begin upload segment... Aug 13 04:35:55.251562933 (107h9m49.682643064s) [seg_pos={0 0}, upload=111532]: Done begin upload segment. Aug 13 04:35:55.251592850 (107h9m49.682672981s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.251640200 (107h9m49.682720331s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252129516 (107h9m49.683209657s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252263212 (107h9m49.683343343s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252446683 (107h9m49.683526814s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252674649 (107h9m49.68375478s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252723483 (107h9m49.683803614s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.252973952 (107h9m49.684054083s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.253217899 (107h9m49.68429803s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.253493757 (107h9m49.684573888s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.253729076 (107h9m49.684809207s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.253951341 (107h9m49.685031473s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254152948 (107h9m49.685233079s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254353331 (107h9m49.685433462s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254560177 (107h9m49.685640308s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254753066 (107h9m49.685833197s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.254998255 (107h9m49.686078387s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:55.255202205 (107h9m49.686282336s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Uploading piece... Aug 13 04:35:56.355719157 (107h9m50.786799288s) [upload=111532]: Next returned nil segment Aug 13 04:35:56.355734617 (107h9m50.786814748s) [upload=111532]: Waiting for error group managing segments... Aug 13 04:35:56.681540013 (107h9m51.112620144s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:56.771566774 (107h9m51.202646895s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.205665703 (107h9m51.636745834s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.212355693 (107h9m51.643435824s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.234601727 (107h9m51.665681858s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.235604687 (107h9m51.666684818s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.243559847 (107h9m51.674639998s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.245581856 (107h9m51.676661987s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.250633902 (107h9m51.681714033s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.312164180 (107h9m51.743244362s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.325353556 (107h9m51.756433687s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.345025115 (107h9m51.776105246s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.349504736 (107h9m51.780584877s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.371997913 (107h9m51.803078064s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil> Aug 13 04:35:57.372029183 (107h9m51.803109324s) [seg_pos={0 0}, upload=111532]: Segment reached optimal threshold of 14 pieces. Aug 13 04:35:57.372262870 (107h9m51.803343001s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF Aug 13 04:35:57.372357411 (107h9m51.803437542s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF Aug 13 04:35:57.372371227 (107h9m51.803451358s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF Aug 13 04:35:57.372379634 (107h9m51.803459765s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KTMqMAjUKJ6NFK3tKvnpcKzdSxfnXTBC1hvWce28g3nP3Rhnv): protocol: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection Aug 13 04:35:57.372397417 (107h9m51.803477548s) [seg_pos={0 0}, upload=111532]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 04:35:57.372479404 (107h9m51.803559535s) [upload=111532]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 04:35:57.372509822 (107h9m51.803589963s) [upload=111532]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:35:57.681213717 (107h9m52.112293848s) [upload=111532]: Done uploading segments... Aug 13 04:35:57.681234457 (107h9m52.112314588s) [upload=111532]: Upload finished. err: <nil> Duration: 4.230702377s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...................X...................................X....] duration: 2.070705862s FAIL (2025-08-13 04:35:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after c82f41086c10e8e784630232b68e0f7cf143b56088b414b7953f1ff8ef739d6a != before 9bf6ec9994ca7c4766b5318f204568e254175c351cfe104bdd6795e4366e1a5b ======LOGS====== Aug 13 04:31:56.429417659 (107h5m50.860497791s) [upload=111466]: Starting upload Aug 13 04:31:56.429489978 (107h5m50.860570109s) [upload=111466]: Done starting upload Aug 13 04:31:56.429575071 (107h5m50.860655202s) [upload=111466]: Uploading segments... Aug 13 04:31:56.429639935 (107h5m50.860720076s) [upload=111466]: Got next segment. Inline: true Aug 13 04:31:56.429646136 (107h5m50.860726267s) [upload=111466]: Waiting for error group managing segments... Aug 13 04:31:56.429701133 (107h5m50.860781264s) [upload=111466]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:31:56.429707254 (107h5m50.860787405s) [upload=111466]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 04:31:56.429711382 (107h5m50.860791533s) [upload=111466]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:31:56.721959480 (107h5m51.153039611s) [upload=111466]: Done uploading segments... Aug 13 04:31:56.721978156 (107h5m51.153058277s) [upload=111466]: Upload finished. err: <nil> Duration:* 2.070733073s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 8.498023286s FAIL (2025-08-13 04:35:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 8.498044046s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 8.122098731s FAIL (2025-08-13 04:35:03 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 8.122124359s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 5.716193226s FAIL (2025-08-13 04:35:01 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a6ab6965f6133e239ccbdf66a1f0be1fef1b0dc5e2e5b52bff2d0f5fa9076658 != before 6fdcc254ba2040cdf14130b98887fb9416aa1dadc61de52caf01724e5ed02bc8 ======LOGS====== Aug 13 04:06:26.424773439 (106h40m20.85585362s) [upload=111021]: Starting upload Aug 13 04:06:26.424859403 (106h40m20.855939584s) [upload=111021]: Done starting upload Aug 13 04:06:26.424943213 (106h40m20.856023344s) [upload=111021]: Uploading segments... Aug 13 04:06:26.425371873 (106h40m20.856452014s) [upload=111021]: Got next segment. Inline: false Aug 13 04:06:26.425416889 (106h40m20.85649702s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:06:26.425422800 (106h40m20.856502931s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 04:06:26.904696973 (106h40m21.335777114s) [seg_pos={0 0}, upload=111021]: Begin upload segment... Aug 13 04:06:26.904765795 (106h40m21.335845926s) [seg_pos={0 0}, upload=111021]: Done begin upload segment. Aug 13 04:06:26.904790663 (106h40m21.335870824s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.904802375 (106h40m21.335882506s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905203663 (106h40m21.336283794s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905280250 (106h40m21.336360381s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905632202 (106h40m21.336712334s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905977053 (106h40m21.337057174s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906235437 (106h40m21.337315568s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906450819 (106h40m21.33753095s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906655601 (106h40m21.337735732s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906903746 (106h40m21.337983887s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907108547 (106h40m21.338188678s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907306706 (106h40m21.338386837s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907513452 (106h40m21.338593583s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907881186 (106h40m21.338961317s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908101247 (106h40m21.339181388s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908297151 (106h40m21.339377282s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908538153 (106h40m21.339618284s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.909131799 (106h40m21.34021193s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:28.021601497 (106h40m22.452681628s) [upload=111021]: Next returned nil segment Aug 13 04:06:28.021615003 (106h40m22.452695134s) [upload=111021]: Waiting for error group managing segments... Aug 13 04:06:28.337292921 (106h40m22.768373052s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.337529053 (106h40m22.768609184s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.444001501 (106h40m22.875081632s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.882606711 (106h40m23.313686842s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.886099483 (106h40m23.317179614s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.892480111 (106h40m23.323560252s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.909776295 (106h40m23.340856426s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.912305053 (106h40m23.343385174s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.914882385 (106h40m23.345962516s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.916707126 (106h40m23.347787257s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.918119980 (106h40m23.349200111s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.931546700 (106h40m23.362626831s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.951933947 (106h40m23.383014078s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964905295 (106h40m23.395985427s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964925074 (106h40m23.396005205s) [seg_pos={0 0}, upload=111021]: Segment reached optimal threshold of 14 pieces. Aug 13 04:06:28.965067476 (106h40m23.396147607s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965125707 (106h40m23.396205838s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AZCJHCR7rF4r62Bg7NcBkpNoLb6r6rEN2a5hZ9KNxJTtjV8jp): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965179801 (106h40m23.396259932s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ukTBGQCf81aFiZhST9sqJEN28d1qg44gv27U2oPJKiGNirRPB): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965229646 (106h40m23.396309777s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ApjPajPXNsWuwWvZ778CTxL33xrFi2cebEDBNHhFa52Nm2aqn): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965240907 (106h40m23.396321038s) [seg_pos={0 0}, upload=111021]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 04:06:28.965352811 (106h40m23.396432942s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 04:06:28.965357411 (106h40m23.396437542s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:06:29.262537166 (106h40m23.693617287s) [upload=111021]: Done uploading segments... Aug 13 04:06:29.262553186 (106h40m23.693633317s) [upload=111021]: Upload finished. err: <nil> Duration: 5.716220819s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [....................X...................................X...] duration: 1.859724015s FAIL (2025-08-13 04:34:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after c82f41086c10e8e784630232b68e0f7cf143b56088b414b7953f1ff8ef739d6a != before 9bf6ec9994ca7c4766b5318f204568e254175c351cfe104bdd6795e4366e1a5b ======LOGS====== Aug 13 04:31:56.429417659 (107h5m50.860497791s) [upload=111466]: Starting upload Aug 13 04:31:56.429489978 (107h5m50.860570109s) [upload=111466]: Done starting upload Aug 13 04:31:56.429575071 (107h5m50.860655202s) [upload=111466]: Uploading segments... Aug 13 04:31:56.429639935 (107h5m50.860720076s) [upload=111466]: Got next segment. Inline: true Aug 13 04:31:56.429646136 (107h5m50.860726267s) [upload=111466]: Waiting for error group managing segments... Aug 13 04:31:56.429701133 (107h5m50.860781264s) [upload=111466]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:31:56.429707254 (107h5m50.860787405s) [upload=111466]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 04:31:56.429711382 (107h5m50.860791533s) [upload=111466]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:31:56.721959480 (107h5m51.153039611s) [upload=111466]: Done uploading segments... Aug 13 04:31:56.721978156 (107h5m51.153058277s) [upload=111466]: Upload finished. err: <nil> Duration:* 1.859753832s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 7.77267279s FAIL (2025-08-13 04:34:15 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.772697718s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 5.642101052s FAIL (2025-08-13 04:34:14 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a6ab6965f6133e239ccbdf66a1f0be1fef1b0dc5e2e5b52bff2d0f5fa9076658 != before 6fdcc254ba2040cdf14130b98887fb9416aa1dadc61de52caf01724e5ed02bc8 ======LOGS====== Aug 13 04:06:26.424773439 (106h40m20.85585362s) [upload=111021]: Starting upload Aug 13 04:06:26.424859403 (106h40m20.855939584s) [upload=111021]: Done starting upload Aug 13 04:06:26.424943213 (106h40m20.856023344s) [upload=111021]: Uploading segments... Aug 13 04:06:26.425371873 (106h40m20.856452014s) [upload=111021]: Got next segment. Inline: false Aug 13 04:06:26.425416889 (106h40m20.85649702s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:06:26.425422800 (106h40m20.856502931s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 04:06:26.904696973 (106h40m21.335777114s) [seg_pos={0 0}, upload=111021]: Begin upload segment... Aug 13 04:06:26.904765795 (106h40m21.335845926s) [seg_pos={0 0}, upload=111021]: Done begin upload segment. Aug 13 04:06:26.904790663 (106h40m21.335870824s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.904802375 (106h40m21.335882506s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905203663 (106h40m21.336283794s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905280250 (106h40m21.336360381s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905632202 (106h40m21.336712334s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905977053 (106h40m21.337057174s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906235437 (106h40m21.337315568s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906450819 (106h40m21.33753095s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906655601 (106h40m21.337735732s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906903746 (106h40m21.337983887s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907108547 (106h40m21.338188678s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907306706 (106h40m21.338386837s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907513452 (106h40m21.338593583s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907881186 (106h40m21.338961317s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908101247 (106h40m21.339181388s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908297151 (106h40m21.339377282s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908538153 (106h40m21.339618284s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.909131799 (106h40m21.34021193s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:28.021601497 (106h40m22.452681628s) [upload=111021]: Next returned nil segment Aug 13 04:06:28.021615003 (106h40m22.452695134s) [upload=111021]: Waiting for error group managing segments... Aug 13 04:06:28.337292921 (106h40m22.768373052s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.337529053 (106h40m22.768609184s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.444001501 (106h40m22.875081632s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.882606711 (106h40m23.313686842s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.886099483 (106h40m23.317179614s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.892480111 (106h40m23.323560252s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.909776295 (106h40m23.340856426s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.912305053 (106h40m23.343385174s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.914882385 (106h40m23.345962516s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.916707126 (106h40m23.347787257s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.918119980 (106h40m23.349200111s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.931546700 (106h40m23.362626831s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.951933947 (106h40m23.383014078s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964905295 (106h40m23.395985427s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964925074 (106h40m23.396005205s) [seg_pos={0 0}, upload=111021]: Segment reached optimal threshold of 14 pieces. Aug 13 04:06:28.965067476 (106h40m23.396147607s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965125707 (106h40m23.396205838s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AZCJHCR7rF4r62Bg7NcBkpNoLb6r6rEN2a5hZ9KNxJTtjV8jp): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965179801 (106h40m23.396259932s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ukTBGQCf81aFiZhST9sqJEN28d1qg44gv27U2oPJKiGNirRPB): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965229646 (106h40m23.396309777s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ApjPajPXNsWuwWvZ778CTxL33xrFi2cebEDBNHhFa52Nm2aqn): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965240907 (106h40m23.396321038s) [seg_pos={0 0}, upload=111021]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 04:06:28.965352811 (106h40m23.396432942s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 04:06:28.965357411 (106h40m23.396437542s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:06:29.262537166 (106h40m23.693617287s) [upload=111021]: Done uploading segments... Aug 13 04:06:29.262553186 (106h40m23.693633317s) [upload=111021]: Upload finished. err: <nil> Duration: 5.64212003s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.....................X...................................X..] duration: 1.850722108s FAIL (2025-08-13 04:33:59 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after c82f41086c10e8e784630232b68e0f7cf143b56088b414b7953f1ff8ef739d6a != before 9bf6ec9994ca7c4766b5318f204568e254175c351cfe104bdd6795e4366e1a5b ======LOGS====== Aug 13 04:31:56.429417659 (107h5m50.860497791s) [upload=111466]: Starting upload Aug 13 04:31:56.429489978 (107h5m50.860570109s) [upload=111466]: Done starting upload Aug 13 04:31:56.429575071 (107h5m50.860655202s) [upload=111466]: Uploading segments... Aug 13 04:31:56.429639935 (107h5m50.860720076s) [upload=111466]: Got next segment. Inline: true Aug 13 04:31:56.429646136 (107h5m50.860726267s) [upload=111466]: Waiting for error group managing segments... Aug 13 04:31:56.429701133 (107h5m50.860781264s) [upload=111466]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:31:56.429707254 (107h5m50.860787405s) [upload=111466]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 04:31:56.429711382 (107h5m50.860791533s) [upload=111466]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:31:56.721959480 (107h5m51.153039611s) [upload=111466]: Done uploading segments... Aug 13 04:31:56.721978156 (107h5m51.153058277s) [upload=111466]: Upload finished. err: <nil> Duration:* 1.850741464s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 5.956521475s FAIL (2025-08-13 04:33:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a6ab6965f6133e239ccbdf66a1f0be1fef1b0dc5e2e5b52bff2d0f5fa9076658 != before 6fdcc254ba2040cdf14130b98887fb9416aa1dadc61de52caf01724e5ed02bc8 ======LOGS====== Aug 13 04:06:26.424773439 (106h40m20.85585362s) [upload=111021]: Starting upload Aug 13 04:06:26.424859403 (106h40m20.855939584s) [upload=111021]: Done starting upload Aug 13 04:06:26.424943213 (106h40m20.856023344s) [upload=111021]: Uploading segments... Aug 13 04:06:26.425371873 (106h40m20.856452014s) [upload=111021]: Got next segment. Inline: false Aug 13 04:06:26.425416889 (106h40m20.85649702s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:06:26.425422800 (106h40m20.856502931s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 04:06:26.904696973 (106h40m21.335777114s) [seg_pos={0 0}, upload=111021]: Begin upload segment... Aug 13 04:06:26.904765795 (106h40m21.335845926s) [seg_pos={0 0}, upload=111021]: Done begin upload segment. Aug 13 04:06:26.904790663 (106h40m21.335870824s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.904802375 (106h40m21.335882506s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905203663 (106h40m21.336283794s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905280250 (106h40m21.336360381s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905632202 (106h40m21.336712334s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905977053 (106h40m21.337057174s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906235437 (106h40m21.337315568s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906450819 (106h40m21.33753095s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906655601 (106h40m21.337735732s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906903746 (106h40m21.337983887s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907108547 (106h40m21.338188678s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907306706 (106h40m21.338386837s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907513452 (106h40m21.338593583s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907881186 (106h40m21.338961317s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908101247 (106h40m21.339181388s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908297151 (106h40m21.339377282s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908538153 (106h40m21.339618284s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.909131799 (106h40m21.34021193s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:28.021601497 (106h40m22.452681628s) [upload=111021]: Next returned nil segment Aug 13 04:06:28.021615003 (106h40m22.452695134s) [upload=111021]: Waiting for error group managing segments... Aug 13 04:06:28.337292921 (106h40m22.768373052s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.337529053 (106h40m22.768609184s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.444001501 (106h40m22.875081632s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.882606711 (106h40m23.313686842s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.886099483 (106h40m23.317179614s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.892480111 (106h40m23.323560252s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.909776295 (106h40m23.340856426s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.912305053 (106h40m23.343385174s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.914882385 (106h40m23.345962516s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.916707126 (106h40m23.347787257s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.918119980 (106h40m23.349200111s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.931546700 (106h40m23.362626831s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.951933947 (106h40m23.383014078s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964905295 (106h40m23.395985427s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964925074 (106h40m23.396005205s) [seg_pos={0 0}, upload=111021]: Segment reached optimal threshold of 14 pieces. Aug 13 04:06:28.965067476 (106h40m23.396147607s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965125707 (106h40m23.396205838s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AZCJHCR7rF4r62Bg7NcBkpNoLb6r6rEN2a5hZ9KNxJTtjV8jp): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965179801 (106h40m23.396259932s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ukTBGQCf81aFiZhST9sqJEN28d1qg44gv27U2oPJKiGNirRPB): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965229646 (106h40m23.396309777s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ApjPajPXNsWuwWvZ778CTxL33xrFi2cebEDBNHhFa52Nm2aqn): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965240907 (106h40m23.396321038s) [seg_pos={0 0}, upload=111021]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 04:06:28.965352811 (106h40m23.396432942s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 04:06:28.965357411 (106h40m23.396437542s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:06:29.262537166 (106h40m23.693617287s) [upload=111021]: Done uploading segments... Aug 13 04:06:29.262553186 (106h40m23.693633317s) [upload=111021]: Upload finished. err: <nil> Duration: 5.956548659s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 7.911385325s FAIL (2025-08-13 04:33:17 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.911405896s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [......................X...................................X.] duration: 2.106126157s FAIL (2025-08-13 04:33:07 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after c82f41086c10e8e784630232b68e0f7cf143b56088b414b7953f1ff8ef739d6a != before 9bf6ec9994ca7c4766b5318f204568e254175c351cfe104bdd6795e4366e1a5b ======LOGS====== Aug 13 04:31:56.429417659 (107h5m50.860497791s) [upload=111466]: Starting upload Aug 13 04:31:56.429489978 (107h5m50.860570109s) [upload=111466]: Done starting upload Aug 13 04:31:56.429575071 (107h5m50.860655202s) [upload=111466]: Uploading segments... Aug 13 04:31:56.429639935 (107h5m50.860720076s) [upload=111466]: Got next segment. Inline: true Aug 13 04:31:56.429646136 (107h5m50.860726267s) [upload=111466]: Waiting for error group managing segments... Aug 13 04:31:56.429701133 (107h5m50.860781264s) [upload=111466]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:31:56.429707254 (107h5m50.860787405s) [upload=111466]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 04:31:56.429711382 (107h5m50.860791533s) [upload=111466]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:31:56.721959480 (107h5m51.153039611s) [upload=111466]: Done uploading segments... Aug 13 04:31:56.721978156 (107h5m51.153058277s) [upload=111466]: Upload finished. err: <nil> Duration:* 2.106153599s core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)