Orbiter History

Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure

Orbiter Check History

Showing 50 of 888958 reports (Page 15605 of 17780)

checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 6.616734307s FAIL (2025-08-12 09:47:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.616758282s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [......................X.......X........X....................] duration: 1.819898778s FAIL (2025-08-12 09:47:25 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after c36fafdabf96bb5b9c4464bc922fb40045dd340ad6b7f61aa3a428437d8c7f85 != before c9b346cbcc10dabc7edd608987d023da7f45c3973830ffa574bb2139ca951f3f ======LOGS====== Aug 12 09:32:43.528352715 (88h6m37.959432847s) [upload=91793]: Starting upload Aug 12 09:32:43.528398883 (88h6m37.959479014s) [upload=91793]: Done starting upload Aug 12 09:32:43.528451965 (88h6m37.959532126s) [upload=91793]: Uploading segments... Aug 12 09:32:43.528498204 (88h6m37.959578365s) [upload=91793]: Got next segment. Inline: true Aug 12 09:32:43.528504716 (88h6m37.959584867s) [upload=91793]: Waiting for error group managing segments... Aug 12 09:32:43.528567947 (88h6m37.959648078s) [upload=91793]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 09:32:43.528574670 (88h6m37.959654861s) [upload=91793]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 09:32:43.528579549 (88h6m37.9596597s) [upload=91793]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 09:32:43.987672872 (88h6m38.418753003s) [upload=91793]: Done uploading segments... Aug 12 09:32:43.987690746 (88h6m38.418770878s) [upload=91793]: Upload finished. err: <nil> Duration:* 1.819929188s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 2.356883535s FAIL (2025-08-12 09:47:00 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.356907491s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 6.02408433s FAIL (2025-08-12 09:46:45 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.024107074s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [...X......................X....X....................XX......] duration: 5.719142538s FAIL (2025-08-12 09:46:30 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f35ee2d072f8e8e457fea0f3861aead04855eb3bbd8f8003ec663c138019c935 != before 8f40c1fe4bccbd85fc958d130a5c0653d335a3e6eef3d2703ded56eb959d065f ======LOGS====== Aug 12 09:41:44.311520534 (88h15m38.742600665s) [upload=91945]: Starting upload Aug 12 09:41:44.311568495 (88h15m38.742648616s) [upload=91945]: Done starting upload Aug 12 09:41:44.311663608 (88h15m38.742743739s) [upload=91945]: Uploading segments... Aug 12 09:41:44.311758038 (88h15m38.742838169s) [upload=91945]: Got next segment. Inline: false Aug 12 09:41:44.311794999 (88h15m38.74287513s) [upload=91945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 09:41:44.311799297 (88h15m38.742879428s) [upload=91945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 09:41:44.758041190 (88h15m39.189121321s) [seg_pos={0 0}, upload=91945]: Begin upload segment... Aug 12 09:41:44.758083541 (88h15m39.189163662s) [seg_pos={0 0}, upload=91945]: Done begin upload segment. Aug 12 09:41:44.758105062 (88h15m39.189185193s) [noise=true , address=104.36.82.3:4775 , piece_id=YOUQZN2JCS76YANNCQST5NM5CW3ALAI3S6L5STUX5Y5TCF4C6DEQ, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.758207217 (88h15m39.189287338s) [noise=true , address=104.36.82.2:4757 , piece_id=JASPRMLAFJ36UVPV4DBP4V66PHAXWHKWY2D3LZXCXEFVLPC6EH6A, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.758474549 (88h15m39.18955468s) [noise=true , address=66.23.193.175:4559 , piece_id=TE3C7ARV5Z5FRWGB4DQO3LHHNU2OLQKN72RDVVVRZ5GJHTEIISEA, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.758635166 (88h15m39.189715297s) [noise=true , address=104.36.82.44:4901 , piece_id=VXW36HT3VDS3LG6QWNFAT3AE2ZA6NZA2WEWAKN72RPX5KP5TDSKA, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.758771638 (88h15m39.189851759s) [noise=true , address=104.36.82.16:4321 , piece_id=QRV5VZKBHKJJR72GFA2WEWK3SZXDD6WNH3MRNZDMQXY4IC2QGA4A, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759021696 (88h15m39.190101817s) [noise=true , address=104.36.82.62:4424 , piece_id=E34NSM2CZNZPULSFKMSHSCY4OIJPUMPMDMLQRVKNKN52U6QFBZXQ, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759041033 (88h15m39.190121164s) [noise=true , address=64.49.13.26:4946 , piece_id=KT33IM65GDYI7CMUPQUBIF7AW22UPXD4I74HH3FXZ4MJNQGTBLFQ, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759302553 (88h15m39.190382684s) [noise=true , address=104.36.82.59:4321 , piece_id=GSLM54DLWGVQEI7EFBA4WN5FTREZLFFPU4CQFANBJ23SZKNI45MA, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759307623 (88h15m39.190387754s) [noise=true , address=79.127.219.38:4017 , piece_id=EG3FNV5HQKNVECL5QZZ7XDTE5IAVTEMAMPCXTDNB3CIJDCUIQ2IQ, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759341918 (88h15m39.190422049s) [noise=true , address=104.36.82.23:4460 , piece_id=5J7OSURHQ2NVVHNSWCKFUCDOAL5XOIDXNNPCO4X7GUW7SR462YXA, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759619400 (88h15m39.190699521s) [noise=true , address=77.90.31.17:4802 , piece_id=XNUBFTCF7XJUZIVEXFSQLZ3RVPY7VJKOAC66WL657SXTPEBTLE4A, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759628587 (88h15m39.190708708s) [noise=true , address=104.36.82.60:4353 , piece_id=ABHP67KF53DQU63BCHWRWI7RRGYE25GKMZBJA7IF55PW54LUL3EQ, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759890307 (88h15m39.190970428s) [noise=true , address=104.36.82.35:4610 , piece_id=UXEE2DEIRZEMRGVI2B35YXZNF5E23VGSQA2CWGMNAIR6DXPUAYIA, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759904415 (88h15m39.190984546s) [noise=true , address=77.90.31.11:4567 , piece_id=TTRTS2P3B2WRE5U27EKWEV4RFPLS76PXWWNYYWLEENRALJGEOZNA, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.760170674 (88h15m39.191250795s) [noise=true , address=79.127.201.215:4351 , piece_id=KDW52DWZKZMJTXZ6POR4AVAFHCA2E5VEKENBMBTCEXGI3ZHW5OGA, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.760239836 (88h15m39.191319977s) [noise=true , address=104.36.82.61:4408 , piece_id=RNZATXKG3FIJRMQ3TXECL3SUOE7WABPBYXTE5ZMHYG6E7PNIZJCQ, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.760635123 (88h15m39.191715264s) [noise=true , address=77.90.31.12:4612 , piece_id=WSBTFE672DB5SBD6R5ME5H4QDSDEYVS4EHRGLPXTIVRRUVJFFDUQ, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.760851216 (88h15m39.191931347s) [noise=true , address=104.36.82.39:4740 , piece_id=BYUW67E46DKD2L3KSHK6YD3Y2FGBXLP62WSINVYJQ66H64F2DC2Q, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:45.871305682 (88h15m40.302385813s) [upload=91945]: Next returned nil segment Aug 12 09:41:45.871322675 (88h15m40.302402806s) [upload=91945]: Waiting for error group managing segments... Aug 12 09:41:46.153588661 (88h15m40.584668782s) [noise=true , address=66.23.193.175:4559 , piece_id=TE3C7ARV5Z5FRWGB4DQO3LHHNU2OLQKN72RDVVVRZ5GJHTEIISEA, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.253519414 (88h15m40.684599545s) [noise=true , address=64.49.13.26:4946 , piece_id=KT33IM65GDYI7CMUPQUBIF7AW22UPXD4I74HH3FXZ4MJNQGTBLFQ, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.664039266 (88h15m41.095119407s) [noise=true , address=79.127.219.38:4017 , piece_id=EG3FNV5HQKNVECL5QZZ7XDTE5IAVTEMAMPCXTDNB3CIJDCUIQ2IQ, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.698415811 (88h15m41.129495942s) [noise=true , address=77.90.31.11:4567 , piece_id=TTRTS2P3B2WRE5U27EKWEV4RFPLS76PXWWNYYWLEENRALJGEOZNA, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.702200412 (88h15m41.133280543s) [noise=true , address=104.36.82.60:4353 , piece_id=ABHP67KF53DQU63BCHWRWI7RRGYE25GKMZBJA7IF55PW54LUL3EQ, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.728460918 (88h15m41.159541049s) [noise=true , address=104.36.82.39:4740 , piece_id=BYUW67E46DKD2L3KSHK6YD3Y2FGBXLP62WSINVYJQ66H64F2DC2Q, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.746548967 (88h15m41.177629088s) [noise=true , address=77.90.31.17:4802 , piece_id=XNUBFTCF7XJUZIVEXFSQLZ3RVPY7VJKOAC66WL657SXTPEBTLE4A, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.746768246 (88h15m41.177848367s) [noise=true , address=104.36.82.59:4321 , piece_id=GSLM54DLWGVQEI7EFBA4WN5FTREZLFFPU4CQFANBJ23SZKNI45MA, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.761049191 (88h15m41.192129322s) [noise=true , address=104.36.82.16:4321 , piece_id=QRV5VZKBHKJJR72GFA2WEWK3SZXDD6WNH3MRNZDMQXY4IC2QGA4A, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.772076420 (88h15m41.203156541s) [noise=true , address=79.127.201.215:4351 , piece_id=KDW52DWZKZMJTXZ6POR4AVAFHCA2E5VEKENBMBTCEXGI3ZHW5OGA, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.773951698 (88h15m41.205031829s) [noise=true , address=77.90.31.12:4612 , piece_id=WSBTFE672DB5SBD6R5ME5H4QDSDEYVS4EHRGLPXTIVRRUVJFFDUQ, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.795243768 (88h15m41.226323899s) [noise=true , address=104.36.82.23:4460 , piece_id=5J7OSURHQ2NVVHNSWCKFUCDOAL5XOIDXNNPCO4X7GUW7SR462YXA, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.796050351 (88h15m41.227130482s) [noise=true , address=104.36.82.62:4424 , piece_id=E34NSM2CZNZPULSFKMSHSCY4OIJPUMPMDMLQRVKNKN52U6QFBZXQ, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.809335530 (88h15m41.240415661s) [noise=true , address=104.36.82.2:4757 , piece_id=JASPRMLAFJ36UVPV4DBP4V66PHAXWHKWY2D3LZXCXEFVLPC6EH6A, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.809359446 (88h15m41.240439577s) [seg_pos={0 0}, upload=91945]: Segment reached optimal threshold of 14 pieces. Aug 12 09:41:46.809494194 (88h15m41.240574325s) [noise=true , address=104.36.82.35:4610 , piece_id=UXEE2DEIRZEMRGVI2B35YXZNF5E23VGSQA2CWGMNAIR6DXPUAYIA, seg_pos={0 0}, upload=91945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KwSqrCrryAnNkjhZkfZjcCetBLLE9EonzgWi3UkBYW4wefZ1B): protocol: expected piece hash; context canceled; EOF Aug 12 09:41:46.809549259 (88h15m41.24062939s) [noise=true , address=104.36.82.3:4775 , piece_id=YOUQZN2JCS76YANNCQST5NM5CW3ALAI3S6L5STUX5Y5TCF4C6DEQ, seg_pos={0 0}, upload=91945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BvQLLnX5A2BgKeqn1ubs5iBeCUsUGH8hFjpB2HvY53YH9Nw1n): protocol: expected piece hash; context canceled; EOF Aug 12 09:41:46.809625154 (88h15m41.240705286s) [noise=true , address=104.36.82.61:4408 , piece_id=RNZATXKG3FIJRMQ3TXECL3SUOE7WABPBYXTE5ZMHYG6E7PNIZJCQ, seg_pos={0 0}, upload=91945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv): protocol: expected piece hash; context canceled; EOF Aug 12 09:41:46.809643048 (88h15m41.240723169s) [noise=true , address=104.36.82.44:4901 , piece_id=VXW36HT3VDS3LG6QWNFAT3AE2ZA6NZA2WEWAKN72RPX5KP5TDSKA, seg_pos={0 0}, upload=91945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FHE84zvBb1MKwB1Ht7puTafgQxDEvPt4mYqkYVSSufAMpWQA1): protocol: expected piece hash; context canceled; EOF Aug 12 09:41:46.809688586 (88h15m41.240768707s) [seg_pos={0 0}, upload=91945]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 09:41:46.809767777 (88h15m41.240847908s) [upload=91945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 09:41:46.809773548 (88h15m41.240853679s) [upload=91945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 09:41:47.108952174 (88h15m41.540032305s) [upload=91945]: Done uploading segments... Aug 12 09:41:47.108970840 (88h15m41.540050971s) [upload=91945]: Upload finished. err: <nil> Duration: 5.719172545s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.......................X.......X........X...................] duration: 1.882107959s FAIL (2025-08-12 09:46:22 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after c36fafdabf96bb5b9c4464bc922fb40045dd340ad6b7f61aa3a428437d8c7f85 != before c9b346cbcc10dabc7edd608987d023da7f45c3973830ffa574bb2139ca951f3f ======LOGS====== Aug 12 09:32:43.528352715 (88h6m37.959432847s) [upload=91793]: Starting upload Aug 12 09:32:43.528398883 (88h6m37.959479014s) [upload=91793]: Done starting upload Aug 12 09:32:43.528451965 (88h6m37.959532126s) [upload=91793]: Uploading segments... Aug 12 09:32:43.528498204 (88h6m37.959578365s) [upload=91793]: Got next segment. Inline: true Aug 12 09:32:43.528504716 (88h6m37.959584867s) [upload=91793]: Waiting for error group managing segments... Aug 12 09:32:43.528567947 (88h6m37.959648078s) [upload=91793]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 09:32:43.528574670 (88h6m37.959654861s) [upload=91793]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 09:32:43.528579549 (88h6m37.9596597s) [upload=91793]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 09:32:43.987672872 (88h6m38.418753003s) [upload=91793]: Done uploading segments... Aug 12 09:32:43.987690746 (88h6m38.418770878s) [upload=91793]: Upload finished. err: <nil> Duration:* 1.882136014s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 2.273374513s FAIL (2025-08-12 09:46:17 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.273393139s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 6.485983221s FAIL (2025-08-12 09:46:15 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.486002979s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [........................X.......X........X..................] duration: 1.839461561s FAIL (2025-08-12 09:45:41 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after c36fafdabf96bb5b9c4464bc922fb40045dd340ad6b7f61aa3a428437d8c7f85 != before c9b346cbcc10dabc7edd608987d023da7f45c3973830ffa574bb2139ca951f3f ======LOGS====== Aug 12 09:32:43.528352715 (88h6m37.959432847s) [upload=91793]: Starting upload Aug 12 09:32:43.528398883 (88h6m37.959479014s) [upload=91793]: Done starting upload Aug 12 09:32:43.528451965 (88h6m37.959532126s) [upload=91793]: Uploading segments... Aug 12 09:32:43.528498204 (88h6m37.959578365s) [upload=91793]: Got next segment. Inline: true Aug 12 09:32:43.528504716 (88h6m37.959584867s) [upload=91793]: Waiting for error group managing segments... Aug 12 09:32:43.528567947 (88h6m37.959648078s) [upload=91793]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 09:32:43.528574670 (88h6m37.959654861s) [upload=91793]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 09:32:43.528579549 (88h6m37.9596597s) [upload=91793]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 09:32:43.987672872 (88h6m38.418753003s) [upload=91793]: Done uploading segments... Aug 12 09:32:43.987690746 (88h6m38.418770878s) [upload=91793]: Upload finished. err: <nil> Duration:* 1.839483953s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [....X......................X....X....................XX.....] duration: 5.620501682s FAIL (2025-08-12 09:45:27 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f35ee2d072f8e8e457fea0f3861aead04855eb3bbd8f8003ec663c138019c935 != before 8f40c1fe4bccbd85fc958d130a5c0653d335a3e6eef3d2703ded56eb959d065f ======LOGS====== Aug 12 09:41:44.311520534 (88h15m38.742600665s) [upload=91945]: Starting upload Aug 12 09:41:44.311568495 (88h15m38.742648616s) [upload=91945]: Done starting upload Aug 12 09:41:44.311663608 (88h15m38.742743739s) [upload=91945]: Uploading segments... Aug 12 09:41:44.311758038 (88h15m38.742838169s) [upload=91945]: Got next segment. Inline: false Aug 12 09:41:44.311794999 (88h15m38.74287513s) [upload=91945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 09:41:44.311799297 (88h15m38.742879428s) [upload=91945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 09:41:44.758041190 (88h15m39.189121321s) [seg_pos={0 0}, upload=91945]: Begin upload segment... Aug 12 09:41:44.758083541 (88h15m39.189163662s) [seg_pos={0 0}, upload=91945]: Done begin upload segment. Aug 12 09:41:44.758105062 (88h15m39.189185193s) [noise=true , address=104.36.82.3:4775 , piece_id=YOUQZN2JCS76YANNCQST5NM5CW3ALAI3S6L5STUX5Y5TCF4C6DEQ, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.758207217 (88h15m39.189287338s) [noise=true , address=104.36.82.2:4757 , piece_id=JASPRMLAFJ36UVPV4DBP4V66PHAXWHKWY2D3LZXCXEFVLPC6EH6A, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.758474549 (88h15m39.18955468s) [noise=true , address=66.23.193.175:4559 , piece_id=TE3C7ARV5Z5FRWGB4DQO3LHHNU2OLQKN72RDVVVRZ5GJHTEIISEA, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.758635166 (88h15m39.189715297s) [noise=true , address=104.36.82.44:4901 , piece_id=VXW36HT3VDS3LG6QWNFAT3AE2ZA6NZA2WEWAKN72RPX5KP5TDSKA, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.758771638 (88h15m39.189851759s) [noise=true , address=104.36.82.16:4321 , piece_id=QRV5VZKBHKJJR72GFA2WEWK3SZXDD6WNH3MRNZDMQXY4IC2QGA4A, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759021696 (88h15m39.190101817s) [noise=true , address=104.36.82.62:4424 , piece_id=E34NSM2CZNZPULSFKMSHSCY4OIJPUMPMDMLQRVKNKN52U6QFBZXQ, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759041033 (88h15m39.190121164s) [noise=true , address=64.49.13.26:4946 , piece_id=KT33IM65GDYI7CMUPQUBIF7AW22UPXD4I74HH3FXZ4MJNQGTBLFQ, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759302553 (88h15m39.190382684s) [noise=true , address=104.36.82.59:4321 , piece_id=GSLM54DLWGVQEI7EFBA4WN5FTREZLFFPU4CQFANBJ23SZKNI45MA, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759307623 (88h15m39.190387754s) [noise=true , address=79.127.219.38:4017 , piece_id=EG3FNV5HQKNVECL5QZZ7XDTE5IAVTEMAMPCXTDNB3CIJDCUIQ2IQ, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759341918 (88h15m39.190422049s) [noise=true , address=104.36.82.23:4460 , piece_id=5J7OSURHQ2NVVHNSWCKFUCDOAL5XOIDXNNPCO4X7GUW7SR462YXA, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759619400 (88h15m39.190699521s) [noise=true , address=77.90.31.17:4802 , piece_id=XNUBFTCF7XJUZIVEXFSQLZ3RVPY7VJKOAC66WL657SXTPEBTLE4A, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759628587 (88h15m39.190708708s) [noise=true , address=104.36.82.60:4353 , piece_id=ABHP67KF53DQU63BCHWRWI7RRGYE25GKMZBJA7IF55PW54LUL3EQ, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759890307 (88h15m39.190970428s) [noise=true , address=104.36.82.35:4610 , piece_id=UXEE2DEIRZEMRGVI2B35YXZNF5E23VGSQA2CWGMNAIR6DXPUAYIA, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759904415 (88h15m39.190984546s) [noise=true , address=77.90.31.11:4567 , piece_id=TTRTS2P3B2WRE5U27EKWEV4RFPLS76PXWWNYYWLEENRALJGEOZNA, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.760170674 (88h15m39.191250795s) [noise=true , address=79.127.201.215:4351 , piece_id=KDW52DWZKZMJTXZ6POR4AVAFHCA2E5VEKENBMBTCEXGI3ZHW5OGA, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.760239836 (88h15m39.191319977s) [noise=true , address=104.36.82.61:4408 , piece_id=RNZATXKG3FIJRMQ3TXECL3SUOE7WABPBYXTE5ZMHYG6E7PNIZJCQ, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.760635123 (88h15m39.191715264s) [noise=true , address=77.90.31.12:4612 , piece_id=WSBTFE672DB5SBD6R5ME5H4QDSDEYVS4EHRGLPXTIVRRUVJFFDUQ, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.760851216 (88h15m39.191931347s) [noise=true , address=104.36.82.39:4740 , piece_id=BYUW67E46DKD2L3KSHK6YD3Y2FGBXLP62WSINVYJQ66H64F2DC2Q, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:45.871305682 (88h15m40.302385813s) [upload=91945]: Next returned nil segment Aug 12 09:41:45.871322675 (88h15m40.302402806s) [upload=91945]: Waiting for error group managing segments... Aug 12 09:41:46.153588661 (88h15m40.584668782s) [noise=true , address=66.23.193.175:4559 , piece_id=TE3C7ARV5Z5FRWGB4DQO3LHHNU2OLQKN72RDVVVRZ5GJHTEIISEA, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.253519414 (88h15m40.684599545s) [noise=true , address=64.49.13.26:4946 , piece_id=KT33IM65GDYI7CMUPQUBIF7AW22UPXD4I74HH3FXZ4MJNQGTBLFQ, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.664039266 (88h15m41.095119407s) [noise=true , address=79.127.219.38:4017 , piece_id=EG3FNV5HQKNVECL5QZZ7XDTE5IAVTEMAMPCXTDNB3CIJDCUIQ2IQ, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.698415811 (88h15m41.129495942s) [noise=true , address=77.90.31.11:4567 , piece_id=TTRTS2P3B2WRE5U27EKWEV4RFPLS76PXWWNYYWLEENRALJGEOZNA, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.702200412 (88h15m41.133280543s) [noise=true , address=104.36.82.60:4353 , piece_id=ABHP67KF53DQU63BCHWRWI7RRGYE25GKMZBJA7IF55PW54LUL3EQ, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.728460918 (88h15m41.159541049s) [noise=true , address=104.36.82.39:4740 , piece_id=BYUW67E46DKD2L3KSHK6YD3Y2FGBXLP62WSINVYJQ66H64F2DC2Q, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.746548967 (88h15m41.177629088s) [noise=true , address=77.90.31.17:4802 , piece_id=XNUBFTCF7XJUZIVEXFSQLZ3RVPY7VJKOAC66WL657SXTPEBTLE4A, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.746768246 (88h15m41.177848367s) [noise=true , address=104.36.82.59:4321 , piece_id=GSLM54DLWGVQEI7EFBA4WN5FTREZLFFPU4CQFANBJ23SZKNI45MA, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.761049191 (88h15m41.192129322s) [noise=true , address=104.36.82.16:4321 , piece_id=QRV5VZKBHKJJR72GFA2WEWK3SZXDD6WNH3MRNZDMQXY4IC2QGA4A, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.772076420 (88h15m41.203156541s) [noise=true , address=79.127.201.215:4351 , piece_id=KDW52DWZKZMJTXZ6POR4AVAFHCA2E5VEKENBMBTCEXGI3ZHW5OGA, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.773951698 (88h15m41.205031829s) [noise=true , address=77.90.31.12:4612 , piece_id=WSBTFE672DB5SBD6R5ME5H4QDSDEYVS4EHRGLPXTIVRRUVJFFDUQ, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.795243768 (88h15m41.226323899s) [noise=true , address=104.36.82.23:4460 , piece_id=5J7OSURHQ2NVVHNSWCKFUCDOAL5XOIDXNNPCO4X7GUW7SR462YXA, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.796050351 (88h15m41.227130482s) [noise=true , address=104.36.82.62:4424 , piece_id=E34NSM2CZNZPULSFKMSHSCY4OIJPUMPMDMLQRVKNKN52U6QFBZXQ, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.809335530 (88h15m41.240415661s) [noise=true , address=104.36.82.2:4757 , piece_id=JASPRMLAFJ36UVPV4DBP4V66PHAXWHKWY2D3LZXCXEFVLPC6EH6A, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.809359446 (88h15m41.240439577s) [seg_pos={0 0}, upload=91945]: Segment reached optimal threshold of 14 pieces. Aug 12 09:41:46.809494194 (88h15m41.240574325s) [noise=true , address=104.36.82.35:4610 , piece_id=UXEE2DEIRZEMRGVI2B35YXZNF5E23VGSQA2CWGMNAIR6DXPUAYIA, seg_pos={0 0}, upload=91945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KwSqrCrryAnNkjhZkfZjcCetBLLE9EonzgWi3UkBYW4wefZ1B): protocol: expected piece hash; context canceled; EOF Aug 12 09:41:46.809549259 (88h15m41.24062939s) [noise=true , address=104.36.82.3:4775 , piece_id=YOUQZN2JCS76YANNCQST5NM5CW3ALAI3S6L5STUX5Y5TCF4C6DEQ, seg_pos={0 0}, upload=91945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BvQLLnX5A2BgKeqn1ubs5iBeCUsUGH8hFjpB2HvY53YH9Nw1n): protocol: expected piece hash; context canceled; EOF Aug 12 09:41:46.809625154 (88h15m41.240705286s) [noise=true , address=104.36.82.61:4408 , piece_id=RNZATXKG3FIJRMQ3TXECL3SUOE7WABPBYXTE5ZMHYG6E7PNIZJCQ, seg_pos={0 0}, upload=91945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv): protocol: expected piece hash; context canceled; EOF Aug 12 09:41:46.809643048 (88h15m41.240723169s) [noise=true , address=104.36.82.44:4901 , piece_id=VXW36HT3VDS3LG6QWNFAT3AE2ZA6NZA2WEWAKN72RPX5KP5TDSKA, seg_pos={0 0}, upload=91945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FHE84zvBb1MKwB1Ht7puTafgQxDEvPt4mYqkYVSSufAMpWQA1): protocol: expected piece hash; context canceled; EOF Aug 12 09:41:46.809688586 (88h15m41.240768707s) [seg_pos={0 0}, upload=91945]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 09:41:46.809767777 (88h15m41.240847908s) [upload=91945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 09:41:46.809773548 (88h15m41.240853679s) [upload=91945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 09:41:47.108952174 (88h15m41.540032305s) [upload=91945]: Done uploading segments... Aug 12 09:41:47.108970840 (88h15m41.540050971s) [upload=91945]: Upload finished. err: <nil> Duration: 5.620527703s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 2.341033374s FAIL (2025-08-12 09:45:22 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.341050346s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 6.158912541s FAIL (2025-08-12 09:45:16 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.158934032s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.........................X.......X........X.................] duration: 2.065841328s FAIL (2025-08-12 09:45:13 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after c36fafdabf96bb5b9c4464bc922fb40045dd340ad6b7f61aa3a428437d8c7f85 != before c9b346cbcc10dabc7edd608987d023da7f45c3973830ffa574bb2139ca951f3f ======LOGS====== Aug 12 09:32:43.528352715 (88h6m37.959432847s) [upload=91793]: Starting upload Aug 12 09:32:43.528398883 (88h6m37.959479014s) [upload=91793]: Done starting upload Aug 12 09:32:43.528451965 (88h6m37.959532126s) [upload=91793]: Uploading segments... Aug 12 09:32:43.528498204 (88h6m37.959578365s) [upload=91793]: Got next segment. Inline: true Aug 12 09:32:43.528504716 (88h6m37.959584867s) [upload=91793]: Waiting for error group managing segments... Aug 12 09:32:43.528567947 (88h6m37.959648078s) [upload=91793]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 09:32:43.528574670 (88h6m37.959654861s) [upload=91793]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 09:32:43.528579549 (88h6m37.9596597s) [upload=91793]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 09:32:43.987672872 (88h6m38.418753003s) [upload=91793]: Done uploading segments... Aug 12 09:32:43.987690746 (88h6m38.418770878s) [upload=91793]: Upload finished. err: <nil> Duration:* 2.065871856s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.....X......................X....X....................XX....] duration: 5.667646669s FAIL (2025-08-12 09:44:58 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f35ee2d072f8e8e457fea0f3861aead04855eb3bbd8f8003ec663c138019c935 != before 8f40c1fe4bccbd85fc958d130a5c0653d335a3e6eef3d2703ded56eb959d065f ======LOGS====== Aug 12 09:41:44.311520534 (88h15m38.742600665s) [upload=91945]: Starting upload Aug 12 09:41:44.311568495 (88h15m38.742648616s) [upload=91945]: Done starting upload Aug 12 09:41:44.311663608 (88h15m38.742743739s) [upload=91945]: Uploading segments... Aug 12 09:41:44.311758038 (88h15m38.742838169s) [upload=91945]: Got next segment. Inline: false Aug 12 09:41:44.311794999 (88h15m38.74287513s) [upload=91945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 09:41:44.311799297 (88h15m38.742879428s) [upload=91945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 09:41:44.758041190 (88h15m39.189121321s) [seg_pos={0 0}, upload=91945]: Begin upload segment... Aug 12 09:41:44.758083541 (88h15m39.189163662s) [seg_pos={0 0}, upload=91945]: Done begin upload segment. Aug 12 09:41:44.758105062 (88h15m39.189185193s) [noise=true , address=104.36.82.3:4775 , piece_id=YOUQZN2JCS76YANNCQST5NM5CW3ALAI3S6L5STUX5Y5TCF4C6DEQ, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.758207217 (88h15m39.189287338s) [noise=true , address=104.36.82.2:4757 , piece_id=JASPRMLAFJ36UVPV4DBP4V66PHAXWHKWY2D3LZXCXEFVLPC6EH6A, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.758474549 (88h15m39.18955468s) [noise=true , address=66.23.193.175:4559 , piece_id=TE3C7ARV5Z5FRWGB4DQO3LHHNU2OLQKN72RDVVVRZ5GJHTEIISEA, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.758635166 (88h15m39.189715297s) [noise=true , address=104.36.82.44:4901 , piece_id=VXW36HT3VDS3LG6QWNFAT3AE2ZA6NZA2WEWAKN72RPX5KP5TDSKA, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.758771638 (88h15m39.189851759s) [noise=true , address=104.36.82.16:4321 , piece_id=QRV5VZKBHKJJR72GFA2WEWK3SZXDD6WNH3MRNZDMQXY4IC2QGA4A, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759021696 (88h15m39.190101817s) [noise=true , address=104.36.82.62:4424 , piece_id=E34NSM2CZNZPULSFKMSHSCY4OIJPUMPMDMLQRVKNKN52U6QFBZXQ, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759041033 (88h15m39.190121164s) [noise=true , address=64.49.13.26:4946 , piece_id=KT33IM65GDYI7CMUPQUBIF7AW22UPXD4I74HH3FXZ4MJNQGTBLFQ, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759302553 (88h15m39.190382684s) [noise=true , address=104.36.82.59:4321 , piece_id=GSLM54DLWGVQEI7EFBA4WN5FTREZLFFPU4CQFANBJ23SZKNI45MA, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759307623 (88h15m39.190387754s) [noise=true , address=79.127.219.38:4017 , piece_id=EG3FNV5HQKNVECL5QZZ7XDTE5IAVTEMAMPCXTDNB3CIJDCUIQ2IQ, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759341918 (88h15m39.190422049s) [noise=true , address=104.36.82.23:4460 , piece_id=5J7OSURHQ2NVVHNSWCKFUCDOAL5XOIDXNNPCO4X7GUW7SR462YXA, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759619400 (88h15m39.190699521s) [noise=true , address=77.90.31.17:4802 , piece_id=XNUBFTCF7XJUZIVEXFSQLZ3RVPY7VJKOAC66WL657SXTPEBTLE4A, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759628587 (88h15m39.190708708s) [noise=true , address=104.36.82.60:4353 , piece_id=ABHP67KF53DQU63BCHWRWI7RRGYE25GKMZBJA7IF55PW54LUL3EQ, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759890307 (88h15m39.190970428s) [noise=true , address=104.36.82.35:4610 , piece_id=UXEE2DEIRZEMRGVI2B35YXZNF5E23VGSQA2CWGMNAIR6DXPUAYIA, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759904415 (88h15m39.190984546s) [noise=true , address=77.90.31.11:4567 , piece_id=TTRTS2P3B2WRE5U27EKWEV4RFPLS76PXWWNYYWLEENRALJGEOZNA, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.760170674 (88h15m39.191250795s) [noise=true , address=79.127.201.215:4351 , piece_id=KDW52DWZKZMJTXZ6POR4AVAFHCA2E5VEKENBMBTCEXGI3ZHW5OGA, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.760239836 (88h15m39.191319977s) [noise=true , address=104.36.82.61:4408 , piece_id=RNZATXKG3FIJRMQ3TXECL3SUOE7WABPBYXTE5ZMHYG6E7PNIZJCQ, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.760635123 (88h15m39.191715264s) [noise=true , address=77.90.31.12:4612 , piece_id=WSBTFE672DB5SBD6R5ME5H4QDSDEYVS4EHRGLPXTIVRRUVJFFDUQ, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.760851216 (88h15m39.191931347s) [noise=true , address=104.36.82.39:4740 , piece_id=BYUW67E46DKD2L3KSHK6YD3Y2FGBXLP62WSINVYJQ66H64F2DC2Q, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:45.871305682 (88h15m40.302385813s) [upload=91945]: Next returned nil segment Aug 12 09:41:45.871322675 (88h15m40.302402806s) [upload=91945]: Waiting for error group managing segments... Aug 12 09:41:46.153588661 (88h15m40.584668782s) [noise=true , address=66.23.193.175:4559 , piece_id=TE3C7ARV5Z5FRWGB4DQO3LHHNU2OLQKN72RDVVVRZ5GJHTEIISEA, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.253519414 (88h15m40.684599545s) [noise=true , address=64.49.13.26:4946 , piece_id=KT33IM65GDYI7CMUPQUBIF7AW22UPXD4I74HH3FXZ4MJNQGTBLFQ, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.664039266 (88h15m41.095119407s) [noise=true , address=79.127.219.38:4017 , piece_id=EG3FNV5HQKNVECL5QZZ7XDTE5IAVTEMAMPCXTDNB3CIJDCUIQ2IQ, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.698415811 (88h15m41.129495942s) [noise=true , address=77.90.31.11:4567 , piece_id=TTRTS2P3B2WRE5U27EKWEV4RFPLS76PXWWNYYWLEENRALJGEOZNA, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.702200412 (88h15m41.133280543s) [noise=true , address=104.36.82.60:4353 , piece_id=ABHP67KF53DQU63BCHWRWI7RRGYE25GKMZBJA7IF55PW54LUL3EQ, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.728460918 (88h15m41.159541049s) [noise=true , address=104.36.82.39:4740 , piece_id=BYUW67E46DKD2L3KSHK6YD3Y2FGBXLP62WSINVYJQ66H64F2DC2Q, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.746548967 (88h15m41.177629088s) [noise=true , address=77.90.31.17:4802 , piece_id=XNUBFTCF7XJUZIVEXFSQLZ3RVPY7VJKOAC66WL657SXTPEBTLE4A, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.746768246 (88h15m41.177848367s) [noise=true , address=104.36.82.59:4321 , piece_id=GSLM54DLWGVQEI7EFBA4WN5FTREZLFFPU4CQFANBJ23SZKNI45MA, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.761049191 (88h15m41.192129322s) [noise=true , address=104.36.82.16:4321 , piece_id=QRV5VZKBHKJJR72GFA2WEWK3SZXDD6WNH3MRNZDMQXY4IC2QGA4A, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.772076420 (88h15m41.203156541s) [noise=true , address=79.127.201.215:4351 , piece_id=KDW52DWZKZMJTXZ6POR4AVAFHCA2E5VEKENBMBTCEXGI3ZHW5OGA, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.773951698 (88h15m41.205031829s) [noise=true , address=77.90.31.12:4612 , piece_id=WSBTFE672DB5SBD6R5ME5H4QDSDEYVS4EHRGLPXTIVRRUVJFFDUQ, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.795243768 (88h15m41.226323899s) [noise=true , address=104.36.82.23:4460 , piece_id=5J7OSURHQ2NVVHNSWCKFUCDOAL5XOIDXNNPCO4X7GUW7SR462YXA, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.796050351 (88h15m41.227130482s) [noise=true , address=104.36.82.62:4424 , piece_id=E34NSM2CZNZPULSFKMSHSCY4OIJPUMPMDMLQRVKNKN52U6QFBZXQ, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.809335530 (88h15m41.240415661s) [noise=true , address=104.36.82.2:4757 , piece_id=JASPRMLAFJ36UVPV4DBP4V66PHAXWHKWY2D3LZXCXEFVLPC6EH6A, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.809359446 (88h15m41.240439577s) [seg_pos={0 0}, upload=91945]: Segment reached optimal threshold of 14 pieces. Aug 12 09:41:46.809494194 (88h15m41.240574325s) [noise=true , address=104.36.82.35:4610 , piece_id=UXEE2DEIRZEMRGVI2B35YXZNF5E23VGSQA2CWGMNAIR6DXPUAYIA, seg_pos={0 0}, upload=91945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KwSqrCrryAnNkjhZkfZjcCetBLLE9EonzgWi3UkBYW4wefZ1B): protocol: expected piece hash; context canceled; EOF Aug 12 09:41:46.809549259 (88h15m41.24062939s) [noise=true , address=104.36.82.3:4775 , piece_id=YOUQZN2JCS76YANNCQST5NM5CW3ALAI3S6L5STUX5Y5TCF4C6DEQ, seg_pos={0 0}, upload=91945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BvQLLnX5A2BgKeqn1ubs5iBeCUsUGH8hFjpB2HvY53YH9Nw1n): protocol: expected piece hash; context canceled; EOF Aug 12 09:41:46.809625154 (88h15m41.240705286s) [noise=true , address=104.36.82.61:4408 , piece_id=RNZATXKG3FIJRMQ3TXECL3SUOE7WABPBYXTE5ZMHYG6E7PNIZJCQ, seg_pos={0 0}, upload=91945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv): protocol: expected piece hash; context canceled; EOF Aug 12 09:41:46.809643048 (88h15m41.240723169s) [noise=true , address=104.36.82.44:4901 , piece_id=VXW36HT3VDS3LG6QWNFAT3AE2ZA6NZA2WEWAKN72RPX5KP5TDSKA, seg_pos={0 0}, upload=91945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FHE84zvBb1MKwB1Ht7puTafgQxDEvPt4mYqkYVSSufAMpWQA1): protocol: expected piece hash; context canceled; EOF Aug 12 09:41:46.809688586 (88h15m41.240768707s) [seg_pos={0 0}, upload=91945]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 09:41:46.809767777 (88h15m41.240847908s) [upload=91945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 09:41:46.809773548 (88h15m41.240853679s) [upload=91945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 09:41:47.108952174 (88h15m41.540032305s) [upload=91945]: Done uploading segments... Aug 12 09:41:47.108970840 (88h15m41.540050971s) [upload=91945]: Upload finished. err: <nil> Duration: 5.667666086s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..........................X.......X........X................] duration: 1.84588003s FAIL (2025-08-12 09:44:57 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after c36fafdabf96bb5b9c4464bc922fb40045dd340ad6b7f61aa3a428437d8c7f85 != before c9b346cbcc10dabc7edd608987d023da7f45c3973830ffa574bb2139ca951f3f ======LOGS====== Aug 12 09:32:43.528352715 (88h6m37.959432847s) [upload=91793]: Starting upload Aug 12 09:32:43.528398883 (88h6m37.959479014s) [upload=91793]: Done starting upload Aug 12 09:32:43.528451965 (88h6m37.959532126s) [upload=91793]: Uploading segments... Aug 12 09:32:43.528498204 (88h6m37.959578365s) [upload=91793]: Got next segment. Inline: true Aug 12 09:32:43.528504716 (88h6m37.959584867s) [upload=91793]: Waiting for error group managing segments... Aug 12 09:32:43.528567947 (88h6m37.959648078s) [upload=91793]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 09:32:43.528574670 (88h6m37.959654861s) [upload=91793]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 09:32:43.528579549 (88h6m37.9596597s) [upload=91793]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 09:32:43.987672872 (88h6m38.418753003s) [upload=91793]: Done uploading segments... Aug 12 09:32:43.987690746 (88h6m38.418770878s) [upload=91793]: Upload finished. err: <nil> Duration:* 1.845928392s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 6.134221126s FAIL (2025-08-12 09:44:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.134242888s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [......X......................X....X....................XX...] duration: 5.769689988s FAIL (2025-08-12 09:44:38 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f35ee2d072f8e8e457fea0f3861aead04855eb3bbd8f8003ec663c138019c935 != before 8f40c1fe4bccbd85fc958d130a5c0653d335a3e6eef3d2703ded56eb959d065f ======LOGS====== Aug 12 09:41:44.311520534 (88h15m38.742600665s) [upload=91945]: Starting upload Aug 12 09:41:44.311568495 (88h15m38.742648616s) [upload=91945]: Done starting upload Aug 12 09:41:44.311663608 (88h15m38.742743739s) [upload=91945]: Uploading segments... Aug 12 09:41:44.311758038 (88h15m38.742838169s) [upload=91945]: Got next segment. Inline: false Aug 12 09:41:44.311794999 (88h15m38.74287513s) [upload=91945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 09:41:44.311799297 (88h15m38.742879428s) [upload=91945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 09:41:44.758041190 (88h15m39.189121321s) [seg_pos={0 0}, upload=91945]: Begin upload segment... Aug 12 09:41:44.758083541 (88h15m39.189163662s) [seg_pos={0 0}, upload=91945]: Done begin upload segment. Aug 12 09:41:44.758105062 (88h15m39.189185193s) [noise=true , address=104.36.82.3:4775 , piece_id=YOUQZN2JCS76YANNCQST5NM5CW3ALAI3S6L5STUX5Y5TCF4C6DEQ, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.758207217 (88h15m39.189287338s) [noise=true , address=104.36.82.2:4757 , piece_id=JASPRMLAFJ36UVPV4DBP4V66PHAXWHKWY2D3LZXCXEFVLPC6EH6A, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.758474549 (88h15m39.18955468s) [noise=true , address=66.23.193.175:4559 , piece_id=TE3C7ARV5Z5FRWGB4DQO3LHHNU2OLQKN72RDVVVRZ5GJHTEIISEA, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.758635166 (88h15m39.189715297s) [noise=true , address=104.36.82.44:4901 , piece_id=VXW36HT3VDS3LG6QWNFAT3AE2ZA6NZA2WEWAKN72RPX5KP5TDSKA, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.758771638 (88h15m39.189851759s) [noise=true , address=104.36.82.16:4321 , piece_id=QRV5VZKBHKJJR72GFA2WEWK3SZXDD6WNH3MRNZDMQXY4IC2QGA4A, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759021696 (88h15m39.190101817s) [noise=true , address=104.36.82.62:4424 , piece_id=E34NSM2CZNZPULSFKMSHSCY4OIJPUMPMDMLQRVKNKN52U6QFBZXQ, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759041033 (88h15m39.190121164s) [noise=true , address=64.49.13.26:4946 , piece_id=KT33IM65GDYI7CMUPQUBIF7AW22UPXD4I74HH3FXZ4MJNQGTBLFQ, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759302553 (88h15m39.190382684s) [noise=true , address=104.36.82.59:4321 , piece_id=GSLM54DLWGVQEI7EFBA4WN5FTREZLFFPU4CQFANBJ23SZKNI45MA, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759307623 (88h15m39.190387754s) [noise=true , address=79.127.219.38:4017 , piece_id=EG3FNV5HQKNVECL5QZZ7XDTE5IAVTEMAMPCXTDNB3CIJDCUIQ2IQ, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759341918 (88h15m39.190422049s) [noise=true , address=104.36.82.23:4460 , piece_id=5J7OSURHQ2NVVHNSWCKFUCDOAL5XOIDXNNPCO4X7GUW7SR462YXA, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759619400 (88h15m39.190699521s) [noise=true , address=77.90.31.17:4802 , piece_id=XNUBFTCF7XJUZIVEXFSQLZ3RVPY7VJKOAC66WL657SXTPEBTLE4A, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759628587 (88h15m39.190708708s) [noise=true , address=104.36.82.60:4353 , piece_id=ABHP67KF53DQU63BCHWRWI7RRGYE25GKMZBJA7IF55PW54LUL3EQ, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759890307 (88h15m39.190970428s) [noise=true , address=104.36.82.35:4610 , piece_id=UXEE2DEIRZEMRGVI2B35YXZNF5E23VGSQA2CWGMNAIR6DXPUAYIA, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759904415 (88h15m39.190984546s) [noise=true , address=77.90.31.11:4567 , piece_id=TTRTS2P3B2WRE5U27EKWEV4RFPLS76PXWWNYYWLEENRALJGEOZNA, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.760170674 (88h15m39.191250795s) [noise=true , address=79.127.201.215:4351 , piece_id=KDW52DWZKZMJTXZ6POR4AVAFHCA2E5VEKENBMBTCEXGI3ZHW5OGA, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.760239836 (88h15m39.191319977s) [noise=true , address=104.36.82.61:4408 , piece_id=RNZATXKG3FIJRMQ3TXECL3SUOE7WABPBYXTE5ZMHYG6E7PNIZJCQ, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.760635123 (88h15m39.191715264s) [noise=true , address=77.90.31.12:4612 , piece_id=WSBTFE672DB5SBD6R5ME5H4QDSDEYVS4EHRGLPXTIVRRUVJFFDUQ, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.760851216 (88h15m39.191931347s) [noise=true , address=104.36.82.39:4740 , piece_id=BYUW67E46DKD2L3KSHK6YD3Y2FGBXLP62WSINVYJQ66H64F2DC2Q, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:45.871305682 (88h15m40.302385813s) [upload=91945]: Next returned nil segment Aug 12 09:41:45.871322675 (88h15m40.302402806s) [upload=91945]: Waiting for error group managing segments... Aug 12 09:41:46.153588661 (88h15m40.584668782s) [noise=true , address=66.23.193.175:4559 , piece_id=TE3C7ARV5Z5FRWGB4DQO3LHHNU2OLQKN72RDVVVRZ5GJHTEIISEA, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.253519414 (88h15m40.684599545s) [noise=true , address=64.49.13.26:4946 , piece_id=KT33IM65GDYI7CMUPQUBIF7AW22UPXD4I74HH3FXZ4MJNQGTBLFQ, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.664039266 (88h15m41.095119407s) [noise=true , address=79.127.219.38:4017 , piece_id=EG3FNV5HQKNVECL5QZZ7XDTE5IAVTEMAMPCXTDNB3CIJDCUIQ2IQ, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.698415811 (88h15m41.129495942s) [noise=true , address=77.90.31.11:4567 , piece_id=TTRTS2P3B2WRE5U27EKWEV4RFPLS76PXWWNYYWLEENRALJGEOZNA, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.702200412 (88h15m41.133280543s) [noise=true , address=104.36.82.60:4353 , piece_id=ABHP67KF53DQU63BCHWRWI7RRGYE25GKMZBJA7IF55PW54LUL3EQ, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.728460918 (88h15m41.159541049s) [noise=true , address=104.36.82.39:4740 , piece_id=BYUW67E46DKD2L3KSHK6YD3Y2FGBXLP62WSINVYJQ66H64F2DC2Q, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.746548967 (88h15m41.177629088s) [noise=true , address=77.90.31.17:4802 , piece_id=XNUBFTCF7XJUZIVEXFSQLZ3RVPY7VJKOAC66WL657SXTPEBTLE4A, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.746768246 (88h15m41.177848367s) [noise=true , address=104.36.82.59:4321 , piece_id=GSLM54DLWGVQEI7EFBA4WN5FTREZLFFPU4CQFANBJ23SZKNI45MA, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.761049191 (88h15m41.192129322s) [noise=true , address=104.36.82.16:4321 , piece_id=QRV5VZKBHKJJR72GFA2WEWK3SZXDD6WNH3MRNZDMQXY4IC2QGA4A, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.772076420 (88h15m41.203156541s) [noise=true , address=79.127.201.215:4351 , piece_id=KDW52DWZKZMJTXZ6POR4AVAFHCA2E5VEKENBMBTCEXGI3ZHW5OGA, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.773951698 (88h15m41.205031829s) [noise=true , address=77.90.31.12:4612 , piece_id=WSBTFE672DB5SBD6R5ME5H4QDSDEYVS4EHRGLPXTIVRRUVJFFDUQ, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.795243768 (88h15m41.226323899s) [noise=true , address=104.36.82.23:4460 , piece_id=5J7OSURHQ2NVVHNSWCKFUCDOAL5XOIDXNNPCO4X7GUW7SR462YXA, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.796050351 (88h15m41.227130482s) [noise=true , address=104.36.82.62:4424 , piece_id=E34NSM2CZNZPULSFKMSHSCY4OIJPUMPMDMLQRVKNKN52U6QFBZXQ, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.809335530 (88h15m41.240415661s) [noise=true , address=104.36.82.2:4757 , piece_id=JASPRMLAFJ36UVPV4DBP4V66PHAXWHKWY2D3LZXCXEFVLPC6EH6A, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.809359446 (88h15m41.240439577s) [seg_pos={0 0}, upload=91945]: Segment reached optimal threshold of 14 pieces. Aug 12 09:41:46.809494194 (88h15m41.240574325s) [noise=true , address=104.36.82.35:4610 , piece_id=UXEE2DEIRZEMRGVI2B35YXZNF5E23VGSQA2CWGMNAIR6DXPUAYIA, seg_pos={0 0}, upload=91945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KwSqrCrryAnNkjhZkfZjcCetBLLE9EonzgWi3UkBYW4wefZ1B): protocol: expected piece hash; context canceled; EOF Aug 12 09:41:46.809549259 (88h15m41.24062939s) [noise=true , address=104.36.82.3:4775 , piece_id=YOUQZN2JCS76YANNCQST5NM5CW3ALAI3S6L5STUX5Y5TCF4C6DEQ, seg_pos={0 0}, upload=91945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BvQLLnX5A2BgKeqn1ubs5iBeCUsUGH8hFjpB2HvY53YH9Nw1n): protocol: expected piece hash; context canceled; EOF Aug 12 09:41:46.809625154 (88h15m41.240705286s) [noise=true , address=104.36.82.61:4408 , piece_id=RNZATXKG3FIJRMQ3TXECL3SUOE7WABPBYXTE5ZMHYG6E7PNIZJCQ, seg_pos={0 0}, upload=91945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv): protocol: expected piece hash; context canceled; EOF Aug 12 09:41:46.809643048 (88h15m41.240723169s) [noise=true , address=104.36.82.44:4901 , piece_id=VXW36HT3VDS3LG6QWNFAT3AE2ZA6NZA2WEWAKN72RPX5KP5TDSKA, seg_pos={0 0}, upload=91945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FHE84zvBb1MKwB1Ht7puTafgQxDEvPt4mYqkYVSSufAMpWQA1): protocol: expected piece hash; context canceled; EOF Aug 12 09:41:46.809688586 (88h15m41.240768707s) [seg_pos={0 0}, upload=91945]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 09:41:46.809767777 (88h15m41.240847908s) [upload=91945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 09:41:46.809773548 (88h15m41.240853679s) [upload=91945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 09:41:47.108952174 (88h15m41.540032305s) [upload=91945]: Done uploading segments... Aug 12 09:41:47.108970840 (88h15m41.540050971s) [upload=91945]: Upload finished. err: <nil> Duration: 5.769709335s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...........................X.......X........X...............] duration: 1.950259946s FAIL (2025-08-12 09:44:29 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after c36fafdabf96bb5b9c4464bc922fb40045dd340ad6b7f61aa3a428437d8c7f85 != before c9b346cbcc10dabc7edd608987d023da7f45c3973830ffa574bb2139ca951f3f ======LOGS====== Aug 12 09:32:43.528352715 (88h6m37.959432847s) [upload=91793]: Starting upload Aug 12 09:32:43.528398883 (88h6m37.959479014s) [upload=91793]: Done starting upload Aug 12 09:32:43.528451965 (88h6m37.959532126s) [upload=91793]: Uploading segments... Aug 12 09:32:43.528498204 (88h6m37.959578365s) [upload=91793]: Got next segment. Inline: true Aug 12 09:32:43.528504716 (88h6m37.959584867s) [upload=91793]: Waiting for error group managing segments... Aug 12 09:32:43.528567947 (88h6m37.959648078s) [upload=91793]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 09:32:43.528574670 (88h6m37.959654861s) [upload=91793]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 09:32:43.528579549 (88h6m37.9596597s) [upload=91793]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 09:32:43.987672872 (88h6m38.418753003s) [upload=91793]: Done uploading segments... Aug 12 09:32:43.987690746 (88h6m38.418770878s) [upload=91793]: Upload finished. err: <nil> Duration:* 1.950285576s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 2.383165953s FAIL (2025-08-12 09:44:08 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.383188446s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 6.665863049s FAIL (2025-08-12 09:43:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.665877226s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [............................X.......X........X..............] duration: 1.854064203s FAIL (2025-08-12 09:43:43 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after c36fafdabf96bb5b9c4464bc922fb40045dd340ad6b7f61aa3a428437d8c7f85 != before c9b346cbcc10dabc7edd608987d023da7f45c3973830ffa574bb2139ca951f3f ======LOGS====== Aug 12 09:32:43.528352715 (88h6m37.959432847s) [upload=91793]: Starting upload Aug 12 09:32:43.528398883 (88h6m37.959479014s) [upload=91793]: Done starting upload Aug 12 09:32:43.528451965 (88h6m37.959532126s) [upload=91793]: Uploading segments... Aug 12 09:32:43.528498204 (88h6m37.959578365s) [upload=91793]: Got next segment. Inline: true Aug 12 09:32:43.528504716 (88h6m37.959584867s) [upload=91793]: Waiting for error group managing segments... Aug 12 09:32:43.528567947 (88h6m37.959648078s) [upload=91793]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 09:32:43.528574670 (88h6m37.959654861s) [upload=91793]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 09:32:43.528579549 (88h6m37.9596597s) [upload=91793]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 09:32:43.987672872 (88h6m38.418753003s) [upload=91793]: Done uploading segments... Aug 12 09:32:43.987690746 (88h6m38.418770878s) [upload=91793]: Upload finished. err: <nil> Duration:* 1.854100641s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 6.084013127s FAIL (2025-08-12 09:43:39 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.084038426s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [X......X......................X....X....................XX..] duration: 5.877751686s FAIL (2025-08-12 09:43:26 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f35ee2d072f8e8e457fea0f3861aead04855eb3bbd8f8003ec663c138019c935 != before 8f40c1fe4bccbd85fc958d130a5c0653d335a3e6eef3d2703ded56eb959d065f ======LOGS====== Aug 12 09:41:44.311520534 (88h15m38.742600665s) [upload=91945]: Starting upload Aug 12 09:41:44.311568495 (88h15m38.742648616s) [upload=91945]: Done starting upload Aug 12 09:41:44.311663608 (88h15m38.742743739s) [upload=91945]: Uploading segments... Aug 12 09:41:44.311758038 (88h15m38.742838169s) [upload=91945]: Got next segment. Inline: false Aug 12 09:41:44.311794999 (88h15m38.74287513s) [upload=91945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 09:41:44.311799297 (88h15m38.742879428s) [upload=91945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 09:41:44.758041190 (88h15m39.189121321s) [seg_pos={0 0}, upload=91945]: Begin upload segment... Aug 12 09:41:44.758083541 (88h15m39.189163662s) [seg_pos={0 0}, upload=91945]: Done begin upload segment. Aug 12 09:41:44.758105062 (88h15m39.189185193s) [noise=true , address=104.36.82.3:4775 , piece_id=YOUQZN2JCS76YANNCQST5NM5CW3ALAI3S6L5STUX5Y5TCF4C6DEQ, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.758207217 (88h15m39.189287338s) [noise=true , address=104.36.82.2:4757 , piece_id=JASPRMLAFJ36UVPV4DBP4V66PHAXWHKWY2D3LZXCXEFVLPC6EH6A, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.758474549 (88h15m39.18955468s) [noise=true , address=66.23.193.175:4559 , piece_id=TE3C7ARV5Z5FRWGB4DQO3LHHNU2OLQKN72RDVVVRZ5GJHTEIISEA, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.758635166 (88h15m39.189715297s) [noise=true , address=104.36.82.44:4901 , piece_id=VXW36HT3VDS3LG6QWNFAT3AE2ZA6NZA2WEWAKN72RPX5KP5TDSKA, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.758771638 (88h15m39.189851759s) [noise=true , address=104.36.82.16:4321 , piece_id=QRV5VZKBHKJJR72GFA2WEWK3SZXDD6WNH3MRNZDMQXY4IC2QGA4A, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759021696 (88h15m39.190101817s) [noise=true , address=104.36.82.62:4424 , piece_id=E34NSM2CZNZPULSFKMSHSCY4OIJPUMPMDMLQRVKNKN52U6QFBZXQ, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759041033 (88h15m39.190121164s) [noise=true , address=64.49.13.26:4946 , piece_id=KT33IM65GDYI7CMUPQUBIF7AW22UPXD4I74HH3FXZ4MJNQGTBLFQ, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759302553 (88h15m39.190382684s) [noise=true , address=104.36.82.59:4321 , piece_id=GSLM54DLWGVQEI7EFBA4WN5FTREZLFFPU4CQFANBJ23SZKNI45MA, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759307623 (88h15m39.190387754s) [noise=true , address=79.127.219.38:4017 , piece_id=EG3FNV5HQKNVECL5QZZ7XDTE5IAVTEMAMPCXTDNB3CIJDCUIQ2IQ, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759341918 (88h15m39.190422049s) [noise=true , address=104.36.82.23:4460 , piece_id=5J7OSURHQ2NVVHNSWCKFUCDOAL5XOIDXNNPCO4X7GUW7SR462YXA, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759619400 (88h15m39.190699521s) [noise=true , address=77.90.31.17:4802 , piece_id=XNUBFTCF7XJUZIVEXFSQLZ3RVPY7VJKOAC66WL657SXTPEBTLE4A, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759628587 (88h15m39.190708708s) [noise=true , address=104.36.82.60:4353 , piece_id=ABHP67KF53DQU63BCHWRWI7RRGYE25GKMZBJA7IF55PW54LUL3EQ, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759890307 (88h15m39.190970428s) [noise=true , address=104.36.82.35:4610 , piece_id=UXEE2DEIRZEMRGVI2B35YXZNF5E23VGSQA2CWGMNAIR6DXPUAYIA, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759904415 (88h15m39.190984546s) [noise=true , address=77.90.31.11:4567 , piece_id=TTRTS2P3B2WRE5U27EKWEV4RFPLS76PXWWNYYWLEENRALJGEOZNA, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.760170674 (88h15m39.191250795s) [noise=true , address=79.127.201.215:4351 , piece_id=KDW52DWZKZMJTXZ6POR4AVAFHCA2E5VEKENBMBTCEXGI3ZHW5OGA, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.760239836 (88h15m39.191319977s) [noise=true , address=104.36.82.61:4408 , piece_id=RNZATXKG3FIJRMQ3TXECL3SUOE7WABPBYXTE5ZMHYG6E7PNIZJCQ, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.760635123 (88h15m39.191715264s) [noise=true , address=77.90.31.12:4612 , piece_id=WSBTFE672DB5SBD6R5ME5H4QDSDEYVS4EHRGLPXTIVRRUVJFFDUQ, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.760851216 (88h15m39.191931347s) [noise=true , address=104.36.82.39:4740 , piece_id=BYUW67E46DKD2L3KSHK6YD3Y2FGBXLP62WSINVYJQ66H64F2DC2Q, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:45.871305682 (88h15m40.302385813s) [upload=91945]: Next returned nil segment Aug 12 09:41:45.871322675 (88h15m40.302402806s) [upload=91945]: Waiting for error group managing segments... Aug 12 09:41:46.153588661 (88h15m40.584668782s) [noise=true , address=66.23.193.175:4559 , piece_id=TE3C7ARV5Z5FRWGB4DQO3LHHNU2OLQKN72RDVVVRZ5GJHTEIISEA, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.253519414 (88h15m40.684599545s) [noise=true , address=64.49.13.26:4946 , piece_id=KT33IM65GDYI7CMUPQUBIF7AW22UPXD4I74HH3FXZ4MJNQGTBLFQ, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.664039266 (88h15m41.095119407s) [noise=true , address=79.127.219.38:4017 , piece_id=EG3FNV5HQKNVECL5QZZ7XDTE5IAVTEMAMPCXTDNB3CIJDCUIQ2IQ, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.698415811 (88h15m41.129495942s) [noise=true , address=77.90.31.11:4567 , piece_id=TTRTS2P3B2WRE5U27EKWEV4RFPLS76PXWWNYYWLEENRALJGEOZNA, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.702200412 (88h15m41.133280543s) [noise=true , address=104.36.82.60:4353 , piece_id=ABHP67KF53DQU63BCHWRWI7RRGYE25GKMZBJA7IF55PW54LUL3EQ, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.728460918 (88h15m41.159541049s) [noise=true , address=104.36.82.39:4740 , piece_id=BYUW67E46DKD2L3KSHK6YD3Y2FGBXLP62WSINVYJQ66H64F2DC2Q, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.746548967 (88h15m41.177629088s) [noise=true , address=77.90.31.17:4802 , piece_id=XNUBFTCF7XJUZIVEXFSQLZ3RVPY7VJKOAC66WL657SXTPEBTLE4A, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.746768246 (88h15m41.177848367s) [noise=true , address=104.36.82.59:4321 , piece_id=GSLM54DLWGVQEI7EFBA4WN5FTREZLFFPU4CQFANBJ23SZKNI45MA, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.761049191 (88h15m41.192129322s) [noise=true , address=104.36.82.16:4321 , piece_id=QRV5VZKBHKJJR72GFA2WEWK3SZXDD6WNH3MRNZDMQXY4IC2QGA4A, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.772076420 (88h15m41.203156541s) [noise=true , address=79.127.201.215:4351 , piece_id=KDW52DWZKZMJTXZ6POR4AVAFHCA2E5VEKENBMBTCEXGI3ZHW5OGA, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.773951698 (88h15m41.205031829s) [noise=true , address=77.90.31.12:4612 , piece_id=WSBTFE672DB5SBD6R5ME5H4QDSDEYVS4EHRGLPXTIVRRUVJFFDUQ, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.795243768 (88h15m41.226323899s) [noise=true , address=104.36.82.23:4460 , piece_id=5J7OSURHQ2NVVHNSWCKFUCDOAL5XOIDXNNPCO4X7GUW7SR462YXA, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.796050351 (88h15m41.227130482s) [noise=true , address=104.36.82.62:4424 , piece_id=E34NSM2CZNZPULSFKMSHSCY4OIJPUMPMDMLQRVKNKN52U6QFBZXQ, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.809335530 (88h15m41.240415661s) [noise=true , address=104.36.82.2:4757 , piece_id=JASPRMLAFJ36UVPV4DBP4V66PHAXWHKWY2D3LZXCXEFVLPC6EH6A, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.809359446 (88h15m41.240439577s) [seg_pos={0 0}, upload=91945]: Segment reached optimal threshold of 14 pieces. Aug 12 09:41:46.809494194 (88h15m41.240574325s) [noise=true , address=104.36.82.35:4610 , piece_id=UXEE2DEIRZEMRGVI2B35YXZNF5E23VGSQA2CWGMNAIR6DXPUAYIA, seg_pos={0 0}, upload=91945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KwSqrCrryAnNkjhZkfZjcCetBLLE9EonzgWi3UkBYW4wefZ1B): protocol: expected piece hash; context canceled; EOF Aug 12 09:41:46.809549259 (88h15m41.24062939s) [noise=true , address=104.36.82.3:4775 , piece_id=YOUQZN2JCS76YANNCQST5NM5CW3ALAI3S6L5STUX5Y5TCF4C6DEQ, seg_pos={0 0}, upload=91945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BvQLLnX5A2BgKeqn1ubs5iBeCUsUGH8hFjpB2HvY53YH9Nw1n): protocol: expected piece hash; context canceled; EOF Aug 12 09:41:46.809625154 (88h15m41.240705286s) [noise=true , address=104.36.82.61:4408 , piece_id=RNZATXKG3FIJRMQ3TXECL3SUOE7WABPBYXTE5ZMHYG6E7PNIZJCQ, seg_pos={0 0}, upload=91945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv): protocol: expected piece hash; context canceled; EOF Aug 12 09:41:46.809643048 (88h15m41.240723169s) [noise=true , address=104.36.82.44:4901 , piece_id=VXW36HT3VDS3LG6QWNFAT3AE2ZA6NZA2WEWAKN72RPX5KP5TDSKA, seg_pos={0 0}, upload=91945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FHE84zvBb1MKwB1Ht7puTafgQxDEvPt4mYqkYVSSufAMpWQA1): protocol: expected piece hash; context canceled; EOF Aug 12 09:41:46.809688586 (88h15m41.240768707s) [seg_pos={0 0}, upload=91945]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 09:41:46.809767777 (88h15m41.240847908s) [upload=91945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 09:41:46.809773548 (88h15m41.240853679s) [upload=91945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 09:41:47.108952174 (88h15m41.540032305s) [upload=91945]: Done uploading segments... Aug 12 09:41:47.108970840 (88h15m41.540050971s) [upload=91945]: Upload finished. err: <nil> Duration: 5.877833562s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 2.462540855s FAIL (2025-08-12 09:43:19 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.462561184s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.............................X.......X........X.............] duration: 2.002850572s FAIL (2025-08-12 09:42:39 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after c36fafdabf96bb5b9c4464bc922fb40045dd340ad6b7f61aa3a428437d8c7f85 != before c9b346cbcc10dabc7edd608987d023da7f45c3973830ffa574bb2139ca951f3f ======LOGS====== Aug 12 09:32:43.528352715 (88h6m37.959432847s) [upload=91793]: Starting upload Aug 12 09:32:43.528398883 (88h6m37.959479014s) [upload=91793]: Done starting upload Aug 12 09:32:43.528451965 (88h6m37.959532126s) [upload=91793]: Uploading segments... Aug 12 09:32:43.528498204 (88h6m37.959578365s) [upload=91793]: Got next segment. Inline: true Aug 12 09:32:43.528504716 (88h6m37.959584867s) [upload=91793]: Waiting for error group managing segments... Aug 12 09:32:43.528567947 (88h6m37.959648078s) [upload=91793]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 09:32:43.528574670 (88h6m37.959654861s) [upload=91793]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 09:32:43.528579549 (88h6m37.9596597s) [upload=91793]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 09:32:43.987672872 (88h6m38.418753003s) [upload=91793]: Done uploading segments... Aug 12 09:32:43.987690746 (88h6m38.418770878s) [upload=91793]: Upload finished. err: <nil> Duration:* 2.003242502s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 2.305068735s FAIL (2025-08-12 09:42:38 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.305091978s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 6.083883651s FAIL (2025-08-12 09:42:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.083918227s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 2.241853259s FAIL (2025-08-12 09:42:20 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.241873157s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 5.540870313s FAIL (2025-08-12 09:42:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.540898007s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [.X......X......................X....X....................XX.] duration: 5.578569566s FAIL (2025-08-12 09:42:11 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f35ee2d072f8e8e457fea0f3861aead04855eb3bbd8f8003ec663c138019c935 != before 8f40c1fe4bccbd85fc958d130a5c0653d335a3e6eef3d2703ded56eb959d065f ======LOGS====== Aug 12 09:41:44.311520534 (88h15m38.742600665s) [upload=91945]: Starting upload Aug 12 09:41:44.311568495 (88h15m38.742648616s) [upload=91945]: Done starting upload Aug 12 09:41:44.311663608 (88h15m38.742743739s) [upload=91945]: Uploading segments... Aug 12 09:41:44.311758038 (88h15m38.742838169s) [upload=91945]: Got next segment. Inline: false Aug 12 09:41:44.311794999 (88h15m38.74287513s) [upload=91945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 09:41:44.311799297 (88h15m38.742879428s) [upload=91945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 09:41:44.758041190 (88h15m39.189121321s) [seg_pos={0 0}, upload=91945]: Begin upload segment... Aug 12 09:41:44.758083541 (88h15m39.189163662s) [seg_pos={0 0}, upload=91945]: Done begin upload segment. Aug 12 09:41:44.758105062 (88h15m39.189185193s) [noise=true , address=104.36.82.3:4775 , piece_id=YOUQZN2JCS76YANNCQST5NM5CW3ALAI3S6L5STUX5Y5TCF4C6DEQ, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.758207217 (88h15m39.189287338s) [noise=true , address=104.36.82.2:4757 , piece_id=JASPRMLAFJ36UVPV4DBP4V66PHAXWHKWY2D3LZXCXEFVLPC6EH6A, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.758474549 (88h15m39.18955468s) [noise=true , address=66.23.193.175:4559 , piece_id=TE3C7ARV5Z5FRWGB4DQO3LHHNU2OLQKN72RDVVVRZ5GJHTEIISEA, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.758635166 (88h15m39.189715297s) [noise=true , address=104.36.82.44:4901 , piece_id=VXW36HT3VDS3LG6QWNFAT3AE2ZA6NZA2WEWAKN72RPX5KP5TDSKA, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.758771638 (88h15m39.189851759s) [noise=true , address=104.36.82.16:4321 , piece_id=QRV5VZKBHKJJR72GFA2WEWK3SZXDD6WNH3MRNZDMQXY4IC2QGA4A, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759021696 (88h15m39.190101817s) [noise=true , address=104.36.82.62:4424 , piece_id=E34NSM2CZNZPULSFKMSHSCY4OIJPUMPMDMLQRVKNKN52U6QFBZXQ, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759041033 (88h15m39.190121164s) [noise=true , address=64.49.13.26:4946 , piece_id=KT33IM65GDYI7CMUPQUBIF7AW22UPXD4I74HH3FXZ4MJNQGTBLFQ, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759302553 (88h15m39.190382684s) [noise=true , address=104.36.82.59:4321 , piece_id=GSLM54DLWGVQEI7EFBA4WN5FTREZLFFPU4CQFANBJ23SZKNI45MA, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759307623 (88h15m39.190387754s) [noise=true , address=79.127.219.38:4017 , piece_id=EG3FNV5HQKNVECL5QZZ7XDTE5IAVTEMAMPCXTDNB3CIJDCUIQ2IQ, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759341918 (88h15m39.190422049s) [noise=true , address=104.36.82.23:4460 , piece_id=5J7OSURHQ2NVVHNSWCKFUCDOAL5XOIDXNNPCO4X7GUW7SR462YXA, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759619400 (88h15m39.190699521s) [noise=true , address=77.90.31.17:4802 , piece_id=XNUBFTCF7XJUZIVEXFSQLZ3RVPY7VJKOAC66WL657SXTPEBTLE4A, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759628587 (88h15m39.190708708s) [noise=true , address=104.36.82.60:4353 , piece_id=ABHP67KF53DQU63BCHWRWI7RRGYE25GKMZBJA7IF55PW54LUL3EQ, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759890307 (88h15m39.190970428s) [noise=true , address=104.36.82.35:4610 , piece_id=UXEE2DEIRZEMRGVI2B35YXZNF5E23VGSQA2CWGMNAIR6DXPUAYIA, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759904415 (88h15m39.190984546s) [noise=true , address=77.90.31.11:4567 , piece_id=TTRTS2P3B2WRE5U27EKWEV4RFPLS76PXWWNYYWLEENRALJGEOZNA, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.760170674 (88h15m39.191250795s) [noise=true , address=79.127.201.215:4351 , piece_id=KDW52DWZKZMJTXZ6POR4AVAFHCA2E5VEKENBMBTCEXGI3ZHW5OGA, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.760239836 (88h15m39.191319977s) [noise=true , address=104.36.82.61:4408 , piece_id=RNZATXKG3FIJRMQ3TXECL3SUOE7WABPBYXTE5ZMHYG6E7PNIZJCQ, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.760635123 (88h15m39.191715264s) [noise=true , address=77.90.31.12:4612 , piece_id=WSBTFE672DB5SBD6R5ME5H4QDSDEYVS4EHRGLPXTIVRRUVJFFDUQ, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.760851216 (88h15m39.191931347s) [noise=true , address=104.36.82.39:4740 , piece_id=BYUW67E46DKD2L3KSHK6YD3Y2FGBXLP62WSINVYJQ66H64F2DC2Q, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:45.871305682 (88h15m40.302385813s) [upload=91945]: Next returned nil segment Aug 12 09:41:45.871322675 (88h15m40.302402806s) [upload=91945]: Waiting for error group managing segments... Aug 12 09:41:46.153588661 (88h15m40.584668782s) [noise=true , address=66.23.193.175:4559 , piece_id=TE3C7ARV5Z5FRWGB4DQO3LHHNU2OLQKN72RDVVVRZ5GJHTEIISEA, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.253519414 (88h15m40.684599545s) [noise=true , address=64.49.13.26:4946 , piece_id=KT33IM65GDYI7CMUPQUBIF7AW22UPXD4I74HH3FXZ4MJNQGTBLFQ, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.664039266 (88h15m41.095119407s) [noise=true , address=79.127.219.38:4017 , piece_id=EG3FNV5HQKNVECL5QZZ7XDTE5IAVTEMAMPCXTDNB3CIJDCUIQ2IQ, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.698415811 (88h15m41.129495942s) [noise=true , address=77.90.31.11:4567 , piece_id=TTRTS2P3B2WRE5U27EKWEV4RFPLS76PXWWNYYWLEENRALJGEOZNA, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.702200412 (88h15m41.133280543s) [noise=true , address=104.36.82.60:4353 , piece_id=ABHP67KF53DQU63BCHWRWI7RRGYE25GKMZBJA7IF55PW54LUL3EQ, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.728460918 (88h15m41.159541049s) [noise=true , address=104.36.82.39:4740 , piece_id=BYUW67E46DKD2L3KSHK6YD3Y2FGBXLP62WSINVYJQ66H64F2DC2Q, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.746548967 (88h15m41.177629088s) [noise=true , address=77.90.31.17:4802 , piece_id=XNUBFTCF7XJUZIVEXFSQLZ3RVPY7VJKOAC66WL657SXTPEBTLE4A, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.746768246 (88h15m41.177848367s) [noise=true , address=104.36.82.59:4321 , piece_id=GSLM54DLWGVQEI7EFBA4WN5FTREZLFFPU4CQFANBJ23SZKNI45MA, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.761049191 (88h15m41.192129322s) [noise=true , address=104.36.82.16:4321 , piece_id=QRV5VZKBHKJJR72GFA2WEWK3SZXDD6WNH3MRNZDMQXY4IC2QGA4A, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.772076420 (88h15m41.203156541s) [noise=true , address=79.127.201.215:4351 , piece_id=KDW52DWZKZMJTXZ6POR4AVAFHCA2E5VEKENBMBTCEXGI3ZHW5OGA, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.773951698 (88h15m41.205031829s) [noise=true , address=77.90.31.12:4612 , piece_id=WSBTFE672DB5SBD6R5ME5H4QDSDEYVS4EHRGLPXTIVRRUVJFFDUQ, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.795243768 (88h15m41.226323899s) [noise=true , address=104.36.82.23:4460 , piece_id=5J7OSURHQ2NVVHNSWCKFUCDOAL5XOIDXNNPCO4X7GUW7SR462YXA, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.796050351 (88h15m41.227130482s) [noise=true , address=104.36.82.62:4424 , piece_id=E34NSM2CZNZPULSFKMSHSCY4OIJPUMPMDMLQRVKNKN52U6QFBZXQ, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.809335530 (88h15m41.240415661s) [noise=true , address=104.36.82.2:4757 , piece_id=JASPRMLAFJ36UVPV4DBP4V66PHAXWHKWY2D3LZXCXEFVLPC6EH6A, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.809359446 (88h15m41.240439577s) [seg_pos={0 0}, upload=91945]: Segment reached optimal threshold of 14 pieces. Aug 12 09:41:46.809494194 (88h15m41.240574325s) [noise=true , address=104.36.82.35:4610 , piece_id=UXEE2DEIRZEMRGVI2B35YXZNF5E23VGSQA2CWGMNAIR6DXPUAYIA, seg_pos={0 0}, upload=91945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KwSqrCrryAnNkjhZkfZjcCetBLLE9EonzgWi3UkBYW4wefZ1B): protocol: expected piece hash; context canceled; EOF Aug 12 09:41:46.809549259 (88h15m41.24062939s) [noise=true , address=104.36.82.3:4775 , piece_id=YOUQZN2JCS76YANNCQST5NM5CW3ALAI3S6L5STUX5Y5TCF4C6DEQ, seg_pos={0 0}, upload=91945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BvQLLnX5A2BgKeqn1ubs5iBeCUsUGH8hFjpB2HvY53YH9Nw1n): protocol: expected piece hash; context canceled; EOF Aug 12 09:41:46.809625154 (88h15m41.240705286s) [noise=true , address=104.36.82.61:4408 , piece_id=RNZATXKG3FIJRMQ3TXECL3SUOE7WABPBYXTE5ZMHYG6E7PNIZJCQ, seg_pos={0 0}, upload=91945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv): protocol: expected piece hash; context canceled; EOF Aug 12 09:41:46.809643048 (88h15m41.240723169s) [noise=true , address=104.36.82.44:4901 , piece_id=VXW36HT3VDS3LG6QWNFAT3AE2ZA6NZA2WEWAKN72RPX5KP5TDSKA, seg_pos={0 0}, upload=91945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FHE84zvBb1MKwB1Ht7puTafgQxDEvPt4mYqkYVSSufAMpWQA1): protocol: expected piece hash; context canceled; EOF Aug 12 09:41:46.809688586 (88h15m41.240768707s) [seg_pos={0 0}, upload=91945]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 09:41:46.809767777 (88h15m41.240847908s) [upload=91945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 09:41:46.809773548 (88h15m41.240853679s) [upload=91945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 09:41:47.108952174 (88h15m41.540032305s) [upload=91945]: Done uploading segments... Aug 12 09:41:47.108970840 (88h15m41.540050971s) [upload=91945]: Upload finished. err: <nil> Duration: 5.578597069s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..............................X.......X........X............] duration: 1.815275055s FAIL (2025-08-12 09:41:51 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after c36fafdabf96bb5b9c4464bc922fb40045dd340ad6b7f61aa3a428437d8c7f85 != before c9b346cbcc10dabc7edd608987d023da7f45c3973830ffa574bb2139ca951f3f ======LOGS====== Aug 12 09:32:43.528352715 (88h6m37.959432847s) [upload=91793]: Starting upload Aug 12 09:32:43.528398883 (88h6m37.959479014s) [upload=91793]: Done starting upload Aug 12 09:32:43.528451965 (88h6m37.959532126s) [upload=91793]: Uploading segments... Aug 12 09:32:43.528498204 (88h6m37.959578365s) [upload=91793]: Got next segment. Inline: true Aug 12 09:32:43.528504716 (88h6m37.959584867s) [upload=91793]: Waiting for error group managing segments... Aug 12 09:32:43.528567947 (88h6m37.959648078s) [upload=91793]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 09:32:43.528574670 (88h6m37.959654861s) [upload=91793]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 09:32:43.528579549 (88h6m37.9596597s) [upload=91793]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 09:32:43.987672872 (88h6m38.418753003s) [upload=91793]: Done uploading segments... Aug 12 09:32:43.987690746 (88h6m38.418770878s) [upload=91793]: Upload finished. err: <nil> Duration:* 1.81529888s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [..X......X......................X....X....................XX] duration: 5.621279374s FAIL (2025-08-12 09:41:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f35ee2d072f8e8e457fea0f3861aead04855eb3bbd8f8003ec663c138019c935 != before 8f40c1fe4bccbd85fc958d130a5c0653d335a3e6eef3d2703ded56eb959d065f ======LOGS====== Aug 12 09:41:44.311520534 (88h15m38.742600665s) [upload=91945]: Starting upload Aug 12 09:41:44.311568495 (88h15m38.742648616s) [upload=91945]: Done starting upload Aug 12 09:41:44.311663608 (88h15m38.742743739s) [upload=91945]: Uploading segments... Aug 12 09:41:44.311758038 (88h15m38.742838169s) [upload=91945]: Got next segment. Inline: false Aug 12 09:41:44.311794999 (88h15m38.74287513s) [upload=91945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 09:41:44.311799297 (88h15m38.742879428s) [upload=91945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 09:41:44.758041190 (88h15m39.189121321s) [seg_pos={0 0}, upload=91945]: Begin upload segment... Aug 12 09:41:44.758083541 (88h15m39.189163662s) [seg_pos={0 0}, upload=91945]: Done begin upload segment. Aug 12 09:41:44.758105062 (88h15m39.189185193s) [noise=true , address=104.36.82.3:4775 , piece_id=YOUQZN2JCS76YANNCQST5NM5CW3ALAI3S6L5STUX5Y5TCF4C6DEQ, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.758207217 (88h15m39.189287338s) [noise=true , address=104.36.82.2:4757 , piece_id=JASPRMLAFJ36UVPV4DBP4V66PHAXWHKWY2D3LZXCXEFVLPC6EH6A, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.758474549 (88h15m39.18955468s) [noise=true , address=66.23.193.175:4559 , piece_id=TE3C7ARV5Z5FRWGB4DQO3LHHNU2OLQKN72RDVVVRZ5GJHTEIISEA, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.758635166 (88h15m39.189715297s) [noise=true , address=104.36.82.44:4901 , piece_id=VXW36HT3VDS3LG6QWNFAT3AE2ZA6NZA2WEWAKN72RPX5KP5TDSKA, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.758771638 (88h15m39.189851759s) [noise=true , address=104.36.82.16:4321 , piece_id=QRV5VZKBHKJJR72GFA2WEWK3SZXDD6WNH3MRNZDMQXY4IC2QGA4A, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759021696 (88h15m39.190101817s) [noise=true , address=104.36.82.62:4424 , piece_id=E34NSM2CZNZPULSFKMSHSCY4OIJPUMPMDMLQRVKNKN52U6QFBZXQ, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759041033 (88h15m39.190121164s) [noise=true , address=64.49.13.26:4946 , piece_id=KT33IM65GDYI7CMUPQUBIF7AW22UPXD4I74HH3FXZ4MJNQGTBLFQ, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759302553 (88h15m39.190382684s) [noise=true , address=104.36.82.59:4321 , piece_id=GSLM54DLWGVQEI7EFBA4WN5FTREZLFFPU4CQFANBJ23SZKNI45MA, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759307623 (88h15m39.190387754s) [noise=true , address=79.127.219.38:4017 , piece_id=EG3FNV5HQKNVECL5QZZ7XDTE5IAVTEMAMPCXTDNB3CIJDCUIQ2IQ, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759341918 (88h15m39.190422049s) [noise=true , address=104.36.82.23:4460 , piece_id=5J7OSURHQ2NVVHNSWCKFUCDOAL5XOIDXNNPCO4X7GUW7SR462YXA, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759619400 (88h15m39.190699521s) [noise=true , address=77.90.31.17:4802 , piece_id=XNUBFTCF7XJUZIVEXFSQLZ3RVPY7VJKOAC66WL657SXTPEBTLE4A, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759628587 (88h15m39.190708708s) [noise=true , address=104.36.82.60:4353 , piece_id=ABHP67KF53DQU63BCHWRWI7RRGYE25GKMZBJA7IF55PW54LUL3EQ, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759890307 (88h15m39.190970428s) [noise=true , address=104.36.82.35:4610 , piece_id=UXEE2DEIRZEMRGVI2B35YXZNF5E23VGSQA2CWGMNAIR6DXPUAYIA, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.759904415 (88h15m39.190984546s) [noise=true , address=77.90.31.11:4567 , piece_id=TTRTS2P3B2WRE5U27EKWEV4RFPLS76PXWWNYYWLEENRALJGEOZNA, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.760170674 (88h15m39.191250795s) [noise=true , address=79.127.201.215:4351 , piece_id=KDW52DWZKZMJTXZ6POR4AVAFHCA2E5VEKENBMBTCEXGI3ZHW5OGA, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.760239836 (88h15m39.191319977s) [noise=true , address=104.36.82.61:4408 , piece_id=RNZATXKG3FIJRMQ3TXECL3SUOE7WABPBYXTE5ZMHYG6E7PNIZJCQ, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.760635123 (88h15m39.191715264s) [noise=true , address=77.90.31.12:4612 , piece_id=WSBTFE672DB5SBD6R5ME5H4QDSDEYVS4EHRGLPXTIVRRUVJFFDUQ, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:44.760851216 (88h15m39.191931347s) [noise=true , address=104.36.82.39:4740 , piece_id=BYUW67E46DKD2L3KSHK6YD3Y2FGBXLP62WSINVYJQ66H64F2DC2Q, seg_pos={0 0}, upload=91945]: Uploading piece... Aug 12 09:41:45.871305682 (88h15m40.302385813s) [upload=91945]: Next returned nil segment Aug 12 09:41:45.871322675 (88h15m40.302402806s) [upload=91945]: Waiting for error group managing segments... Aug 12 09:41:46.153588661 (88h15m40.584668782s) [noise=true , address=66.23.193.175:4559 , piece_id=TE3C7ARV5Z5FRWGB4DQO3LHHNU2OLQKN72RDVVVRZ5GJHTEIISEA, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.253519414 (88h15m40.684599545s) [noise=true , address=64.49.13.26:4946 , piece_id=KT33IM65GDYI7CMUPQUBIF7AW22UPXD4I74HH3FXZ4MJNQGTBLFQ, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.664039266 (88h15m41.095119407s) [noise=true , address=79.127.219.38:4017 , piece_id=EG3FNV5HQKNVECL5QZZ7XDTE5IAVTEMAMPCXTDNB3CIJDCUIQ2IQ, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.698415811 (88h15m41.129495942s) [noise=true , address=77.90.31.11:4567 , piece_id=TTRTS2P3B2WRE5U27EKWEV4RFPLS76PXWWNYYWLEENRALJGEOZNA, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.702200412 (88h15m41.133280543s) [noise=true , address=104.36.82.60:4353 , piece_id=ABHP67KF53DQU63BCHWRWI7RRGYE25GKMZBJA7IF55PW54LUL3EQ, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.728460918 (88h15m41.159541049s) [noise=true , address=104.36.82.39:4740 , piece_id=BYUW67E46DKD2L3KSHK6YD3Y2FGBXLP62WSINVYJQ66H64F2DC2Q, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.746548967 (88h15m41.177629088s) [noise=true , address=77.90.31.17:4802 , piece_id=XNUBFTCF7XJUZIVEXFSQLZ3RVPY7VJKOAC66WL657SXTPEBTLE4A, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.746768246 (88h15m41.177848367s) [noise=true , address=104.36.82.59:4321 , piece_id=GSLM54DLWGVQEI7EFBA4WN5FTREZLFFPU4CQFANBJ23SZKNI45MA, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.761049191 (88h15m41.192129322s) [noise=true , address=104.36.82.16:4321 , piece_id=QRV5VZKBHKJJR72GFA2WEWK3SZXDD6WNH3MRNZDMQXY4IC2QGA4A, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.772076420 (88h15m41.203156541s) [noise=true , address=79.127.201.215:4351 , piece_id=KDW52DWZKZMJTXZ6POR4AVAFHCA2E5VEKENBMBTCEXGI3ZHW5OGA, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.773951698 (88h15m41.205031829s) [noise=true , address=77.90.31.12:4612 , piece_id=WSBTFE672DB5SBD6R5ME5H4QDSDEYVS4EHRGLPXTIVRRUVJFFDUQ, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.795243768 (88h15m41.226323899s) [noise=true , address=104.36.82.23:4460 , piece_id=5J7OSURHQ2NVVHNSWCKFUCDOAL5XOIDXNNPCO4X7GUW7SR462YXA, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.796050351 (88h15m41.227130482s) [noise=true , address=104.36.82.62:4424 , piece_id=E34NSM2CZNZPULSFKMSHSCY4OIJPUMPMDMLQRVKNKN52U6QFBZXQ, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.809335530 (88h15m41.240415661s) [noise=true , address=104.36.82.2:4757 , piece_id=JASPRMLAFJ36UVPV4DBP4V66PHAXWHKWY2D3LZXCXEFVLPC6EH6A, seg_pos={0 0}, upload=91945]: Done uploading piece. err: <nil> Aug 12 09:41:46.809359446 (88h15m41.240439577s) [seg_pos={0 0}, upload=91945]: Segment reached optimal threshold of 14 pieces. Aug 12 09:41:46.809494194 (88h15m41.240574325s) [noise=true , address=104.36.82.35:4610 , piece_id=UXEE2DEIRZEMRGVI2B35YXZNF5E23VGSQA2CWGMNAIR6DXPUAYIA, seg_pos={0 0}, upload=91945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KwSqrCrryAnNkjhZkfZjcCetBLLE9EonzgWi3UkBYW4wefZ1B): protocol: expected piece hash; context canceled; EOF Aug 12 09:41:46.809549259 (88h15m41.24062939s) [noise=true , address=104.36.82.3:4775 , piece_id=YOUQZN2JCS76YANNCQST5NM5CW3ALAI3S6L5STUX5Y5TCF4C6DEQ, seg_pos={0 0}, upload=91945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BvQLLnX5A2BgKeqn1ubs5iBeCUsUGH8hFjpB2HvY53YH9Nw1n): protocol: expected piece hash; context canceled; EOF Aug 12 09:41:46.809625154 (88h15m41.240705286s) [noise=true , address=104.36.82.61:4408 , piece_id=RNZATXKG3FIJRMQ3TXECL3SUOE7WABPBYXTE5ZMHYG6E7PNIZJCQ, seg_pos={0 0}, upload=91945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv): protocol: expected piece hash; context canceled; EOF Aug 12 09:41:46.809643048 (88h15m41.240723169s) [noise=true , address=104.36.82.44:4901 , piece_id=VXW36HT3VDS3LG6QWNFAT3AE2ZA6NZA2WEWAKN72RPX5KP5TDSKA, seg_pos={0 0}, upload=91945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FHE84zvBb1MKwB1Ht7puTafgQxDEvPt4mYqkYVSSufAMpWQA1): protocol: expected piece hash; context canceled; EOF Aug 12 09:41:46.809688586 (88h15m41.240768707s) [seg_pos={0 0}, upload=91945]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 09:41:46.809767777 (88h15m41.240847908s) [upload=91945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 09:41:46.809773548 (88h15m41.240853679s) [upload=91945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 09:41:47.108952174 (88h15m41.540032305s) [upload=91945]: Done uploading segments... Aug 12 09:41:47.108970840 (88h15m41.540050971s) [upload=91945]: Upload finished. err: <nil> Duration: 5.621305163s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 6.356966695s FAIL (2025-08-12 09:41:43 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.356987083s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 2.285668934s FAIL (2025-08-12 09:41:39 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.285690215s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...............................X.......X........X...........] duration: 1.819927024s FAIL (2025-08-12 09:41:18 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after c36fafdabf96bb5b9c4464bc922fb40045dd340ad6b7f61aa3a428437d8c7f85 != before c9b346cbcc10dabc7edd608987d023da7f45c3973830ffa574bb2139ca951f3f ======LOGS====== Aug 12 09:32:43.528352715 (88h6m37.959432847s) [upload=91793]: Starting upload Aug 12 09:32:43.528398883 (88h6m37.959479014s) [upload=91793]: Done starting upload Aug 12 09:32:43.528451965 (88h6m37.959532126s) [upload=91793]: Uploading segments... Aug 12 09:32:43.528498204 (88h6m37.959578365s) [upload=91793]: Got next segment. Inline: true Aug 12 09:32:43.528504716 (88h6m37.959584867s) [upload=91793]: Waiting for error group managing segments... Aug 12 09:32:43.528567947 (88h6m37.959648078s) [upload=91793]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 09:32:43.528574670 (88h6m37.959654861s) [upload=91793]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 09:32:43.528579549 (88h6m37.9596597s) [upload=91793]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 09:32:43.987672872 (88h6m38.418753003s) [upload=91793]: Done uploading segments... Aug 12 09:32:43.987690746 (88h6m38.418770878s) [upload=91793]: Upload finished. err: <nil> Duration:* 1.819947964s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 2.321651611s FAIL (2025-08-12 09:40:56 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.321674526s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 6.545183077s FAIL (2025-08-12 09:40:46 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.545202515s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [...X......X......................X....X....................X] duration: 5.827742992s FAIL (2025-08-12 09:40:38 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 0fc96fde5806e1e3de92faea4b72f1ae57abc377489f6cedba17470d4f5cc0fc != before 7232133e1c2ebdac11d279c7897a837825c5db6123d391365771f0726c6bf27e ======LOGS====== Aug 12 09:40:33.606658726 (88h14m28.037738877s) [upload=91928]: Starting upload Aug 12 09:40:33.606785179 (88h14m28.03786532s) [upload=91928]: Done starting upload Aug 12 09:40:33.606937930 (88h14m28.038018101s) [upload=91928]: Uploading segments... Aug 12 09:40:33.607018985 (88h14m28.038099116s) [upload=91928]: Got next segment. Inline: false Aug 12 09:40:33.607060766 (88h14m28.038140897s) [upload=91928]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 09:40:33.607066957 (88h14m28.038147109s) [upload=91928]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 09:40:34.092146890 (88h14m28.523227011s) [seg_pos={0 0}, upload=91928]: Begin upload segment... Aug 12 09:40:34.092201394 (88h14m28.523281566s) [seg_pos={0 0}, upload=91928]: Done begin upload segment. Aug 12 09:40:34.092234227 (88h14m28.523314358s) [noise=true , address=104.36.82.62:4416 , piece_id=3ZNZMSDHIMIVMP25RLQTQI4L5LY3HMU3BGJQ5INAFXWA3NWGV2HQ, seg_pos={0 0}, upload=91928]: Uploading piece... Aug 12 09:40:34.092250709 (88h14m28.52333088s) [noise=true , address=66.23.193.175:4563 , piece_id=OFSROHILQI7LJOEKVX3UL233THLP5B2IT5BIIK3FSBXPEB7OMWFA, seg_pos={0 0}, upload=91928]: Uploading piece... Aug 12 09:40:34.092625896 (88h14m28.523706017s) [noise=true , address=104.36.82.61:4402 , piece_id=DJE46LL2UNHIFWOYULJUDMABJQ7J5L7SYH7GQJ6C4RGV4NZMMXYA, seg_pos={0 0}, upload=91928]: Uploading piece... Aug 12 09:40:34.092715318 (88h14m28.523795449s) [noise=true , address=64.49.13.140:4513 , piece_id=ZM3T7JFFPY6XSRJWFHBXJUFSY76LGD2YKPZQHHXZUTZEYG3V4QLQ, seg_pos={0 0}, upload=91928]: Uploading piece... Aug 12 09:40:34.092883750 (88h14m28.523963881s) [noise=true , address=77.90.31.15:4714 , piece_id=VWUZ4JXRHP5IIJRKF7ROQVOQYEK3MYIXLYUZUF4SXNGT735PI7MQ, seg_pos={0 0}, upload=91928]: Uploading piece... Aug 12 09:40:34.092994432 (88h14m28.524074563s) [noise=true , address=104.36.82.16:4299 , piece_id=W2XFF675K4462EL6JQDRFVBYT254PWQ27V62KAOGQITOWV5QRMYQ, seg_pos={0 0}, upload=91928]: Uploading piece... Aug 12 09:40:34.093125874 (88h14m28.524206005s) [noise=true , address=79.127.201.215:4347 , piece_id=6SSDS5ENEBR2SMLPH3NU4PATJ4MG2JGLBCH6JPUZU6UE33S73Z5A, seg_pos={0 0}, upload=91928]: Uploading piece... Aug 12 09:40:34.093268146 (88h14m28.524348267s) [noise=true , address=104.36.82.60:4349 , piece_id=LN4ALALZSPNHINMVTXOTFGV3WPWRY52GZ3EBFO75PKGQHU7UJYQQ, seg_pos={0 0}, upload=91928]: Uploading piece... Aug 12 09:40:34.093331827 (88h14m28.524411958s) [noise=true , address=104.36.82.23:4468 , piece_id=SJOJD7G72A4AINLYJ323DUSYP3B2G7CPOWUVKNCSUJYTJ4VS6FSQ, seg_pos={0 0}, upload=91928]: Uploading piece... Aug 12 09:40:34.093486634 (88h14m28.524566765s) [noise=true , address=104.36.82.34:4569 , piece_id=NE2D2STL745MKBOMINWN565HVOYIAGIEZXGLPNQVIUX3TNI3AGLA, seg_pos={0 0}, upload=91928]: Uploading piece... Aug 12 09:40:34.093697537 (88h14m28.524777668s) [noise=true , address=66.23.193.175:4561 , piece_id=6Q5TREIQ6Q6ESXGODB5X6FNQ4J3BQFE62BTURRMGS74MFWEKMESQ, seg_pos={0 0}, upload=91928]: Uploading piece... Aug 12 09:40:34.093932497 (88h14m28.525012628s) [noise=true , address=79.127.220.101:4070 , piece_id=JJICX25SOA7KBITCMJEKHY3U3SQRD6UINJCLFP4IFLCQUUABZXDA, seg_pos={0 0}, upload=91928]: Uploading piece... Aug 12 09:40:34.094170552 (88h14m28.525250683s) [noise=true , address=104.36.82.44:4900 , piece_id=BLEA4M6WAWWGBRS3L2GWQ3HDYX2Z7O6US6UKRRKS6LNFHV22LBMA, seg_pos={0 0}, upload=91928]: Uploading piece... Aug 12 09:40:34.094525271 (88h14m28.525605402s) [noise=true , address=104.36.82.38:4703 , piece_id=ZKEKJEOLWFJ7BOAFHQZV5FMZWV55SD3DCYWPXHC6L4GTB3ITAFIA, seg_pos={0 0}, upload=91928]: Uploading piece... Aug 12 09:40:34.094885360 (88h14m28.525965491s) [noise=true , address=64.49.13.169:4716 , piece_id=GUURL7MO7PNRNEUMDSEJY5FFFUSVTJWZ2SGJGEZESFJJZCG3JPOQ, seg_pos={0 0}, upload=91928]: Uploading piece... Aug 12 09:40:34.095084912 (88h14m28.526165033s) [noise=true , address=104.36.82.37:4678 , piece_id=TADG5GXRS22D5OGC7ABOYUG2N3APPAFHIVY63D5L6XYGRNHCRT5Q, seg_pos={0 0}, upload=91928]: Uploading piece... Aug 12 09:40:34.095275196 (88h14m28.526355327s) [noise=true , address=77.90.31.17:4802 , piece_id=YPHII43XXBNGDN2VTPAN3B7HSU3YYPA7FTASCO7XWY23CAXOGDHQ, seg_pos={0 0}, upload=91928]: Uploading piece... Aug 12 09:40:34.095472042 (88h14m28.526552173s) [noise=true , address=77.90.31.19:4851 , piece_id=3JC4JUTW3ONK5PSGPULTEEBBMLSHYDBHJH3WHCYULAPZFV7DECPA, seg_pos={0 0}, upload=91928]: Uploading piece... Aug 12 09:40:35.240468370 (88h14m29.671548502s) [upload=91928]: Next returned nil segment Aug 12 09:40:35.240485464 (88h14m29.671565595s) [upload=91928]: Waiting for error group managing segments... Aug 12 09:40:35.528522331 (88h14m29.959602462s) [noise=true , address=64.49.13.169:4716 , piece_id=GUURL7MO7PNRNEUMDSEJY5FFFUSVTJWZ2SGJGEZESFJJZCG3JPOQ, seg_pos={0 0}, upload=91928]: Done uploading piece. err: <nil> Aug 12 09:40:35.556931408 (88h14m29.988011529s) [noise=true , address=66.23.193.175:4563 , piece_id=OFSROHILQI7LJOEKVX3UL233THLP5B2IT5BIIK3FSBXPEB7OMWFA, seg_pos={0 0}, upload=91928]: Done uploading piece. err: <nil> Aug 12 09:40:35.564981912 (88h14m29.996062043s) [noise=true , address=66.23.193.175:4561 , piece_id=6Q5TREIQ6Q6ESXGODB5X6FNQ4J3BQFE62BTURRMGS74MFWEKMESQ, seg_pos={0 0}, upload=91928]: Done uploading piece. err: <nil> Aug 12 09:40:35.582428493 (88h14m30.013508624s) [noise=true , address=64.49.13.140:4513 , piece_id=ZM3T7JFFPY6XSRJWFHBXJUFSY76LGD2YKPZQHHXZUTZEYG3V4QLQ, seg_pos={0 0}, upload=91928]: Done uploading piece. err: <nil> Aug 12 09:40:35.932112053 (88h14m30.363192184s) [noise=true , address=79.127.220.101:4070 , piece_id=JJICX25SOA7KBITCMJEKHY3U3SQRD6UINJCLFP4IFLCQUUABZXDA, seg_pos={0 0}, upload=91928]: Done uploading piece. err: <nil> Aug 12 09:40:36.011282054 (88h14m30.442362185s) [noise=true , address=77.90.31.19:4851 , piece_id=3JC4JUTW3ONK5PSGPULTEEBBMLSHYDBHJH3WHCYULAPZFV7DECPA, seg_pos={0 0}, upload=91928]: Done uploading piece. err: <nil> Aug 12 09:40:36.029115326 (88h14m30.460195457s) [noise=true , address=104.36.82.23:4468 , piece_id=SJOJD7G72A4AINLYJ323DUSYP3B2G7CPOWUVKNCSUJYTJ4VS6FSQ, seg_pos={0 0}, upload=91928]: Done uploading piece. err: <nil> Aug 12 09:40:36.031812817 (88h14m30.462892948s) [noise=true , address=104.36.82.38:4703 , piece_id=ZKEKJEOLWFJ7BOAFHQZV5FMZWV55SD3DCYWPXHC6L4GTB3ITAFIA, seg_pos={0 0}, upload=91928]: Done uploading piece. err: <nil> Aug 12 09:40:36.045286577 (88h14m30.476366708s) [noise=true , address=104.36.82.34:4569 , piece_id=NE2D2STL745MKBOMINWN565HVOYIAGIEZXGLPNQVIUX3TNI3AGLA, seg_pos={0 0}, upload=91928]: Done uploading piece. err: <nil> Aug 12 09:40:36.046141442 (88h14m30.477221563s) [noise=true , address=104.36.82.16:4299 , piece_id=W2XFF675K4462EL6JQDRFVBYT254PWQ27V62KAOGQITOWV5QRMYQ, seg_pos={0 0}, upload=91928]: Done uploading piece. err: <nil> Aug 12 09:40:36.054419882 (88h14m30.485500014s) [noise=true , address=104.36.82.61:4402 , piece_id=DJE46LL2UNHIFWOYULJUDMABJQ7J5L7SYH7GQJ6C4RGV4NZMMXYA, seg_pos={0 0}, upload=91928]: Done uploading piece. err: <nil> Aug 12 09:40:36.066340240 (88h14m30.497420361s) [noise=true , address=79.127.201.215:4347 , piece_id=6SSDS5ENEBR2SMLPH3NU4PATJ4MG2JGLBCH6JPUZU6UE33S73Z5A, seg_pos={0 0}, upload=91928]: Done uploading piece. err: <nil> Aug 12 09:40:36.074943862 (88h14m30.506023993s) [noise=true , address=77.90.31.17:4802 , piece_id=YPHII43XXBNGDN2VTPAN3B7HSU3YYPA7FTASCO7XWY23CAXOGDHQ, seg_pos={0 0}, upload=91928]: Done uploading piece. err: <nil> Aug 12 09:40:36.135618764 (88h14m30.566698895s) [noise=true , address=104.36.82.60:4349 , piece_id=LN4ALALZSPNHINMVTXOTFGV3WPWRY52GZ3EBFO75PKGQHU7UJYQQ, seg_pos={0 0}, upload=91928]: Done uploading piece. err: <nil> Aug 12 09:40:36.135648783 (88h14m30.566728914s) [seg_pos={0 0}, upload=91928]: Segment reached optimal threshold of 14 pieces. Aug 12 09:40:36.135792988 (88h14m30.566873119s) [noise=true , address=104.36.82.37:4678 , piece_id=TADG5GXRS22D5OGC7ABOYUG2N3APPAFHIVY63D5L6XYGRNHCRT5Q, seg_pos={0 0}, upload=91928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Eqo4D6dYxJBJXN3Ww2FYoL2cFudeBSyJQdbKqnuMAS6mZ4En6): protocol: expected piece hash; context canceled; EOF Aug 12 09:40:36.135833976 (88h14m30.566914107s) [noise=true , address=104.36.82.44:4900 , piece_id=BLEA4M6WAWWGBRS3L2GWQ3HDYX2Z7O6US6UKRRKS6LNFHV22LBMA, seg_pos={0 0}, upload=91928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1R8K65zsCspu7W2oAnvtpz7zEsQFkDG1e5BAp6faQYMQrkh4oQ): protocol: expected piece hash; context canceled; EOF Aug 12 09:40:36.135867221 (88h14m30.566947352s) [noise=true , address=77.90.31.15:4714 , piece_id=VWUZ4JXRHP5IIJRKF7ROQVOQYEK3MYIXLYUZUF4SXNGT735PI7MQ, seg_pos={0 0}, upload=91928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTMJVUhaPKvEnvujCAk9byGb88QsevLbtCBB9R1mxS4DxShiP): protocol: expected piece hash; context canceled; EOF Aug 12 09:40:36.135913058 (88h14m30.566993189s) [noise=true , address=104.36.82.62:4416 , piece_id=3ZNZMSDHIMIVMP25RLQTQI4L5LY3HMU3BGJQ5INAFXWA3NWGV2HQ, seg_pos={0 0}, upload=91928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12syasUPsyYf4UstQ6cFAr6qamze3vCyAm9dnobk5e83w4bTz69): protocol: expected piece hash; context canceled; EOF Aug 12 09:40:36.135924670 (88h14m30.567004801s) [seg_pos={0 0}, upload=91928]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 09:40:36.135980517 (88h14m30.567060638s) [upload=91928]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 09:40:36.135984755 (88h14m30.567064886s) [upload=91928]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 09:40:36.422758204 (88h14m30.853838345s) [upload=91928]: Done uploading segments... Aug 12 09:40:36.422780928 (88h14m30.853861069s) [upload=91928]: Upload finished. err: <nil> Duration: 5.827768892s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 2.258050359s FAIL (2025-08-12 09:40:09 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.258074455s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [................................X.......X........X..........] duration: 1.81359046s FAIL (2025-08-12 09:40:08 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after c36fafdabf96bb5b9c4464bc922fb40045dd340ad6b7f61aa3a428437d8c7f85 != before c9b346cbcc10dabc7edd608987d023da7f45c3973830ffa574bb2139ca951f3f ======LOGS====== Aug 12 09:32:43.528352715 (88h6m37.959432847s) [upload=91793]: Starting upload Aug 12 09:32:43.528398883 (88h6m37.959479014s) [upload=91793]: Done starting upload Aug 12 09:32:43.528451965 (88h6m37.959532126s) [upload=91793]: Uploading segments... Aug 12 09:32:43.528498204 (88h6m37.959578365s) [upload=91793]: Got next segment. Inline: true Aug 12 09:32:43.528504716 (88h6m37.959584867s) [upload=91793]: Waiting for error group managing segments... Aug 12 09:32:43.528567947 (88h6m37.959648078s) [upload=91793]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 09:32:43.528574670 (88h6m37.959654861s) [upload=91793]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 09:32:43.528579549 (88h6m37.9596597s) [upload=91793]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 09:32:43.987672872 (88h6m38.418753003s) [upload=91793]: Done uploading segments... Aug 12 09:32:43.987690746 (88h6m38.418770878s) [upload=91793]: Upload finished. err: <nil> Duration:* 1.813618873s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [....X......X......................X....X....................] duration: 5.72418635s FAIL (2025-08-12 09:39:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 09:23:08.516266754 (87h57m2.947346885s) [upload=91621]: Starting upload Aug 12 09:23:08.516319585 (87h57m2.947399716s) [upload=91621]: Done starting upload Aug 12 09:23:08.516447219 (87h57m2.947527371s) [upload=91621]: Uploading segments... Aug 12 09:23:08.516526641 (87h57m2.947606772s) [upload=91621]: Got next segment. Inline: false Aug 12 09:23:08.516564794 (87h57m2.947644925s) [upload=91621]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 09:23:08.516570595 (87h57m2.947650736s) [upload=91621]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 09:23:08.760094669 (87h57m3.1911748s) [upload=91621]: Next segment err: metaclient: Too Many Requests Aug 12 09:23:08.760114537 (87h57m3.191194668s) [upload=91621]: Done uploading segments... Aug 12 09:23:08.760127261 (87h57m3.191207392s) [upload=91621]: Upload finished. err: metaclient: Too Many Requests Duration: 5.724243429s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 2.340138944s FAIL (2025-08-12 09:39:50 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.34015742s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 6.118427093s FAIL (2025-08-12 09:39:43 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.118476278s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.................................X.......X........X.........] duration: 1.866004827s FAIL (2025-08-12 09:39:30 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after c36fafdabf96bb5b9c4464bc922fb40045dd340ad6b7f61aa3a428437d8c7f85 != before c9b346cbcc10dabc7edd608987d023da7f45c3973830ffa574bb2139ca951f3f ======LOGS====== Aug 12 09:32:43.528352715 (88h6m37.959432847s) [upload=91793]: Starting upload Aug 12 09:32:43.528398883 (88h6m37.959479014s) [upload=91793]: Done starting upload Aug 12 09:32:43.528451965 (88h6m37.959532126s) [upload=91793]: Uploading segments... Aug 12 09:32:43.528498204 (88h6m37.959578365s) [upload=91793]: Got next segment. Inline: true Aug 12 09:32:43.528504716 (88h6m37.959584867s) [upload=91793]: Waiting for error group managing segments... Aug 12 09:32:43.528567947 (88h6m37.959648078s) [upload=91793]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 09:32:43.528574670 (88h6m37.959654861s) [upload=91793]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 09:32:43.528579549 (88h6m37.9596597s) [upload=91793]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 09:32:43.987672872 (88h6m38.418753003s) [upload=91793]: Done uploading segments... Aug 12 09:32:43.987690746 (88h6m38.418770878s) [upload=91793]: Upload finished. err: <nil> Duration:* 1.866030925s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 1.790508115s FAIL (2025-08-12 09:39:26 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.790535707s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.....X......X......................X....X...................] duration: 5.827712985s FAIL (2025-08-12 09:38:42 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 09:23:08.516266754 (87h57m2.947346885s) [upload=91621]: Starting upload Aug 12 09:23:08.516319585 (87h57m2.947399716s) [upload=91621]: Done starting upload Aug 12 09:23:08.516447219 (87h57m2.947527371s) [upload=91621]: Uploading segments... Aug 12 09:23:08.516526641 (87h57m2.947606772s) [upload=91621]: Got next segment. Inline: false Aug 12 09:23:08.516564794 (87h57m2.947644925s) [upload=91621]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 09:23:08.516570595 (87h57m2.947650736s) [upload=91621]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 09:23:08.760094669 (87h57m3.1911748s) [upload=91621]: Next segment err: metaclient: Too Many Requests Aug 12 09:23:08.760114537 (87h57m3.191194668s) [upload=91621]: Done uploading segments... Aug 12 09:23:08.760127261 (87h57m3.191207392s) [upload=91621]: Upload finished. err: metaclient: Too Many Requests Duration: 5.827731571s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 5.854645958s FAIL (2025-08-12 09:38:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.854665546s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 2.62211721s FAIL (2025-08-12 09:38:32 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.622140967s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..................................X.......X........X........] duration: 1.839410433s FAIL (2025-08-12 09:38:18 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after c36fafdabf96bb5b9c4464bc922fb40045dd340ad6b7f61aa3a428437d8c7f85 != before c9b346cbcc10dabc7edd608987d023da7f45c3973830ffa574bb2139ca951f3f ======LOGS====== Aug 12 09:32:43.528352715 (88h6m37.959432847s) [upload=91793]: Starting upload Aug 12 09:32:43.528398883 (88h6m37.959479014s) [upload=91793]: Done starting upload Aug 12 09:32:43.528451965 (88h6m37.959532126s) [upload=91793]: Uploading segments... Aug 12 09:32:43.528498204 (88h6m37.959578365s) [upload=91793]: Got next segment. Inline: true Aug 12 09:32:43.528504716 (88h6m37.959584867s) [upload=91793]: Waiting for error group managing segments... Aug 12 09:32:43.528567947 (88h6m37.959648078s) [upload=91793]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 09:32:43.528574670 (88h6m37.959654861s) [upload=91793]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 09:32:43.528579549 (88h6m37.9596597s) [upload=91793]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 09:32:43.987672872 (88h6m38.418753003s) [upload=91793]: Done uploading segments... Aug 12 09:32:43.987690746 (88h6m38.418770878s) [upload=91793]: Upload finished. err: <nil> Duration:* 1.839436183s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 6.133574629s FAIL (2025-08-12 09:38:17 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.133595771s edge gateway us-select-1

1
...
15603
15604
15605
15606
15607
...
17780