Orbiter History

checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 6.271348587s FAIL (2025-08-08 06:03:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.271371983s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 6.499953213s FAIL (2025-08-08 06:02:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.499993739s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.XX...............X.X.......................X...............] duration: 5.762449468s FAIL (2025-08-08 06:02:48 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== ad finished. err: <nil> Aug 8 05:50:40.893567535 (20h10m40.482912522s) [upload=20903]: Starting upload Aug 8 05:50:40.893617581 (20h10m40.482962568s) [upload=20903]: Done starting upload Aug 8 05:50:40.893745836 (20h10m40.483090823s) [upload=20903]: Uploading segments... Aug 8 05:50:40.893860175 (20h10m40.483205162s) [upload=20903]: Got next segment. Inline: false Aug 8 05:50:40.893898729 (20h10m40.483243706s) [upload=20903]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:50:40.893904339 (20h10m40.483249326s) [upload=20903]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:50:41.341218008 (20h10m40.930562995s) [seg_pos={0 0}, upload=20903]: Begin upload segment... Aug 8 05:50:41.341265508 (20h10m40.930610495s) [seg_pos={0 0}, upload=20903]: Done begin upload segment. Aug 8 05:50:41.341287290 (20h10m40.930632267s) [noise=true , address=104.36.82.37:4657 , piece_id=6G2JI22ZFKN72YYNJZ4Q3PK4ODRBF4QOK5OH3XNI245MOEV4INRA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341358447 (20h10m40.930703434s) [noise=true , address=64.49.13.155:4916 , piece_id=R4EDGKGU5O3XMIEDBT3P3YDZ6M5NDSW627JISIFRRYM3YFY7OJ7A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341670363 (20h10m40.93101535s) [noise=true , address=104.36.82.44:4873 , piece_id=OGMZZTN6R646OCIKFIN2ARH7HBXIYI4RG3RHOVEFGTGOS6EFLPFA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341830500 (20h10m40.931175487s) [noise=true , address=193.149.164.143:4696 , piece_id=FNRXKJGRXG64FVEF7U6WLJT56RBHEONLJF5FM3K7ZRBCQVBL3VFQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341990977 (20h10m40.931335954s) [noise=true , address=104.36.82.39:4735 , piece_id=VYEESGWFD57OTLITJU27YFV3IKI34JW7GANQ2U34PV6WAGMPEFXQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342205478 (20h10m40.931550465s) [noise=true , address=104.36.82.60:4348 , piece_id=DSQCOTEIOHDKJSUZYR7RQGXLT6A3FQNPBHZ36UKT3G56PNEWBKZA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342313615 (20h10m40.931658602s) [noise=true , address=104.36.82.36:4633 , piece_id=N6ZYWVZ7CODZ3SWA3T2KL6HWOPISACLE6YNECGDNL6S6NHP6TYZA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342583129 (20h10m40.931928117s) [noise=true , address=104.36.82.47:4529 , piece_id=UESMFD5UVKCQ4F5XKAG6OMNTA4BS6QV2BME5E7DMIJP7XWHJHT6A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342596976 (20h10m40.931941953s) [noise=true , address=104.36.82.61:4406 , piece_id=WQCH472JAJNEAGQGOF5LYU6RAUICVUOFXDTJC52NWFCEU43YTHEA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342935484 (20h10m40.932280471s) [noise=true , address=104.36.82.44:4881 , piece_id=JQKJCCUHCJSWLBDF5G5IEP2HAQJXH3FA6H7X4RNUH342SM6CNB5A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342953539 (20h10m40.932298526s) [noise=true , address=45.91.116.10:4092 , piece_id=FDHA5FCWTAFZ5N6AJA254W7QKGN3RGCGT7ZGWBIGLTI65DEIG4ZQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343204499 (20h10m40.932549486s) [noise=true , address=104.36.82.13:4202 , piece_id=GNTUDR6M4TV66KTCUMQKC33ESLZAQP4WK3PWS5CDQN5M6FE4ALQQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343223045 (20h10m40.932568032s) [noise=true , address=64.49.13.138:4481 , piece_id=HDNKCDGYH2LAFM2DRIW364W5XRSKF5XK7YZI47ATAAC5A6EBTOUQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343469105 (20h10m40.932814092s) [noise=true , address=64.49.13.140:4509 , piece_id=52T2SWYDXGGJ2IGMUAX5DJQZUFAQUHQTBW4NFC27RQQFLERI2EBQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343567834 (20h10m40.932912821s) [noise=true , address=104.36.82.23:4460 , piece_id=GKYZZOHC5J2FV2PWHI4IVTZV7FMVP2OFSJ2UOF24W5USG734RH7Q, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343687393 (20h10m40.93303237s) [noise=true , address=104.36.82.58:4273 , piece_id=WGPLZNLVUSYYJF7FJSBWAKRZ4LDAXSGBVWSTFRJ3KPBJIXOFSDGQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.344008046 (20h10m40.933353033s) [noise=true , address=104.36.82.43:4868 , piece_id=BM2WYHNTNNQAZHBSITN3ZIACMJLHLO6QACEZFCLYHODB4FYVYHNA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.345979839 (20h10m40.935324816s) [noise=true , address=104.36.82.20:4457 , piece_id=COVFTVTMO3DGUFVMZH633Q7RMZQRV7P2SRYOVJ2JZFP7RY5N7RHA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:42.438670912 (20h10m42.028015899s) [upload=20903]: Next returned nil segment Aug 8 05:50:42.438688716 (20h10m42.028033703s) [upload=20903]: Waiting for error group managing segments... Aug 8 05:50:42.778812377 (20h10m42.368157364s) [noise=true , address=193.149.164.143:4696 , piece_id=FNRXKJGRXG64FVEF7U6WLJT56RBHEONLJF5FM3K7ZRBCQVBL3VFQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.793688260 (20h10m42.383033237s) [noise=true , address=64.49.13.140:4509 , piece_id=52T2SWYDXGGJ2IGMUAX5DJQZUFAQUHQTBW4NFC27RQQFLERI2EBQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.814603478 (20h10m42.403948465s) [noise=true , address=64.49.13.155:4916 , piece_id=R4EDGKGU5O3XMIEDBT3P3YDZ6M5NDSW627JISIFRRYM3YFY7OJ7A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.846619684 (20h10m42.435964671s) [noise=true , address=64.49.13.138:4481 , piece_id=HDNKCDGYH2LAFM2DRIW364W5XRSKF5XK7YZI47ATAAC5A6EBTOUQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.248617890 (20h10m42.837962877s) [noise=true , address=104.36.82.47:4529 , piece_id=UESMFD5UVKCQ4F5XKAG6OMNTA4BS6QV2BME5E7DMIJP7XWHJHT6A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.252848605 (20h10m42.842193592s) [noise=true , address=104.36.82.39:4735 , piece_id=VYEESGWFD57OTLITJU27YFV3IKI34JW7GANQ2U34PV6WAGMPEFXQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.255650606 (20h10m42.844995593s) [noise=true , address=104.36.82.61:4406 , piece_id=WQCH472JAJNEAGQGOF5LYU6RAUICVUOFXDTJC52NWFCEU43YTHEA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.261140931 (20h10m42.850485918s) [noise=true , address=104.36.82.23:4460 , piece_id=GKYZZOHC5J2FV2PWHI4IVTZV7FMVP2OFSJ2UOF24W5USG734RH7Q, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.269129284 (20h10m42.858474261s) [noise=true , address=104.36.82.58:4273 , piece_id=WGPLZNLVUSYYJF7FJSBWAKRZ4LDAXSGBVWSTFRJ3KPBJIXOFSDGQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.274156393 (20h10m42.86350137s) [noise=true , address=104.36.82.43:4868 , piece_id=BM2WYHNTNNQAZHBSITN3ZIACMJLHLO6QACEZFCLYHODB4FYVYHNA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.313273526 (20h10m42.902618513s) [noise=true , address=45.91.116.10:4092 , piece_id=FDHA5FCWTAFZ5N6AJA254W7QKGN3RGCGT7ZGWBIGLTI65DEIG4ZQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.330724515 (20h10m42.920069502s) [noise=true , address=104.36.82.44:4881 , piece_id=JQKJCCUHCJSWLBDF5G5IEP2HAQJXH3FA6H7X4RNUH342SM6CNB5A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345245168 (20h10m42.934590155s) [noise=true , address=104.36.82.20:4457 , piece_id=COVFTVTMO3DGUFVMZH633Q7RMZQRV7P2SRYOVJ2JZFP7RY5N7RHA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345588405 (20h10m42.934933392s) [noise=true , address=104.36.82.60:4348 , piece_id=DSQCOTEIOHDKJSUZYR7RQGXLT6A3FQNPBHZ36UKT3G56PNEWBKZA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345621758 (20h10m42.934966745s) [seg_pos={0 0}, upload=20903]: Segment reached optimal threshold of 14 pieces. Aug 8 05:50:43.345774391 (20h10m42.935119378s) [noise=true , address=104.36.82.13:4202 , piece_id=GNTUDR6M4TV66KTCUMQKC33ESLZAQP4WK3PWS5CDQN5M6FE4ALQQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18wf5KnaR6WaR7MJivJkMJ7FejbuR6KnyvtRQgazNKfDb8fbsH): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345829917 (20h10m42.935174914s) [noise=true , address=104.36.82.36:4633 , piece_id=N6ZYWVZ7CODZ3SWA3T2KL6HWOPISACLE6YNECGDNL6S6NHP6TYZA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345878609 (20h10m42.935223607s) [noise=true , address=104.36.82.44:4873 , piece_id=OGMZZTN6R646OCIKFIN2ARH7HBXIYI4RG3RHOVEFGTGOS6EFLPFA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b5GdYtmYz9D1QW2z78W3Z2fWvMJGtrvrMJ1njbcqbtCDUdwHo): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345924307 (20h10m42.935269294s) [noise=true , address=104.36.82.37:4657 , piece_id=6G2JI22ZFKN72YYNJZ4Q3PK4ODRBF4QOK5OH3XNI245MOEV4INRA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345954214 (20h10m42.935299282s) [seg_pos={0 0}, upload=20903]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:50:43.346042142 (20h10m42.93538716s) [upload=20903]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:50:43.346050880 (20h10m42.935395897s) [upload=20903]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:50:43.643950132 (20h10m43.233295119s) [upload=20903]: Done uploading segments... Aug 8 05:50:43.643971202 (20h10m43.233316189s) [upload=20903]: Upload finished. err: <nil> Duration: 5.762497209s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [..XX...............X.X.......................X..............] duration: 5.625157305s FAIL (2025-08-08 06:02:31 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== ad finished. err: <nil> Aug 8 05:50:40.893567535 (20h10m40.482912522s) [upload=20903]: Starting upload Aug 8 05:50:40.893617581 (20h10m40.482962568s) [upload=20903]: Done starting upload Aug 8 05:50:40.893745836 (20h10m40.483090823s) [upload=20903]: Uploading segments... Aug 8 05:50:40.893860175 (20h10m40.483205162s) [upload=20903]: Got next segment. Inline: false Aug 8 05:50:40.893898729 (20h10m40.483243706s) [upload=20903]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:50:40.893904339 (20h10m40.483249326s) [upload=20903]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:50:41.341218008 (20h10m40.930562995s) [seg_pos={0 0}, upload=20903]: Begin upload segment... Aug 8 05:50:41.341265508 (20h10m40.930610495s) [seg_pos={0 0}, upload=20903]: Done begin upload segment. Aug 8 05:50:41.341287290 (20h10m40.930632267s) [noise=true , address=104.36.82.37:4657 , piece_id=6G2JI22ZFKN72YYNJZ4Q3PK4ODRBF4QOK5OH3XNI245MOEV4INRA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341358447 (20h10m40.930703434s) [noise=true , address=64.49.13.155:4916 , piece_id=R4EDGKGU5O3XMIEDBT3P3YDZ6M5NDSW627JISIFRRYM3YFY7OJ7A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341670363 (20h10m40.93101535s) [noise=true , address=104.36.82.44:4873 , piece_id=OGMZZTN6R646OCIKFIN2ARH7HBXIYI4RG3RHOVEFGTGOS6EFLPFA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341830500 (20h10m40.931175487s) [noise=true , address=193.149.164.143:4696 , piece_id=FNRXKJGRXG64FVEF7U6WLJT56RBHEONLJF5FM3K7ZRBCQVBL3VFQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341990977 (20h10m40.931335954s) [noise=true , address=104.36.82.39:4735 , piece_id=VYEESGWFD57OTLITJU27YFV3IKI34JW7GANQ2U34PV6WAGMPEFXQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342205478 (20h10m40.931550465s) [noise=true , address=104.36.82.60:4348 , piece_id=DSQCOTEIOHDKJSUZYR7RQGXLT6A3FQNPBHZ36UKT3G56PNEWBKZA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342313615 (20h10m40.931658602s) [noise=true , address=104.36.82.36:4633 , piece_id=N6ZYWVZ7CODZ3SWA3T2KL6HWOPISACLE6YNECGDNL6S6NHP6TYZA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342583129 (20h10m40.931928117s) [noise=true , address=104.36.82.47:4529 , piece_id=UESMFD5UVKCQ4F5XKAG6OMNTA4BS6QV2BME5E7DMIJP7XWHJHT6A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342596976 (20h10m40.931941953s) [noise=true , address=104.36.82.61:4406 , piece_id=WQCH472JAJNEAGQGOF5LYU6RAUICVUOFXDTJC52NWFCEU43YTHEA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342935484 (20h10m40.932280471s) [noise=true , address=104.36.82.44:4881 , piece_id=JQKJCCUHCJSWLBDF5G5IEP2HAQJXH3FA6H7X4RNUH342SM6CNB5A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342953539 (20h10m40.932298526s) [noise=true , address=45.91.116.10:4092 , piece_id=FDHA5FCWTAFZ5N6AJA254W7QKGN3RGCGT7ZGWBIGLTI65DEIG4ZQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343204499 (20h10m40.932549486s) [noise=true , address=104.36.82.13:4202 , piece_id=GNTUDR6M4TV66KTCUMQKC33ESLZAQP4WK3PWS5CDQN5M6FE4ALQQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343223045 (20h10m40.932568032s) [noise=true , address=64.49.13.138:4481 , piece_id=HDNKCDGYH2LAFM2DRIW364W5XRSKF5XK7YZI47ATAAC5A6EBTOUQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343469105 (20h10m40.932814092s) [noise=true , address=64.49.13.140:4509 , piece_id=52T2SWYDXGGJ2IGMUAX5DJQZUFAQUHQTBW4NFC27RQQFLERI2EBQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343567834 (20h10m40.932912821s) [noise=true , address=104.36.82.23:4460 , piece_id=GKYZZOHC5J2FV2PWHI4IVTZV7FMVP2OFSJ2UOF24W5USG734RH7Q, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343687393 (20h10m40.93303237s) [noise=true , address=104.36.82.58:4273 , piece_id=WGPLZNLVUSYYJF7FJSBWAKRZ4LDAXSGBVWSTFRJ3KPBJIXOFSDGQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.344008046 (20h10m40.933353033s) [noise=true , address=104.36.82.43:4868 , piece_id=BM2WYHNTNNQAZHBSITN3ZIACMJLHLO6QACEZFCLYHODB4FYVYHNA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.345979839 (20h10m40.935324816s) [noise=true , address=104.36.82.20:4457 , piece_id=COVFTVTMO3DGUFVMZH633Q7RMZQRV7P2SRYOVJ2JZFP7RY5N7RHA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:42.438670912 (20h10m42.028015899s) [upload=20903]: Next returned nil segment Aug 8 05:50:42.438688716 (20h10m42.028033703s) [upload=20903]: Waiting for error group managing segments... Aug 8 05:50:42.778812377 (20h10m42.368157364s) [noise=true , address=193.149.164.143:4696 , piece_id=FNRXKJGRXG64FVEF7U6WLJT56RBHEONLJF5FM3K7ZRBCQVBL3VFQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.793688260 (20h10m42.383033237s) [noise=true , address=64.49.13.140:4509 , piece_id=52T2SWYDXGGJ2IGMUAX5DJQZUFAQUHQTBW4NFC27RQQFLERI2EBQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.814603478 (20h10m42.403948465s) [noise=true , address=64.49.13.155:4916 , piece_id=R4EDGKGU5O3XMIEDBT3P3YDZ6M5NDSW627JISIFRRYM3YFY7OJ7A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.846619684 (20h10m42.435964671s) [noise=true , address=64.49.13.138:4481 , piece_id=HDNKCDGYH2LAFM2DRIW364W5XRSKF5XK7YZI47ATAAC5A6EBTOUQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.248617890 (20h10m42.837962877s) [noise=true , address=104.36.82.47:4529 , piece_id=UESMFD5UVKCQ4F5XKAG6OMNTA4BS6QV2BME5E7DMIJP7XWHJHT6A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.252848605 (20h10m42.842193592s) [noise=true , address=104.36.82.39:4735 , piece_id=VYEESGWFD57OTLITJU27YFV3IKI34JW7GANQ2U34PV6WAGMPEFXQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.255650606 (20h10m42.844995593s) [noise=true , address=104.36.82.61:4406 , piece_id=WQCH472JAJNEAGQGOF5LYU6RAUICVUOFXDTJC52NWFCEU43YTHEA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.261140931 (20h10m42.850485918s) [noise=true , address=104.36.82.23:4460 , piece_id=GKYZZOHC5J2FV2PWHI4IVTZV7FMVP2OFSJ2UOF24W5USG734RH7Q, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.269129284 (20h10m42.858474261s) [noise=true , address=104.36.82.58:4273 , piece_id=WGPLZNLVUSYYJF7FJSBWAKRZ4LDAXSGBVWSTFRJ3KPBJIXOFSDGQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.274156393 (20h10m42.86350137s) [noise=true , address=104.36.82.43:4868 , piece_id=BM2WYHNTNNQAZHBSITN3ZIACMJLHLO6QACEZFCLYHODB4FYVYHNA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.313273526 (20h10m42.902618513s) [noise=true , address=45.91.116.10:4092 , piece_id=FDHA5FCWTAFZ5N6AJA254W7QKGN3RGCGT7ZGWBIGLTI65DEIG4ZQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.330724515 (20h10m42.920069502s) [noise=true , address=104.36.82.44:4881 , piece_id=JQKJCCUHCJSWLBDF5G5IEP2HAQJXH3FA6H7X4RNUH342SM6CNB5A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345245168 (20h10m42.934590155s) [noise=true , address=104.36.82.20:4457 , piece_id=COVFTVTMO3DGUFVMZH633Q7RMZQRV7P2SRYOVJ2JZFP7RY5N7RHA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345588405 (20h10m42.934933392s) [noise=true , address=104.36.82.60:4348 , piece_id=DSQCOTEIOHDKJSUZYR7RQGXLT6A3FQNPBHZ36UKT3G56PNEWBKZA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345621758 (20h10m42.934966745s) [seg_pos={0 0}, upload=20903]: Segment reached optimal threshold of 14 pieces. Aug 8 05:50:43.345774391 (20h10m42.935119378s) [noise=true , address=104.36.82.13:4202 , piece_id=GNTUDR6M4TV66KTCUMQKC33ESLZAQP4WK3PWS5CDQN5M6FE4ALQQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18wf5KnaR6WaR7MJivJkMJ7FejbuR6KnyvtRQgazNKfDb8fbsH): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345829917 (20h10m42.935174914s) [noise=true , address=104.36.82.36:4633 , piece_id=N6ZYWVZ7CODZ3SWA3T2KL6HWOPISACLE6YNECGDNL6S6NHP6TYZA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345878609 (20h10m42.935223607s) [noise=true , address=104.36.82.44:4873 , piece_id=OGMZZTN6R646OCIKFIN2ARH7HBXIYI4RG3RHOVEFGTGOS6EFLPFA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b5GdYtmYz9D1QW2z78W3Z2fWvMJGtrvrMJ1njbcqbtCDUdwHo): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345924307 (20h10m42.935269294s) [noise=true , address=104.36.82.37:4657 , piece_id=6G2JI22ZFKN72YYNJZ4Q3PK4ODRBF4QOK5OH3XNI245MOEV4INRA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345954214 (20h10m42.935299282s) [seg_pos={0 0}, upload=20903]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:50:43.346042142 (20h10m42.93538716s) [upload=20903]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:50:43.346050880 (20h10m42.935395897s) [upload=20903]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:50:43.643950132 (20h10m43.233295119s) [upload=20903]: Done uploading segments... Aug 8 05:50:43.643971202 (20h10m43.233316189s) [upload=20903]: Upload finished. err: <nil> Duration: 5.6251811s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [........X...X..........X......X.............X............X..] duration: 1.905795577s FAIL (2025-08-08 06:02:27 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== 160951s) [upload=20968]: Done uploading segments... Aug 8 05:54:36.926841433 (20h14m36.51618642s) [upload=20968]: Upload finished. err: <nil> Aug 8 05:55:27.854993433 (20h15m27.44433842s) [upload=20984]: Starting upload Aug 8 05:55:27.855037267 (20h15m27.444382254s) [upload=20984]: Done starting upload Aug 8 05:55:27.855083446 (20h15m27.444428433s) [upload=20984]: Uploading segments... Aug 8 05:55:27.855122760 (20h15m27.444467737s) [upload=20984]: Got next segment. Inline: true Aug 8 05:55:27.855126417 (20h15m27.444471404s) [upload=20984]: Waiting for error group managing segments... Aug 8 05:55:27.855155914 (20h15m27.444500901s) [upload=20984]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:55:27.855159560 (20h15m27.444504547s) [upload=20984]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:55:27.855163459 (20h15m27.444508446s) [upload=20984]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:55:28.125690519 (20h15m27.715035507s) [upload=20984]: Done uploading segments... Aug 8 05:55:28.125709145 (20h15m27.715054132s) [upload=20984]: Upload finished. err: <nil> Aug 8 05:56:12.975108195 (20h16m12.564453192s) [upload=20997]: Starting upload Aug 8 05:56:12.975180884 (20h16m12.564525871s) [upload=20997]: Done starting upload Aug 8 05:56:12.975225229 (20h16m12.564570206s) [upload=20997]: Uploading segments... Aug 8 05:56:12.975287538 (20h16m12.564632525s) [upload=20997]: Got next segment. Inline: true Aug 8 05:56:12.975292537 (20h16m12.564637524s) [upload=20997]: Waiting for error group managing segments... Aug 8 05:56:12.975330330 (20h16m12.564675317s) [upload=20997]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:56:12.975334578 (20h16m12.564679565s) [upload=20997]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:56:12.975337123 (20h16m12.5646821s) [upload=20997]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:56:13.249013471 (20h16m12.838358478s) [upload=20997]: Done uploading segments... Aug 8 05:56:13.249036024 (20h16m12.838381011s) [upload=20997]: Upload finished. err: <nil> Aug 8 05:57:00.963085117 (20h17m0.552430125s) [upload=21012]: Starting upload Aug 8 05:57:00.963153639 (20h17m0.552498626s) [upload=21012]: Done starting upload Aug 8 05:57:00.963221999 (20h17m0.552566996s) [upload=21012]: Uploading segments... Aug 8 05:57:00.963261165 (20h17m0.552606152s) [upload=21012]: Got next segment. Inline: true Aug 8 05:57:00.963266154 (20h17m0.552611141s) [upload=21012]: Waiting for error group managing segments... Aug 8 05:57:00.963311341 (20h17m0.552656348s) [upload=21012]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:57:00.963316741 (20h17m0.552661738s) [upload=21012]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:57:00.963320128 (20h17m0.552665115s) [upload=21012]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:57:01.228868724 (20h17m0.818213711s) [upload=21012]: Done uploading segments... Aug 8 05:57:01.228887450 (20h17m0.818232437s) [upload=21012]: Upload finished. err: <nil> Aug 8 05:57:24.321170903 (20h17m23.91051589s) [upload=21016]: Starting upload Aug 8 05:57:24.321217862 (20h17m23.910562849s) [upload=21016]: Done starting upload Aug 8 05:57:24.321267848 (20h17m23.910612835s) [upload=21016]: Uploading segments... Aug 8 05:57:24.321295200 (20h17m23.910640187s) [upload=21016]: Got next segment. Inline: true Aug 8 05:57:24.321299188 (20h17m23.910644175s) [upload=21016]: Waiting for error group managing segments... Aug 8 05:57:24.321332873 (20h17m23.91067786s) [upload=21016]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:57:24.321337021 (20h17m23.910682008s) [upload=21016]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:57:24.321339625 (20h17m23.910684613s) [upload=21016]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:57:24.588125509 (20h17m24.177470496s) [upload=21016]: Done uploading segments... Aug 8 05:57:24.588141280 (20h17m24.177486267s) [upload=21016]: Upload finished. err: <nil> Aug 8 05:57:44.984884963 (20h17m44.57422994s) [upload=21023]: Starting upload Aug 8 05:57:44.984936812 (20h17m44.574281799s) [upload=21023]: Done starting upload Aug 8 05:57:44.984983341 (20h17m44.574328318s) [upload=21023]: Uploading segments... Aug 8 05:57:44.985012868 (20h17m44.574357855s) [upload=21023]: Got next segment. Inline: true Aug 8 05:57:44.985016384 (20h17m44.574361371s) [upload=21023]: Waiting for error group managing segments... Aug 8 05:57:44.985049217 (20h17m44.574394204s) [upload=21023]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:57:44.985053685 (20h17m44.574398672s) [upload=21023]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:57:44.985056100 (20h17m44.574401087s) [upload=21023]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:57:45.266330504 (20h17m44.855675502s) [upload=21023]: Done uploading segments... Aug 8 05:57:45.266352646 (20h17m44.855697673s) [upload=21023]: Upload finished. err: <nil> Aug 8 05:58:38.485929103 (20h18m38.07527409s) [upload=21038]: Starting upload Aug 8 05:58:38.485976022 (20h18m38.075321009s) [upload=21038]: Done starting upload Aug 8 05:58:38.486076905 (20h18m38.075421892s) [upload=21038]: Uploading segments... Aug 8 05:58:38.486169102 (20h18m38.07551409s) [upload=21038]: Got next segment. Inline: true Aug 8 05:58:38.486175585 (20h18m38.075520572s) [upload=21038]: Waiting for error group managing segments... Aug 8 05:58:38.486240599 (20h18m38.075585586s) [upload=21038]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:58:38.486248534 (20h18m38.075593521s) [upload=21038]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:58:38.486253514 (20h18m38.075598521s) [upload=21038]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:58:38.744419005 (20h18m38.333763992s) [upload=21038]: Done uploading segments... Aug 8 05:58:38.744438663 (20h18m38.33378365s) [upload=21038]: Upload finished. err: <nil> Aug 8 05:59:50.694095379 (20h19m50.283440366s) [upload=21061]: Starting upload Aug 8 05:59:50.694206050 (20h19m50.283551037s) [upload=21061]: Done starting upload Aug 8 05:59:50.694302564 (20h19m50.283647552s) [upload=21061]: Uploading segments... Aug 8 05:59:50.694344205 (20h19m50.283689192s) [upload=21061]: Got next segment. Inline: true Aug 8 05:59:50.694348683 (20h19m50.28369367s) [upload=21061]: Waiting for error group managing segments... Aug 8 05:59:50.694393579 (20h19m50.283738566s) [upload=21061]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:59:50.694398278 (20h19m50.283743265s) [upload=21061]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:59:50.694400452 (20h19m50.283745439s) [upload=21061]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:59:50.960603812 (20h19m50.549948799s) [upload=21061]: Done uploading segments... Aug 8 05:59:50.960623008 (20h19m50.549967996s) [upload=21061]: Upload finished. err: <nil> Aug 8 06:00:05.820178578 (20h20m5.409523575s) [upload=21064]: Starting upload Aug 8 06:00:05.820224024 (20h20m5.409569011s) [upload=21064]: Done starting upload Aug 8 06:00:05.820280151 (20h20m5.409625148s) [upload=21064]: Uploading segments... Aug 8 06:00:05.820313224 (20h20m5.409658211s) [upload=21064]: Got next segment. Inline: true Aug 8 06:00:05.820317283 (20h20m5.40966227s) [upload=21064]: Waiting for error group managing segments... Aug 8 06:00:05.820356718 (20h20m5.409701705s) [upload=21064]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:00:05.820361287 (20h20m5.409706284s) [upload=21064]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:00:05.820363932 (20h20m5.409708919s) [upload=21064]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:00:06.105183529 (20h20m5.694528516s) [upload=21064]: Done uploading segments... Aug 8 06:00:06.105206524 (20h20m5.694551511s) [upload=21064]: Upload finished. err: <nil> Aug 8 06:00:39.721535110 (20h20m39.310880097s) [upload=21078]: Starting upload Aug 8 06:00:39.721598201 (20h20m39.310943188s) [upload=21078]: Done starting upload Aug 8 06:00:39.721649058 (20h20m39.310994045s) [upload=21078]: Uploading segments... Aug 8 06:00:39.721702660 (20h20m39.311047647s) [upload=21078]: Got next segment. Inline: true Aug 8 06:00:39.721706318 (20h20m39.311051305s) [upload=21078]: Waiting for error group managing segments... Aug 8 06:00:39.721750833 (20h20m39.31109582s) [upload=21078]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:00:39.721755371 (20h20m39.311100358s) [upload=21078]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:00:39.721757786 (20h20m39.311102773s) [upload=21078]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:00:39.985732442 (20h20m39.575077429s) [upload=21078]: Done uploading segments... Aug 8 06:00:39.985751518 (20h20m39.575096505s) [upload=21078]: Upload finished. err: <nil> Aug 8 06:01:01.755195514 (20h21m1.344540511s) [upload=21083]: Starting upload Aug 8 06:01:01.755269686 (20h21m1.344614683s) [upload=21083]: Done starting upload Aug 8 06:01:01.755363906 (20h21m1.344708893s) [upload=21083]: Uploading segments... Aug 8 06:01:01.755543540 (20h21m1.344888537s) [upload=21083]: Got next segment. Inline: true Aug 8 06:01:01.755549311 (20h21m1.344894308s) [upload=21083]: Waiting for error group managing segments... Aug 8 06:01:01.755615418 (20h21m1.344960415s) [upload=21083]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:01:01.755620938 (20h21m1.344965925s) [upload=21083]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:01:01.755623503 (20h21m1.34496849s) [upload=21083]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:01:02.090931160 (20h21m1.680276157s) [upload=21083]: Done uploading segments... Aug 8 06:01:02.090955637 (20h21m1.680300624s) [upload=21083]: Upload finished. err: <nil> Duration: 1.905827959s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 6.368580444s FAIL (2025-08-08 06:02:00 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.368603488s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [...XX...............X.X.......................X.............] duration: 5.752259613s FAIL (2025-08-08 06:01:39 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== ad finished. err: <nil> Aug 8 05:50:40.893567535 (20h10m40.482912522s) [upload=20903]: Starting upload Aug 8 05:50:40.893617581 (20h10m40.482962568s) [upload=20903]: Done starting upload Aug 8 05:50:40.893745836 (20h10m40.483090823s) [upload=20903]: Uploading segments... Aug 8 05:50:40.893860175 (20h10m40.483205162s) [upload=20903]: Got next segment. Inline: false Aug 8 05:50:40.893898729 (20h10m40.483243706s) [upload=20903]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:50:40.893904339 (20h10m40.483249326s) [upload=20903]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:50:41.341218008 (20h10m40.930562995s) [seg_pos={0 0}, upload=20903]: Begin upload segment... Aug 8 05:50:41.341265508 (20h10m40.930610495s) [seg_pos={0 0}, upload=20903]: Done begin upload segment. Aug 8 05:50:41.341287290 (20h10m40.930632267s) [noise=true , address=104.36.82.37:4657 , piece_id=6G2JI22ZFKN72YYNJZ4Q3PK4ODRBF4QOK5OH3XNI245MOEV4INRA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341358447 (20h10m40.930703434s) [noise=true , address=64.49.13.155:4916 , piece_id=R4EDGKGU5O3XMIEDBT3P3YDZ6M5NDSW627JISIFRRYM3YFY7OJ7A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341670363 (20h10m40.93101535s) [noise=true , address=104.36.82.44:4873 , piece_id=OGMZZTN6R646OCIKFIN2ARH7HBXIYI4RG3RHOVEFGTGOS6EFLPFA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341830500 (20h10m40.931175487s) [noise=true , address=193.149.164.143:4696 , piece_id=FNRXKJGRXG64FVEF7U6WLJT56RBHEONLJF5FM3K7ZRBCQVBL3VFQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341990977 (20h10m40.931335954s) [noise=true , address=104.36.82.39:4735 , piece_id=VYEESGWFD57OTLITJU27YFV3IKI34JW7GANQ2U34PV6WAGMPEFXQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342205478 (20h10m40.931550465s) [noise=true , address=104.36.82.60:4348 , piece_id=DSQCOTEIOHDKJSUZYR7RQGXLT6A3FQNPBHZ36UKT3G56PNEWBKZA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342313615 (20h10m40.931658602s) [noise=true , address=104.36.82.36:4633 , piece_id=N6ZYWVZ7CODZ3SWA3T2KL6HWOPISACLE6YNECGDNL6S6NHP6TYZA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342583129 (20h10m40.931928117s) [noise=true , address=104.36.82.47:4529 , piece_id=UESMFD5UVKCQ4F5XKAG6OMNTA4BS6QV2BME5E7DMIJP7XWHJHT6A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342596976 (20h10m40.931941953s) [noise=true , address=104.36.82.61:4406 , piece_id=WQCH472JAJNEAGQGOF5LYU6RAUICVUOFXDTJC52NWFCEU43YTHEA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342935484 (20h10m40.932280471s) [noise=true , address=104.36.82.44:4881 , piece_id=JQKJCCUHCJSWLBDF5G5IEP2HAQJXH3FA6H7X4RNUH342SM6CNB5A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342953539 (20h10m40.932298526s) [noise=true , address=45.91.116.10:4092 , piece_id=FDHA5FCWTAFZ5N6AJA254W7QKGN3RGCGT7ZGWBIGLTI65DEIG4ZQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343204499 (20h10m40.932549486s) [noise=true , address=104.36.82.13:4202 , piece_id=GNTUDR6M4TV66KTCUMQKC33ESLZAQP4WK3PWS5CDQN5M6FE4ALQQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343223045 (20h10m40.932568032s) [noise=true , address=64.49.13.138:4481 , piece_id=HDNKCDGYH2LAFM2DRIW364W5XRSKF5XK7YZI47ATAAC5A6EBTOUQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343469105 (20h10m40.932814092s) [noise=true , address=64.49.13.140:4509 , piece_id=52T2SWYDXGGJ2IGMUAX5DJQZUFAQUHQTBW4NFC27RQQFLERI2EBQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343567834 (20h10m40.932912821s) [noise=true , address=104.36.82.23:4460 , piece_id=GKYZZOHC5J2FV2PWHI4IVTZV7FMVP2OFSJ2UOF24W5USG734RH7Q, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343687393 (20h10m40.93303237s) [noise=true , address=104.36.82.58:4273 , piece_id=WGPLZNLVUSYYJF7FJSBWAKRZ4LDAXSGBVWSTFRJ3KPBJIXOFSDGQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.344008046 (20h10m40.933353033s) [noise=true , address=104.36.82.43:4868 , piece_id=BM2WYHNTNNQAZHBSITN3ZIACMJLHLO6QACEZFCLYHODB4FYVYHNA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.345979839 (20h10m40.935324816s) [noise=true , address=104.36.82.20:4457 , piece_id=COVFTVTMO3DGUFVMZH633Q7RMZQRV7P2SRYOVJ2JZFP7RY5N7RHA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:42.438670912 (20h10m42.028015899s) [upload=20903]: Next returned nil segment Aug 8 05:50:42.438688716 (20h10m42.028033703s) [upload=20903]: Waiting for error group managing segments... Aug 8 05:50:42.778812377 (20h10m42.368157364s) [noise=true , address=193.149.164.143:4696 , piece_id=FNRXKJGRXG64FVEF7U6WLJT56RBHEONLJF5FM3K7ZRBCQVBL3VFQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.793688260 (20h10m42.383033237s) [noise=true , address=64.49.13.140:4509 , piece_id=52T2SWYDXGGJ2IGMUAX5DJQZUFAQUHQTBW4NFC27RQQFLERI2EBQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.814603478 (20h10m42.403948465s) [noise=true , address=64.49.13.155:4916 , piece_id=R4EDGKGU5O3XMIEDBT3P3YDZ6M5NDSW627JISIFRRYM3YFY7OJ7A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.846619684 (20h10m42.435964671s) [noise=true , address=64.49.13.138:4481 , piece_id=HDNKCDGYH2LAFM2DRIW364W5XRSKF5XK7YZI47ATAAC5A6EBTOUQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.248617890 (20h10m42.837962877s) [noise=true , address=104.36.82.47:4529 , piece_id=UESMFD5UVKCQ4F5XKAG6OMNTA4BS6QV2BME5E7DMIJP7XWHJHT6A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.252848605 (20h10m42.842193592s) [noise=true , address=104.36.82.39:4735 , piece_id=VYEESGWFD57OTLITJU27YFV3IKI34JW7GANQ2U34PV6WAGMPEFXQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.255650606 (20h10m42.844995593s) [noise=true , address=104.36.82.61:4406 , piece_id=WQCH472JAJNEAGQGOF5LYU6RAUICVUOFXDTJC52NWFCEU43YTHEA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.261140931 (20h10m42.850485918s) [noise=true , address=104.36.82.23:4460 , piece_id=GKYZZOHC5J2FV2PWHI4IVTZV7FMVP2OFSJ2UOF24W5USG734RH7Q, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.269129284 (20h10m42.858474261s) [noise=true , address=104.36.82.58:4273 , piece_id=WGPLZNLVUSYYJF7FJSBWAKRZ4LDAXSGBVWSTFRJ3KPBJIXOFSDGQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.274156393 (20h10m42.86350137s) [noise=true , address=104.36.82.43:4868 , piece_id=BM2WYHNTNNQAZHBSITN3ZIACMJLHLO6QACEZFCLYHODB4FYVYHNA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.313273526 (20h10m42.902618513s) [noise=true , address=45.91.116.10:4092 , piece_id=FDHA5FCWTAFZ5N6AJA254W7QKGN3RGCGT7ZGWBIGLTI65DEIG4ZQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.330724515 (20h10m42.920069502s) [noise=true , address=104.36.82.44:4881 , piece_id=JQKJCCUHCJSWLBDF5G5IEP2HAQJXH3FA6H7X4RNUH342SM6CNB5A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345245168 (20h10m42.934590155s) [noise=true , address=104.36.82.20:4457 , piece_id=COVFTVTMO3DGUFVMZH633Q7RMZQRV7P2SRYOVJ2JZFP7RY5N7RHA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345588405 (20h10m42.934933392s) [noise=true , address=104.36.82.60:4348 , piece_id=DSQCOTEIOHDKJSUZYR7RQGXLT6A3FQNPBHZ36UKT3G56PNEWBKZA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345621758 (20h10m42.934966745s) [seg_pos={0 0}, upload=20903]: Segment reached optimal threshold of 14 pieces. Aug 8 05:50:43.345774391 (20h10m42.935119378s) [noise=true , address=104.36.82.13:4202 , piece_id=GNTUDR6M4TV66KTCUMQKC33ESLZAQP4WK3PWS5CDQN5M6FE4ALQQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18wf5KnaR6WaR7MJivJkMJ7FejbuR6KnyvtRQgazNKfDb8fbsH): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345829917 (20h10m42.935174914s) [noise=true , address=104.36.82.36:4633 , piece_id=N6ZYWVZ7CODZ3SWA3T2KL6HWOPISACLE6YNECGDNL6S6NHP6TYZA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345878609 (20h10m42.935223607s) [noise=true , address=104.36.82.44:4873 , piece_id=OGMZZTN6R646OCIKFIN2ARH7HBXIYI4RG3RHOVEFGTGOS6EFLPFA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b5GdYtmYz9D1QW2z78W3Z2fWvMJGtrvrMJ1njbcqbtCDUdwHo): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345924307 (20h10m42.935269294s) [noise=true , address=104.36.82.37:4657 , piece_id=6G2JI22ZFKN72YYNJZ4Q3PK4ODRBF4QOK5OH3XNI245MOEV4INRA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345954214 (20h10m42.935299282s) [seg_pos={0 0}, upload=20903]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:50:43.346042142 (20h10m42.93538716s) [upload=20903]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:50:43.346050880 (20h10m42.935395897s) [upload=20903]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:50:43.643950132 (20h10m43.233295119s) [upload=20903]: Done uploading segments... Aug 8 05:50:43.643971202 (20h10m43.233316189s) [upload=20903]: Upload finished. err: <nil> Duration: 5.752285643s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [.........X...X..........X......X.............X............X.] duration: 1.805475134s FAIL (2025-08-08 06:01:39 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== 160951s) [upload=20968]: Done uploading segments... Aug 8 05:54:36.926841433 (20h14m36.51618642s) [upload=20968]: Upload finished. err: <nil> Aug 8 05:55:27.854993433 (20h15m27.44433842s) [upload=20984]: Starting upload Aug 8 05:55:27.855037267 (20h15m27.444382254s) [upload=20984]: Done starting upload Aug 8 05:55:27.855083446 (20h15m27.444428433s) [upload=20984]: Uploading segments... Aug 8 05:55:27.855122760 (20h15m27.444467737s) [upload=20984]: Got next segment. Inline: true Aug 8 05:55:27.855126417 (20h15m27.444471404s) [upload=20984]: Waiting for error group managing segments... Aug 8 05:55:27.855155914 (20h15m27.444500901s) [upload=20984]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:55:27.855159560 (20h15m27.444504547s) [upload=20984]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:55:27.855163459 (20h15m27.444508446s) [upload=20984]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:55:28.125690519 (20h15m27.715035507s) [upload=20984]: Done uploading segments... Aug 8 05:55:28.125709145 (20h15m27.715054132s) [upload=20984]: Upload finished. err: <nil> Aug 8 05:56:12.975108195 (20h16m12.564453192s) [upload=20997]: Starting upload Aug 8 05:56:12.975180884 (20h16m12.564525871s) [upload=20997]: Done starting upload Aug 8 05:56:12.975225229 (20h16m12.564570206s) [upload=20997]: Uploading segments... Aug 8 05:56:12.975287538 (20h16m12.564632525s) [upload=20997]: Got next segment. Inline: true Aug 8 05:56:12.975292537 (20h16m12.564637524s) [upload=20997]: Waiting for error group managing segments... Aug 8 05:56:12.975330330 (20h16m12.564675317s) [upload=20997]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:56:12.975334578 (20h16m12.564679565s) [upload=20997]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:56:12.975337123 (20h16m12.5646821s) [upload=20997]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:56:13.249013471 (20h16m12.838358478s) [upload=20997]: Done uploading segments... Aug 8 05:56:13.249036024 (20h16m12.838381011s) [upload=20997]: Upload finished. err: <nil> Aug 8 05:57:00.963085117 (20h17m0.552430125s) [upload=21012]: Starting upload Aug 8 05:57:00.963153639 (20h17m0.552498626s) [upload=21012]: Done starting upload Aug 8 05:57:00.963221999 (20h17m0.552566996s) [upload=21012]: Uploading segments... Aug 8 05:57:00.963261165 (20h17m0.552606152s) [upload=21012]: Got next segment. Inline: true Aug 8 05:57:00.963266154 (20h17m0.552611141s) [upload=21012]: Waiting for error group managing segments... Aug 8 05:57:00.963311341 (20h17m0.552656348s) [upload=21012]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:57:00.963316741 (20h17m0.552661738s) [upload=21012]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:57:00.963320128 (20h17m0.552665115s) [upload=21012]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:57:01.228868724 (20h17m0.818213711s) [upload=21012]: Done uploading segments... Aug 8 05:57:01.228887450 (20h17m0.818232437s) [upload=21012]: Upload finished. err: <nil> Aug 8 05:57:24.321170903 (20h17m23.91051589s) [upload=21016]: Starting upload Aug 8 05:57:24.321217862 (20h17m23.910562849s) [upload=21016]: Done starting upload Aug 8 05:57:24.321267848 (20h17m23.910612835s) [upload=21016]: Uploading segments... Aug 8 05:57:24.321295200 (20h17m23.910640187s) [upload=21016]: Got next segment. Inline: true Aug 8 05:57:24.321299188 (20h17m23.910644175s) [upload=21016]: Waiting for error group managing segments... Aug 8 05:57:24.321332873 (20h17m23.91067786s) [upload=21016]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:57:24.321337021 (20h17m23.910682008s) [upload=21016]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:57:24.321339625 (20h17m23.910684613s) [upload=21016]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:57:24.588125509 (20h17m24.177470496s) [upload=21016]: Done uploading segments... Aug 8 05:57:24.588141280 (20h17m24.177486267s) [upload=21016]: Upload finished. err: <nil> Aug 8 05:57:44.984884963 (20h17m44.57422994s) [upload=21023]: Starting upload Aug 8 05:57:44.984936812 (20h17m44.574281799s) [upload=21023]: Done starting upload Aug 8 05:57:44.984983341 (20h17m44.574328318s) [upload=21023]: Uploading segments... Aug 8 05:57:44.985012868 (20h17m44.574357855s) [upload=21023]: Got next segment. Inline: true Aug 8 05:57:44.985016384 (20h17m44.574361371s) [upload=21023]: Waiting for error group managing segments... Aug 8 05:57:44.985049217 (20h17m44.574394204s) [upload=21023]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:57:44.985053685 (20h17m44.574398672s) [upload=21023]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:57:44.985056100 (20h17m44.574401087s) [upload=21023]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:57:45.266330504 (20h17m44.855675502s) [upload=21023]: Done uploading segments... Aug 8 05:57:45.266352646 (20h17m44.855697673s) [upload=21023]: Upload finished. err: <nil> Aug 8 05:58:38.485929103 (20h18m38.07527409s) [upload=21038]: Starting upload Aug 8 05:58:38.485976022 (20h18m38.075321009s) [upload=21038]: Done starting upload Aug 8 05:58:38.486076905 (20h18m38.075421892s) [upload=21038]: Uploading segments... Aug 8 05:58:38.486169102 (20h18m38.07551409s) [upload=21038]: Got next segment. Inline: true Aug 8 05:58:38.486175585 (20h18m38.075520572s) [upload=21038]: Waiting for error group managing segments... Aug 8 05:58:38.486240599 (20h18m38.075585586s) [upload=21038]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:58:38.486248534 (20h18m38.075593521s) [upload=21038]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:58:38.486253514 (20h18m38.075598521s) [upload=21038]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:58:38.744419005 (20h18m38.333763992s) [upload=21038]: Done uploading segments... Aug 8 05:58:38.744438663 (20h18m38.33378365s) [upload=21038]: Upload finished. err: <nil> Aug 8 05:59:50.694095379 (20h19m50.283440366s) [upload=21061]: Starting upload Aug 8 05:59:50.694206050 (20h19m50.283551037s) [upload=21061]: Done starting upload Aug 8 05:59:50.694302564 (20h19m50.283647552s) [upload=21061]: Uploading segments... Aug 8 05:59:50.694344205 (20h19m50.283689192s) [upload=21061]: Got next segment. Inline: true Aug 8 05:59:50.694348683 (20h19m50.28369367s) [upload=21061]: Waiting for error group managing segments... Aug 8 05:59:50.694393579 (20h19m50.283738566s) [upload=21061]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:59:50.694398278 (20h19m50.283743265s) [upload=21061]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:59:50.694400452 (20h19m50.283745439s) [upload=21061]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:59:50.960603812 (20h19m50.549948799s) [upload=21061]: Done uploading segments... Aug 8 05:59:50.960623008 (20h19m50.549967996s) [upload=21061]: Upload finished. err: <nil> Aug 8 06:00:05.820178578 (20h20m5.409523575s) [upload=21064]: Starting upload Aug 8 06:00:05.820224024 (20h20m5.409569011s) [upload=21064]: Done starting upload Aug 8 06:00:05.820280151 (20h20m5.409625148s) [upload=21064]: Uploading segments... Aug 8 06:00:05.820313224 (20h20m5.409658211s) [upload=21064]: Got next segment. Inline: true Aug 8 06:00:05.820317283 (20h20m5.40966227s) [upload=21064]: Waiting for error group managing segments... Aug 8 06:00:05.820356718 (20h20m5.409701705s) [upload=21064]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:00:05.820361287 (20h20m5.409706284s) [upload=21064]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:00:05.820363932 (20h20m5.409708919s) [upload=21064]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:00:06.105183529 (20h20m5.694528516s) [upload=21064]: Done uploading segments... Aug 8 06:00:06.105206524 (20h20m5.694551511s) [upload=21064]: Upload finished. err: <nil> Aug 8 06:00:39.721535110 (20h20m39.310880097s) [upload=21078]: Starting upload Aug 8 06:00:39.721598201 (20h20m39.310943188s) [upload=21078]: Done starting upload Aug 8 06:00:39.721649058 (20h20m39.310994045s) [upload=21078]: Uploading segments... Aug 8 06:00:39.721702660 (20h20m39.311047647s) [upload=21078]: Got next segment. Inline: true Aug 8 06:00:39.721706318 (20h20m39.311051305s) [upload=21078]: Waiting for error group managing segments... Aug 8 06:00:39.721750833 (20h20m39.31109582s) [upload=21078]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:00:39.721755371 (20h20m39.311100358s) [upload=21078]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:00:39.721757786 (20h20m39.311102773s) [upload=21078]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:00:39.985732442 (20h20m39.575077429s) [upload=21078]: Done uploading segments... Aug 8 06:00:39.985751518 (20h20m39.575096505s) [upload=21078]: Upload finished. err: <nil> Aug 8 06:01:01.755195514 (20h21m1.344540511s) [upload=21083]: Starting upload Aug 8 06:01:01.755269686 (20h21m1.344614683s) [upload=21083]: Done starting upload Aug 8 06:01:01.755363906 (20h21m1.344708893s) [upload=21083]: Uploading segments... Aug 8 06:01:01.755543540 (20h21m1.344888537s) [upload=21083]: Got next segment. Inline: true Aug 8 06:01:01.755549311 (20h21m1.344894308s) [upload=21083]: Waiting for error group managing segments... Aug 8 06:01:01.755615418 (20h21m1.344960415s) [upload=21083]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:01:01.755620938 (20h21m1.344965925s) [upload=21083]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:01:01.755623503 (20h21m1.34496849s) [upload=21083]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:01:02.090931160 (20h21m1.680276157s) [upload=21083]: Done uploading segments... Aug 8 06:01:02.090955637 (20h21m1.680300624s) [upload=21083]: Upload finished. err: <nil> Duration: 1.805504981s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [..........X...X..........X......X.............X............X] duration: 1.69990837s FAIL (2025-08-08 06:01:02 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== 160951s) [upload=20968]: Done uploading segments... Aug 8 05:54:36.926841433 (20h14m36.51618642s) [upload=20968]: Upload finished. err: <nil> Aug 8 05:55:27.854993433 (20h15m27.44433842s) [upload=20984]: Starting upload Aug 8 05:55:27.855037267 (20h15m27.444382254s) [upload=20984]: Done starting upload Aug 8 05:55:27.855083446 (20h15m27.444428433s) [upload=20984]: Uploading segments... Aug 8 05:55:27.855122760 (20h15m27.444467737s) [upload=20984]: Got next segment. Inline: true Aug 8 05:55:27.855126417 (20h15m27.444471404s) [upload=20984]: Waiting for error group managing segments... Aug 8 05:55:27.855155914 (20h15m27.444500901s) [upload=20984]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:55:27.855159560 (20h15m27.444504547s) [upload=20984]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:55:27.855163459 (20h15m27.444508446s) [upload=20984]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:55:28.125690519 (20h15m27.715035507s) [upload=20984]: Done uploading segments... Aug 8 05:55:28.125709145 (20h15m27.715054132s) [upload=20984]: Upload finished. err: <nil> Aug 8 05:56:12.975108195 (20h16m12.564453192s) [upload=20997]: Starting upload Aug 8 05:56:12.975180884 (20h16m12.564525871s) [upload=20997]: Done starting upload Aug 8 05:56:12.975225229 (20h16m12.564570206s) [upload=20997]: Uploading segments... Aug 8 05:56:12.975287538 (20h16m12.564632525s) [upload=20997]: Got next segment. Inline: true Aug 8 05:56:12.975292537 (20h16m12.564637524s) [upload=20997]: Waiting for error group managing segments... Aug 8 05:56:12.975330330 (20h16m12.564675317s) [upload=20997]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:56:12.975334578 (20h16m12.564679565s) [upload=20997]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:56:12.975337123 (20h16m12.5646821s) [upload=20997]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:56:13.249013471 (20h16m12.838358478s) [upload=20997]: Done uploading segments... Aug 8 05:56:13.249036024 (20h16m12.838381011s) [upload=20997]: Upload finished. err: <nil> Aug 8 05:57:00.963085117 (20h17m0.552430125s) [upload=21012]: Starting upload Aug 8 05:57:00.963153639 (20h17m0.552498626s) [upload=21012]: Done starting upload Aug 8 05:57:00.963221999 (20h17m0.552566996s) [upload=21012]: Uploading segments... Aug 8 05:57:00.963261165 (20h17m0.552606152s) [upload=21012]: Got next segment. Inline: true Aug 8 05:57:00.963266154 (20h17m0.552611141s) [upload=21012]: Waiting for error group managing segments... Aug 8 05:57:00.963311341 (20h17m0.552656348s) [upload=21012]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:57:00.963316741 (20h17m0.552661738s) [upload=21012]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:57:00.963320128 (20h17m0.552665115s) [upload=21012]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:57:01.228868724 (20h17m0.818213711s) [upload=21012]: Done uploading segments... Aug 8 05:57:01.228887450 (20h17m0.818232437s) [upload=21012]: Upload finished. err: <nil> Aug 8 05:57:24.321170903 (20h17m23.91051589s) [upload=21016]: Starting upload Aug 8 05:57:24.321217862 (20h17m23.910562849s) [upload=21016]: Done starting upload Aug 8 05:57:24.321267848 (20h17m23.910612835s) [upload=21016]: Uploading segments... Aug 8 05:57:24.321295200 (20h17m23.910640187s) [upload=21016]: Got next segment. Inline: true Aug 8 05:57:24.321299188 (20h17m23.910644175s) [upload=21016]: Waiting for error group managing segments... Aug 8 05:57:24.321332873 (20h17m23.91067786s) [upload=21016]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:57:24.321337021 (20h17m23.910682008s) [upload=21016]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:57:24.321339625 (20h17m23.910684613s) [upload=21016]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:57:24.588125509 (20h17m24.177470496s) [upload=21016]: Done uploading segments... Aug 8 05:57:24.588141280 (20h17m24.177486267s) [upload=21016]: Upload finished. err: <nil> Aug 8 05:57:44.984884963 (20h17m44.57422994s) [upload=21023]: Starting upload Aug 8 05:57:44.984936812 (20h17m44.574281799s) [upload=21023]: Done starting upload Aug 8 05:57:44.984983341 (20h17m44.574328318s) [upload=21023]: Uploading segments... Aug 8 05:57:44.985012868 (20h17m44.574357855s) [upload=21023]: Got next segment. Inline: true Aug 8 05:57:44.985016384 (20h17m44.574361371s) [upload=21023]: Waiting for error group managing segments... Aug 8 05:57:44.985049217 (20h17m44.574394204s) [upload=21023]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:57:44.985053685 (20h17m44.574398672s) [upload=21023]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:57:44.985056100 (20h17m44.574401087s) [upload=21023]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:57:45.266330504 (20h17m44.855675502s) [upload=21023]: Done uploading segments... Aug 8 05:57:45.266352646 (20h17m44.855697673s) [upload=21023]: Upload finished. err: <nil> Aug 8 05:58:38.485929103 (20h18m38.07527409s) [upload=21038]: Starting upload Aug 8 05:58:38.485976022 (20h18m38.075321009s) [upload=21038]: Done starting upload Aug 8 05:58:38.486076905 (20h18m38.075421892s) [upload=21038]: Uploading segments... Aug 8 05:58:38.486169102 (20h18m38.07551409s) [upload=21038]: Got next segment. Inline: true Aug 8 05:58:38.486175585 (20h18m38.075520572s) [upload=21038]: Waiting for error group managing segments... Aug 8 05:58:38.486240599 (20h18m38.075585586s) [upload=21038]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:58:38.486248534 (20h18m38.075593521s) [upload=21038]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:58:38.486253514 (20h18m38.075598521s) [upload=21038]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:58:38.744419005 (20h18m38.333763992s) [upload=21038]: Done uploading segments... Aug 8 05:58:38.744438663 (20h18m38.33378365s) [upload=21038]: Upload finished. err: <nil> Aug 8 05:59:50.694095379 (20h19m50.283440366s) [upload=21061]: Starting upload Aug 8 05:59:50.694206050 (20h19m50.283551037s) [upload=21061]: Done starting upload Aug 8 05:59:50.694302564 (20h19m50.283647552s) [upload=21061]: Uploading segments... Aug 8 05:59:50.694344205 (20h19m50.283689192s) [upload=21061]: Got next segment. Inline: true Aug 8 05:59:50.694348683 (20h19m50.28369367s) [upload=21061]: Waiting for error group managing segments... Aug 8 05:59:50.694393579 (20h19m50.283738566s) [upload=21061]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:59:50.694398278 (20h19m50.283743265s) [upload=21061]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:59:50.694400452 (20h19m50.283745439s) [upload=21061]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:59:50.960603812 (20h19m50.549948799s) [upload=21061]: Done uploading segments... Aug 8 05:59:50.960623008 (20h19m50.549967996s) [upload=21061]: Upload finished. err: <nil> Aug 8 06:00:05.820178578 (20h20m5.409523575s) [upload=21064]: Starting upload Aug 8 06:00:05.820224024 (20h20m5.409569011s) [upload=21064]: Done starting upload Aug 8 06:00:05.820280151 (20h20m5.409625148s) [upload=21064]: Uploading segments... Aug 8 06:00:05.820313224 (20h20m5.409658211s) [upload=21064]: Got next segment. Inline: true Aug 8 06:00:05.820317283 (20h20m5.40966227s) [upload=21064]: Waiting for error group managing segments... Aug 8 06:00:05.820356718 (20h20m5.409701705s) [upload=21064]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:00:05.820361287 (20h20m5.409706284s) [upload=21064]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:00:05.820363932 (20h20m5.409708919s) [upload=21064]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:00:06.105183529 (20h20m5.694528516s) [upload=21064]: Done uploading segments... Aug 8 06:00:06.105206524 (20h20m5.694551511s) [upload=21064]: Upload finished. err: <nil> Aug 8 06:00:39.721535110 (20h20m39.310880097s) [upload=21078]: Starting upload Aug 8 06:00:39.721598201 (20h20m39.310943188s) [upload=21078]: Done starting upload Aug 8 06:00:39.721649058 (20h20m39.310994045s) [upload=21078]: Uploading segments... Aug 8 06:00:39.721702660 (20h20m39.311047647s) [upload=21078]: Got next segment. Inline: true Aug 8 06:00:39.721706318 (20h20m39.311051305s) [upload=21078]: Waiting for error group managing segments... Aug 8 06:00:39.721750833 (20h20m39.31109582s) [upload=21078]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:00:39.721755371 (20h20m39.311100358s) [upload=21078]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:00:39.721757786 (20h20m39.311102773s) [upload=21078]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:00:39.985732442 (20h20m39.575077429s) [upload=21078]: Done uploading segments... Aug 8 06:00:39.985751518 (20h20m39.575096505s) [upload=21078]: Upload finished. err: <nil> Aug 8 06:01:01.755195514 (20h21m1.344540511s) [upload=21083]: Starting upload Aug 8 06:01:01.755269686 (20h21m1.344614683s) [upload=21083]: Done starting upload Aug 8 06:01:01.755363906 (20h21m1.344708893s) [upload=21083]: Uploading segments... Aug 8 06:01:01.755543540 (20h21m1.344888537s) [upload=21083]: Got next segment. Inline: true Aug 8 06:01:01.755549311 (20h21m1.344894308s) [upload=21083]: Waiting for error group managing segments... Aug 8 06:01:01.755615418 (20h21m1.344960415s) [upload=21083]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:01:01.755620938 (20h21m1.344965925s) [upload=21083]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:01:01.755623503 (20h21m1.34496849s) [upload=21083]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:01:02.090931160 (20h21m1.680276157s) [upload=21083]: Done uploading segments... Aug 8 06:01:02.090955637 (20h21m1.680300624s) [upload=21083]: Upload finished. err: <nil> Duration: 1.699963356s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 5.925186113s FAIL (2025-08-08 06:00:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.925209858s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [...........X...X..........X......X.............X............] duration: 1.81736949s FAIL (2025-08-08 06:00:40 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== _ObjectCommit Aug 8 05:45:35.317184488 (20h5m34.906529475s) [upload=20811]: Done uploading segments... Aug 8 05:45:35.317202442 (20h5m34.906547429s) [upload=20811]: Upload finished. err: <nil> Aug 8 05:46:01.441656651 (20h6m1.031001648s) [upload=20820]: Starting upload Aug 8 05:46:01.441723649 (20h6m1.031068636s) [upload=20820]: Done starting upload Aug 8 05:46:01.441780508 (20h6m1.031125495s) [upload=20820]: Uploading segments... Aug 8 05:46:01.441873716 (20h6m1.031218703s) [upload=20820]: Got next segment. Inline: true Aug 8 05:46:01.441879027 (20h6m1.031224024s) [upload=20820]: Waiting for error group managing segments... Aug 8 05:46:01.441920596 (20h6m1.031265583s) [upload=20820]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:46:01.441926427 (20h6m1.031271414s) [upload=20820]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:46:01.441929072 (20h6m1.031274069s) [upload=20820]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:46:01.715339951 (20h6m1.304684948s) [upload=20820]: Done uploading segments... Aug 8 05:46:01.715363486 (20h6m1.304708483s) [upload=20820]: Upload finished. err: <nil> Aug 8 05:46:30.814289733 (20h6m30.40363472s) [upload=20825]: Starting upload Aug 8 05:46:30.814402789 (20h6m30.403747776s) [upload=20825]: Done starting upload Aug 8 05:46:30.814469807 (20h6m30.403814794s) [upload=20825]: Uploading segments... Aug 8 05:46:30.814503302 (20h6m30.403848289s) [upload=20825]: Got next segment. Inline: true Aug 8 05:46:30.814507149 (20h6m30.403852136s) [upload=20825]: Waiting for error group managing segments... Aug 8 05:46:30.814539130 (20h6m30.403884117s) [upload=20825]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:46:30.814543147 (20h6m30.403888134s) [upload=20825]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:46:30.814545893 (20h6m30.40389088s) [upload=20825]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:46:31.079785599 (20h6m30.669130586s) [upload=20825]: Done uploading segments... Aug 8 05:46:31.079802632 (20h6m30.669147619s) [upload=20825]: Upload finished. err: <nil> Aug 8 05:47:12.882345463 (20h7m12.47169044s) [upload=20838]: Starting upload Aug 8 05:47:12.882381172 (20h7m12.471726179s) [upload=20838]: Done starting upload Aug 8 05:47:12.882425195 (20h7m12.471770182s) [upload=20838]: Uploading segments... Aug 8 05:47:12.882453229 (20h7m12.471798216s) [upload=20838]: Got next segment. Inline: true Aug 8 05:47:12.882456685 (20h7m12.471801672s) [upload=20838]: Waiting for error group managing segments... Aug 8 05:47:12.882487545 (20h7m12.471832532s) [upload=20838]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:47:12.882491432 (20h7m12.47183642s) [upload=20838]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:47:12.882494017 (20h7m12.471838994s) [upload=20838]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:47:13.318462618 (20h7m12.907807606s) [upload=20838]: Done uploading segments... Aug 8 05:47:13.318481204 (20h7m12.907826191s) [upload=20838]: Upload finished. err: <nil> Aug 8 05:48:17.691657531 (20h8m17.281002518s) [upload=20856]: Starting upload Aug 8 05:48:17.691709179 (20h8m17.281054166s) [upload=20856]: Done starting upload Aug 8 05:48:17.691766710 (20h8m17.281111697s) [upload=20856]: Uploading segments... Aug 8 05:48:17.691802789 (20h8m17.281147776s) [upload=20856]: Got next segment. Inline: true Aug 8 05:48:17.691807738 (20h8m17.281152725s) [upload=20856]: Waiting for error group managing segments... Aug 8 05:48:17.691840431 (20h8m17.281185418s) [upload=20856]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:48:17.691844428 (20h8m17.281189415s) [upload=20856]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:48:17.691846712 (20h8m17.281191699s) [upload=20856]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:48:17.965025328 (20h8m17.554370315s) [upload=20856]: Done uploading segments... Aug 8 05:48:17.965043924 (20h8m17.554388911s) [upload=20856]: Upload finished. err: <nil> Aug 8 05:48:48.116229309 (20h8m47.705574296s) [upload=20866]: Starting upload Aug 8 05:48:48.116275538 (20h8m47.705620525s) [upload=20866]: Done starting upload Aug 8 05:48:48.116329812 (20h8m47.705674789s) [upload=20866]: Uploading segments... Aug 8 05:48:48.116361262 (20h8m47.705706249s) [upload=20866]: Got next segment. Inline: true Aug 8 05:48:48.116364939 (20h8m47.705709926s) [upload=20866]: Waiting for error group managing segments... Aug 8 05:48:48.116397010 (20h8m47.705741997s) [upload=20866]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:48:48.116400528 (20h8m47.705745505s) [upload=20866]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:48:48.116402822 (20h8m47.705747809s) [upload=20866]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:48:48.385497422 (20h8m47.974842409s) [upload=20866]: Done uploading segments... Aug 8 05:48:48.385516399 (20h8m47.974861386s) [upload=20866]: Upload finished. err: <nil> Aug 8 05:49:03.413885916 (20h9m3.003230903s) [upload=20875]: Starting upload Aug 8 05:49:03.413943406 (20h9m3.003288393s) [upload=20875]: Done starting upload Aug 8 05:49:03.413992931 (20h9m3.003337918s) [upload=20875]: Uploading segments... Aug 8 05:49:03.414026846 (20h9m3.003371833s) [upload=20875]: Got next segment. Inline: true Aug 8 05:49:03.414030522 (20h9m3.003375509s) [upload=20875]: Waiting for error group managing segments... Aug 8 05:49:03.414064968 (20h9m3.003409955s) [upload=20875]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:49:03.414068956 (20h9m3.003413933s) [upload=20875]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:49:03.414071261 (20h9m3.003416248s) [upload=20875]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:49:03.687532396 (20h9m3.276877383s) [upload=20875]: Done uploading segments... Aug 8 05:49:03.687559157 (20h9m3.276904194s) [upload=20875]: Upload finished. err: <nil> Aug 8 05:50:11.620858006 (20h10m11.210202993s) [upload=20891]: Starting upload Aug 8 05:50:11.620940003 (20h10m11.21028505s) [upload=20891]: Done starting upload Aug 8 05:50:11.621045826 (20h10m11.210390813s) [upload=20891]: Uploading segments... Aug 8 05:50:11.621132682 (20h10m11.210477659s) [upload=20891]: Got next segment. Inline: true Aug 8 05:50:11.621137571 (20h10m11.210482548s) [upload=20891]: Waiting for error group managing segments... Aug 8 05:50:11.621215971 (20h10m11.210560968s) [upload=20891]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:50:11.621224186 (20h10m11.210569214s) [upload=20891]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:50:11.621227904 (20h10m11.210572891s) [upload=20891]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:50:11.902419833 (20h10m11.49176482s) [upload=20891]: Done uploading segments... Aug 8 05:50:11.902443819 (20h10m11.491788826s) [upload=20891]: Upload finished. err: <nil> Aug 8 05:50:43.301715332 (20h10m42.891060319s) [upload=20904]: Starting upload Aug 8 05:50:43.301764246 (20h10m42.891109223s) [upload=20904]: Done starting upload Aug 8 05:50:43.301849319 (20h10m42.891194306s) [upload=20904]: Uploading segments... Aug 8 05:50:43.301881360 (20h10m42.891226347s) [upload=20904]: Got next segment. Inline: true Aug 8 05:50:43.301884586 (20h10m42.891229573s) [upload=20904]: Waiting for error group managing segments... Aug 8 05:50:43.301917438 (20h10m42.891262425s) [upload=20904]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:50:43.301921266 (20h10m42.891266253s) [upload=20904]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:50:43.301923800 (20h10m42.891268787s) [upload=20904]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:50:43.581330942 (20h10m43.170675929s) [upload=20904]: Done uploading segments... Aug 8 05:50:43.581348606 (20h10m43.170693594s) [upload=20904]: Upload finished. err: <nil> Aug 8 05:51:48.829995842 (20h11m48.419340859s) [upload=20917]: Starting upload Aug 8 05:51:48.830078530 (20h11m48.419423537s) [upload=20917]: Done starting upload Aug 8 05:51:48.830166959 (20h11m48.419511966s) [upload=20917]: Uploading segments... Aug 8 05:51:48.830198750 (20h11m48.419543727s) [upload=20917]: Got next segment. Inline: true Aug 8 05:51:48.830203038 (20h11m48.419548025s) [upload=20917]: Waiting for error group managing segments... Aug 8 05:51:48.830253845 (20h11m48.419598832s) [upload=20917]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:51:48.830263293 (20h11m48.41960828s) [upload=20917]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:51:48.830267131 (20h11m48.419612118s) [upload=20917]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:51:49.104016229 (20h11m48.693361216s) [upload=20917]: Done uploading segments... Aug 8 05:51:49.104034853 (20h11m48.693379831s) [upload=20917]: Upload finished. err: <nil> Aug 8 05:52:06.425779511 (20h12m6.015124498s) [upload=20924]: Starting upload Aug 8 05:52:06.426077070 (20h12m6.015422047s) [upload=20924]: Done starting upload Aug 8 05:52:06.426405829 (20h12m6.015750816s) [upload=20924]: Uploading segments... Aug 8 05:52:06.426449272 (20h12m6.015794259s) [upload=20924]: Got next segment. Inline: true Aug 8 05:52:06.426453941 (20h12m6.015798928s) [upload=20924]: Waiting for error group managing segments... Aug 8 05:52:06.426502244 (20h12m6.015847231s) [upload=20924]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:52:06.426507774 (20h12m6.015852761s) [upload=20924]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:52:06.426510529 (20h12m6.015855506s) [upload=20924]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:52:12.513554098 (20h12m12.102899085s) [upload=20924]: Done uploading segments... Aug 8 05:52:12.513577011 (20h12m12.102921998s) [upload=20924]: Upload finished. err: <nil> Duration: 1.817402944s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [....XX...............X.X.......................X............] duration: 5.739609016s FAIL (2025-08-08 06:00:26 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== ad finished. err: <nil> Aug 8 05:50:40.893567535 (20h10m40.482912522s) [upload=20903]: Starting upload Aug 8 05:50:40.893617581 (20h10m40.482962568s) [upload=20903]: Done starting upload Aug 8 05:50:40.893745836 (20h10m40.483090823s) [upload=20903]: Uploading segments... Aug 8 05:50:40.893860175 (20h10m40.483205162s) [upload=20903]: Got next segment. Inline: false Aug 8 05:50:40.893898729 (20h10m40.483243706s) [upload=20903]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:50:40.893904339 (20h10m40.483249326s) [upload=20903]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:50:41.341218008 (20h10m40.930562995s) [seg_pos={0 0}, upload=20903]: Begin upload segment... Aug 8 05:50:41.341265508 (20h10m40.930610495s) [seg_pos={0 0}, upload=20903]: Done begin upload segment. Aug 8 05:50:41.341287290 (20h10m40.930632267s) [noise=true , address=104.36.82.37:4657 , piece_id=6G2JI22ZFKN72YYNJZ4Q3PK4ODRBF4QOK5OH3XNI245MOEV4INRA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341358447 (20h10m40.930703434s) [noise=true , address=64.49.13.155:4916 , piece_id=R4EDGKGU5O3XMIEDBT3P3YDZ6M5NDSW627JISIFRRYM3YFY7OJ7A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341670363 (20h10m40.93101535s) [noise=true , address=104.36.82.44:4873 , piece_id=OGMZZTN6R646OCIKFIN2ARH7HBXIYI4RG3RHOVEFGTGOS6EFLPFA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341830500 (20h10m40.931175487s) [noise=true , address=193.149.164.143:4696 , piece_id=FNRXKJGRXG64FVEF7U6WLJT56RBHEONLJF5FM3K7ZRBCQVBL3VFQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341990977 (20h10m40.931335954s) [noise=true , address=104.36.82.39:4735 , piece_id=VYEESGWFD57OTLITJU27YFV3IKI34JW7GANQ2U34PV6WAGMPEFXQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342205478 (20h10m40.931550465s) [noise=true , address=104.36.82.60:4348 , piece_id=DSQCOTEIOHDKJSUZYR7RQGXLT6A3FQNPBHZ36UKT3G56PNEWBKZA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342313615 (20h10m40.931658602s) [noise=true , address=104.36.82.36:4633 , piece_id=N6ZYWVZ7CODZ3SWA3T2KL6HWOPISACLE6YNECGDNL6S6NHP6TYZA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342583129 (20h10m40.931928117s) [noise=true , address=104.36.82.47:4529 , piece_id=UESMFD5UVKCQ4F5XKAG6OMNTA4BS6QV2BME5E7DMIJP7XWHJHT6A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342596976 (20h10m40.931941953s) [noise=true , address=104.36.82.61:4406 , piece_id=WQCH472JAJNEAGQGOF5LYU6RAUICVUOFXDTJC52NWFCEU43YTHEA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342935484 (20h10m40.932280471s) [noise=true , address=104.36.82.44:4881 , piece_id=JQKJCCUHCJSWLBDF5G5IEP2HAQJXH3FA6H7X4RNUH342SM6CNB5A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342953539 (20h10m40.932298526s) [noise=true , address=45.91.116.10:4092 , piece_id=FDHA5FCWTAFZ5N6AJA254W7QKGN3RGCGT7ZGWBIGLTI65DEIG4ZQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343204499 (20h10m40.932549486s) [noise=true , address=104.36.82.13:4202 , piece_id=GNTUDR6M4TV66KTCUMQKC33ESLZAQP4WK3PWS5CDQN5M6FE4ALQQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343223045 (20h10m40.932568032s) [noise=true , address=64.49.13.138:4481 , piece_id=HDNKCDGYH2LAFM2DRIW364W5XRSKF5XK7YZI47ATAAC5A6EBTOUQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343469105 (20h10m40.932814092s) [noise=true , address=64.49.13.140:4509 , piece_id=52T2SWYDXGGJ2IGMUAX5DJQZUFAQUHQTBW4NFC27RQQFLERI2EBQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343567834 (20h10m40.932912821s) [noise=true , address=104.36.82.23:4460 , piece_id=GKYZZOHC5J2FV2PWHI4IVTZV7FMVP2OFSJ2UOF24W5USG734RH7Q, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343687393 (20h10m40.93303237s) [noise=true , address=104.36.82.58:4273 , piece_id=WGPLZNLVUSYYJF7FJSBWAKRZ4LDAXSGBVWSTFRJ3KPBJIXOFSDGQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.344008046 (20h10m40.933353033s) [noise=true , address=104.36.82.43:4868 , piece_id=BM2WYHNTNNQAZHBSITN3ZIACMJLHLO6QACEZFCLYHODB4FYVYHNA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.345979839 (20h10m40.935324816s) [noise=true , address=104.36.82.20:4457 , piece_id=COVFTVTMO3DGUFVMZH633Q7RMZQRV7P2SRYOVJ2JZFP7RY5N7RHA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:42.438670912 (20h10m42.028015899s) [upload=20903]: Next returned nil segment Aug 8 05:50:42.438688716 (20h10m42.028033703s) [upload=20903]: Waiting for error group managing segments... Aug 8 05:50:42.778812377 (20h10m42.368157364s) [noise=true , address=193.149.164.143:4696 , piece_id=FNRXKJGRXG64FVEF7U6WLJT56RBHEONLJF5FM3K7ZRBCQVBL3VFQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.793688260 (20h10m42.383033237s) [noise=true , address=64.49.13.140:4509 , piece_id=52T2SWYDXGGJ2IGMUAX5DJQZUFAQUHQTBW4NFC27RQQFLERI2EBQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.814603478 (20h10m42.403948465s) [noise=true , address=64.49.13.155:4916 , piece_id=R4EDGKGU5O3XMIEDBT3P3YDZ6M5NDSW627JISIFRRYM3YFY7OJ7A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.846619684 (20h10m42.435964671s) [noise=true , address=64.49.13.138:4481 , piece_id=HDNKCDGYH2LAFM2DRIW364W5XRSKF5XK7YZI47ATAAC5A6EBTOUQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.248617890 (20h10m42.837962877s) [noise=true , address=104.36.82.47:4529 , piece_id=UESMFD5UVKCQ4F5XKAG6OMNTA4BS6QV2BME5E7DMIJP7XWHJHT6A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.252848605 (20h10m42.842193592s) [noise=true , address=104.36.82.39:4735 , piece_id=VYEESGWFD57OTLITJU27YFV3IKI34JW7GANQ2U34PV6WAGMPEFXQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.255650606 (20h10m42.844995593s) [noise=true , address=104.36.82.61:4406 , piece_id=WQCH472JAJNEAGQGOF5LYU6RAUICVUOFXDTJC52NWFCEU43YTHEA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.261140931 (20h10m42.850485918s) [noise=true , address=104.36.82.23:4460 , piece_id=GKYZZOHC5J2FV2PWHI4IVTZV7FMVP2OFSJ2UOF24W5USG734RH7Q, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.269129284 (20h10m42.858474261s) [noise=true , address=104.36.82.58:4273 , piece_id=WGPLZNLVUSYYJF7FJSBWAKRZ4LDAXSGBVWSTFRJ3KPBJIXOFSDGQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.274156393 (20h10m42.86350137s) [noise=true , address=104.36.82.43:4868 , piece_id=BM2WYHNTNNQAZHBSITN3ZIACMJLHLO6QACEZFCLYHODB4FYVYHNA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.313273526 (20h10m42.902618513s) [noise=true , address=45.91.116.10:4092 , piece_id=FDHA5FCWTAFZ5N6AJA254W7QKGN3RGCGT7ZGWBIGLTI65DEIG4ZQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.330724515 (20h10m42.920069502s) [noise=true , address=104.36.82.44:4881 , piece_id=JQKJCCUHCJSWLBDF5G5IEP2HAQJXH3FA6H7X4RNUH342SM6CNB5A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345245168 (20h10m42.934590155s) [noise=true , address=104.36.82.20:4457 , piece_id=COVFTVTMO3DGUFVMZH633Q7RMZQRV7P2SRYOVJ2JZFP7RY5N7RHA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345588405 (20h10m42.934933392s) [noise=true , address=104.36.82.60:4348 , piece_id=DSQCOTEIOHDKJSUZYR7RQGXLT6A3FQNPBHZ36UKT3G56PNEWBKZA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345621758 (20h10m42.934966745s) [seg_pos={0 0}, upload=20903]: Segment reached optimal threshold of 14 pieces. Aug 8 05:50:43.345774391 (20h10m42.935119378s) [noise=true , address=104.36.82.13:4202 , piece_id=GNTUDR6M4TV66KTCUMQKC33ESLZAQP4WK3PWS5CDQN5M6FE4ALQQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18wf5KnaR6WaR7MJivJkMJ7FejbuR6KnyvtRQgazNKfDb8fbsH): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345829917 (20h10m42.935174914s) [noise=true , address=104.36.82.36:4633 , piece_id=N6ZYWVZ7CODZ3SWA3T2KL6HWOPISACLE6YNECGDNL6S6NHP6TYZA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345878609 (20h10m42.935223607s) [noise=true , address=104.36.82.44:4873 , piece_id=OGMZZTN6R646OCIKFIN2ARH7HBXIYI4RG3RHOVEFGTGOS6EFLPFA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b5GdYtmYz9D1QW2z78W3Z2fWvMJGtrvrMJ1njbcqbtCDUdwHo): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345924307 (20h10m42.935269294s) [noise=true , address=104.36.82.37:4657 , piece_id=6G2JI22ZFKN72YYNJZ4Q3PK4ODRBF4QOK5OH3XNI245MOEV4INRA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345954214 (20h10m42.935299282s) [seg_pos={0 0}, upload=20903]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:50:43.346042142 (20h10m42.93538716s) [upload=20903]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:50:43.346050880 (20h10m42.935395897s) [upload=20903]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:50:43.643950132 (20h10m43.233295119s) [upload=20903]: Done uploading segments... Aug 8 05:50:43.643971202 (20h10m43.233316189s) [upload=20903]: Upload finished. err: <nil> Duration: 5.73963703s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [............X...X..........X......X.............X...........] duration: 2.042298136s FAIL (2025-08-08 06:00:07 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== _ObjectCommit Aug 8 05:45:35.317184488 (20h5m34.906529475s) [upload=20811]: Done uploading segments... Aug 8 05:45:35.317202442 (20h5m34.906547429s) [upload=20811]: Upload finished. err: <nil> Aug 8 05:46:01.441656651 (20h6m1.031001648s) [upload=20820]: Starting upload Aug 8 05:46:01.441723649 (20h6m1.031068636s) [upload=20820]: Done starting upload Aug 8 05:46:01.441780508 (20h6m1.031125495s) [upload=20820]: Uploading segments... Aug 8 05:46:01.441873716 (20h6m1.031218703s) [upload=20820]: Got next segment. Inline: true Aug 8 05:46:01.441879027 (20h6m1.031224024s) [upload=20820]: Waiting for error group managing segments... Aug 8 05:46:01.441920596 (20h6m1.031265583s) [upload=20820]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:46:01.441926427 (20h6m1.031271414s) [upload=20820]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:46:01.441929072 (20h6m1.031274069s) [upload=20820]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:46:01.715339951 (20h6m1.304684948s) [upload=20820]: Done uploading segments... Aug 8 05:46:01.715363486 (20h6m1.304708483s) [upload=20820]: Upload finished. err: <nil> Aug 8 05:46:30.814289733 (20h6m30.40363472s) [upload=20825]: Starting upload Aug 8 05:46:30.814402789 (20h6m30.403747776s) [upload=20825]: Done starting upload Aug 8 05:46:30.814469807 (20h6m30.403814794s) [upload=20825]: Uploading segments... Aug 8 05:46:30.814503302 (20h6m30.403848289s) [upload=20825]: Got next segment. Inline: true Aug 8 05:46:30.814507149 (20h6m30.403852136s) [upload=20825]: Waiting for error group managing segments... Aug 8 05:46:30.814539130 (20h6m30.403884117s) [upload=20825]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:46:30.814543147 (20h6m30.403888134s) [upload=20825]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:46:30.814545893 (20h6m30.40389088s) [upload=20825]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:46:31.079785599 (20h6m30.669130586s) [upload=20825]: Done uploading segments... Aug 8 05:46:31.079802632 (20h6m30.669147619s) [upload=20825]: Upload finished. err: <nil> Aug 8 05:47:12.882345463 (20h7m12.47169044s) [upload=20838]: Starting upload Aug 8 05:47:12.882381172 (20h7m12.471726179s) [upload=20838]: Done starting upload Aug 8 05:47:12.882425195 (20h7m12.471770182s) [upload=20838]: Uploading segments... Aug 8 05:47:12.882453229 (20h7m12.471798216s) [upload=20838]: Got next segment. Inline: true Aug 8 05:47:12.882456685 (20h7m12.471801672s) [upload=20838]: Waiting for error group managing segments... Aug 8 05:47:12.882487545 (20h7m12.471832532s) [upload=20838]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:47:12.882491432 (20h7m12.47183642s) [upload=20838]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:47:12.882494017 (20h7m12.471838994s) [upload=20838]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:47:13.318462618 (20h7m12.907807606s) [upload=20838]: Done uploading segments... Aug 8 05:47:13.318481204 (20h7m12.907826191s) [upload=20838]: Upload finished. err: <nil> Aug 8 05:48:17.691657531 (20h8m17.281002518s) [upload=20856]: Starting upload Aug 8 05:48:17.691709179 (20h8m17.281054166s) [upload=20856]: Done starting upload Aug 8 05:48:17.691766710 (20h8m17.281111697s) [upload=20856]: Uploading segments... Aug 8 05:48:17.691802789 (20h8m17.281147776s) [upload=20856]: Got next segment. Inline: true Aug 8 05:48:17.691807738 (20h8m17.281152725s) [upload=20856]: Waiting for error group managing segments... Aug 8 05:48:17.691840431 (20h8m17.281185418s) [upload=20856]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:48:17.691844428 (20h8m17.281189415s) [upload=20856]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:48:17.691846712 (20h8m17.281191699s) [upload=20856]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:48:17.965025328 (20h8m17.554370315s) [upload=20856]: Done uploading segments... Aug 8 05:48:17.965043924 (20h8m17.554388911s) [upload=20856]: Upload finished. err: <nil> Aug 8 05:48:48.116229309 (20h8m47.705574296s) [upload=20866]: Starting upload Aug 8 05:48:48.116275538 (20h8m47.705620525s) [upload=20866]: Done starting upload Aug 8 05:48:48.116329812 (20h8m47.705674789s) [upload=20866]: Uploading segments... Aug 8 05:48:48.116361262 (20h8m47.705706249s) [upload=20866]: Got next segment. Inline: true Aug 8 05:48:48.116364939 (20h8m47.705709926s) [upload=20866]: Waiting for error group managing segments... Aug 8 05:48:48.116397010 (20h8m47.705741997s) [upload=20866]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:48:48.116400528 (20h8m47.705745505s) [upload=20866]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:48:48.116402822 (20h8m47.705747809s) [upload=20866]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:48:48.385497422 (20h8m47.974842409s) [upload=20866]: Done uploading segments... Aug 8 05:48:48.385516399 (20h8m47.974861386s) [upload=20866]: Upload finished. err: <nil> Aug 8 05:49:03.413885916 (20h9m3.003230903s) [upload=20875]: Starting upload Aug 8 05:49:03.413943406 (20h9m3.003288393s) [upload=20875]: Done starting upload Aug 8 05:49:03.413992931 (20h9m3.003337918s) [upload=20875]: Uploading segments... Aug 8 05:49:03.414026846 (20h9m3.003371833s) [upload=20875]: Got next segment. Inline: true Aug 8 05:49:03.414030522 (20h9m3.003375509s) [upload=20875]: Waiting for error group managing segments... Aug 8 05:49:03.414064968 (20h9m3.003409955s) [upload=20875]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:49:03.414068956 (20h9m3.003413933s) [upload=20875]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:49:03.414071261 (20h9m3.003416248s) [upload=20875]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:49:03.687532396 (20h9m3.276877383s) [upload=20875]: Done uploading segments... Aug 8 05:49:03.687559157 (20h9m3.276904194s) [upload=20875]: Upload finished. err: <nil> Aug 8 05:50:11.620858006 (20h10m11.210202993s) [upload=20891]: Starting upload Aug 8 05:50:11.620940003 (20h10m11.21028505s) [upload=20891]: Done starting upload Aug 8 05:50:11.621045826 (20h10m11.210390813s) [upload=20891]: Uploading segments... Aug 8 05:50:11.621132682 (20h10m11.210477659s) [upload=20891]: Got next segment. Inline: true Aug 8 05:50:11.621137571 (20h10m11.210482548s) [upload=20891]: Waiting for error group managing segments... Aug 8 05:50:11.621215971 (20h10m11.210560968s) [upload=20891]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:50:11.621224186 (20h10m11.210569214s) [upload=20891]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:50:11.621227904 (20h10m11.210572891s) [upload=20891]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:50:11.902419833 (20h10m11.49176482s) [upload=20891]: Done uploading segments... Aug 8 05:50:11.902443819 (20h10m11.491788826s) [upload=20891]: Upload finished. err: <nil> Aug 8 05:50:43.301715332 (20h10m42.891060319s) [upload=20904]: Starting upload Aug 8 05:50:43.301764246 (20h10m42.891109223s) [upload=20904]: Done starting upload Aug 8 05:50:43.301849319 (20h10m42.891194306s) [upload=20904]: Uploading segments... Aug 8 05:50:43.301881360 (20h10m42.891226347s) [upload=20904]: Got next segment. Inline: true Aug 8 05:50:43.301884586 (20h10m42.891229573s) [upload=20904]: Waiting for error group managing segments... Aug 8 05:50:43.301917438 (20h10m42.891262425s) [upload=20904]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:50:43.301921266 (20h10m42.891266253s) [upload=20904]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:50:43.301923800 (20h10m42.891268787s) [upload=20904]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:50:43.581330942 (20h10m43.170675929s) [upload=20904]: Done uploading segments... Aug 8 05:50:43.581348606 (20h10m43.170693594s) [upload=20904]: Upload finished. err: <nil> Aug 8 05:51:48.829995842 (20h11m48.419340859s) [upload=20917]: Starting upload Aug 8 05:51:48.830078530 (20h11m48.419423537s) [upload=20917]: Done starting upload Aug 8 05:51:48.830166959 (20h11m48.419511966s) [upload=20917]: Uploading segments... Aug 8 05:51:48.830198750 (20h11m48.419543727s) [upload=20917]: Got next segment. Inline: true Aug 8 05:51:48.830203038 (20h11m48.419548025s) [upload=20917]: Waiting for error group managing segments... Aug 8 05:51:48.830253845 (20h11m48.419598832s) [upload=20917]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:51:48.830263293 (20h11m48.41960828s) [upload=20917]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:51:48.830267131 (20h11m48.419612118s) [upload=20917]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:51:49.104016229 (20h11m48.693361216s) [upload=20917]: Done uploading segments... Aug 8 05:51:49.104034853 (20h11m48.693379831s) [upload=20917]: Upload finished. err: <nil> Aug 8 05:52:06.425779511 (20h12m6.015124498s) [upload=20924]: Starting upload Aug 8 05:52:06.426077070 (20h12m6.015422047s) [upload=20924]: Done starting upload Aug 8 05:52:06.426405829 (20h12m6.015750816s) [upload=20924]: Uploading segments... Aug 8 05:52:06.426449272 (20h12m6.015794259s) [upload=20924]: Got next segment. Inline: true Aug 8 05:52:06.426453941 (20h12m6.015798928s) [upload=20924]: Waiting for error group managing segments... Aug 8 05:52:06.426502244 (20h12m6.015847231s) [upload=20924]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:52:06.426507774 (20h12m6.015852761s) [upload=20924]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:52:06.426510529 (20h12m6.015855506s) [upload=20924]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:52:12.513554098 (20h12m12.102899085s) [upload=20924]: Done uploading segments... Aug 8 05:52:12.513577011 (20h12m12.102921998s) [upload=20924]: Upload finished. err: <nil> Duration: 2.042328824s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 6.218878377s FAIL (2025-08-08 05:59:54 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.21890066s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.............X...X..........X......X.............X..........] duration: 1.881540639s FAIL (2025-08-08 05:59:51 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== _ObjectCommit Aug 8 05:45:35.317184488 (20h5m34.906529475s) [upload=20811]: Done uploading segments... Aug 8 05:45:35.317202442 (20h5m34.906547429s) [upload=20811]: Upload finished. err: <nil> Aug 8 05:46:01.441656651 (20h6m1.031001648s) [upload=20820]: Starting upload Aug 8 05:46:01.441723649 (20h6m1.031068636s) [upload=20820]: Done starting upload Aug 8 05:46:01.441780508 (20h6m1.031125495s) [upload=20820]: Uploading segments... Aug 8 05:46:01.441873716 (20h6m1.031218703s) [upload=20820]: Got next segment. Inline: true Aug 8 05:46:01.441879027 (20h6m1.031224024s) [upload=20820]: Waiting for error group managing segments... Aug 8 05:46:01.441920596 (20h6m1.031265583s) [upload=20820]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:46:01.441926427 (20h6m1.031271414s) [upload=20820]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:46:01.441929072 (20h6m1.031274069s) [upload=20820]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:46:01.715339951 (20h6m1.304684948s) [upload=20820]: Done uploading segments... Aug 8 05:46:01.715363486 (20h6m1.304708483s) [upload=20820]: Upload finished. err: <nil> Aug 8 05:46:30.814289733 (20h6m30.40363472s) [upload=20825]: Starting upload Aug 8 05:46:30.814402789 (20h6m30.403747776s) [upload=20825]: Done starting upload Aug 8 05:46:30.814469807 (20h6m30.403814794s) [upload=20825]: Uploading segments... Aug 8 05:46:30.814503302 (20h6m30.403848289s) [upload=20825]: Got next segment. Inline: true Aug 8 05:46:30.814507149 (20h6m30.403852136s) [upload=20825]: Waiting for error group managing segments... Aug 8 05:46:30.814539130 (20h6m30.403884117s) [upload=20825]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:46:30.814543147 (20h6m30.403888134s) [upload=20825]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:46:30.814545893 (20h6m30.40389088s) [upload=20825]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:46:31.079785599 (20h6m30.669130586s) [upload=20825]: Done uploading segments... Aug 8 05:46:31.079802632 (20h6m30.669147619s) [upload=20825]: Upload finished. err: <nil> Aug 8 05:47:12.882345463 (20h7m12.47169044s) [upload=20838]: Starting upload Aug 8 05:47:12.882381172 (20h7m12.471726179s) [upload=20838]: Done starting upload Aug 8 05:47:12.882425195 (20h7m12.471770182s) [upload=20838]: Uploading segments... Aug 8 05:47:12.882453229 (20h7m12.471798216s) [upload=20838]: Got next segment. Inline: true Aug 8 05:47:12.882456685 (20h7m12.471801672s) [upload=20838]: Waiting for error group managing segments... Aug 8 05:47:12.882487545 (20h7m12.471832532s) [upload=20838]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:47:12.882491432 (20h7m12.47183642s) [upload=20838]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:47:12.882494017 (20h7m12.471838994s) [upload=20838]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:47:13.318462618 (20h7m12.907807606s) [upload=20838]: Done uploading segments... Aug 8 05:47:13.318481204 (20h7m12.907826191s) [upload=20838]: Upload finished. err: <nil> Aug 8 05:48:17.691657531 (20h8m17.281002518s) [upload=20856]: Starting upload Aug 8 05:48:17.691709179 (20h8m17.281054166s) [upload=20856]: Done starting upload Aug 8 05:48:17.691766710 (20h8m17.281111697s) [upload=20856]: Uploading segments... Aug 8 05:48:17.691802789 (20h8m17.281147776s) [upload=20856]: Got next segment. Inline: true Aug 8 05:48:17.691807738 (20h8m17.281152725s) [upload=20856]: Waiting for error group managing segments... Aug 8 05:48:17.691840431 (20h8m17.281185418s) [upload=20856]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:48:17.691844428 (20h8m17.281189415s) [upload=20856]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:48:17.691846712 (20h8m17.281191699s) [upload=20856]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:48:17.965025328 (20h8m17.554370315s) [upload=20856]: Done uploading segments... Aug 8 05:48:17.965043924 (20h8m17.554388911s) [upload=20856]: Upload finished. err: <nil> Aug 8 05:48:48.116229309 (20h8m47.705574296s) [upload=20866]: Starting upload Aug 8 05:48:48.116275538 (20h8m47.705620525s) [upload=20866]: Done starting upload Aug 8 05:48:48.116329812 (20h8m47.705674789s) [upload=20866]: Uploading segments... Aug 8 05:48:48.116361262 (20h8m47.705706249s) [upload=20866]: Got next segment. Inline: true Aug 8 05:48:48.116364939 (20h8m47.705709926s) [upload=20866]: Waiting for error group managing segments... Aug 8 05:48:48.116397010 (20h8m47.705741997s) [upload=20866]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:48:48.116400528 (20h8m47.705745505s) [upload=20866]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:48:48.116402822 (20h8m47.705747809s) [upload=20866]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:48:48.385497422 (20h8m47.974842409s) [upload=20866]: Done uploading segments... Aug 8 05:48:48.385516399 (20h8m47.974861386s) [upload=20866]: Upload finished. err: <nil> Aug 8 05:49:03.413885916 (20h9m3.003230903s) [upload=20875]: Starting upload Aug 8 05:49:03.413943406 (20h9m3.003288393s) [upload=20875]: Done starting upload Aug 8 05:49:03.413992931 (20h9m3.003337918s) [upload=20875]: Uploading segments... Aug 8 05:49:03.414026846 (20h9m3.003371833s) [upload=20875]: Got next segment. Inline: true Aug 8 05:49:03.414030522 (20h9m3.003375509s) [upload=20875]: Waiting for error group managing segments... Aug 8 05:49:03.414064968 (20h9m3.003409955s) [upload=20875]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:49:03.414068956 (20h9m3.003413933s) [upload=20875]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:49:03.414071261 (20h9m3.003416248s) [upload=20875]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:49:03.687532396 (20h9m3.276877383s) [upload=20875]: Done uploading segments... Aug 8 05:49:03.687559157 (20h9m3.276904194s) [upload=20875]: Upload finished. err: <nil> Aug 8 05:50:11.620858006 (20h10m11.210202993s) [upload=20891]: Starting upload Aug 8 05:50:11.620940003 (20h10m11.21028505s) [upload=20891]: Done starting upload Aug 8 05:50:11.621045826 (20h10m11.210390813s) [upload=20891]: Uploading segments... Aug 8 05:50:11.621132682 (20h10m11.210477659s) [upload=20891]: Got next segment. Inline: true Aug 8 05:50:11.621137571 (20h10m11.210482548s) [upload=20891]: Waiting for error group managing segments... Aug 8 05:50:11.621215971 (20h10m11.210560968s) [upload=20891]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:50:11.621224186 (20h10m11.210569214s) [upload=20891]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:50:11.621227904 (20h10m11.210572891s) [upload=20891]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:50:11.902419833 (20h10m11.49176482s) [upload=20891]: Done uploading segments... Aug 8 05:50:11.902443819 (20h10m11.491788826s) [upload=20891]: Upload finished. err: <nil> Aug 8 05:50:43.301715332 (20h10m42.891060319s) [upload=20904]: Starting upload Aug 8 05:50:43.301764246 (20h10m42.891109223s) [upload=20904]: Done starting upload Aug 8 05:50:43.301849319 (20h10m42.891194306s) [upload=20904]: Uploading segments... Aug 8 05:50:43.301881360 (20h10m42.891226347s) [upload=20904]: Got next segment. Inline: true Aug 8 05:50:43.301884586 (20h10m42.891229573s) [upload=20904]: Waiting for error group managing segments... Aug 8 05:50:43.301917438 (20h10m42.891262425s) [upload=20904]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:50:43.301921266 (20h10m42.891266253s) [upload=20904]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:50:43.301923800 (20h10m42.891268787s) [upload=20904]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:50:43.581330942 (20h10m43.170675929s) [upload=20904]: Done uploading segments... Aug 8 05:50:43.581348606 (20h10m43.170693594s) [upload=20904]: Upload finished. err: <nil> Aug 8 05:51:48.829995842 (20h11m48.419340859s) [upload=20917]: Starting upload Aug 8 05:51:48.830078530 (20h11m48.419423537s) [upload=20917]: Done starting upload Aug 8 05:51:48.830166959 (20h11m48.419511966s) [upload=20917]: Uploading segments... Aug 8 05:51:48.830198750 (20h11m48.419543727s) [upload=20917]: Got next segment. Inline: true Aug 8 05:51:48.830203038 (20h11m48.419548025s) [upload=20917]: Waiting for error group managing segments... Aug 8 05:51:48.830253845 (20h11m48.419598832s) [upload=20917]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:51:48.830263293 (20h11m48.41960828s) [upload=20917]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:51:48.830267131 (20h11m48.419612118s) [upload=20917]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:51:49.104016229 (20h11m48.693361216s) [upload=20917]: Done uploading segments... Aug 8 05:51:49.104034853 (20h11m48.693379831s) [upload=20917]: Upload finished. err: <nil> Aug 8 05:52:06.425779511 (20h12m6.015124498s) [upload=20924]: Starting upload Aug 8 05:52:06.426077070 (20h12m6.015422047s) [upload=20924]: Done starting upload Aug 8 05:52:06.426405829 (20h12m6.015750816s) [upload=20924]: Uploading segments... Aug 8 05:52:06.426449272 (20h12m6.015794259s) [upload=20924]: Got next segment. Inline: true Aug 8 05:52:06.426453941 (20h12m6.015798928s) [upload=20924]: Waiting for error group managing segments... Aug 8 05:52:06.426502244 (20h12m6.015847231s) [upload=20924]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:52:06.426507774 (20h12m6.015852761s) [upload=20924]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:52:06.426510529 (20h12m6.015855506s) [upload=20924]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:52:12.513554098 (20h12m12.102899085s) [upload=20924]: Done uploading segments... Aug 8 05:52:12.513577011 (20h12m12.102921998s) [upload=20924]: Upload finished. err: <nil> Duration: 1.881566128s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.....XX...............X.X.......................X...........] duration: 5.608913257s FAIL (2025-08-08 05:59:48 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== ad finished. err: <nil> Aug 8 05:50:40.893567535 (20h10m40.482912522s) [upload=20903]: Starting upload Aug 8 05:50:40.893617581 (20h10m40.482962568s) [upload=20903]: Done starting upload Aug 8 05:50:40.893745836 (20h10m40.483090823s) [upload=20903]: Uploading segments... Aug 8 05:50:40.893860175 (20h10m40.483205162s) [upload=20903]: Got next segment. Inline: false Aug 8 05:50:40.893898729 (20h10m40.483243706s) [upload=20903]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:50:40.893904339 (20h10m40.483249326s) [upload=20903]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:50:41.341218008 (20h10m40.930562995s) [seg_pos={0 0}, upload=20903]: Begin upload segment... Aug 8 05:50:41.341265508 (20h10m40.930610495s) [seg_pos={0 0}, upload=20903]: Done begin upload segment. Aug 8 05:50:41.341287290 (20h10m40.930632267s) [noise=true , address=104.36.82.37:4657 , piece_id=6G2JI22ZFKN72YYNJZ4Q3PK4ODRBF4QOK5OH3XNI245MOEV4INRA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341358447 (20h10m40.930703434s) [noise=true , address=64.49.13.155:4916 , piece_id=R4EDGKGU5O3XMIEDBT3P3YDZ6M5NDSW627JISIFRRYM3YFY7OJ7A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341670363 (20h10m40.93101535s) [noise=true , address=104.36.82.44:4873 , piece_id=OGMZZTN6R646OCIKFIN2ARH7HBXIYI4RG3RHOVEFGTGOS6EFLPFA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341830500 (20h10m40.931175487s) [noise=true , address=193.149.164.143:4696 , piece_id=FNRXKJGRXG64FVEF7U6WLJT56RBHEONLJF5FM3K7ZRBCQVBL3VFQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341990977 (20h10m40.931335954s) [noise=true , address=104.36.82.39:4735 , piece_id=VYEESGWFD57OTLITJU27YFV3IKI34JW7GANQ2U34PV6WAGMPEFXQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342205478 (20h10m40.931550465s) [noise=true , address=104.36.82.60:4348 , piece_id=DSQCOTEIOHDKJSUZYR7RQGXLT6A3FQNPBHZ36UKT3G56PNEWBKZA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342313615 (20h10m40.931658602s) [noise=true , address=104.36.82.36:4633 , piece_id=N6ZYWVZ7CODZ3SWA3T2KL6HWOPISACLE6YNECGDNL6S6NHP6TYZA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342583129 (20h10m40.931928117s) [noise=true , address=104.36.82.47:4529 , piece_id=UESMFD5UVKCQ4F5XKAG6OMNTA4BS6QV2BME5E7DMIJP7XWHJHT6A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342596976 (20h10m40.931941953s) [noise=true , address=104.36.82.61:4406 , piece_id=WQCH472JAJNEAGQGOF5LYU6RAUICVUOFXDTJC52NWFCEU43YTHEA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342935484 (20h10m40.932280471s) [noise=true , address=104.36.82.44:4881 , piece_id=JQKJCCUHCJSWLBDF5G5IEP2HAQJXH3FA6H7X4RNUH342SM6CNB5A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342953539 (20h10m40.932298526s) [noise=true , address=45.91.116.10:4092 , piece_id=FDHA5FCWTAFZ5N6AJA254W7QKGN3RGCGT7ZGWBIGLTI65DEIG4ZQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343204499 (20h10m40.932549486s) [noise=true , address=104.36.82.13:4202 , piece_id=GNTUDR6M4TV66KTCUMQKC33ESLZAQP4WK3PWS5CDQN5M6FE4ALQQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343223045 (20h10m40.932568032s) [noise=true , address=64.49.13.138:4481 , piece_id=HDNKCDGYH2LAFM2DRIW364W5XRSKF5XK7YZI47ATAAC5A6EBTOUQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343469105 (20h10m40.932814092s) [noise=true , address=64.49.13.140:4509 , piece_id=52T2SWYDXGGJ2IGMUAX5DJQZUFAQUHQTBW4NFC27RQQFLERI2EBQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343567834 (20h10m40.932912821s) [noise=true , address=104.36.82.23:4460 , piece_id=GKYZZOHC5J2FV2PWHI4IVTZV7FMVP2OFSJ2UOF24W5USG734RH7Q, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343687393 (20h10m40.93303237s) [noise=true , address=104.36.82.58:4273 , piece_id=WGPLZNLVUSYYJF7FJSBWAKRZ4LDAXSGBVWSTFRJ3KPBJIXOFSDGQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.344008046 (20h10m40.933353033s) [noise=true , address=104.36.82.43:4868 , piece_id=BM2WYHNTNNQAZHBSITN3ZIACMJLHLO6QACEZFCLYHODB4FYVYHNA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.345979839 (20h10m40.935324816s) [noise=true , address=104.36.82.20:4457 , piece_id=COVFTVTMO3DGUFVMZH633Q7RMZQRV7P2SRYOVJ2JZFP7RY5N7RHA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:42.438670912 (20h10m42.028015899s) [upload=20903]: Next returned nil segment Aug 8 05:50:42.438688716 (20h10m42.028033703s) [upload=20903]: Waiting for error group managing segments... Aug 8 05:50:42.778812377 (20h10m42.368157364s) [noise=true , address=193.149.164.143:4696 , piece_id=FNRXKJGRXG64FVEF7U6WLJT56RBHEONLJF5FM3K7ZRBCQVBL3VFQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.793688260 (20h10m42.383033237s) [noise=true , address=64.49.13.140:4509 , piece_id=52T2SWYDXGGJ2IGMUAX5DJQZUFAQUHQTBW4NFC27RQQFLERI2EBQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.814603478 (20h10m42.403948465s) [noise=true , address=64.49.13.155:4916 , piece_id=R4EDGKGU5O3XMIEDBT3P3YDZ6M5NDSW627JISIFRRYM3YFY7OJ7A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.846619684 (20h10m42.435964671s) [noise=true , address=64.49.13.138:4481 , piece_id=HDNKCDGYH2LAFM2DRIW364W5XRSKF5XK7YZI47ATAAC5A6EBTOUQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.248617890 (20h10m42.837962877s) [noise=true , address=104.36.82.47:4529 , piece_id=UESMFD5UVKCQ4F5XKAG6OMNTA4BS6QV2BME5E7DMIJP7XWHJHT6A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.252848605 (20h10m42.842193592s) [noise=true , address=104.36.82.39:4735 , piece_id=VYEESGWFD57OTLITJU27YFV3IKI34JW7GANQ2U34PV6WAGMPEFXQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.255650606 (20h10m42.844995593s) [noise=true , address=104.36.82.61:4406 , piece_id=WQCH472JAJNEAGQGOF5LYU6RAUICVUOFXDTJC52NWFCEU43YTHEA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.261140931 (20h10m42.850485918s) [noise=true , address=104.36.82.23:4460 , piece_id=GKYZZOHC5J2FV2PWHI4IVTZV7FMVP2OFSJ2UOF24W5USG734RH7Q, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.269129284 (20h10m42.858474261s) [noise=true , address=104.36.82.58:4273 , piece_id=WGPLZNLVUSYYJF7FJSBWAKRZ4LDAXSGBVWSTFRJ3KPBJIXOFSDGQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.274156393 (20h10m42.86350137s) [noise=true , address=104.36.82.43:4868 , piece_id=BM2WYHNTNNQAZHBSITN3ZIACMJLHLO6QACEZFCLYHODB4FYVYHNA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.313273526 (20h10m42.902618513s) [noise=true , address=45.91.116.10:4092 , piece_id=FDHA5FCWTAFZ5N6AJA254W7QKGN3RGCGT7ZGWBIGLTI65DEIG4ZQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.330724515 (20h10m42.920069502s) [noise=true , address=104.36.82.44:4881 , piece_id=JQKJCCUHCJSWLBDF5G5IEP2HAQJXH3FA6H7X4RNUH342SM6CNB5A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345245168 (20h10m42.934590155s) [noise=true , address=104.36.82.20:4457 , piece_id=COVFTVTMO3DGUFVMZH633Q7RMZQRV7P2SRYOVJ2JZFP7RY5N7RHA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345588405 (20h10m42.934933392s) [noise=true , address=104.36.82.60:4348 , piece_id=DSQCOTEIOHDKJSUZYR7RQGXLT6A3FQNPBHZ36UKT3G56PNEWBKZA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345621758 (20h10m42.934966745s) [seg_pos={0 0}, upload=20903]: Segment reached optimal threshold of 14 pieces. Aug 8 05:50:43.345774391 (20h10m42.935119378s) [noise=true , address=104.36.82.13:4202 , piece_id=GNTUDR6M4TV66KTCUMQKC33ESLZAQP4WK3PWS5CDQN5M6FE4ALQQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18wf5KnaR6WaR7MJivJkMJ7FejbuR6KnyvtRQgazNKfDb8fbsH): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345829917 (20h10m42.935174914s) [noise=true , address=104.36.82.36:4633 , piece_id=N6ZYWVZ7CODZ3SWA3T2KL6HWOPISACLE6YNECGDNL6S6NHP6TYZA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345878609 (20h10m42.935223607s) [noise=true , address=104.36.82.44:4873 , piece_id=OGMZZTN6R646OCIKFIN2ARH7HBXIYI4RG3RHOVEFGTGOS6EFLPFA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b5GdYtmYz9D1QW2z78W3Z2fWvMJGtrvrMJ1njbcqbtCDUdwHo): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345924307 (20h10m42.935269294s) [noise=true , address=104.36.82.37:4657 , piece_id=6G2JI22ZFKN72YYNJZ4Q3PK4ODRBF4QOK5OH3XNI245MOEV4INRA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345954214 (20h10m42.935299282s) [seg_pos={0 0}, upload=20903]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:50:43.346042142 (20h10m42.93538716s) [upload=20903]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:50:43.346050880 (20h10m42.935395897s) [upload=20903]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:50:43.643950132 (20h10m43.233295119s) [upload=20903]: Done uploading segments... Aug 8 05:50:43.643971202 (20h10m43.233316189s) [upload=20903]: Upload finished. err: <nil> Duration: 5.608951049s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 6.050461579s FAIL (2025-08-08 05:59:28 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.050488641s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 6.116500798s FAIL (2025-08-08 05:58:54 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.116519273s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [......XX...............X.X.......................X..........] duration: 5.780258731s FAIL (2025-08-08 05:58:51 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== ad finished. err: <nil> Aug 8 05:50:40.893567535 (20h10m40.482912522s) [upload=20903]: Starting upload Aug 8 05:50:40.893617581 (20h10m40.482962568s) [upload=20903]: Done starting upload Aug 8 05:50:40.893745836 (20h10m40.483090823s) [upload=20903]: Uploading segments... Aug 8 05:50:40.893860175 (20h10m40.483205162s) [upload=20903]: Got next segment. Inline: false Aug 8 05:50:40.893898729 (20h10m40.483243706s) [upload=20903]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:50:40.893904339 (20h10m40.483249326s) [upload=20903]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:50:41.341218008 (20h10m40.930562995s) [seg_pos={0 0}, upload=20903]: Begin upload segment... Aug 8 05:50:41.341265508 (20h10m40.930610495s) [seg_pos={0 0}, upload=20903]: Done begin upload segment. Aug 8 05:50:41.341287290 (20h10m40.930632267s) [noise=true , address=104.36.82.37:4657 , piece_id=6G2JI22ZFKN72YYNJZ4Q3PK4ODRBF4QOK5OH3XNI245MOEV4INRA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341358447 (20h10m40.930703434s) [noise=true , address=64.49.13.155:4916 , piece_id=R4EDGKGU5O3XMIEDBT3P3YDZ6M5NDSW627JISIFRRYM3YFY7OJ7A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341670363 (20h10m40.93101535s) [noise=true , address=104.36.82.44:4873 , piece_id=OGMZZTN6R646OCIKFIN2ARH7HBXIYI4RG3RHOVEFGTGOS6EFLPFA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341830500 (20h10m40.931175487s) [noise=true , address=193.149.164.143:4696 , piece_id=FNRXKJGRXG64FVEF7U6WLJT56RBHEONLJF5FM3K7ZRBCQVBL3VFQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341990977 (20h10m40.931335954s) [noise=true , address=104.36.82.39:4735 , piece_id=VYEESGWFD57OTLITJU27YFV3IKI34JW7GANQ2U34PV6WAGMPEFXQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342205478 (20h10m40.931550465s) [noise=true , address=104.36.82.60:4348 , piece_id=DSQCOTEIOHDKJSUZYR7RQGXLT6A3FQNPBHZ36UKT3G56PNEWBKZA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342313615 (20h10m40.931658602s) [noise=true , address=104.36.82.36:4633 , piece_id=N6ZYWVZ7CODZ3SWA3T2KL6HWOPISACLE6YNECGDNL6S6NHP6TYZA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342583129 (20h10m40.931928117s) [noise=true , address=104.36.82.47:4529 , piece_id=UESMFD5UVKCQ4F5XKAG6OMNTA4BS6QV2BME5E7DMIJP7XWHJHT6A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342596976 (20h10m40.931941953s) [noise=true , address=104.36.82.61:4406 , piece_id=WQCH472JAJNEAGQGOF5LYU6RAUICVUOFXDTJC52NWFCEU43YTHEA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342935484 (20h10m40.932280471s) [noise=true , address=104.36.82.44:4881 , piece_id=JQKJCCUHCJSWLBDF5G5IEP2HAQJXH3FA6H7X4RNUH342SM6CNB5A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342953539 (20h10m40.932298526s) [noise=true , address=45.91.116.10:4092 , piece_id=FDHA5FCWTAFZ5N6AJA254W7QKGN3RGCGT7ZGWBIGLTI65DEIG4ZQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343204499 (20h10m40.932549486s) [noise=true , address=104.36.82.13:4202 , piece_id=GNTUDR6M4TV66KTCUMQKC33ESLZAQP4WK3PWS5CDQN5M6FE4ALQQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343223045 (20h10m40.932568032s) [noise=true , address=64.49.13.138:4481 , piece_id=HDNKCDGYH2LAFM2DRIW364W5XRSKF5XK7YZI47ATAAC5A6EBTOUQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343469105 (20h10m40.932814092s) [noise=true , address=64.49.13.140:4509 , piece_id=52T2SWYDXGGJ2IGMUAX5DJQZUFAQUHQTBW4NFC27RQQFLERI2EBQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343567834 (20h10m40.932912821s) [noise=true , address=104.36.82.23:4460 , piece_id=GKYZZOHC5J2FV2PWHI4IVTZV7FMVP2OFSJ2UOF24W5USG734RH7Q, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343687393 (20h10m40.93303237s) [noise=true , address=104.36.82.58:4273 , piece_id=WGPLZNLVUSYYJF7FJSBWAKRZ4LDAXSGBVWSTFRJ3KPBJIXOFSDGQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.344008046 (20h10m40.933353033s) [noise=true , address=104.36.82.43:4868 , piece_id=BM2WYHNTNNQAZHBSITN3ZIACMJLHLO6QACEZFCLYHODB4FYVYHNA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.345979839 (20h10m40.935324816s) [noise=true , address=104.36.82.20:4457 , piece_id=COVFTVTMO3DGUFVMZH633Q7RMZQRV7P2SRYOVJ2JZFP7RY5N7RHA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:42.438670912 (20h10m42.028015899s) [upload=20903]: Next returned nil segment Aug 8 05:50:42.438688716 (20h10m42.028033703s) [upload=20903]: Waiting for error group managing segments... Aug 8 05:50:42.778812377 (20h10m42.368157364s) [noise=true , address=193.149.164.143:4696 , piece_id=FNRXKJGRXG64FVEF7U6WLJT56RBHEONLJF5FM3K7ZRBCQVBL3VFQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.793688260 (20h10m42.383033237s) [noise=true , address=64.49.13.140:4509 , piece_id=52T2SWYDXGGJ2IGMUAX5DJQZUFAQUHQTBW4NFC27RQQFLERI2EBQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.814603478 (20h10m42.403948465s) [noise=true , address=64.49.13.155:4916 , piece_id=R4EDGKGU5O3XMIEDBT3P3YDZ6M5NDSW627JISIFRRYM3YFY7OJ7A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.846619684 (20h10m42.435964671s) [noise=true , address=64.49.13.138:4481 , piece_id=HDNKCDGYH2LAFM2DRIW364W5XRSKF5XK7YZI47ATAAC5A6EBTOUQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.248617890 (20h10m42.837962877s) [noise=true , address=104.36.82.47:4529 , piece_id=UESMFD5UVKCQ4F5XKAG6OMNTA4BS6QV2BME5E7DMIJP7XWHJHT6A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.252848605 (20h10m42.842193592s) [noise=true , address=104.36.82.39:4735 , piece_id=VYEESGWFD57OTLITJU27YFV3IKI34JW7GANQ2U34PV6WAGMPEFXQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.255650606 (20h10m42.844995593s) [noise=true , address=104.36.82.61:4406 , piece_id=WQCH472JAJNEAGQGOF5LYU6RAUICVUOFXDTJC52NWFCEU43YTHEA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.261140931 (20h10m42.850485918s) [noise=true , address=104.36.82.23:4460 , piece_id=GKYZZOHC5J2FV2PWHI4IVTZV7FMVP2OFSJ2UOF24W5USG734RH7Q, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.269129284 (20h10m42.858474261s) [noise=true , address=104.36.82.58:4273 , piece_id=WGPLZNLVUSYYJF7FJSBWAKRZ4LDAXSGBVWSTFRJ3KPBJIXOFSDGQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.274156393 (20h10m42.86350137s) [noise=true , address=104.36.82.43:4868 , piece_id=BM2WYHNTNNQAZHBSITN3ZIACMJLHLO6QACEZFCLYHODB4FYVYHNA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.313273526 (20h10m42.902618513s) [noise=true , address=45.91.116.10:4092 , piece_id=FDHA5FCWTAFZ5N6AJA254W7QKGN3RGCGT7ZGWBIGLTI65DEIG4ZQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.330724515 (20h10m42.920069502s) [noise=true , address=104.36.82.44:4881 , piece_id=JQKJCCUHCJSWLBDF5G5IEP2HAQJXH3FA6H7X4RNUH342SM6CNB5A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345245168 (20h10m42.934590155s) [noise=true , address=104.36.82.20:4457 , piece_id=COVFTVTMO3DGUFVMZH633Q7RMZQRV7P2SRYOVJ2JZFP7RY5N7RHA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345588405 (20h10m42.934933392s) [noise=true , address=104.36.82.60:4348 , piece_id=DSQCOTEIOHDKJSUZYR7RQGXLT6A3FQNPBHZ36UKT3G56PNEWBKZA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345621758 (20h10m42.934966745s) [seg_pos={0 0}, upload=20903]: Segment reached optimal threshold of 14 pieces. Aug 8 05:50:43.345774391 (20h10m42.935119378s) [noise=true , address=104.36.82.13:4202 , piece_id=GNTUDR6M4TV66KTCUMQKC33ESLZAQP4WK3PWS5CDQN5M6FE4ALQQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18wf5KnaR6WaR7MJivJkMJ7FejbuR6KnyvtRQgazNKfDb8fbsH): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345829917 (20h10m42.935174914s) [noise=true , address=104.36.82.36:4633 , piece_id=N6ZYWVZ7CODZ3SWA3T2KL6HWOPISACLE6YNECGDNL6S6NHP6TYZA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345878609 (20h10m42.935223607s) [noise=true , address=104.36.82.44:4873 , piece_id=OGMZZTN6R646OCIKFIN2ARH7HBXIYI4RG3RHOVEFGTGOS6EFLPFA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b5GdYtmYz9D1QW2z78W3Z2fWvMJGtrvrMJ1njbcqbtCDUdwHo): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345924307 (20h10m42.935269294s) [noise=true , address=104.36.82.37:4657 , piece_id=6G2JI22ZFKN72YYNJZ4Q3PK4ODRBF4QOK5OH3XNI245MOEV4INRA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345954214 (20h10m42.935299282s) [seg_pos={0 0}, upload=20903]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:50:43.346042142 (20h10m42.93538716s) [upload=20903]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:50:43.346050880 (20h10m42.935395897s) [upload=20903]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:50:43.643950132 (20h10m43.233295119s) [upload=20903]: Done uploading segments... Aug 8 05:50:43.643971202 (20h10m43.233316189s) [upload=20903]: Upload finished. err: <nil> Duration: 5.780285102s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [..............X...X..........X......X.............X.........] duration: 1.796719652s FAIL (2025-08-08 05:58:39 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== _ObjectCommit Aug 8 05:45:35.317184488 (20h5m34.906529475s) [upload=20811]: Done uploading segments... Aug 8 05:45:35.317202442 (20h5m34.906547429s) [upload=20811]: Upload finished. err: <nil> Aug 8 05:46:01.441656651 (20h6m1.031001648s) [upload=20820]: Starting upload Aug 8 05:46:01.441723649 (20h6m1.031068636s) [upload=20820]: Done starting upload Aug 8 05:46:01.441780508 (20h6m1.031125495s) [upload=20820]: Uploading segments... Aug 8 05:46:01.441873716 (20h6m1.031218703s) [upload=20820]: Got next segment. Inline: true Aug 8 05:46:01.441879027 (20h6m1.031224024s) [upload=20820]: Waiting for error group managing segments... Aug 8 05:46:01.441920596 (20h6m1.031265583s) [upload=20820]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:46:01.441926427 (20h6m1.031271414s) [upload=20820]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:46:01.441929072 (20h6m1.031274069s) [upload=20820]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:46:01.715339951 (20h6m1.304684948s) [upload=20820]: Done uploading segments... Aug 8 05:46:01.715363486 (20h6m1.304708483s) [upload=20820]: Upload finished. err: <nil> Aug 8 05:46:30.814289733 (20h6m30.40363472s) [upload=20825]: Starting upload Aug 8 05:46:30.814402789 (20h6m30.403747776s) [upload=20825]: Done starting upload Aug 8 05:46:30.814469807 (20h6m30.403814794s) [upload=20825]: Uploading segments... Aug 8 05:46:30.814503302 (20h6m30.403848289s) [upload=20825]: Got next segment. Inline: true Aug 8 05:46:30.814507149 (20h6m30.403852136s) [upload=20825]: Waiting for error group managing segments... Aug 8 05:46:30.814539130 (20h6m30.403884117s) [upload=20825]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:46:30.814543147 (20h6m30.403888134s) [upload=20825]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:46:30.814545893 (20h6m30.40389088s) [upload=20825]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:46:31.079785599 (20h6m30.669130586s) [upload=20825]: Done uploading segments... Aug 8 05:46:31.079802632 (20h6m30.669147619s) [upload=20825]: Upload finished. err: <nil> Aug 8 05:47:12.882345463 (20h7m12.47169044s) [upload=20838]: Starting upload Aug 8 05:47:12.882381172 (20h7m12.471726179s) [upload=20838]: Done starting upload Aug 8 05:47:12.882425195 (20h7m12.471770182s) [upload=20838]: Uploading segments... Aug 8 05:47:12.882453229 (20h7m12.471798216s) [upload=20838]: Got next segment. Inline: true Aug 8 05:47:12.882456685 (20h7m12.471801672s) [upload=20838]: Waiting for error group managing segments... Aug 8 05:47:12.882487545 (20h7m12.471832532s) [upload=20838]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:47:12.882491432 (20h7m12.47183642s) [upload=20838]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:47:12.882494017 (20h7m12.471838994s) [upload=20838]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:47:13.318462618 (20h7m12.907807606s) [upload=20838]: Done uploading segments... Aug 8 05:47:13.318481204 (20h7m12.907826191s) [upload=20838]: Upload finished. err: <nil> Aug 8 05:48:17.691657531 (20h8m17.281002518s) [upload=20856]: Starting upload Aug 8 05:48:17.691709179 (20h8m17.281054166s) [upload=20856]: Done starting upload Aug 8 05:48:17.691766710 (20h8m17.281111697s) [upload=20856]: Uploading segments... Aug 8 05:48:17.691802789 (20h8m17.281147776s) [upload=20856]: Got next segment. Inline: true Aug 8 05:48:17.691807738 (20h8m17.281152725s) [upload=20856]: Waiting for error group managing segments... Aug 8 05:48:17.691840431 (20h8m17.281185418s) [upload=20856]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:48:17.691844428 (20h8m17.281189415s) [upload=20856]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:48:17.691846712 (20h8m17.281191699s) [upload=20856]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:48:17.965025328 (20h8m17.554370315s) [upload=20856]: Done uploading segments... Aug 8 05:48:17.965043924 (20h8m17.554388911s) [upload=20856]: Upload finished. err: <nil> Aug 8 05:48:48.116229309 (20h8m47.705574296s) [upload=20866]: Starting upload Aug 8 05:48:48.116275538 (20h8m47.705620525s) [upload=20866]: Done starting upload Aug 8 05:48:48.116329812 (20h8m47.705674789s) [upload=20866]: Uploading segments... Aug 8 05:48:48.116361262 (20h8m47.705706249s) [upload=20866]: Got next segment. Inline: true Aug 8 05:48:48.116364939 (20h8m47.705709926s) [upload=20866]: Waiting for error group managing segments... Aug 8 05:48:48.116397010 (20h8m47.705741997s) [upload=20866]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:48:48.116400528 (20h8m47.705745505s) [upload=20866]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:48:48.116402822 (20h8m47.705747809s) [upload=20866]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:48:48.385497422 (20h8m47.974842409s) [upload=20866]: Done uploading segments... Aug 8 05:48:48.385516399 (20h8m47.974861386s) [upload=20866]: Upload finished. err: <nil> Aug 8 05:49:03.413885916 (20h9m3.003230903s) [upload=20875]: Starting upload Aug 8 05:49:03.413943406 (20h9m3.003288393s) [upload=20875]: Done starting upload Aug 8 05:49:03.413992931 (20h9m3.003337918s) [upload=20875]: Uploading segments... Aug 8 05:49:03.414026846 (20h9m3.003371833s) [upload=20875]: Got next segment. Inline: true Aug 8 05:49:03.414030522 (20h9m3.003375509s) [upload=20875]: Waiting for error group managing segments... Aug 8 05:49:03.414064968 (20h9m3.003409955s) [upload=20875]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:49:03.414068956 (20h9m3.003413933s) [upload=20875]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:49:03.414071261 (20h9m3.003416248s) [upload=20875]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:49:03.687532396 (20h9m3.276877383s) [upload=20875]: Done uploading segments... Aug 8 05:49:03.687559157 (20h9m3.276904194s) [upload=20875]: Upload finished. err: <nil> Aug 8 05:50:11.620858006 (20h10m11.210202993s) [upload=20891]: Starting upload Aug 8 05:50:11.620940003 (20h10m11.21028505s) [upload=20891]: Done starting upload Aug 8 05:50:11.621045826 (20h10m11.210390813s) [upload=20891]: Uploading segments... Aug 8 05:50:11.621132682 (20h10m11.210477659s) [upload=20891]: Got next segment. Inline: true Aug 8 05:50:11.621137571 (20h10m11.210482548s) [upload=20891]: Waiting for error group managing segments... Aug 8 05:50:11.621215971 (20h10m11.210560968s) [upload=20891]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:50:11.621224186 (20h10m11.210569214s) [upload=20891]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:50:11.621227904 (20h10m11.210572891s) [upload=20891]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:50:11.902419833 (20h10m11.49176482s) [upload=20891]: Done uploading segments... Aug 8 05:50:11.902443819 (20h10m11.491788826s) [upload=20891]: Upload finished. err: <nil> Aug 8 05:50:43.301715332 (20h10m42.891060319s) [upload=20904]: Starting upload Aug 8 05:50:43.301764246 (20h10m42.891109223s) [upload=20904]: Done starting upload Aug 8 05:50:43.301849319 (20h10m42.891194306s) [upload=20904]: Uploading segments... Aug 8 05:50:43.301881360 (20h10m42.891226347s) [upload=20904]: Got next segment. Inline: true Aug 8 05:50:43.301884586 (20h10m42.891229573s) [upload=20904]: Waiting for error group managing segments... Aug 8 05:50:43.301917438 (20h10m42.891262425s) [upload=20904]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:50:43.301921266 (20h10m42.891266253s) [upload=20904]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:50:43.301923800 (20h10m42.891268787s) [upload=20904]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:50:43.581330942 (20h10m43.170675929s) [upload=20904]: Done uploading segments... Aug 8 05:50:43.581348606 (20h10m43.170693594s) [upload=20904]: Upload finished. err: <nil> Aug 8 05:51:48.829995842 (20h11m48.419340859s) [upload=20917]: Starting upload Aug 8 05:51:48.830078530 (20h11m48.419423537s) [upload=20917]: Done starting upload Aug 8 05:51:48.830166959 (20h11m48.419511966s) [upload=20917]: Uploading segments... Aug 8 05:51:48.830198750 (20h11m48.419543727s) [upload=20917]: Got next segment. Inline: true Aug 8 05:51:48.830203038 (20h11m48.419548025s) [upload=20917]: Waiting for error group managing segments... Aug 8 05:51:48.830253845 (20h11m48.419598832s) [upload=20917]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:51:48.830263293 (20h11m48.41960828s) [upload=20917]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:51:48.830267131 (20h11m48.419612118s) [upload=20917]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:51:49.104016229 (20h11m48.693361216s) [upload=20917]: Done uploading segments... Aug 8 05:51:49.104034853 (20h11m48.693379831s) [upload=20917]: Upload finished. err: <nil> Aug 8 05:52:06.425779511 (20h12m6.015124498s) [upload=20924]: Starting upload Aug 8 05:52:06.426077070 (20h12m6.015422047s) [upload=20924]: Done starting upload Aug 8 05:52:06.426405829 (20h12m6.015750816s) [upload=20924]: Uploading segments... Aug 8 05:52:06.426449272 (20h12m6.015794259s) [upload=20924]: Got next segment. Inline: true Aug 8 05:52:06.426453941 (20h12m6.015798928s) [upload=20924]: Waiting for error group managing segments... Aug 8 05:52:06.426502244 (20h12m6.015847231s) [upload=20924]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:52:06.426507774 (20h12m6.015852761s) [upload=20924]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:52:06.426510529 (20h12m6.015855506s) [upload=20924]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:52:12.513554098 (20h12m12.102899085s) [upload=20924]: Done uploading segments... Aug 8 05:52:12.513577011 (20h12m12.102921998s) [upload=20924]: Upload finished. err: <nil> Duration: 1.796751352s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.......XX...............X.X.......................X.........] duration: 5.534242116s FAIL (2025-08-08 05:58:34 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== ad finished. err: <nil> Aug 8 05:50:40.893567535 (20h10m40.482912522s) [upload=20903]: Starting upload Aug 8 05:50:40.893617581 (20h10m40.482962568s) [upload=20903]: Done starting upload Aug 8 05:50:40.893745836 (20h10m40.483090823s) [upload=20903]: Uploading segments... Aug 8 05:50:40.893860175 (20h10m40.483205162s) [upload=20903]: Got next segment. Inline: false Aug 8 05:50:40.893898729 (20h10m40.483243706s) [upload=20903]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:50:40.893904339 (20h10m40.483249326s) [upload=20903]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:50:41.341218008 (20h10m40.930562995s) [seg_pos={0 0}, upload=20903]: Begin upload segment... Aug 8 05:50:41.341265508 (20h10m40.930610495s) [seg_pos={0 0}, upload=20903]: Done begin upload segment. Aug 8 05:50:41.341287290 (20h10m40.930632267s) [noise=true , address=104.36.82.37:4657 , piece_id=6G2JI22ZFKN72YYNJZ4Q3PK4ODRBF4QOK5OH3XNI245MOEV4INRA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341358447 (20h10m40.930703434s) [noise=true , address=64.49.13.155:4916 , piece_id=R4EDGKGU5O3XMIEDBT3P3YDZ6M5NDSW627JISIFRRYM3YFY7OJ7A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341670363 (20h10m40.93101535s) [noise=true , address=104.36.82.44:4873 , piece_id=OGMZZTN6R646OCIKFIN2ARH7HBXIYI4RG3RHOVEFGTGOS6EFLPFA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341830500 (20h10m40.931175487s) [noise=true , address=193.149.164.143:4696 , piece_id=FNRXKJGRXG64FVEF7U6WLJT56RBHEONLJF5FM3K7ZRBCQVBL3VFQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341990977 (20h10m40.931335954s) [noise=true , address=104.36.82.39:4735 , piece_id=VYEESGWFD57OTLITJU27YFV3IKI34JW7GANQ2U34PV6WAGMPEFXQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342205478 (20h10m40.931550465s) [noise=true , address=104.36.82.60:4348 , piece_id=DSQCOTEIOHDKJSUZYR7RQGXLT6A3FQNPBHZ36UKT3G56PNEWBKZA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342313615 (20h10m40.931658602s) [noise=true , address=104.36.82.36:4633 , piece_id=N6ZYWVZ7CODZ3SWA3T2KL6HWOPISACLE6YNECGDNL6S6NHP6TYZA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342583129 (20h10m40.931928117s) [noise=true , address=104.36.82.47:4529 , piece_id=UESMFD5UVKCQ4F5XKAG6OMNTA4BS6QV2BME5E7DMIJP7XWHJHT6A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342596976 (20h10m40.931941953s) [noise=true , address=104.36.82.61:4406 , piece_id=WQCH472JAJNEAGQGOF5LYU6RAUICVUOFXDTJC52NWFCEU43YTHEA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342935484 (20h10m40.932280471s) [noise=true , address=104.36.82.44:4881 , piece_id=JQKJCCUHCJSWLBDF5G5IEP2HAQJXH3FA6H7X4RNUH342SM6CNB5A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342953539 (20h10m40.932298526s) [noise=true , address=45.91.116.10:4092 , piece_id=FDHA5FCWTAFZ5N6AJA254W7QKGN3RGCGT7ZGWBIGLTI65DEIG4ZQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343204499 (20h10m40.932549486s) [noise=true , address=104.36.82.13:4202 , piece_id=GNTUDR6M4TV66KTCUMQKC33ESLZAQP4WK3PWS5CDQN5M6FE4ALQQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343223045 (20h10m40.932568032s) [noise=true , address=64.49.13.138:4481 , piece_id=HDNKCDGYH2LAFM2DRIW364W5XRSKF5XK7YZI47ATAAC5A6EBTOUQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343469105 (20h10m40.932814092s) [noise=true , address=64.49.13.140:4509 , piece_id=52T2SWYDXGGJ2IGMUAX5DJQZUFAQUHQTBW4NFC27RQQFLERI2EBQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343567834 (20h10m40.932912821s) [noise=true , address=104.36.82.23:4460 , piece_id=GKYZZOHC5J2FV2PWHI4IVTZV7FMVP2OFSJ2UOF24W5USG734RH7Q, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343687393 (20h10m40.93303237s) [noise=true , address=104.36.82.58:4273 , piece_id=WGPLZNLVUSYYJF7FJSBWAKRZ4LDAXSGBVWSTFRJ3KPBJIXOFSDGQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.344008046 (20h10m40.933353033s) [noise=true , address=104.36.82.43:4868 , piece_id=BM2WYHNTNNQAZHBSITN3ZIACMJLHLO6QACEZFCLYHODB4FYVYHNA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.345979839 (20h10m40.935324816s) [noise=true , address=104.36.82.20:4457 , piece_id=COVFTVTMO3DGUFVMZH633Q7RMZQRV7P2SRYOVJ2JZFP7RY5N7RHA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:42.438670912 (20h10m42.028015899s) [upload=20903]: Next returned nil segment Aug 8 05:50:42.438688716 (20h10m42.028033703s) [upload=20903]: Waiting for error group managing segments... Aug 8 05:50:42.778812377 (20h10m42.368157364s) [noise=true , address=193.149.164.143:4696 , piece_id=FNRXKJGRXG64FVEF7U6WLJT56RBHEONLJF5FM3K7ZRBCQVBL3VFQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.793688260 (20h10m42.383033237s) [noise=true , address=64.49.13.140:4509 , piece_id=52T2SWYDXGGJ2IGMUAX5DJQZUFAQUHQTBW4NFC27RQQFLERI2EBQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.814603478 (20h10m42.403948465s) [noise=true , address=64.49.13.155:4916 , piece_id=R4EDGKGU5O3XMIEDBT3P3YDZ6M5NDSW627JISIFRRYM3YFY7OJ7A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.846619684 (20h10m42.435964671s) [noise=true , address=64.49.13.138:4481 , piece_id=HDNKCDGYH2LAFM2DRIW364W5XRSKF5XK7YZI47ATAAC5A6EBTOUQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.248617890 (20h10m42.837962877s) [noise=true , address=104.36.82.47:4529 , piece_id=UESMFD5UVKCQ4F5XKAG6OMNTA4BS6QV2BME5E7DMIJP7XWHJHT6A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.252848605 (20h10m42.842193592s) [noise=true , address=104.36.82.39:4735 , piece_id=VYEESGWFD57OTLITJU27YFV3IKI34JW7GANQ2U34PV6WAGMPEFXQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.255650606 (20h10m42.844995593s) [noise=true , address=104.36.82.61:4406 , piece_id=WQCH472JAJNEAGQGOF5LYU6RAUICVUOFXDTJC52NWFCEU43YTHEA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.261140931 (20h10m42.850485918s) [noise=true , address=104.36.82.23:4460 , piece_id=GKYZZOHC5J2FV2PWHI4IVTZV7FMVP2OFSJ2UOF24W5USG734RH7Q, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.269129284 (20h10m42.858474261s) [noise=true , address=104.36.82.58:4273 , piece_id=WGPLZNLVUSYYJF7FJSBWAKRZ4LDAXSGBVWSTFRJ3KPBJIXOFSDGQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.274156393 (20h10m42.86350137s) [noise=true , address=104.36.82.43:4868 , piece_id=BM2WYHNTNNQAZHBSITN3ZIACMJLHLO6QACEZFCLYHODB4FYVYHNA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.313273526 (20h10m42.902618513s) [noise=true , address=45.91.116.10:4092 , piece_id=FDHA5FCWTAFZ5N6AJA254W7QKGN3RGCGT7ZGWBIGLTI65DEIG4ZQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.330724515 (20h10m42.920069502s) [noise=true , address=104.36.82.44:4881 , piece_id=JQKJCCUHCJSWLBDF5G5IEP2HAQJXH3FA6H7X4RNUH342SM6CNB5A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345245168 (20h10m42.934590155s) [noise=true , address=104.36.82.20:4457 , piece_id=COVFTVTMO3DGUFVMZH633Q7RMZQRV7P2SRYOVJ2JZFP7RY5N7RHA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345588405 (20h10m42.934933392s) [noise=true , address=104.36.82.60:4348 , piece_id=DSQCOTEIOHDKJSUZYR7RQGXLT6A3FQNPBHZ36UKT3G56PNEWBKZA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345621758 (20h10m42.934966745s) [seg_pos={0 0}, upload=20903]: Segment reached optimal threshold of 14 pieces. Aug 8 05:50:43.345774391 (20h10m42.935119378s) [noise=true , address=104.36.82.13:4202 , piece_id=GNTUDR6M4TV66KTCUMQKC33ESLZAQP4WK3PWS5CDQN5M6FE4ALQQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18wf5KnaR6WaR7MJivJkMJ7FejbuR6KnyvtRQgazNKfDb8fbsH): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345829917 (20h10m42.935174914s) [noise=true , address=104.36.82.36:4633 , piece_id=N6ZYWVZ7CODZ3SWA3T2KL6HWOPISACLE6YNECGDNL6S6NHP6TYZA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345878609 (20h10m42.935223607s) [noise=true , address=104.36.82.44:4873 , piece_id=OGMZZTN6R646OCIKFIN2ARH7HBXIYI4RG3RHOVEFGTGOS6EFLPFA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b5GdYtmYz9D1QW2z78W3Z2fWvMJGtrvrMJ1njbcqbtCDUdwHo): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345924307 (20h10m42.935269294s) [noise=true , address=104.36.82.37:4657 , piece_id=6G2JI22ZFKN72YYNJZ4Q3PK4ODRBF4QOK5OH3XNI245MOEV4INRA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345954214 (20h10m42.935299282s) [seg_pos={0 0}, upload=20903]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:50:43.346042142 (20h10m42.93538716s) [upload=20903]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:50:43.346050880 (20h10m42.935395897s) [upload=20903]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:50:43.643950132 (20h10m43.233295119s) [upload=20903]: Done uploading segments... Aug 8 05:50:43.643971202 (20h10m43.233316189s) [upload=20903]: Upload finished. err: <nil> Duration: 5.534267635s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [........XX...............X.X.......................X........] duration: 5.694178594s FAIL (2025-08-08 05:58:04 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== ad finished. err: <nil> Aug 8 05:50:40.893567535 (20h10m40.482912522s) [upload=20903]: Starting upload Aug 8 05:50:40.893617581 (20h10m40.482962568s) [upload=20903]: Done starting upload Aug 8 05:50:40.893745836 (20h10m40.483090823s) [upload=20903]: Uploading segments... Aug 8 05:50:40.893860175 (20h10m40.483205162s) [upload=20903]: Got next segment. Inline: false Aug 8 05:50:40.893898729 (20h10m40.483243706s) [upload=20903]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:50:40.893904339 (20h10m40.483249326s) [upload=20903]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:50:41.341218008 (20h10m40.930562995s) [seg_pos={0 0}, upload=20903]: Begin upload segment... Aug 8 05:50:41.341265508 (20h10m40.930610495s) [seg_pos={0 0}, upload=20903]: Done begin upload segment. Aug 8 05:50:41.341287290 (20h10m40.930632267s) [noise=true , address=104.36.82.37:4657 , piece_id=6G2JI22ZFKN72YYNJZ4Q3PK4ODRBF4QOK5OH3XNI245MOEV4INRA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341358447 (20h10m40.930703434s) [noise=true , address=64.49.13.155:4916 , piece_id=R4EDGKGU5O3XMIEDBT3P3YDZ6M5NDSW627JISIFRRYM3YFY7OJ7A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341670363 (20h10m40.93101535s) [noise=true , address=104.36.82.44:4873 , piece_id=OGMZZTN6R646OCIKFIN2ARH7HBXIYI4RG3RHOVEFGTGOS6EFLPFA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341830500 (20h10m40.931175487s) [noise=true , address=193.149.164.143:4696 , piece_id=FNRXKJGRXG64FVEF7U6WLJT56RBHEONLJF5FM3K7ZRBCQVBL3VFQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341990977 (20h10m40.931335954s) [noise=true , address=104.36.82.39:4735 , piece_id=VYEESGWFD57OTLITJU27YFV3IKI34JW7GANQ2U34PV6WAGMPEFXQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342205478 (20h10m40.931550465s) [noise=true , address=104.36.82.60:4348 , piece_id=DSQCOTEIOHDKJSUZYR7RQGXLT6A3FQNPBHZ36UKT3G56PNEWBKZA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342313615 (20h10m40.931658602s) [noise=true , address=104.36.82.36:4633 , piece_id=N6ZYWVZ7CODZ3SWA3T2KL6HWOPISACLE6YNECGDNL6S6NHP6TYZA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342583129 (20h10m40.931928117s) [noise=true , address=104.36.82.47:4529 , piece_id=UESMFD5UVKCQ4F5XKAG6OMNTA4BS6QV2BME5E7DMIJP7XWHJHT6A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342596976 (20h10m40.931941953s) [noise=true , address=104.36.82.61:4406 , piece_id=WQCH472JAJNEAGQGOF5LYU6RAUICVUOFXDTJC52NWFCEU43YTHEA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342935484 (20h10m40.932280471s) [noise=true , address=104.36.82.44:4881 , piece_id=JQKJCCUHCJSWLBDF5G5IEP2HAQJXH3FA6H7X4RNUH342SM6CNB5A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342953539 (20h10m40.932298526s) [noise=true , address=45.91.116.10:4092 , piece_id=FDHA5FCWTAFZ5N6AJA254W7QKGN3RGCGT7ZGWBIGLTI65DEIG4ZQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343204499 (20h10m40.932549486s) [noise=true , address=104.36.82.13:4202 , piece_id=GNTUDR6M4TV66KTCUMQKC33ESLZAQP4WK3PWS5CDQN5M6FE4ALQQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343223045 (20h10m40.932568032s) [noise=true , address=64.49.13.138:4481 , piece_id=HDNKCDGYH2LAFM2DRIW364W5XRSKF5XK7YZI47ATAAC5A6EBTOUQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343469105 (20h10m40.932814092s) [noise=true , address=64.49.13.140:4509 , piece_id=52T2SWYDXGGJ2IGMUAX5DJQZUFAQUHQTBW4NFC27RQQFLERI2EBQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343567834 (20h10m40.932912821s) [noise=true , address=104.36.82.23:4460 , piece_id=GKYZZOHC5J2FV2PWHI4IVTZV7FMVP2OFSJ2UOF24W5USG734RH7Q, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343687393 (20h10m40.93303237s) [noise=true , address=104.36.82.58:4273 , piece_id=WGPLZNLVUSYYJF7FJSBWAKRZ4LDAXSGBVWSTFRJ3KPBJIXOFSDGQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.344008046 (20h10m40.933353033s) [noise=true , address=104.36.82.43:4868 , piece_id=BM2WYHNTNNQAZHBSITN3ZIACMJLHLO6QACEZFCLYHODB4FYVYHNA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.345979839 (20h10m40.935324816s) [noise=true , address=104.36.82.20:4457 , piece_id=COVFTVTMO3DGUFVMZH633Q7RMZQRV7P2SRYOVJ2JZFP7RY5N7RHA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:42.438670912 (20h10m42.028015899s) [upload=20903]: Next returned nil segment Aug 8 05:50:42.438688716 (20h10m42.028033703s) [upload=20903]: Waiting for error group managing segments... Aug 8 05:50:42.778812377 (20h10m42.368157364s) [noise=true , address=193.149.164.143:4696 , piece_id=FNRXKJGRXG64FVEF7U6WLJT56RBHEONLJF5FM3K7ZRBCQVBL3VFQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.793688260 (20h10m42.383033237s) [noise=true , address=64.49.13.140:4509 , piece_id=52T2SWYDXGGJ2IGMUAX5DJQZUFAQUHQTBW4NFC27RQQFLERI2EBQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.814603478 (20h10m42.403948465s) [noise=true , address=64.49.13.155:4916 , piece_id=R4EDGKGU5O3XMIEDBT3P3YDZ6M5NDSW627JISIFRRYM3YFY7OJ7A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.846619684 (20h10m42.435964671s) [noise=true , address=64.49.13.138:4481 , piece_id=HDNKCDGYH2LAFM2DRIW364W5XRSKF5XK7YZI47ATAAC5A6EBTOUQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.248617890 (20h10m42.837962877s) [noise=true , address=104.36.82.47:4529 , piece_id=UESMFD5UVKCQ4F5XKAG6OMNTA4BS6QV2BME5E7DMIJP7XWHJHT6A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.252848605 (20h10m42.842193592s) [noise=true , address=104.36.82.39:4735 , piece_id=VYEESGWFD57OTLITJU27YFV3IKI34JW7GANQ2U34PV6WAGMPEFXQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.255650606 (20h10m42.844995593s) [noise=true , address=104.36.82.61:4406 , piece_id=WQCH472JAJNEAGQGOF5LYU6RAUICVUOFXDTJC52NWFCEU43YTHEA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.261140931 (20h10m42.850485918s) [noise=true , address=104.36.82.23:4460 , piece_id=GKYZZOHC5J2FV2PWHI4IVTZV7FMVP2OFSJ2UOF24W5USG734RH7Q, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.269129284 (20h10m42.858474261s) [noise=true , address=104.36.82.58:4273 , piece_id=WGPLZNLVUSYYJF7FJSBWAKRZ4LDAXSGBVWSTFRJ3KPBJIXOFSDGQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.274156393 (20h10m42.86350137s) [noise=true , address=104.36.82.43:4868 , piece_id=BM2WYHNTNNQAZHBSITN3ZIACMJLHLO6QACEZFCLYHODB4FYVYHNA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.313273526 (20h10m42.902618513s) [noise=true , address=45.91.116.10:4092 , piece_id=FDHA5FCWTAFZ5N6AJA254W7QKGN3RGCGT7ZGWBIGLTI65DEIG4ZQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.330724515 (20h10m42.920069502s) [noise=true , address=104.36.82.44:4881 , piece_id=JQKJCCUHCJSWLBDF5G5IEP2HAQJXH3FA6H7X4RNUH342SM6CNB5A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345245168 (20h10m42.934590155s) [noise=true , address=104.36.82.20:4457 , piece_id=COVFTVTMO3DGUFVMZH633Q7RMZQRV7P2SRYOVJ2JZFP7RY5N7RHA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345588405 (20h10m42.934933392s) [noise=true , address=104.36.82.60:4348 , piece_id=DSQCOTEIOHDKJSUZYR7RQGXLT6A3FQNPBHZ36UKT3G56PNEWBKZA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345621758 (20h10m42.934966745s) [seg_pos={0 0}, upload=20903]: Segment reached optimal threshold of 14 pieces. Aug 8 05:50:43.345774391 (20h10m42.935119378s) [noise=true , address=104.36.82.13:4202 , piece_id=GNTUDR6M4TV66KTCUMQKC33ESLZAQP4WK3PWS5CDQN5M6FE4ALQQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18wf5KnaR6WaR7MJivJkMJ7FejbuR6KnyvtRQgazNKfDb8fbsH): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345829917 (20h10m42.935174914s) [noise=true , address=104.36.82.36:4633 , piece_id=N6ZYWVZ7CODZ3SWA3T2KL6HWOPISACLE6YNECGDNL6S6NHP6TYZA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345878609 (20h10m42.935223607s) [noise=true , address=104.36.82.44:4873 , piece_id=OGMZZTN6R646OCIKFIN2ARH7HBXIYI4RG3RHOVEFGTGOS6EFLPFA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b5GdYtmYz9D1QW2z78W3Z2fWvMJGtrvrMJ1njbcqbtCDUdwHo): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345924307 (20h10m42.935269294s) [noise=true , address=104.36.82.37:4657 , piece_id=6G2JI22ZFKN72YYNJZ4Q3PK4ODRBF4QOK5OH3XNI245MOEV4INRA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345954214 (20h10m42.935299282s) [seg_pos={0 0}, upload=20903]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:50:43.346042142 (20h10m42.93538716s) [upload=20903]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:50:43.346050880 (20h10m42.935395897s) [upload=20903]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:50:43.643950132 (20h10m43.233295119s) [upload=20903]: Done uploading segments... Aug 8 05:50:43.643971202 (20h10m43.233316189s) [upload=20903]: Upload finished. err: <nil> Duration: 5.694196567s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 5.86618579s FAIL (2025-08-08 05:57:57 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.866210678s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [...............X...X..........X......X.............X........] duration: 1.85363742s FAIL (2025-08-08 05:57:46 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== _ObjectCommit Aug 8 05:45:35.317184488 (20h5m34.906529475s) [upload=20811]: Done uploading segments... Aug 8 05:45:35.317202442 (20h5m34.906547429s) [upload=20811]: Upload finished. err: <nil> Aug 8 05:46:01.441656651 (20h6m1.031001648s) [upload=20820]: Starting upload Aug 8 05:46:01.441723649 (20h6m1.031068636s) [upload=20820]: Done starting upload Aug 8 05:46:01.441780508 (20h6m1.031125495s) [upload=20820]: Uploading segments... Aug 8 05:46:01.441873716 (20h6m1.031218703s) [upload=20820]: Got next segment. Inline: true Aug 8 05:46:01.441879027 (20h6m1.031224024s) [upload=20820]: Waiting for error group managing segments... Aug 8 05:46:01.441920596 (20h6m1.031265583s) [upload=20820]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:46:01.441926427 (20h6m1.031271414s) [upload=20820]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:46:01.441929072 (20h6m1.031274069s) [upload=20820]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:46:01.715339951 (20h6m1.304684948s) [upload=20820]: Done uploading segments... Aug 8 05:46:01.715363486 (20h6m1.304708483s) [upload=20820]: Upload finished. err: <nil> Aug 8 05:46:30.814289733 (20h6m30.40363472s) [upload=20825]: Starting upload Aug 8 05:46:30.814402789 (20h6m30.403747776s) [upload=20825]: Done starting upload Aug 8 05:46:30.814469807 (20h6m30.403814794s) [upload=20825]: Uploading segments... Aug 8 05:46:30.814503302 (20h6m30.403848289s) [upload=20825]: Got next segment. Inline: true Aug 8 05:46:30.814507149 (20h6m30.403852136s) [upload=20825]: Waiting for error group managing segments... Aug 8 05:46:30.814539130 (20h6m30.403884117s) [upload=20825]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:46:30.814543147 (20h6m30.403888134s) [upload=20825]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:46:30.814545893 (20h6m30.40389088s) [upload=20825]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:46:31.079785599 (20h6m30.669130586s) [upload=20825]: Done uploading segments... Aug 8 05:46:31.079802632 (20h6m30.669147619s) [upload=20825]: Upload finished. err: <nil> Aug 8 05:47:12.882345463 (20h7m12.47169044s) [upload=20838]: Starting upload Aug 8 05:47:12.882381172 (20h7m12.471726179s) [upload=20838]: Done starting upload Aug 8 05:47:12.882425195 (20h7m12.471770182s) [upload=20838]: Uploading segments... Aug 8 05:47:12.882453229 (20h7m12.471798216s) [upload=20838]: Got next segment. Inline: true Aug 8 05:47:12.882456685 (20h7m12.471801672s) [upload=20838]: Waiting for error group managing segments... Aug 8 05:47:12.882487545 (20h7m12.471832532s) [upload=20838]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:47:12.882491432 (20h7m12.47183642s) [upload=20838]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:47:12.882494017 (20h7m12.471838994s) [upload=20838]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:47:13.318462618 (20h7m12.907807606s) [upload=20838]: Done uploading segments... Aug 8 05:47:13.318481204 (20h7m12.907826191s) [upload=20838]: Upload finished. err: <nil> Aug 8 05:48:17.691657531 (20h8m17.281002518s) [upload=20856]: Starting upload Aug 8 05:48:17.691709179 (20h8m17.281054166s) [upload=20856]: Done starting upload Aug 8 05:48:17.691766710 (20h8m17.281111697s) [upload=20856]: Uploading segments... Aug 8 05:48:17.691802789 (20h8m17.281147776s) [upload=20856]: Got next segment. Inline: true Aug 8 05:48:17.691807738 (20h8m17.281152725s) [upload=20856]: Waiting for error group managing segments... Aug 8 05:48:17.691840431 (20h8m17.281185418s) [upload=20856]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:48:17.691844428 (20h8m17.281189415s) [upload=20856]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:48:17.691846712 (20h8m17.281191699s) [upload=20856]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:48:17.965025328 (20h8m17.554370315s) [upload=20856]: Done uploading segments... Aug 8 05:48:17.965043924 (20h8m17.554388911s) [upload=20856]: Upload finished. err: <nil> Aug 8 05:48:48.116229309 (20h8m47.705574296s) [upload=20866]: Starting upload Aug 8 05:48:48.116275538 (20h8m47.705620525s) [upload=20866]: Done starting upload Aug 8 05:48:48.116329812 (20h8m47.705674789s) [upload=20866]: Uploading segments... Aug 8 05:48:48.116361262 (20h8m47.705706249s) [upload=20866]: Got next segment. Inline: true Aug 8 05:48:48.116364939 (20h8m47.705709926s) [upload=20866]: Waiting for error group managing segments... Aug 8 05:48:48.116397010 (20h8m47.705741997s) [upload=20866]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:48:48.116400528 (20h8m47.705745505s) [upload=20866]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:48:48.116402822 (20h8m47.705747809s) [upload=20866]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:48:48.385497422 (20h8m47.974842409s) [upload=20866]: Done uploading segments... Aug 8 05:48:48.385516399 (20h8m47.974861386s) [upload=20866]: Upload finished. err: <nil> Aug 8 05:49:03.413885916 (20h9m3.003230903s) [upload=20875]: Starting upload Aug 8 05:49:03.413943406 (20h9m3.003288393s) [upload=20875]: Done starting upload Aug 8 05:49:03.413992931 (20h9m3.003337918s) [upload=20875]: Uploading segments... Aug 8 05:49:03.414026846 (20h9m3.003371833s) [upload=20875]: Got next segment. Inline: true Aug 8 05:49:03.414030522 (20h9m3.003375509s) [upload=20875]: Waiting for error group managing segments... Aug 8 05:49:03.414064968 (20h9m3.003409955s) [upload=20875]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:49:03.414068956 (20h9m3.003413933s) [upload=20875]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:49:03.414071261 (20h9m3.003416248s) [upload=20875]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:49:03.687532396 (20h9m3.276877383s) [upload=20875]: Done uploading segments... Aug 8 05:49:03.687559157 (20h9m3.276904194s) [upload=20875]: Upload finished. err: <nil> Aug 8 05:50:11.620858006 (20h10m11.210202993s) [upload=20891]: Starting upload Aug 8 05:50:11.620940003 (20h10m11.21028505s) [upload=20891]: Done starting upload Aug 8 05:50:11.621045826 (20h10m11.210390813s) [upload=20891]: Uploading segments... Aug 8 05:50:11.621132682 (20h10m11.210477659s) [upload=20891]: Got next segment. Inline: true Aug 8 05:50:11.621137571 (20h10m11.210482548s) [upload=20891]: Waiting for error group managing segments... Aug 8 05:50:11.621215971 (20h10m11.210560968s) [upload=20891]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:50:11.621224186 (20h10m11.210569214s) [upload=20891]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:50:11.621227904 (20h10m11.210572891s) [upload=20891]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:50:11.902419833 (20h10m11.49176482s) [upload=20891]: Done uploading segments... Aug 8 05:50:11.902443819 (20h10m11.491788826s) [upload=20891]: Upload finished. err: <nil> Aug 8 05:50:43.301715332 (20h10m42.891060319s) [upload=20904]: Starting upload Aug 8 05:50:43.301764246 (20h10m42.891109223s) [upload=20904]: Done starting upload Aug 8 05:50:43.301849319 (20h10m42.891194306s) [upload=20904]: Uploading segments... Aug 8 05:50:43.301881360 (20h10m42.891226347s) [upload=20904]: Got next segment. Inline: true Aug 8 05:50:43.301884586 (20h10m42.891229573s) [upload=20904]: Waiting for error group managing segments... Aug 8 05:50:43.301917438 (20h10m42.891262425s) [upload=20904]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:50:43.301921266 (20h10m42.891266253s) [upload=20904]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:50:43.301923800 (20h10m42.891268787s) [upload=20904]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:50:43.581330942 (20h10m43.170675929s) [upload=20904]: Done uploading segments... Aug 8 05:50:43.581348606 (20h10m43.170693594s) [upload=20904]: Upload finished. err: <nil> Aug 8 05:51:48.829995842 (20h11m48.419340859s) [upload=20917]: Starting upload Aug 8 05:51:48.830078530 (20h11m48.419423537s) [upload=20917]: Done starting upload Aug 8 05:51:48.830166959 (20h11m48.419511966s) [upload=20917]: Uploading segments... Aug 8 05:51:48.830198750 (20h11m48.419543727s) [upload=20917]: Got next segment. Inline: true Aug 8 05:51:48.830203038 (20h11m48.419548025s) [upload=20917]: Waiting for error group managing segments... Aug 8 05:51:48.830253845 (20h11m48.419598832s) [upload=20917]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:51:48.830263293 (20h11m48.41960828s) [upload=20917]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:51:48.830267131 (20h11m48.419612118s) [upload=20917]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:51:49.104016229 (20h11m48.693361216s) [upload=20917]: Done uploading segments... Aug 8 05:51:49.104034853 (20h11m48.693379831s) [upload=20917]: Upload finished. err: <nil> Aug 8 05:52:06.425779511 (20h12m6.015124498s) [upload=20924]: Starting upload Aug 8 05:52:06.426077070 (20h12m6.015422047s) [upload=20924]: Done starting upload Aug 8 05:52:06.426405829 (20h12m6.015750816s) [upload=20924]: Uploading segments... Aug 8 05:52:06.426449272 (20h12m6.015794259s) [upload=20924]: Got next segment. Inline: true Aug 8 05:52:06.426453941 (20h12m6.015798928s) [upload=20924]: Waiting for error group managing segments... Aug 8 05:52:06.426502244 (20h12m6.015847231s) [upload=20924]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:52:06.426507774 (20h12m6.015852761s) [upload=20924]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:52:06.426510529 (20h12m6.015855506s) [upload=20924]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:52:12.513554098 (20h12m12.102899085s) [upload=20924]: Done uploading segments... Aug 8 05:52:12.513577011 (20h12m12.102921998s) [upload=20924]: Upload finished. err: <nil> Duration: 1.853669072s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [X...............X...X..........X......X.............X.......] duration: 1.836247731s FAIL (2025-08-08 05:57:25 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== _ObjectCommit Aug 8 05:45:35.317184488 (20h5m34.906529475s) [upload=20811]: Done uploading segments... Aug 8 05:45:35.317202442 (20h5m34.906547429s) [upload=20811]: Upload finished. err: <nil> Aug 8 05:46:01.441656651 (20h6m1.031001648s) [upload=20820]: Starting upload Aug 8 05:46:01.441723649 (20h6m1.031068636s) [upload=20820]: Done starting upload Aug 8 05:46:01.441780508 (20h6m1.031125495s) [upload=20820]: Uploading segments... Aug 8 05:46:01.441873716 (20h6m1.031218703s) [upload=20820]: Got next segment. Inline: true Aug 8 05:46:01.441879027 (20h6m1.031224024s) [upload=20820]: Waiting for error group managing segments... Aug 8 05:46:01.441920596 (20h6m1.031265583s) [upload=20820]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:46:01.441926427 (20h6m1.031271414s) [upload=20820]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:46:01.441929072 (20h6m1.031274069s) [upload=20820]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:46:01.715339951 (20h6m1.304684948s) [upload=20820]: Done uploading segments... Aug 8 05:46:01.715363486 (20h6m1.304708483s) [upload=20820]: Upload finished. err: <nil> Aug 8 05:46:30.814289733 (20h6m30.40363472s) [upload=20825]: Starting upload Aug 8 05:46:30.814402789 (20h6m30.403747776s) [upload=20825]: Done starting upload Aug 8 05:46:30.814469807 (20h6m30.403814794s) [upload=20825]: Uploading segments... Aug 8 05:46:30.814503302 (20h6m30.403848289s) [upload=20825]: Got next segment. Inline: true Aug 8 05:46:30.814507149 (20h6m30.403852136s) [upload=20825]: Waiting for error group managing segments... Aug 8 05:46:30.814539130 (20h6m30.403884117s) [upload=20825]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:46:30.814543147 (20h6m30.403888134s) [upload=20825]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:46:30.814545893 (20h6m30.40389088s) [upload=20825]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:46:31.079785599 (20h6m30.669130586s) [upload=20825]: Done uploading segments... Aug 8 05:46:31.079802632 (20h6m30.669147619s) [upload=20825]: Upload finished. err: <nil> Aug 8 05:47:12.882345463 (20h7m12.47169044s) [upload=20838]: Starting upload Aug 8 05:47:12.882381172 (20h7m12.471726179s) [upload=20838]: Done starting upload Aug 8 05:47:12.882425195 (20h7m12.471770182s) [upload=20838]: Uploading segments... Aug 8 05:47:12.882453229 (20h7m12.471798216s) [upload=20838]: Got next segment. Inline: true Aug 8 05:47:12.882456685 (20h7m12.471801672s) [upload=20838]: Waiting for error group managing segments... Aug 8 05:47:12.882487545 (20h7m12.471832532s) [upload=20838]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:47:12.882491432 (20h7m12.47183642s) [upload=20838]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:47:12.882494017 (20h7m12.471838994s) [upload=20838]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:47:13.318462618 (20h7m12.907807606s) [upload=20838]: Done uploading segments... Aug 8 05:47:13.318481204 (20h7m12.907826191s) [upload=20838]: Upload finished. err: <nil> Aug 8 05:48:17.691657531 (20h8m17.281002518s) [upload=20856]: Starting upload Aug 8 05:48:17.691709179 (20h8m17.281054166s) [upload=20856]: Done starting upload Aug 8 05:48:17.691766710 (20h8m17.281111697s) [upload=20856]: Uploading segments... Aug 8 05:48:17.691802789 (20h8m17.281147776s) [upload=20856]: Got next segment. Inline: true Aug 8 05:48:17.691807738 (20h8m17.281152725s) [upload=20856]: Waiting for error group managing segments... Aug 8 05:48:17.691840431 (20h8m17.281185418s) [upload=20856]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:48:17.691844428 (20h8m17.281189415s) [upload=20856]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:48:17.691846712 (20h8m17.281191699s) [upload=20856]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:48:17.965025328 (20h8m17.554370315s) [upload=20856]: Done uploading segments... Aug 8 05:48:17.965043924 (20h8m17.554388911s) [upload=20856]: Upload finished. err: <nil> Aug 8 05:48:48.116229309 (20h8m47.705574296s) [upload=20866]: Starting upload Aug 8 05:48:48.116275538 (20h8m47.705620525s) [upload=20866]: Done starting upload Aug 8 05:48:48.116329812 (20h8m47.705674789s) [upload=20866]: Uploading segments... Aug 8 05:48:48.116361262 (20h8m47.705706249s) [upload=20866]: Got next segment. Inline: true Aug 8 05:48:48.116364939 (20h8m47.705709926s) [upload=20866]: Waiting for error group managing segments... Aug 8 05:48:48.116397010 (20h8m47.705741997s) [upload=20866]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:48:48.116400528 (20h8m47.705745505s) [upload=20866]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:48:48.116402822 (20h8m47.705747809s) [upload=20866]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:48:48.385497422 (20h8m47.974842409s) [upload=20866]: Done uploading segments... Aug 8 05:48:48.385516399 (20h8m47.974861386s) [upload=20866]: Upload finished. err: <nil> Aug 8 05:49:03.413885916 (20h9m3.003230903s) [upload=20875]: Starting upload Aug 8 05:49:03.413943406 (20h9m3.003288393s) [upload=20875]: Done starting upload Aug 8 05:49:03.413992931 (20h9m3.003337918s) [upload=20875]: Uploading segments... Aug 8 05:49:03.414026846 (20h9m3.003371833s) [upload=20875]: Got next segment. Inline: true Aug 8 05:49:03.414030522 (20h9m3.003375509s) [upload=20875]: Waiting for error group managing segments... Aug 8 05:49:03.414064968 (20h9m3.003409955s) [upload=20875]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:49:03.414068956 (20h9m3.003413933s) [upload=20875]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:49:03.414071261 (20h9m3.003416248s) [upload=20875]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:49:03.687532396 (20h9m3.276877383s) [upload=20875]: Done uploading segments... Aug 8 05:49:03.687559157 (20h9m3.276904194s) [upload=20875]: Upload finished. err: <nil> Aug 8 05:50:11.620858006 (20h10m11.210202993s) [upload=20891]: Starting upload Aug 8 05:50:11.620940003 (20h10m11.21028505s) [upload=20891]: Done starting upload Aug 8 05:50:11.621045826 (20h10m11.210390813s) [upload=20891]: Uploading segments... Aug 8 05:50:11.621132682 (20h10m11.210477659s) [upload=20891]: Got next segment. Inline: true Aug 8 05:50:11.621137571 (20h10m11.210482548s) [upload=20891]: Waiting for error group managing segments... Aug 8 05:50:11.621215971 (20h10m11.210560968s) [upload=20891]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:50:11.621224186 (20h10m11.210569214s) [upload=20891]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:50:11.621227904 (20h10m11.210572891s) [upload=20891]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:50:11.902419833 (20h10m11.49176482s) [upload=20891]: Done uploading segments... Aug 8 05:50:11.902443819 (20h10m11.491788826s) [upload=20891]: Upload finished. err: <nil> Aug 8 05:50:43.301715332 (20h10m42.891060319s) [upload=20904]: Starting upload Aug 8 05:50:43.301764246 (20h10m42.891109223s) [upload=20904]: Done starting upload Aug 8 05:50:43.301849319 (20h10m42.891194306s) [upload=20904]: Uploading segments... Aug 8 05:50:43.301881360 (20h10m42.891226347s) [upload=20904]: Got next segment. Inline: true Aug 8 05:50:43.301884586 (20h10m42.891229573s) [upload=20904]: Waiting for error group managing segments... Aug 8 05:50:43.301917438 (20h10m42.891262425s) [upload=20904]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:50:43.301921266 (20h10m42.891266253s) [upload=20904]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:50:43.301923800 (20h10m42.891268787s) [upload=20904]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:50:43.581330942 (20h10m43.170675929s) [upload=20904]: Done uploading segments... Aug 8 05:50:43.581348606 (20h10m43.170693594s) [upload=20904]: Upload finished. err: <nil> Aug 8 05:51:48.829995842 (20h11m48.419340859s) [upload=20917]: Starting upload Aug 8 05:51:48.830078530 (20h11m48.419423537s) [upload=20917]: Done starting upload Aug 8 05:51:48.830166959 (20h11m48.419511966s) [upload=20917]: Uploading segments... Aug 8 05:51:48.830198750 (20h11m48.419543727s) [upload=20917]: Got next segment. Inline: true Aug 8 05:51:48.830203038 (20h11m48.419548025s) [upload=20917]: Waiting for error group managing segments... Aug 8 05:51:48.830253845 (20h11m48.419598832s) [upload=20917]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:51:48.830263293 (20h11m48.41960828s) [upload=20917]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:51:48.830267131 (20h11m48.419612118s) [upload=20917]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:51:49.104016229 (20h11m48.693361216s) [upload=20917]: Done uploading segments... Aug 8 05:51:49.104034853 (20h11m48.693379831s) [upload=20917]: Upload finished. err: <nil> Aug 8 05:52:06.425779511 (20h12m6.015124498s) [upload=20924]: Starting upload Aug 8 05:52:06.426077070 (20h12m6.015422047s) [upload=20924]: Done starting upload Aug 8 05:52:06.426405829 (20h12m6.015750816s) [upload=20924]: Uploading segments... Aug 8 05:52:06.426449272 (20h12m6.015794259s) [upload=20924]: Got next segment. Inline: true Aug 8 05:52:06.426453941 (20h12m6.015798928s) [upload=20924]: Waiting for error group managing segments... Aug 8 05:52:06.426502244 (20h12m6.015847231s) [upload=20924]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:52:06.426507774 (20h12m6.015852761s) [upload=20924]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:52:06.426510529 (20h12m6.015855506s) [upload=20924]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:52:12.513554098 (20h12m12.102899085s) [upload=20924]: Done uploading segments... Aug 8 05:52:12.513577011 (20h12m12.102921998s) [upload=20924]: Upload finished. err: <nil> Duration: 1.836280062s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [.X...............X...X..........X......X.............X......] duration: 1.89097067s FAIL (2025-08-08 05:57:02 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== _ObjectCommit Aug 8 05:45:35.317184488 (20h5m34.906529475s) [upload=20811]: Done uploading segments... Aug 8 05:45:35.317202442 (20h5m34.906547429s) [upload=20811]: Upload finished. err: <nil> Aug 8 05:46:01.441656651 (20h6m1.031001648s) [upload=20820]: Starting upload Aug 8 05:46:01.441723649 (20h6m1.031068636s) [upload=20820]: Done starting upload Aug 8 05:46:01.441780508 (20h6m1.031125495s) [upload=20820]: Uploading segments... Aug 8 05:46:01.441873716 (20h6m1.031218703s) [upload=20820]: Got next segment. Inline: true Aug 8 05:46:01.441879027 (20h6m1.031224024s) [upload=20820]: Waiting for error group managing segments... Aug 8 05:46:01.441920596 (20h6m1.031265583s) [upload=20820]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:46:01.441926427 (20h6m1.031271414s) [upload=20820]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:46:01.441929072 (20h6m1.031274069s) [upload=20820]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:46:01.715339951 (20h6m1.304684948s) [upload=20820]: Done uploading segments... Aug 8 05:46:01.715363486 (20h6m1.304708483s) [upload=20820]: Upload finished. err: <nil> Aug 8 05:46:30.814289733 (20h6m30.40363472s) [upload=20825]: Starting upload Aug 8 05:46:30.814402789 (20h6m30.403747776s) [upload=20825]: Done starting upload Aug 8 05:46:30.814469807 (20h6m30.403814794s) [upload=20825]: Uploading segments... Aug 8 05:46:30.814503302 (20h6m30.403848289s) [upload=20825]: Got next segment. Inline: true Aug 8 05:46:30.814507149 (20h6m30.403852136s) [upload=20825]: Waiting for error group managing segments... Aug 8 05:46:30.814539130 (20h6m30.403884117s) [upload=20825]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:46:30.814543147 (20h6m30.403888134s) [upload=20825]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:46:30.814545893 (20h6m30.40389088s) [upload=20825]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:46:31.079785599 (20h6m30.669130586s) [upload=20825]: Done uploading segments... Aug 8 05:46:31.079802632 (20h6m30.669147619s) [upload=20825]: Upload finished. err: <nil> Aug 8 05:47:12.882345463 (20h7m12.47169044s) [upload=20838]: Starting upload Aug 8 05:47:12.882381172 (20h7m12.471726179s) [upload=20838]: Done starting upload Aug 8 05:47:12.882425195 (20h7m12.471770182s) [upload=20838]: Uploading segments... Aug 8 05:47:12.882453229 (20h7m12.471798216s) [upload=20838]: Got next segment. Inline: true Aug 8 05:47:12.882456685 (20h7m12.471801672s) [upload=20838]: Waiting for error group managing segments... Aug 8 05:47:12.882487545 (20h7m12.471832532s) [upload=20838]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:47:12.882491432 (20h7m12.47183642s) [upload=20838]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:47:12.882494017 (20h7m12.471838994s) [upload=20838]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:47:13.318462618 (20h7m12.907807606s) [upload=20838]: Done uploading segments... Aug 8 05:47:13.318481204 (20h7m12.907826191s) [upload=20838]: Upload finished. err: <nil> Aug 8 05:48:17.691657531 (20h8m17.281002518s) [upload=20856]: Starting upload Aug 8 05:48:17.691709179 (20h8m17.281054166s) [upload=20856]: Done starting upload Aug 8 05:48:17.691766710 (20h8m17.281111697s) [upload=20856]: Uploading segments... Aug 8 05:48:17.691802789 (20h8m17.281147776s) [upload=20856]: Got next segment. Inline: true Aug 8 05:48:17.691807738 (20h8m17.281152725s) [upload=20856]: Waiting for error group managing segments... Aug 8 05:48:17.691840431 (20h8m17.281185418s) [upload=20856]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:48:17.691844428 (20h8m17.281189415s) [upload=20856]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:48:17.691846712 (20h8m17.281191699s) [upload=20856]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:48:17.965025328 (20h8m17.554370315s) [upload=20856]: Done uploading segments... Aug 8 05:48:17.965043924 (20h8m17.554388911s) [upload=20856]: Upload finished. err: <nil> Aug 8 05:48:48.116229309 (20h8m47.705574296s) [upload=20866]: Starting upload Aug 8 05:48:48.116275538 (20h8m47.705620525s) [upload=20866]: Done starting upload Aug 8 05:48:48.116329812 (20h8m47.705674789s) [upload=20866]: Uploading segments... Aug 8 05:48:48.116361262 (20h8m47.705706249s) [upload=20866]: Got next segment. Inline: true Aug 8 05:48:48.116364939 (20h8m47.705709926s) [upload=20866]: Waiting for error group managing segments... Aug 8 05:48:48.116397010 (20h8m47.705741997s) [upload=20866]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:48:48.116400528 (20h8m47.705745505s) [upload=20866]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:48:48.116402822 (20h8m47.705747809s) [upload=20866]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:48:48.385497422 (20h8m47.974842409s) [upload=20866]: Done uploading segments... Aug 8 05:48:48.385516399 (20h8m47.974861386s) [upload=20866]: Upload finished. err: <nil> Aug 8 05:49:03.413885916 (20h9m3.003230903s) [upload=20875]: Starting upload Aug 8 05:49:03.413943406 (20h9m3.003288393s) [upload=20875]: Done starting upload Aug 8 05:49:03.413992931 (20h9m3.003337918s) [upload=20875]: Uploading segments... Aug 8 05:49:03.414026846 (20h9m3.003371833s) [upload=20875]: Got next segment. Inline: true Aug 8 05:49:03.414030522 (20h9m3.003375509s) [upload=20875]: Waiting for error group managing segments... Aug 8 05:49:03.414064968 (20h9m3.003409955s) [upload=20875]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:49:03.414068956 (20h9m3.003413933s) [upload=20875]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:49:03.414071261 (20h9m3.003416248s) [upload=20875]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:49:03.687532396 (20h9m3.276877383s) [upload=20875]: Done uploading segments... Aug 8 05:49:03.687559157 (20h9m3.276904194s) [upload=20875]: Upload finished. err: <nil> Aug 8 05:50:11.620858006 (20h10m11.210202993s) [upload=20891]: Starting upload Aug 8 05:50:11.620940003 (20h10m11.21028505s) [upload=20891]: Done starting upload Aug 8 05:50:11.621045826 (20h10m11.210390813s) [upload=20891]: Uploading segments... Aug 8 05:50:11.621132682 (20h10m11.210477659s) [upload=20891]: Got next segment. Inline: true Aug 8 05:50:11.621137571 (20h10m11.210482548s) [upload=20891]: Waiting for error group managing segments... Aug 8 05:50:11.621215971 (20h10m11.210560968s) [upload=20891]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:50:11.621224186 (20h10m11.210569214s) [upload=20891]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:50:11.621227904 (20h10m11.210572891s) [upload=20891]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:50:11.902419833 (20h10m11.49176482s) [upload=20891]: Done uploading segments... Aug 8 05:50:11.902443819 (20h10m11.491788826s) [upload=20891]: Upload finished. err: <nil> Aug 8 05:50:43.301715332 (20h10m42.891060319s) [upload=20904]: Starting upload Aug 8 05:50:43.301764246 (20h10m42.891109223s) [upload=20904]: Done starting upload Aug 8 05:50:43.301849319 (20h10m42.891194306s) [upload=20904]: Uploading segments... Aug 8 05:50:43.301881360 (20h10m42.891226347s) [upload=20904]: Got next segment. Inline: true Aug 8 05:50:43.301884586 (20h10m42.891229573s) [upload=20904]: Waiting for error group managing segments... Aug 8 05:50:43.301917438 (20h10m42.891262425s) [upload=20904]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:50:43.301921266 (20h10m42.891266253s) [upload=20904]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:50:43.301923800 (20h10m42.891268787s) [upload=20904]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:50:43.581330942 (20h10m43.170675929s) [upload=20904]: Done uploading segments... Aug 8 05:50:43.581348606 (20h10m43.170693594s) [upload=20904]: Upload finished. err: <nil> Aug 8 05:51:48.829995842 (20h11m48.419340859s) [upload=20917]: Starting upload Aug 8 05:51:48.830078530 (20h11m48.419423537s) [upload=20917]: Done starting upload Aug 8 05:51:48.830166959 (20h11m48.419511966s) [upload=20917]: Uploading segments... Aug 8 05:51:48.830198750 (20h11m48.419543727s) [upload=20917]: Got next segment. Inline: true Aug 8 05:51:48.830203038 (20h11m48.419548025s) [upload=20917]: Waiting for error group managing segments... Aug 8 05:51:48.830253845 (20h11m48.419598832s) [upload=20917]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:51:48.830263293 (20h11m48.41960828s) [upload=20917]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:51:48.830267131 (20h11m48.419612118s) [upload=20917]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:51:49.104016229 (20h11m48.693361216s) [upload=20917]: Done uploading segments... Aug 8 05:51:49.104034853 (20h11m48.693379831s) [upload=20917]: Upload finished. err: <nil> Aug 8 05:52:06.425779511 (20h12m6.015124498s) [upload=20924]: Starting upload Aug 8 05:52:06.426077070 (20h12m6.015422047s) [upload=20924]: Done starting upload Aug 8 05:52:06.426405829 (20h12m6.015750816s) [upload=20924]: Uploading segments... Aug 8 05:52:06.426449272 (20h12m6.015794259s) [upload=20924]: Got next segment. Inline: true Aug 8 05:52:06.426453941 (20h12m6.015798928s) [upload=20924]: Waiting for error group managing segments... Aug 8 05:52:06.426502244 (20h12m6.015847231s) [upload=20924]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:52:06.426507774 (20h12m6.015852761s) [upload=20924]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:52:06.426510529 (20h12m6.015855506s) [upload=20924]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:52:12.513554098 (20h12m12.102899085s) [upload=20924]: Done uploading segments... Aug 8 05:52:12.513577011 (20h12m12.102921998s) [upload=20924]: Upload finished. err: <nil> Duration: 1.890993314s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.........XX...............X.X.......................X.......] duration: 5.682969098s FAIL (2025-08-08 05:56:57 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== ad finished. err: <nil> Aug 8 05:50:40.893567535 (20h10m40.482912522s) [upload=20903]: Starting upload Aug 8 05:50:40.893617581 (20h10m40.482962568s) [upload=20903]: Done starting upload Aug 8 05:50:40.893745836 (20h10m40.483090823s) [upload=20903]: Uploading segments... Aug 8 05:50:40.893860175 (20h10m40.483205162s) [upload=20903]: Got next segment. Inline: false Aug 8 05:50:40.893898729 (20h10m40.483243706s) [upload=20903]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:50:40.893904339 (20h10m40.483249326s) [upload=20903]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:50:41.341218008 (20h10m40.930562995s) [seg_pos={0 0}, upload=20903]: Begin upload segment... Aug 8 05:50:41.341265508 (20h10m40.930610495s) [seg_pos={0 0}, upload=20903]: Done begin upload segment. Aug 8 05:50:41.341287290 (20h10m40.930632267s) [noise=true , address=104.36.82.37:4657 , piece_id=6G2JI22ZFKN72YYNJZ4Q3PK4ODRBF4QOK5OH3XNI245MOEV4INRA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341358447 (20h10m40.930703434s) [noise=true , address=64.49.13.155:4916 , piece_id=R4EDGKGU5O3XMIEDBT3P3YDZ6M5NDSW627JISIFRRYM3YFY7OJ7A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341670363 (20h10m40.93101535s) [noise=true , address=104.36.82.44:4873 , piece_id=OGMZZTN6R646OCIKFIN2ARH7HBXIYI4RG3RHOVEFGTGOS6EFLPFA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341830500 (20h10m40.931175487s) [noise=true , address=193.149.164.143:4696 , piece_id=FNRXKJGRXG64FVEF7U6WLJT56RBHEONLJF5FM3K7ZRBCQVBL3VFQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341990977 (20h10m40.931335954s) [noise=true , address=104.36.82.39:4735 , piece_id=VYEESGWFD57OTLITJU27YFV3IKI34JW7GANQ2U34PV6WAGMPEFXQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342205478 (20h10m40.931550465s) [noise=true , address=104.36.82.60:4348 , piece_id=DSQCOTEIOHDKJSUZYR7RQGXLT6A3FQNPBHZ36UKT3G56PNEWBKZA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342313615 (20h10m40.931658602s) [noise=true , address=104.36.82.36:4633 , piece_id=N6ZYWVZ7CODZ3SWA3T2KL6HWOPISACLE6YNECGDNL6S6NHP6TYZA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342583129 (20h10m40.931928117s) [noise=true , address=104.36.82.47:4529 , piece_id=UESMFD5UVKCQ4F5XKAG6OMNTA4BS6QV2BME5E7DMIJP7XWHJHT6A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342596976 (20h10m40.931941953s) [noise=true , address=104.36.82.61:4406 , piece_id=WQCH472JAJNEAGQGOF5LYU6RAUICVUOFXDTJC52NWFCEU43YTHEA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342935484 (20h10m40.932280471s) [noise=true , address=104.36.82.44:4881 , piece_id=JQKJCCUHCJSWLBDF5G5IEP2HAQJXH3FA6H7X4RNUH342SM6CNB5A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342953539 (20h10m40.932298526s) [noise=true , address=45.91.116.10:4092 , piece_id=FDHA5FCWTAFZ5N6AJA254W7QKGN3RGCGT7ZGWBIGLTI65DEIG4ZQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343204499 (20h10m40.932549486s) [noise=true , address=104.36.82.13:4202 , piece_id=GNTUDR6M4TV66KTCUMQKC33ESLZAQP4WK3PWS5CDQN5M6FE4ALQQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343223045 (20h10m40.932568032s) [noise=true , address=64.49.13.138:4481 , piece_id=HDNKCDGYH2LAFM2DRIW364W5XRSKF5XK7YZI47ATAAC5A6EBTOUQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343469105 (20h10m40.932814092s) [noise=true , address=64.49.13.140:4509 , piece_id=52T2SWYDXGGJ2IGMUAX5DJQZUFAQUHQTBW4NFC27RQQFLERI2EBQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343567834 (20h10m40.932912821s) [noise=true , address=104.36.82.23:4460 , piece_id=GKYZZOHC5J2FV2PWHI4IVTZV7FMVP2OFSJ2UOF24W5USG734RH7Q, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343687393 (20h10m40.93303237s) [noise=true , address=104.36.82.58:4273 , piece_id=WGPLZNLVUSYYJF7FJSBWAKRZ4LDAXSGBVWSTFRJ3KPBJIXOFSDGQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.344008046 (20h10m40.933353033s) [noise=true , address=104.36.82.43:4868 , piece_id=BM2WYHNTNNQAZHBSITN3ZIACMJLHLO6QACEZFCLYHODB4FYVYHNA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.345979839 (20h10m40.935324816s) [noise=true , address=104.36.82.20:4457 , piece_id=COVFTVTMO3DGUFVMZH633Q7RMZQRV7P2SRYOVJ2JZFP7RY5N7RHA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:42.438670912 (20h10m42.028015899s) [upload=20903]: Next returned nil segment Aug 8 05:50:42.438688716 (20h10m42.028033703s) [upload=20903]: Waiting for error group managing segments... Aug 8 05:50:42.778812377 (20h10m42.368157364s) [noise=true , address=193.149.164.143:4696 , piece_id=FNRXKJGRXG64FVEF7U6WLJT56RBHEONLJF5FM3K7ZRBCQVBL3VFQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.793688260 (20h10m42.383033237s) [noise=true , address=64.49.13.140:4509 , piece_id=52T2SWYDXGGJ2IGMUAX5DJQZUFAQUHQTBW4NFC27RQQFLERI2EBQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.814603478 (20h10m42.403948465s) [noise=true , address=64.49.13.155:4916 , piece_id=R4EDGKGU5O3XMIEDBT3P3YDZ6M5NDSW627JISIFRRYM3YFY7OJ7A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.846619684 (20h10m42.435964671s) [noise=true , address=64.49.13.138:4481 , piece_id=HDNKCDGYH2LAFM2DRIW364W5XRSKF5XK7YZI47ATAAC5A6EBTOUQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.248617890 (20h10m42.837962877s) [noise=true , address=104.36.82.47:4529 , piece_id=UESMFD5UVKCQ4F5XKAG6OMNTA4BS6QV2BME5E7DMIJP7XWHJHT6A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.252848605 (20h10m42.842193592s) [noise=true , address=104.36.82.39:4735 , piece_id=VYEESGWFD57OTLITJU27YFV3IKI34JW7GANQ2U34PV6WAGMPEFXQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.255650606 (20h10m42.844995593s) [noise=true , address=104.36.82.61:4406 , piece_id=WQCH472JAJNEAGQGOF5LYU6RAUICVUOFXDTJC52NWFCEU43YTHEA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.261140931 (20h10m42.850485918s) [noise=true , address=104.36.82.23:4460 , piece_id=GKYZZOHC5J2FV2PWHI4IVTZV7FMVP2OFSJ2UOF24W5USG734RH7Q, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.269129284 (20h10m42.858474261s) [noise=true , address=104.36.82.58:4273 , piece_id=WGPLZNLVUSYYJF7FJSBWAKRZ4LDAXSGBVWSTFRJ3KPBJIXOFSDGQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.274156393 (20h10m42.86350137s) [noise=true , address=104.36.82.43:4868 , piece_id=BM2WYHNTNNQAZHBSITN3ZIACMJLHLO6QACEZFCLYHODB4FYVYHNA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.313273526 (20h10m42.902618513s) [noise=true , address=45.91.116.10:4092 , piece_id=FDHA5FCWTAFZ5N6AJA254W7QKGN3RGCGT7ZGWBIGLTI65DEIG4ZQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.330724515 (20h10m42.920069502s) [noise=true , address=104.36.82.44:4881 , piece_id=JQKJCCUHCJSWLBDF5G5IEP2HAQJXH3FA6H7X4RNUH342SM6CNB5A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345245168 (20h10m42.934590155s) [noise=true , address=104.36.82.20:4457 , piece_id=COVFTVTMO3DGUFVMZH633Q7RMZQRV7P2SRYOVJ2JZFP7RY5N7RHA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345588405 (20h10m42.934933392s) [noise=true , address=104.36.82.60:4348 , piece_id=DSQCOTEIOHDKJSUZYR7RQGXLT6A3FQNPBHZ36UKT3G56PNEWBKZA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345621758 (20h10m42.934966745s) [seg_pos={0 0}, upload=20903]: Segment reached optimal threshold of 14 pieces. Aug 8 05:50:43.345774391 (20h10m42.935119378s) [noise=true , address=104.36.82.13:4202 , piece_id=GNTUDR6M4TV66KTCUMQKC33ESLZAQP4WK3PWS5CDQN5M6FE4ALQQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18wf5KnaR6WaR7MJivJkMJ7FejbuR6KnyvtRQgazNKfDb8fbsH): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345829917 (20h10m42.935174914s) [noise=true , address=104.36.82.36:4633 , piece_id=N6ZYWVZ7CODZ3SWA3T2KL6HWOPISACLE6YNECGDNL6S6NHP6TYZA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345878609 (20h10m42.935223607s) [noise=true , address=104.36.82.44:4873 , piece_id=OGMZZTN6R646OCIKFIN2ARH7HBXIYI4RG3RHOVEFGTGOS6EFLPFA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b5GdYtmYz9D1QW2z78W3Z2fWvMJGtrvrMJ1njbcqbtCDUdwHo): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345924307 (20h10m42.935269294s) [noise=true , address=104.36.82.37:4657 , piece_id=6G2JI22ZFKN72YYNJZ4Q3PK4ODRBF4QOK5OH3XNI245MOEV4INRA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345954214 (20h10m42.935299282s) [seg_pos={0 0}, upload=20903]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:50:43.346042142 (20h10m42.93538716s) [upload=20903]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:50:43.346050880 (20h10m42.935395897s) [upload=20903]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:50:43.643950132 (20h10m43.233295119s) [upload=20903]: Done uploading segments... Aug 8 05:50:43.643971202 (20h10m43.233316189s) [upload=20903]: Upload finished. err: <nil> Duration: 5.682994656s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 6.384575536s FAIL (2025-08-08 05:56:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.384606977s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [..........XX...............X.X.......................X......] duration: 5.525208251s FAIL (2025-08-08 05:56:19 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== ad finished. err: <nil> Aug 8 05:50:40.893567535 (20h10m40.482912522s) [upload=20903]: Starting upload Aug 8 05:50:40.893617581 (20h10m40.482962568s) [upload=20903]: Done starting upload Aug 8 05:50:40.893745836 (20h10m40.483090823s) [upload=20903]: Uploading segments... Aug 8 05:50:40.893860175 (20h10m40.483205162s) [upload=20903]: Got next segment. Inline: false Aug 8 05:50:40.893898729 (20h10m40.483243706s) [upload=20903]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:50:40.893904339 (20h10m40.483249326s) [upload=20903]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:50:41.341218008 (20h10m40.930562995s) [seg_pos={0 0}, upload=20903]: Begin upload segment... Aug 8 05:50:41.341265508 (20h10m40.930610495s) [seg_pos={0 0}, upload=20903]: Done begin upload segment. Aug 8 05:50:41.341287290 (20h10m40.930632267s) [noise=true , address=104.36.82.37:4657 , piece_id=6G2JI22ZFKN72YYNJZ4Q3PK4ODRBF4QOK5OH3XNI245MOEV4INRA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341358447 (20h10m40.930703434s) [noise=true , address=64.49.13.155:4916 , piece_id=R4EDGKGU5O3XMIEDBT3P3YDZ6M5NDSW627JISIFRRYM3YFY7OJ7A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341670363 (20h10m40.93101535s) [noise=true , address=104.36.82.44:4873 , piece_id=OGMZZTN6R646OCIKFIN2ARH7HBXIYI4RG3RHOVEFGTGOS6EFLPFA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341830500 (20h10m40.931175487s) [noise=true , address=193.149.164.143:4696 , piece_id=FNRXKJGRXG64FVEF7U6WLJT56RBHEONLJF5FM3K7ZRBCQVBL3VFQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341990977 (20h10m40.931335954s) [noise=true , address=104.36.82.39:4735 , piece_id=VYEESGWFD57OTLITJU27YFV3IKI34JW7GANQ2U34PV6WAGMPEFXQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342205478 (20h10m40.931550465s) [noise=true , address=104.36.82.60:4348 , piece_id=DSQCOTEIOHDKJSUZYR7RQGXLT6A3FQNPBHZ36UKT3G56PNEWBKZA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342313615 (20h10m40.931658602s) [noise=true , address=104.36.82.36:4633 , piece_id=N6ZYWVZ7CODZ3SWA3T2KL6HWOPISACLE6YNECGDNL6S6NHP6TYZA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342583129 (20h10m40.931928117s) [noise=true , address=104.36.82.47:4529 , piece_id=UESMFD5UVKCQ4F5XKAG6OMNTA4BS6QV2BME5E7DMIJP7XWHJHT6A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342596976 (20h10m40.931941953s) [noise=true , address=104.36.82.61:4406 , piece_id=WQCH472JAJNEAGQGOF5LYU6RAUICVUOFXDTJC52NWFCEU43YTHEA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342935484 (20h10m40.932280471s) [noise=true , address=104.36.82.44:4881 , piece_id=JQKJCCUHCJSWLBDF5G5IEP2HAQJXH3FA6H7X4RNUH342SM6CNB5A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342953539 (20h10m40.932298526s) [noise=true , address=45.91.116.10:4092 , piece_id=FDHA5FCWTAFZ5N6AJA254W7QKGN3RGCGT7ZGWBIGLTI65DEIG4ZQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343204499 (20h10m40.932549486s) [noise=true , address=104.36.82.13:4202 , piece_id=GNTUDR6M4TV66KTCUMQKC33ESLZAQP4WK3PWS5CDQN5M6FE4ALQQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343223045 (20h10m40.932568032s) [noise=true , address=64.49.13.138:4481 , piece_id=HDNKCDGYH2LAFM2DRIW364W5XRSKF5XK7YZI47ATAAC5A6EBTOUQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343469105 (20h10m40.932814092s) [noise=true , address=64.49.13.140:4509 , piece_id=52T2SWYDXGGJ2IGMUAX5DJQZUFAQUHQTBW4NFC27RQQFLERI2EBQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343567834 (20h10m40.932912821s) [noise=true , address=104.36.82.23:4460 , piece_id=GKYZZOHC5J2FV2PWHI4IVTZV7FMVP2OFSJ2UOF24W5USG734RH7Q, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343687393 (20h10m40.93303237s) [noise=true , address=104.36.82.58:4273 , piece_id=WGPLZNLVUSYYJF7FJSBWAKRZ4LDAXSGBVWSTFRJ3KPBJIXOFSDGQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.344008046 (20h10m40.933353033s) [noise=true , address=104.36.82.43:4868 , piece_id=BM2WYHNTNNQAZHBSITN3ZIACMJLHLO6QACEZFCLYHODB4FYVYHNA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.345979839 (20h10m40.935324816s) [noise=true , address=104.36.82.20:4457 , piece_id=COVFTVTMO3DGUFVMZH633Q7RMZQRV7P2SRYOVJ2JZFP7RY5N7RHA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:42.438670912 (20h10m42.028015899s) [upload=20903]: Next returned nil segment Aug 8 05:50:42.438688716 (20h10m42.028033703s) [upload=20903]: Waiting for error group managing segments... Aug 8 05:50:42.778812377 (20h10m42.368157364s) [noise=true , address=193.149.164.143:4696 , piece_id=FNRXKJGRXG64FVEF7U6WLJT56RBHEONLJF5FM3K7ZRBCQVBL3VFQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.793688260 (20h10m42.383033237s) [noise=true , address=64.49.13.140:4509 , piece_id=52T2SWYDXGGJ2IGMUAX5DJQZUFAQUHQTBW4NFC27RQQFLERI2EBQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.814603478 (20h10m42.403948465s) [noise=true , address=64.49.13.155:4916 , piece_id=R4EDGKGU5O3XMIEDBT3P3YDZ6M5NDSW627JISIFRRYM3YFY7OJ7A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.846619684 (20h10m42.435964671s) [noise=true , address=64.49.13.138:4481 , piece_id=HDNKCDGYH2LAFM2DRIW364W5XRSKF5XK7YZI47ATAAC5A6EBTOUQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.248617890 (20h10m42.837962877s) [noise=true , address=104.36.82.47:4529 , piece_id=UESMFD5UVKCQ4F5XKAG6OMNTA4BS6QV2BME5E7DMIJP7XWHJHT6A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.252848605 (20h10m42.842193592s) [noise=true , address=104.36.82.39:4735 , piece_id=VYEESGWFD57OTLITJU27YFV3IKI34JW7GANQ2U34PV6WAGMPEFXQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.255650606 (20h10m42.844995593s) [noise=true , address=104.36.82.61:4406 , piece_id=WQCH472JAJNEAGQGOF5LYU6RAUICVUOFXDTJC52NWFCEU43YTHEA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.261140931 (20h10m42.850485918s) [noise=true , address=104.36.82.23:4460 , piece_id=GKYZZOHC5J2FV2PWHI4IVTZV7FMVP2OFSJ2UOF24W5USG734RH7Q, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.269129284 (20h10m42.858474261s) [noise=true , address=104.36.82.58:4273 , piece_id=WGPLZNLVUSYYJF7FJSBWAKRZ4LDAXSGBVWSTFRJ3KPBJIXOFSDGQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.274156393 (20h10m42.86350137s) [noise=true , address=104.36.82.43:4868 , piece_id=BM2WYHNTNNQAZHBSITN3ZIACMJLHLO6QACEZFCLYHODB4FYVYHNA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.313273526 (20h10m42.902618513s) [noise=true , address=45.91.116.10:4092 , piece_id=FDHA5FCWTAFZ5N6AJA254W7QKGN3RGCGT7ZGWBIGLTI65DEIG4ZQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.330724515 (20h10m42.920069502s) [noise=true , address=104.36.82.44:4881 , piece_id=JQKJCCUHCJSWLBDF5G5IEP2HAQJXH3FA6H7X4RNUH342SM6CNB5A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345245168 (20h10m42.934590155s) [noise=true , address=104.36.82.20:4457 , piece_id=COVFTVTMO3DGUFVMZH633Q7RMZQRV7P2SRYOVJ2JZFP7RY5N7RHA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345588405 (20h10m42.934933392s) [noise=true , address=104.36.82.60:4348 , piece_id=DSQCOTEIOHDKJSUZYR7RQGXLT6A3FQNPBHZ36UKT3G56PNEWBKZA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345621758 (20h10m42.934966745s) [seg_pos={0 0}, upload=20903]: Segment reached optimal threshold of 14 pieces. Aug 8 05:50:43.345774391 (20h10m42.935119378s) [noise=true , address=104.36.82.13:4202 , piece_id=GNTUDR6M4TV66KTCUMQKC33ESLZAQP4WK3PWS5CDQN5M6FE4ALQQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18wf5KnaR6WaR7MJivJkMJ7FejbuR6KnyvtRQgazNKfDb8fbsH): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345829917 (20h10m42.935174914s) [noise=true , address=104.36.82.36:4633 , piece_id=N6ZYWVZ7CODZ3SWA3T2KL6HWOPISACLE6YNECGDNL6S6NHP6TYZA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345878609 (20h10m42.935223607s) [noise=true , address=104.36.82.44:4873 , piece_id=OGMZZTN6R646OCIKFIN2ARH7HBXIYI4RG3RHOVEFGTGOS6EFLPFA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b5GdYtmYz9D1QW2z78W3Z2fWvMJGtrvrMJ1njbcqbtCDUdwHo): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345924307 (20h10m42.935269294s) [noise=true , address=104.36.82.37:4657 , piece_id=6G2JI22ZFKN72YYNJZ4Q3PK4ODRBF4QOK5OH3XNI245MOEV4INRA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345954214 (20h10m42.935299282s) [seg_pos={0 0}, upload=20903]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:50:43.346042142 (20h10m42.93538716s) [upload=20903]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:50:43.346050880 (20h10m42.935395897s) [upload=20903]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:50:43.643950132 (20h10m43.233295119s) [upload=20903]: Done uploading segments... Aug 8 05:50:43.643971202 (20h10m43.233316189s) [upload=20903]: Upload finished. err: <nil> Duration: 5.525226045s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [..X...............X...X..........X......X.............X.....] duration: 1.821409741s FAIL (2025-08-08 05:56:14 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== _ObjectCommit Aug 8 05:45:35.317184488 (20h5m34.906529475s) [upload=20811]: Done uploading segments... Aug 8 05:45:35.317202442 (20h5m34.906547429s) [upload=20811]: Upload finished. err: <nil> Aug 8 05:46:01.441656651 (20h6m1.031001648s) [upload=20820]: Starting upload Aug 8 05:46:01.441723649 (20h6m1.031068636s) [upload=20820]: Done starting upload Aug 8 05:46:01.441780508 (20h6m1.031125495s) [upload=20820]: Uploading segments... Aug 8 05:46:01.441873716 (20h6m1.031218703s) [upload=20820]: Got next segment. Inline: true Aug 8 05:46:01.441879027 (20h6m1.031224024s) [upload=20820]: Waiting for error group managing segments... Aug 8 05:46:01.441920596 (20h6m1.031265583s) [upload=20820]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:46:01.441926427 (20h6m1.031271414s) [upload=20820]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:46:01.441929072 (20h6m1.031274069s) [upload=20820]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:46:01.715339951 (20h6m1.304684948s) [upload=20820]: Done uploading segments... Aug 8 05:46:01.715363486 (20h6m1.304708483s) [upload=20820]: Upload finished. err: <nil> Aug 8 05:46:30.814289733 (20h6m30.40363472s) [upload=20825]: Starting upload Aug 8 05:46:30.814402789 (20h6m30.403747776s) [upload=20825]: Done starting upload Aug 8 05:46:30.814469807 (20h6m30.403814794s) [upload=20825]: Uploading segments... Aug 8 05:46:30.814503302 (20h6m30.403848289s) [upload=20825]: Got next segment. Inline: true Aug 8 05:46:30.814507149 (20h6m30.403852136s) [upload=20825]: Waiting for error group managing segments... Aug 8 05:46:30.814539130 (20h6m30.403884117s) [upload=20825]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:46:30.814543147 (20h6m30.403888134s) [upload=20825]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:46:30.814545893 (20h6m30.40389088s) [upload=20825]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:46:31.079785599 (20h6m30.669130586s) [upload=20825]: Done uploading segments... Aug 8 05:46:31.079802632 (20h6m30.669147619s) [upload=20825]: Upload finished. err: <nil> Aug 8 05:47:12.882345463 (20h7m12.47169044s) [upload=20838]: Starting upload Aug 8 05:47:12.882381172 (20h7m12.471726179s) [upload=20838]: Done starting upload Aug 8 05:47:12.882425195 (20h7m12.471770182s) [upload=20838]: Uploading segments... Aug 8 05:47:12.882453229 (20h7m12.471798216s) [upload=20838]: Got next segment. Inline: true Aug 8 05:47:12.882456685 (20h7m12.471801672s) [upload=20838]: Waiting for error group managing segments... Aug 8 05:47:12.882487545 (20h7m12.471832532s) [upload=20838]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:47:12.882491432 (20h7m12.47183642s) [upload=20838]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:47:12.882494017 (20h7m12.471838994s) [upload=20838]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:47:13.318462618 (20h7m12.907807606s) [upload=20838]: Done uploading segments... Aug 8 05:47:13.318481204 (20h7m12.907826191s) [upload=20838]: Upload finished. err: <nil> Aug 8 05:48:17.691657531 (20h8m17.281002518s) [upload=20856]: Starting upload Aug 8 05:48:17.691709179 (20h8m17.281054166s) [upload=20856]: Done starting upload Aug 8 05:48:17.691766710 (20h8m17.281111697s) [upload=20856]: Uploading segments... Aug 8 05:48:17.691802789 (20h8m17.281147776s) [upload=20856]: Got next segment. Inline: true Aug 8 05:48:17.691807738 (20h8m17.281152725s) [upload=20856]: Waiting for error group managing segments... Aug 8 05:48:17.691840431 (20h8m17.281185418s) [upload=20856]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:48:17.691844428 (20h8m17.281189415s) [upload=20856]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:48:17.691846712 (20h8m17.281191699s) [upload=20856]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:48:17.965025328 (20h8m17.554370315s) [upload=20856]: Done uploading segments... Aug 8 05:48:17.965043924 (20h8m17.554388911s) [upload=20856]: Upload finished. err: <nil> Aug 8 05:48:48.116229309 (20h8m47.705574296s) [upload=20866]: Starting upload Aug 8 05:48:48.116275538 (20h8m47.705620525s) [upload=20866]: Done starting upload Aug 8 05:48:48.116329812 (20h8m47.705674789s) [upload=20866]: Uploading segments... Aug 8 05:48:48.116361262 (20h8m47.705706249s) [upload=20866]: Got next segment. Inline: true Aug 8 05:48:48.116364939 (20h8m47.705709926s) [upload=20866]: Waiting for error group managing segments... Aug 8 05:48:48.116397010 (20h8m47.705741997s) [upload=20866]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:48:48.116400528 (20h8m47.705745505s) [upload=20866]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:48:48.116402822 (20h8m47.705747809s) [upload=20866]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:48:48.385497422 (20h8m47.974842409s) [upload=20866]: Done uploading segments... Aug 8 05:48:48.385516399 (20h8m47.974861386s) [upload=20866]: Upload finished. err: <nil> Aug 8 05:49:03.413885916 (20h9m3.003230903s) [upload=20875]: Starting upload Aug 8 05:49:03.413943406 (20h9m3.003288393s) [upload=20875]: Done starting upload Aug 8 05:49:03.413992931 (20h9m3.003337918s) [upload=20875]: Uploading segments... Aug 8 05:49:03.414026846 (20h9m3.003371833s) [upload=20875]: Got next segment. Inline: true Aug 8 05:49:03.414030522 (20h9m3.003375509s) [upload=20875]: Waiting for error group managing segments... Aug 8 05:49:03.414064968 (20h9m3.003409955s) [upload=20875]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:49:03.414068956 (20h9m3.003413933s) [upload=20875]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:49:03.414071261 (20h9m3.003416248s) [upload=20875]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:49:03.687532396 (20h9m3.276877383s) [upload=20875]: Done uploading segments... Aug 8 05:49:03.687559157 (20h9m3.276904194s) [upload=20875]: Upload finished. err: <nil> Aug 8 05:50:11.620858006 (20h10m11.210202993s) [upload=20891]: Starting upload Aug 8 05:50:11.620940003 (20h10m11.21028505s) [upload=20891]: Done starting upload Aug 8 05:50:11.621045826 (20h10m11.210390813s) [upload=20891]: Uploading segments... Aug 8 05:50:11.621132682 (20h10m11.210477659s) [upload=20891]: Got next segment. Inline: true Aug 8 05:50:11.621137571 (20h10m11.210482548s) [upload=20891]: Waiting for error group managing segments... Aug 8 05:50:11.621215971 (20h10m11.210560968s) [upload=20891]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:50:11.621224186 (20h10m11.210569214s) [upload=20891]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:50:11.621227904 (20h10m11.210572891s) [upload=20891]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:50:11.902419833 (20h10m11.49176482s) [upload=20891]: Done uploading segments... Aug 8 05:50:11.902443819 (20h10m11.491788826s) [upload=20891]: Upload finished. err: <nil> Aug 8 05:50:43.301715332 (20h10m42.891060319s) [upload=20904]: Starting upload Aug 8 05:50:43.301764246 (20h10m42.891109223s) [upload=20904]: Done starting upload Aug 8 05:50:43.301849319 (20h10m42.891194306s) [upload=20904]: Uploading segments... Aug 8 05:50:43.301881360 (20h10m42.891226347s) [upload=20904]: Got next segment. Inline: true Aug 8 05:50:43.301884586 (20h10m42.891229573s) [upload=20904]: Waiting for error group managing segments... Aug 8 05:50:43.301917438 (20h10m42.891262425s) [upload=20904]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:50:43.301921266 (20h10m42.891266253s) [upload=20904]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:50:43.301923800 (20h10m42.891268787s) [upload=20904]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:50:43.581330942 (20h10m43.170675929s) [upload=20904]: Done uploading segments... Aug 8 05:50:43.581348606 (20h10m43.170693594s) [upload=20904]: Upload finished. err: <nil> Aug 8 05:51:48.829995842 (20h11m48.419340859s) [upload=20917]: Starting upload Aug 8 05:51:48.830078530 (20h11m48.419423537s) [upload=20917]: Done starting upload Aug 8 05:51:48.830166959 (20h11m48.419511966s) [upload=20917]: Uploading segments... Aug 8 05:51:48.830198750 (20h11m48.419543727s) [upload=20917]: Got next segment. Inline: true Aug 8 05:51:48.830203038 (20h11m48.419548025s) [upload=20917]: Waiting for error group managing segments... Aug 8 05:51:48.830253845 (20h11m48.419598832s) [upload=20917]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:51:48.830263293 (20h11m48.41960828s) [upload=20917]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:51:48.830267131 (20h11m48.419612118s) [upload=20917]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:51:49.104016229 (20h11m48.693361216s) [upload=20917]: Done uploading segments... Aug 8 05:51:49.104034853 (20h11m48.693379831s) [upload=20917]: Upload finished. err: <nil> Aug 8 05:52:06.425779511 (20h12m6.015124498s) [upload=20924]: Starting upload Aug 8 05:52:06.426077070 (20h12m6.015422047s) [upload=20924]: Done starting upload Aug 8 05:52:06.426405829 (20h12m6.015750816s) [upload=20924]: Uploading segments... Aug 8 05:52:06.426449272 (20h12m6.015794259s) [upload=20924]: Got next segment. Inline: true Aug 8 05:52:06.426453941 (20h12m6.015798928s) [upload=20924]: Waiting for error group managing segments... Aug 8 05:52:06.426502244 (20h12m6.015847231s) [upload=20924]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:52:06.426507774 (20h12m6.015852761s) [upload=20924]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:52:06.426510529 (20h12m6.015855506s) [upload=20924]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:52:12.513554098 (20h12m12.102899085s) [upload=20924]: Done uploading segments... Aug 8 05:52:12.513577011 (20h12m12.102921998s) [upload=20924]: Upload finished. err: <nil> Duration: 1.8214356s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 6.104741243s FAIL (2025-08-08 05:55:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.104759428s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [...........XX...............X.X.......................X.....] duration: 5.577941252s FAIL (2025-08-08 05:55:46 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== ad finished. err: <nil> Aug 8 05:50:40.893567535 (20h10m40.482912522s) [upload=20903]: Starting upload Aug 8 05:50:40.893617581 (20h10m40.482962568s) [upload=20903]: Done starting upload Aug 8 05:50:40.893745836 (20h10m40.483090823s) [upload=20903]: Uploading segments... Aug 8 05:50:40.893860175 (20h10m40.483205162s) [upload=20903]: Got next segment. Inline: false Aug 8 05:50:40.893898729 (20h10m40.483243706s) [upload=20903]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:50:40.893904339 (20h10m40.483249326s) [upload=20903]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:50:41.341218008 (20h10m40.930562995s) [seg_pos={0 0}, upload=20903]: Begin upload segment... Aug 8 05:50:41.341265508 (20h10m40.930610495s) [seg_pos={0 0}, upload=20903]: Done begin upload segment. Aug 8 05:50:41.341287290 (20h10m40.930632267s) [noise=true , address=104.36.82.37:4657 , piece_id=6G2JI22ZFKN72YYNJZ4Q3PK4ODRBF4QOK5OH3XNI245MOEV4INRA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341358447 (20h10m40.930703434s) [noise=true , address=64.49.13.155:4916 , piece_id=R4EDGKGU5O3XMIEDBT3P3YDZ6M5NDSW627JISIFRRYM3YFY7OJ7A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341670363 (20h10m40.93101535s) [noise=true , address=104.36.82.44:4873 , piece_id=OGMZZTN6R646OCIKFIN2ARH7HBXIYI4RG3RHOVEFGTGOS6EFLPFA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341830500 (20h10m40.931175487s) [noise=true , address=193.149.164.143:4696 , piece_id=FNRXKJGRXG64FVEF7U6WLJT56RBHEONLJF5FM3K7ZRBCQVBL3VFQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341990977 (20h10m40.931335954s) [noise=true , address=104.36.82.39:4735 , piece_id=VYEESGWFD57OTLITJU27YFV3IKI34JW7GANQ2U34PV6WAGMPEFXQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342205478 (20h10m40.931550465s) [noise=true , address=104.36.82.60:4348 , piece_id=DSQCOTEIOHDKJSUZYR7RQGXLT6A3FQNPBHZ36UKT3G56PNEWBKZA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342313615 (20h10m40.931658602s) [noise=true , address=104.36.82.36:4633 , piece_id=N6ZYWVZ7CODZ3SWA3T2KL6HWOPISACLE6YNECGDNL6S6NHP6TYZA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342583129 (20h10m40.931928117s) [noise=true , address=104.36.82.47:4529 , piece_id=UESMFD5UVKCQ4F5XKAG6OMNTA4BS6QV2BME5E7DMIJP7XWHJHT6A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342596976 (20h10m40.931941953s) [noise=true , address=104.36.82.61:4406 , piece_id=WQCH472JAJNEAGQGOF5LYU6RAUICVUOFXDTJC52NWFCEU43YTHEA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342935484 (20h10m40.932280471s) [noise=true , address=104.36.82.44:4881 , piece_id=JQKJCCUHCJSWLBDF5G5IEP2HAQJXH3FA6H7X4RNUH342SM6CNB5A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342953539 (20h10m40.932298526s) [noise=true , address=45.91.116.10:4092 , piece_id=FDHA5FCWTAFZ5N6AJA254W7QKGN3RGCGT7ZGWBIGLTI65DEIG4ZQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343204499 (20h10m40.932549486s) [noise=true , address=104.36.82.13:4202 , piece_id=GNTUDR6M4TV66KTCUMQKC33ESLZAQP4WK3PWS5CDQN5M6FE4ALQQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343223045 (20h10m40.932568032s) [noise=true , address=64.49.13.138:4481 , piece_id=HDNKCDGYH2LAFM2DRIW364W5XRSKF5XK7YZI47ATAAC5A6EBTOUQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343469105 (20h10m40.932814092s) [noise=true , address=64.49.13.140:4509 , piece_id=52T2SWYDXGGJ2IGMUAX5DJQZUFAQUHQTBW4NFC27RQQFLERI2EBQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343567834 (20h10m40.932912821s) [noise=true , address=104.36.82.23:4460 , piece_id=GKYZZOHC5J2FV2PWHI4IVTZV7FMVP2OFSJ2UOF24W5USG734RH7Q, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343687393 (20h10m40.93303237s) [noise=true , address=104.36.82.58:4273 , piece_id=WGPLZNLVUSYYJF7FJSBWAKRZ4LDAXSGBVWSTFRJ3KPBJIXOFSDGQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.344008046 (20h10m40.933353033s) [noise=true , address=104.36.82.43:4868 , piece_id=BM2WYHNTNNQAZHBSITN3ZIACMJLHLO6QACEZFCLYHODB4FYVYHNA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.345979839 (20h10m40.935324816s) [noise=true , address=104.36.82.20:4457 , piece_id=COVFTVTMO3DGUFVMZH633Q7RMZQRV7P2SRYOVJ2JZFP7RY5N7RHA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:42.438670912 (20h10m42.028015899s) [upload=20903]: Next returned nil segment Aug 8 05:50:42.438688716 (20h10m42.028033703s) [upload=20903]: Waiting for error group managing segments... Aug 8 05:50:42.778812377 (20h10m42.368157364s) [noise=true , address=193.149.164.143:4696 , piece_id=FNRXKJGRXG64FVEF7U6WLJT56RBHEONLJF5FM3K7ZRBCQVBL3VFQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.793688260 (20h10m42.383033237s) [noise=true , address=64.49.13.140:4509 , piece_id=52T2SWYDXGGJ2IGMUAX5DJQZUFAQUHQTBW4NFC27RQQFLERI2EBQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.814603478 (20h10m42.403948465s) [noise=true , address=64.49.13.155:4916 , piece_id=R4EDGKGU5O3XMIEDBT3P3YDZ6M5NDSW627JISIFRRYM3YFY7OJ7A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.846619684 (20h10m42.435964671s) [noise=true , address=64.49.13.138:4481 , piece_id=HDNKCDGYH2LAFM2DRIW364W5XRSKF5XK7YZI47ATAAC5A6EBTOUQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.248617890 (20h10m42.837962877s) [noise=true , address=104.36.82.47:4529 , piece_id=UESMFD5UVKCQ4F5XKAG6OMNTA4BS6QV2BME5E7DMIJP7XWHJHT6A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.252848605 (20h10m42.842193592s) [noise=true , address=104.36.82.39:4735 , piece_id=VYEESGWFD57OTLITJU27YFV3IKI34JW7GANQ2U34PV6WAGMPEFXQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.255650606 (20h10m42.844995593s) [noise=true , address=104.36.82.61:4406 , piece_id=WQCH472JAJNEAGQGOF5LYU6RAUICVUOFXDTJC52NWFCEU43YTHEA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.261140931 (20h10m42.850485918s) [noise=true , address=104.36.82.23:4460 , piece_id=GKYZZOHC5J2FV2PWHI4IVTZV7FMVP2OFSJ2UOF24W5USG734RH7Q, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.269129284 (20h10m42.858474261s) [noise=true , address=104.36.82.58:4273 , piece_id=WGPLZNLVUSYYJF7FJSBWAKRZ4LDAXSGBVWSTFRJ3KPBJIXOFSDGQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.274156393 (20h10m42.86350137s) [noise=true , address=104.36.82.43:4868 , piece_id=BM2WYHNTNNQAZHBSITN3ZIACMJLHLO6QACEZFCLYHODB4FYVYHNA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.313273526 (20h10m42.902618513s) [noise=true , address=45.91.116.10:4092 , piece_id=FDHA5FCWTAFZ5N6AJA254W7QKGN3RGCGT7ZGWBIGLTI65DEIG4ZQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.330724515 (20h10m42.920069502s) [noise=true , address=104.36.82.44:4881 , piece_id=JQKJCCUHCJSWLBDF5G5IEP2HAQJXH3FA6H7X4RNUH342SM6CNB5A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345245168 (20h10m42.934590155s) [noise=true , address=104.36.82.20:4457 , piece_id=COVFTVTMO3DGUFVMZH633Q7RMZQRV7P2SRYOVJ2JZFP7RY5N7RHA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345588405 (20h10m42.934933392s) [noise=true , address=104.36.82.60:4348 , piece_id=DSQCOTEIOHDKJSUZYR7RQGXLT6A3FQNPBHZ36UKT3G56PNEWBKZA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345621758 (20h10m42.934966745s) [seg_pos={0 0}, upload=20903]: Segment reached optimal threshold of 14 pieces. Aug 8 05:50:43.345774391 (20h10m42.935119378s) [noise=true , address=104.36.82.13:4202 , piece_id=GNTUDR6M4TV66KTCUMQKC33ESLZAQP4WK3PWS5CDQN5M6FE4ALQQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18wf5KnaR6WaR7MJivJkMJ7FejbuR6KnyvtRQgazNKfDb8fbsH): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345829917 (20h10m42.935174914s) [noise=true , address=104.36.82.36:4633 , piece_id=N6ZYWVZ7CODZ3SWA3T2KL6HWOPISACLE6YNECGDNL6S6NHP6TYZA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345878609 (20h10m42.935223607s) [noise=true , address=104.36.82.44:4873 , piece_id=OGMZZTN6R646OCIKFIN2ARH7HBXIYI4RG3RHOVEFGTGOS6EFLPFA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b5GdYtmYz9D1QW2z78W3Z2fWvMJGtrvrMJ1njbcqbtCDUdwHo): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345924307 (20h10m42.935269294s) [noise=true , address=104.36.82.37:4657 , piece_id=6G2JI22ZFKN72YYNJZ4Q3PK4ODRBF4QOK5OH3XNI245MOEV4INRA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345954214 (20h10m42.935299282s) [seg_pos={0 0}, upload=20903]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:50:43.346042142 (20h10m42.93538716s) [upload=20903]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:50:43.346050880 (20h10m42.935395897s) [upload=20903]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:50:43.643950132 (20h10m43.233295119s) [upload=20903]: Done uploading segments... Aug 8 05:50:43.643971202 (20h10m43.233316189s) [upload=20903]: Upload finished. err: <nil> Duration: 5.577968352s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [...X...............X...X..........X......X.............X....] duration: 1.845644819s FAIL (2025-08-08 05:55:29 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== _ObjectCommit Aug 8 05:45:35.317184488 (20h5m34.906529475s) [upload=20811]: Done uploading segments... Aug 8 05:45:35.317202442 (20h5m34.906547429s) [upload=20811]: Upload finished. err: <nil> Aug 8 05:46:01.441656651 (20h6m1.031001648s) [upload=20820]: Starting upload Aug 8 05:46:01.441723649 (20h6m1.031068636s) [upload=20820]: Done starting upload Aug 8 05:46:01.441780508 (20h6m1.031125495s) [upload=20820]: Uploading segments... Aug 8 05:46:01.441873716 (20h6m1.031218703s) [upload=20820]: Got next segment. Inline: true Aug 8 05:46:01.441879027 (20h6m1.031224024s) [upload=20820]: Waiting for error group managing segments... Aug 8 05:46:01.441920596 (20h6m1.031265583s) [upload=20820]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:46:01.441926427 (20h6m1.031271414s) [upload=20820]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:46:01.441929072 (20h6m1.031274069s) [upload=20820]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:46:01.715339951 (20h6m1.304684948s) [upload=20820]: Done uploading segments... Aug 8 05:46:01.715363486 (20h6m1.304708483s) [upload=20820]: Upload finished. err: <nil> Aug 8 05:46:30.814289733 (20h6m30.40363472s) [upload=20825]: Starting upload Aug 8 05:46:30.814402789 (20h6m30.403747776s) [upload=20825]: Done starting upload Aug 8 05:46:30.814469807 (20h6m30.403814794s) [upload=20825]: Uploading segments... Aug 8 05:46:30.814503302 (20h6m30.403848289s) [upload=20825]: Got next segment. Inline: true Aug 8 05:46:30.814507149 (20h6m30.403852136s) [upload=20825]: Waiting for error group managing segments... Aug 8 05:46:30.814539130 (20h6m30.403884117s) [upload=20825]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:46:30.814543147 (20h6m30.403888134s) [upload=20825]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:46:30.814545893 (20h6m30.40389088s) [upload=20825]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:46:31.079785599 (20h6m30.669130586s) [upload=20825]: Done uploading segments... Aug 8 05:46:31.079802632 (20h6m30.669147619s) [upload=20825]: Upload finished. err: <nil> Aug 8 05:47:12.882345463 (20h7m12.47169044s) [upload=20838]: Starting upload Aug 8 05:47:12.882381172 (20h7m12.471726179s) [upload=20838]: Done starting upload Aug 8 05:47:12.882425195 (20h7m12.471770182s) [upload=20838]: Uploading segments... Aug 8 05:47:12.882453229 (20h7m12.471798216s) [upload=20838]: Got next segment. Inline: true Aug 8 05:47:12.882456685 (20h7m12.471801672s) [upload=20838]: Waiting for error group managing segments... Aug 8 05:47:12.882487545 (20h7m12.471832532s) [upload=20838]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:47:12.882491432 (20h7m12.47183642s) [upload=20838]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:47:12.882494017 (20h7m12.471838994s) [upload=20838]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:47:13.318462618 (20h7m12.907807606s) [upload=20838]: Done uploading segments... Aug 8 05:47:13.318481204 (20h7m12.907826191s) [upload=20838]: Upload finished. err: <nil> Aug 8 05:48:17.691657531 (20h8m17.281002518s) [upload=20856]: Starting upload Aug 8 05:48:17.691709179 (20h8m17.281054166s) [upload=20856]: Done starting upload Aug 8 05:48:17.691766710 (20h8m17.281111697s) [upload=20856]: Uploading segments... Aug 8 05:48:17.691802789 (20h8m17.281147776s) [upload=20856]: Got next segment. Inline: true Aug 8 05:48:17.691807738 (20h8m17.281152725s) [upload=20856]: Waiting for error group managing segments... Aug 8 05:48:17.691840431 (20h8m17.281185418s) [upload=20856]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:48:17.691844428 (20h8m17.281189415s) [upload=20856]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:48:17.691846712 (20h8m17.281191699s) [upload=20856]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:48:17.965025328 (20h8m17.554370315s) [upload=20856]: Done uploading segments... Aug 8 05:48:17.965043924 (20h8m17.554388911s) [upload=20856]: Upload finished. err: <nil> Aug 8 05:48:48.116229309 (20h8m47.705574296s) [upload=20866]: Starting upload Aug 8 05:48:48.116275538 (20h8m47.705620525s) [upload=20866]: Done starting upload Aug 8 05:48:48.116329812 (20h8m47.705674789s) [upload=20866]: Uploading segments... Aug 8 05:48:48.116361262 (20h8m47.705706249s) [upload=20866]: Got next segment. Inline: true Aug 8 05:48:48.116364939 (20h8m47.705709926s) [upload=20866]: Waiting for error group managing segments... Aug 8 05:48:48.116397010 (20h8m47.705741997s) [upload=20866]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:48:48.116400528 (20h8m47.705745505s) [upload=20866]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:48:48.116402822 (20h8m47.705747809s) [upload=20866]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:48:48.385497422 (20h8m47.974842409s) [upload=20866]: Done uploading segments... Aug 8 05:48:48.385516399 (20h8m47.974861386s) [upload=20866]: Upload finished. err: <nil> Aug 8 05:49:03.413885916 (20h9m3.003230903s) [upload=20875]: Starting upload Aug 8 05:49:03.413943406 (20h9m3.003288393s) [upload=20875]: Done starting upload Aug 8 05:49:03.413992931 (20h9m3.003337918s) [upload=20875]: Uploading segments... Aug 8 05:49:03.414026846 (20h9m3.003371833s) [upload=20875]: Got next segment. Inline: true Aug 8 05:49:03.414030522 (20h9m3.003375509s) [upload=20875]: Waiting for error group managing segments... Aug 8 05:49:03.414064968 (20h9m3.003409955s) [upload=20875]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:49:03.414068956 (20h9m3.003413933s) [upload=20875]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:49:03.414071261 (20h9m3.003416248s) [upload=20875]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:49:03.687532396 (20h9m3.276877383s) [upload=20875]: Done uploading segments... Aug 8 05:49:03.687559157 (20h9m3.276904194s) [upload=20875]: Upload finished. err: <nil> Aug 8 05:50:11.620858006 (20h10m11.210202993s) [upload=20891]: Starting upload Aug 8 05:50:11.620940003 (20h10m11.21028505s) [upload=20891]: Done starting upload Aug 8 05:50:11.621045826 (20h10m11.210390813s) [upload=20891]: Uploading segments... Aug 8 05:50:11.621132682 (20h10m11.210477659s) [upload=20891]: Got next segment. Inline: true Aug 8 05:50:11.621137571 (20h10m11.210482548s) [upload=20891]: Waiting for error group managing segments... Aug 8 05:50:11.621215971 (20h10m11.210560968s) [upload=20891]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:50:11.621224186 (20h10m11.210569214s) [upload=20891]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:50:11.621227904 (20h10m11.210572891s) [upload=20891]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:50:11.902419833 (20h10m11.49176482s) [upload=20891]: Done uploading segments... Aug 8 05:50:11.902443819 (20h10m11.491788826s) [upload=20891]: Upload finished. err: <nil> Aug 8 05:50:43.301715332 (20h10m42.891060319s) [upload=20904]: Starting upload Aug 8 05:50:43.301764246 (20h10m42.891109223s) [upload=20904]: Done starting upload Aug 8 05:50:43.301849319 (20h10m42.891194306s) [upload=20904]: Uploading segments... Aug 8 05:50:43.301881360 (20h10m42.891226347s) [upload=20904]: Got next segment. Inline: true Aug 8 05:50:43.301884586 (20h10m42.891229573s) [upload=20904]: Waiting for error group managing segments... Aug 8 05:50:43.301917438 (20h10m42.891262425s) [upload=20904]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:50:43.301921266 (20h10m42.891266253s) [upload=20904]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:50:43.301923800 (20h10m42.891268787s) [upload=20904]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:50:43.581330942 (20h10m43.170675929s) [upload=20904]: Done uploading segments... Aug 8 05:50:43.581348606 (20h10m43.170693594s) [upload=20904]: Upload finished. err: <nil> Aug 8 05:51:48.829995842 (20h11m48.419340859s) [upload=20917]: Starting upload Aug 8 05:51:48.830078530 (20h11m48.419423537s) [upload=20917]: Done starting upload Aug 8 05:51:48.830166959 (20h11m48.419511966s) [upload=20917]: Uploading segments... Aug 8 05:51:48.830198750 (20h11m48.419543727s) [upload=20917]: Got next segment. Inline: true Aug 8 05:51:48.830203038 (20h11m48.419548025s) [upload=20917]: Waiting for error group managing segments... Aug 8 05:51:48.830253845 (20h11m48.419598832s) [upload=20917]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:51:48.830263293 (20h11m48.41960828s) [upload=20917]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:51:48.830267131 (20h11m48.419612118s) [upload=20917]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:51:49.104016229 (20h11m48.693361216s) [upload=20917]: Done uploading segments... Aug 8 05:51:49.104034853 (20h11m48.693379831s) [upload=20917]: Upload finished. err: <nil> Aug 8 05:52:06.425779511 (20h12m6.015124498s) [upload=20924]: Starting upload Aug 8 05:52:06.426077070 (20h12m6.015422047s) [upload=20924]: Done starting upload Aug 8 05:52:06.426405829 (20h12m6.015750816s) [upload=20924]: Uploading segments... Aug 8 05:52:06.426449272 (20h12m6.015794259s) [upload=20924]: Got next segment. Inline: true Aug 8 05:52:06.426453941 (20h12m6.015798928s) [upload=20924]: Waiting for error group managing segments... Aug 8 05:52:06.426502244 (20h12m6.015847231s) [upload=20924]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:52:06.426507774 (20h12m6.015852761s) [upload=20924]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:52:06.426510529 (20h12m6.015855506s) [upload=20924]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:52:12.513554098 (20h12m12.102899085s) [upload=20924]: Done uploading segments... Aug 8 05:52:12.513577011 (20h12m12.102921998s) [upload=20924]: Upload finished. err: <nil> Duration: 1.845678323s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [............XX...............X.X.......................X....] duration: 5.772740146s FAIL (2025-08-08 05:55:03 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== ad finished. err: <nil> Aug 8 05:50:40.893567535 (20h10m40.482912522s) [upload=20903]: Starting upload Aug 8 05:50:40.893617581 (20h10m40.482962568s) [upload=20903]: Done starting upload Aug 8 05:50:40.893745836 (20h10m40.483090823s) [upload=20903]: Uploading segments... Aug 8 05:50:40.893860175 (20h10m40.483205162s) [upload=20903]: Got next segment. Inline: false Aug 8 05:50:40.893898729 (20h10m40.483243706s) [upload=20903]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:50:40.893904339 (20h10m40.483249326s) [upload=20903]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:50:41.341218008 (20h10m40.930562995s) [seg_pos={0 0}, upload=20903]: Begin upload segment... Aug 8 05:50:41.341265508 (20h10m40.930610495s) [seg_pos={0 0}, upload=20903]: Done begin upload segment. Aug 8 05:50:41.341287290 (20h10m40.930632267s) [noise=true , address=104.36.82.37:4657 , piece_id=6G2JI22ZFKN72YYNJZ4Q3PK4ODRBF4QOK5OH3XNI245MOEV4INRA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341358447 (20h10m40.930703434s) [noise=true , address=64.49.13.155:4916 , piece_id=R4EDGKGU5O3XMIEDBT3P3YDZ6M5NDSW627JISIFRRYM3YFY7OJ7A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341670363 (20h10m40.93101535s) [noise=true , address=104.36.82.44:4873 , piece_id=OGMZZTN6R646OCIKFIN2ARH7HBXIYI4RG3RHOVEFGTGOS6EFLPFA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341830500 (20h10m40.931175487s) [noise=true , address=193.149.164.143:4696 , piece_id=FNRXKJGRXG64FVEF7U6WLJT56RBHEONLJF5FM3K7ZRBCQVBL3VFQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341990977 (20h10m40.931335954s) [noise=true , address=104.36.82.39:4735 , piece_id=VYEESGWFD57OTLITJU27YFV3IKI34JW7GANQ2U34PV6WAGMPEFXQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342205478 (20h10m40.931550465s) [noise=true , address=104.36.82.60:4348 , piece_id=DSQCOTEIOHDKJSUZYR7RQGXLT6A3FQNPBHZ36UKT3G56PNEWBKZA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342313615 (20h10m40.931658602s) [noise=true , address=104.36.82.36:4633 , piece_id=N6ZYWVZ7CODZ3SWA3T2KL6HWOPISACLE6YNECGDNL6S6NHP6TYZA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342583129 (20h10m40.931928117s) [noise=true , address=104.36.82.47:4529 , piece_id=UESMFD5UVKCQ4F5XKAG6OMNTA4BS6QV2BME5E7DMIJP7XWHJHT6A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342596976 (20h10m40.931941953s) [noise=true , address=104.36.82.61:4406 , piece_id=WQCH472JAJNEAGQGOF5LYU6RAUICVUOFXDTJC52NWFCEU43YTHEA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342935484 (20h10m40.932280471s) [noise=true , address=104.36.82.44:4881 , piece_id=JQKJCCUHCJSWLBDF5G5IEP2HAQJXH3FA6H7X4RNUH342SM6CNB5A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342953539 (20h10m40.932298526s) [noise=true , address=45.91.116.10:4092 , piece_id=FDHA5FCWTAFZ5N6AJA254W7QKGN3RGCGT7ZGWBIGLTI65DEIG4ZQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343204499 (20h10m40.932549486s) [noise=true , address=104.36.82.13:4202 , piece_id=GNTUDR6M4TV66KTCUMQKC33ESLZAQP4WK3PWS5CDQN5M6FE4ALQQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343223045 (20h10m40.932568032s) [noise=true , address=64.49.13.138:4481 , piece_id=HDNKCDGYH2LAFM2DRIW364W5XRSKF5XK7YZI47ATAAC5A6EBTOUQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343469105 (20h10m40.932814092s) [noise=true , address=64.49.13.140:4509 , piece_id=52T2SWYDXGGJ2IGMUAX5DJQZUFAQUHQTBW4NFC27RQQFLERI2EBQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343567834 (20h10m40.932912821s) [noise=true , address=104.36.82.23:4460 , piece_id=GKYZZOHC5J2FV2PWHI4IVTZV7FMVP2OFSJ2UOF24W5USG734RH7Q, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343687393 (20h10m40.93303237s) [noise=true , address=104.36.82.58:4273 , piece_id=WGPLZNLVUSYYJF7FJSBWAKRZ4LDAXSGBVWSTFRJ3KPBJIXOFSDGQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.344008046 (20h10m40.933353033s) [noise=true , address=104.36.82.43:4868 , piece_id=BM2WYHNTNNQAZHBSITN3ZIACMJLHLO6QACEZFCLYHODB4FYVYHNA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.345979839 (20h10m40.935324816s) [noise=true , address=104.36.82.20:4457 , piece_id=COVFTVTMO3DGUFVMZH633Q7RMZQRV7P2SRYOVJ2JZFP7RY5N7RHA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:42.438670912 (20h10m42.028015899s) [upload=20903]: Next returned nil segment Aug 8 05:50:42.438688716 (20h10m42.028033703s) [upload=20903]: Waiting for error group managing segments... Aug 8 05:50:42.778812377 (20h10m42.368157364s) [noise=true , address=193.149.164.143:4696 , piece_id=FNRXKJGRXG64FVEF7U6WLJT56RBHEONLJF5FM3K7ZRBCQVBL3VFQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.793688260 (20h10m42.383033237s) [noise=true , address=64.49.13.140:4509 , piece_id=52T2SWYDXGGJ2IGMUAX5DJQZUFAQUHQTBW4NFC27RQQFLERI2EBQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.814603478 (20h10m42.403948465s) [noise=true , address=64.49.13.155:4916 , piece_id=R4EDGKGU5O3XMIEDBT3P3YDZ6M5NDSW627JISIFRRYM3YFY7OJ7A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.846619684 (20h10m42.435964671s) [noise=true , address=64.49.13.138:4481 , piece_id=HDNKCDGYH2LAFM2DRIW364W5XRSKF5XK7YZI47ATAAC5A6EBTOUQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.248617890 (20h10m42.837962877s) [noise=true , address=104.36.82.47:4529 , piece_id=UESMFD5UVKCQ4F5XKAG6OMNTA4BS6QV2BME5E7DMIJP7XWHJHT6A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.252848605 (20h10m42.842193592s) [noise=true , address=104.36.82.39:4735 , piece_id=VYEESGWFD57OTLITJU27YFV3IKI34JW7GANQ2U34PV6WAGMPEFXQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.255650606 (20h10m42.844995593s) [noise=true , address=104.36.82.61:4406 , piece_id=WQCH472JAJNEAGQGOF5LYU6RAUICVUOFXDTJC52NWFCEU43YTHEA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.261140931 (20h10m42.850485918s) [noise=true , address=104.36.82.23:4460 , piece_id=GKYZZOHC5J2FV2PWHI4IVTZV7FMVP2OFSJ2UOF24W5USG734RH7Q, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.269129284 (20h10m42.858474261s) [noise=true , address=104.36.82.58:4273 , piece_id=WGPLZNLVUSYYJF7FJSBWAKRZ4LDAXSGBVWSTFRJ3KPBJIXOFSDGQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.274156393 (20h10m42.86350137s) [noise=true , address=104.36.82.43:4868 , piece_id=BM2WYHNTNNQAZHBSITN3ZIACMJLHLO6QACEZFCLYHODB4FYVYHNA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.313273526 (20h10m42.902618513s) [noise=true , address=45.91.116.10:4092 , piece_id=FDHA5FCWTAFZ5N6AJA254W7QKGN3RGCGT7ZGWBIGLTI65DEIG4ZQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.330724515 (20h10m42.920069502s) [noise=true , address=104.36.82.44:4881 , piece_id=JQKJCCUHCJSWLBDF5G5IEP2HAQJXH3FA6H7X4RNUH342SM6CNB5A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345245168 (20h10m42.934590155s) [noise=true , address=104.36.82.20:4457 , piece_id=COVFTVTMO3DGUFVMZH633Q7RMZQRV7P2SRYOVJ2JZFP7RY5N7RHA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345588405 (20h10m42.934933392s) [noise=true , address=104.36.82.60:4348 , piece_id=DSQCOTEIOHDKJSUZYR7RQGXLT6A3FQNPBHZ36UKT3G56PNEWBKZA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345621758 (20h10m42.934966745s) [seg_pos={0 0}, upload=20903]: Segment reached optimal threshold of 14 pieces. Aug 8 05:50:43.345774391 (20h10m42.935119378s) [noise=true , address=104.36.82.13:4202 , piece_id=GNTUDR6M4TV66KTCUMQKC33ESLZAQP4WK3PWS5CDQN5M6FE4ALQQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18wf5KnaR6WaR7MJivJkMJ7FejbuR6KnyvtRQgazNKfDb8fbsH): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345829917 (20h10m42.935174914s) [noise=true , address=104.36.82.36:4633 , piece_id=N6ZYWVZ7CODZ3SWA3T2KL6HWOPISACLE6YNECGDNL6S6NHP6TYZA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345878609 (20h10m42.935223607s) [noise=true , address=104.36.82.44:4873 , piece_id=OGMZZTN6R646OCIKFIN2ARH7HBXIYI4RG3RHOVEFGTGOS6EFLPFA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b5GdYtmYz9D1QW2z78W3Z2fWvMJGtrvrMJ1njbcqbtCDUdwHo): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345924307 (20h10m42.935269294s) [noise=true , address=104.36.82.37:4657 , piece_id=6G2JI22ZFKN72YYNJZ4Q3PK4ODRBF4QOK5OH3XNI245MOEV4INRA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345954214 (20h10m42.935299282s) [seg_pos={0 0}, upload=20903]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:50:43.346042142 (20h10m42.93538716s) [upload=20903]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:50:43.346050880 (20h10m42.935395897s) [upload=20903]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:50:43.643950132 (20h10m43.233295119s) [upload=20903]: Done uploading segments... Aug 8 05:50:43.643971202 (20h10m43.233316189s) [upload=20903]: Upload finished. err: <nil> Duration: 5.772771487s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 5.908174924s FAIL (2025-08-08 05:55:03 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.908199702s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [....X...............X...X..........X......X.............X...] duration: 1.815316172s FAIL (2025-08-08 05:54:37 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== _ObjectCommit Aug 8 05:45:35.317184488 (20h5m34.906529475s) [upload=20811]: Done uploading segments... Aug 8 05:45:35.317202442 (20h5m34.906547429s) [upload=20811]: Upload finished. err: <nil> Aug 8 05:46:01.441656651 (20h6m1.031001648s) [upload=20820]: Starting upload Aug 8 05:46:01.441723649 (20h6m1.031068636s) [upload=20820]: Done starting upload Aug 8 05:46:01.441780508 (20h6m1.031125495s) [upload=20820]: Uploading segments... Aug 8 05:46:01.441873716 (20h6m1.031218703s) [upload=20820]: Got next segment. Inline: true Aug 8 05:46:01.441879027 (20h6m1.031224024s) [upload=20820]: Waiting for error group managing segments... Aug 8 05:46:01.441920596 (20h6m1.031265583s) [upload=20820]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:46:01.441926427 (20h6m1.031271414s) [upload=20820]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:46:01.441929072 (20h6m1.031274069s) [upload=20820]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:46:01.715339951 (20h6m1.304684948s) [upload=20820]: Done uploading segments... Aug 8 05:46:01.715363486 (20h6m1.304708483s) [upload=20820]: Upload finished. err: <nil> Aug 8 05:46:30.814289733 (20h6m30.40363472s) [upload=20825]: Starting upload Aug 8 05:46:30.814402789 (20h6m30.403747776s) [upload=20825]: Done starting upload Aug 8 05:46:30.814469807 (20h6m30.403814794s) [upload=20825]: Uploading segments... Aug 8 05:46:30.814503302 (20h6m30.403848289s) [upload=20825]: Got next segment. Inline: true Aug 8 05:46:30.814507149 (20h6m30.403852136s) [upload=20825]: Waiting for error group managing segments... Aug 8 05:46:30.814539130 (20h6m30.403884117s) [upload=20825]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:46:30.814543147 (20h6m30.403888134s) [upload=20825]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:46:30.814545893 (20h6m30.40389088s) [upload=20825]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:46:31.079785599 (20h6m30.669130586s) [upload=20825]: Done uploading segments... Aug 8 05:46:31.079802632 (20h6m30.669147619s) [upload=20825]: Upload finished. err: <nil> Aug 8 05:47:12.882345463 (20h7m12.47169044s) [upload=20838]: Starting upload Aug 8 05:47:12.882381172 (20h7m12.471726179s) [upload=20838]: Done starting upload Aug 8 05:47:12.882425195 (20h7m12.471770182s) [upload=20838]: Uploading segments... Aug 8 05:47:12.882453229 (20h7m12.471798216s) [upload=20838]: Got next segment. Inline: true Aug 8 05:47:12.882456685 (20h7m12.471801672s) [upload=20838]: Waiting for error group managing segments... Aug 8 05:47:12.882487545 (20h7m12.471832532s) [upload=20838]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:47:12.882491432 (20h7m12.47183642s) [upload=20838]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:47:12.882494017 (20h7m12.471838994s) [upload=20838]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:47:13.318462618 (20h7m12.907807606s) [upload=20838]: Done uploading segments... Aug 8 05:47:13.318481204 (20h7m12.907826191s) [upload=20838]: Upload finished. err: <nil> Aug 8 05:48:17.691657531 (20h8m17.281002518s) [upload=20856]: Starting upload Aug 8 05:48:17.691709179 (20h8m17.281054166s) [upload=20856]: Done starting upload Aug 8 05:48:17.691766710 (20h8m17.281111697s) [upload=20856]: Uploading segments... Aug 8 05:48:17.691802789 (20h8m17.281147776s) [upload=20856]: Got next segment. Inline: true Aug 8 05:48:17.691807738 (20h8m17.281152725s) [upload=20856]: Waiting for error group managing segments... Aug 8 05:48:17.691840431 (20h8m17.281185418s) [upload=20856]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:48:17.691844428 (20h8m17.281189415s) [upload=20856]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:48:17.691846712 (20h8m17.281191699s) [upload=20856]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:48:17.965025328 (20h8m17.554370315s) [upload=20856]: Done uploading segments... Aug 8 05:48:17.965043924 (20h8m17.554388911s) [upload=20856]: Upload finished. err: <nil> Aug 8 05:48:48.116229309 (20h8m47.705574296s) [upload=20866]: Starting upload Aug 8 05:48:48.116275538 (20h8m47.705620525s) [upload=20866]: Done starting upload Aug 8 05:48:48.116329812 (20h8m47.705674789s) [upload=20866]: Uploading segments... Aug 8 05:48:48.116361262 (20h8m47.705706249s) [upload=20866]: Got next segment. Inline: true Aug 8 05:48:48.116364939 (20h8m47.705709926s) [upload=20866]: Waiting for error group managing segments... Aug 8 05:48:48.116397010 (20h8m47.705741997s) [upload=20866]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:48:48.116400528 (20h8m47.705745505s) [upload=20866]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:48:48.116402822 (20h8m47.705747809s) [upload=20866]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:48:48.385497422 (20h8m47.974842409s) [upload=20866]: Done uploading segments... Aug 8 05:48:48.385516399 (20h8m47.974861386s) [upload=20866]: Upload finished. err: <nil> Aug 8 05:49:03.413885916 (20h9m3.003230903s) [upload=20875]: Starting upload Aug 8 05:49:03.413943406 (20h9m3.003288393s) [upload=20875]: Done starting upload Aug 8 05:49:03.413992931 (20h9m3.003337918s) [upload=20875]: Uploading segments... Aug 8 05:49:03.414026846 (20h9m3.003371833s) [upload=20875]: Got next segment. Inline: true Aug 8 05:49:03.414030522 (20h9m3.003375509s) [upload=20875]: Waiting for error group managing segments... Aug 8 05:49:03.414064968 (20h9m3.003409955s) [upload=20875]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:49:03.414068956 (20h9m3.003413933s) [upload=20875]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:49:03.414071261 (20h9m3.003416248s) [upload=20875]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:49:03.687532396 (20h9m3.276877383s) [upload=20875]: Done uploading segments... Aug 8 05:49:03.687559157 (20h9m3.276904194s) [upload=20875]: Upload finished. err: <nil> Aug 8 05:50:11.620858006 (20h10m11.210202993s) [upload=20891]: Starting upload Aug 8 05:50:11.620940003 (20h10m11.21028505s) [upload=20891]: Done starting upload Aug 8 05:50:11.621045826 (20h10m11.210390813s) [upload=20891]: Uploading segments... Aug 8 05:50:11.621132682 (20h10m11.210477659s) [upload=20891]: Got next segment. Inline: true Aug 8 05:50:11.621137571 (20h10m11.210482548s) [upload=20891]: Waiting for error group managing segments... Aug 8 05:50:11.621215971 (20h10m11.210560968s) [upload=20891]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:50:11.621224186 (20h10m11.210569214s) [upload=20891]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:50:11.621227904 (20h10m11.210572891s) [upload=20891]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:50:11.902419833 (20h10m11.49176482s) [upload=20891]: Done uploading segments... Aug 8 05:50:11.902443819 (20h10m11.491788826s) [upload=20891]: Upload finished. err: <nil> Aug 8 05:50:43.301715332 (20h10m42.891060319s) [upload=20904]: Starting upload Aug 8 05:50:43.301764246 (20h10m42.891109223s) [upload=20904]: Done starting upload Aug 8 05:50:43.301849319 (20h10m42.891194306s) [upload=20904]: Uploading segments... Aug 8 05:50:43.301881360 (20h10m42.891226347s) [upload=20904]: Got next segment. Inline: true Aug 8 05:50:43.301884586 (20h10m42.891229573s) [upload=20904]: Waiting for error group managing segments... Aug 8 05:50:43.301917438 (20h10m42.891262425s) [upload=20904]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:50:43.301921266 (20h10m42.891266253s) [upload=20904]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:50:43.301923800 (20h10m42.891268787s) [upload=20904]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:50:43.581330942 (20h10m43.170675929s) [upload=20904]: Done uploading segments... Aug 8 05:50:43.581348606 (20h10m43.170693594s) [upload=20904]: Upload finished. err: <nil> Aug 8 05:51:48.829995842 (20h11m48.419340859s) [upload=20917]: Starting upload Aug 8 05:51:48.830078530 (20h11m48.419423537s) [upload=20917]: Done starting upload Aug 8 05:51:48.830166959 (20h11m48.419511966s) [upload=20917]: Uploading segments... Aug 8 05:51:48.830198750 (20h11m48.419543727s) [upload=20917]: Got next segment. Inline: true Aug 8 05:51:48.830203038 (20h11m48.419548025s) [upload=20917]: Waiting for error group managing segments... Aug 8 05:51:48.830253845 (20h11m48.419598832s) [upload=20917]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:51:48.830263293 (20h11m48.41960828s) [upload=20917]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:51:48.830267131 (20h11m48.419612118s) [upload=20917]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:51:49.104016229 (20h11m48.693361216s) [upload=20917]: Done uploading segments... Aug 8 05:51:49.104034853 (20h11m48.693379831s) [upload=20917]: Upload finished. err: <nil> Aug 8 05:52:06.425779511 (20h12m6.015124498s) [upload=20924]: Starting upload Aug 8 05:52:06.426077070 (20h12m6.015422047s) [upload=20924]: Done starting upload Aug 8 05:52:06.426405829 (20h12m6.015750816s) [upload=20924]: Uploading segments... Aug 8 05:52:06.426449272 (20h12m6.015794259s) [upload=20924]: Got next segment. Inline: true Aug 8 05:52:06.426453941 (20h12m6.015798928s) [upload=20924]: Waiting for error group managing segments... Aug 8 05:52:06.426502244 (20h12m6.015847231s) [upload=20924]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:52:06.426507774 (20h12m6.015852761s) [upload=20924]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:52:06.426510529 (20h12m6.015855506s) [upload=20924]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:52:12.513554098 (20h12m12.102899085s) [upload=20924]: Done uploading segments... Aug 8 05:52:12.513577011 (20h12m12.102921998s) [upload=20924]: Upload finished. err: <nil> Duration: 1.815346489s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [X............XX...............X.X.......................X...] duration: 5.637984915s FAIL (2025-08-08 05:53:55 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== ad finished. err: <nil> Aug 8 05:50:40.893567535 (20h10m40.482912522s) [upload=20903]: Starting upload Aug 8 05:50:40.893617581 (20h10m40.482962568s) [upload=20903]: Done starting upload Aug 8 05:50:40.893745836 (20h10m40.483090823s) [upload=20903]: Uploading segments... Aug 8 05:50:40.893860175 (20h10m40.483205162s) [upload=20903]: Got next segment. Inline: false Aug 8 05:50:40.893898729 (20h10m40.483243706s) [upload=20903]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:50:40.893904339 (20h10m40.483249326s) [upload=20903]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:50:41.341218008 (20h10m40.930562995s) [seg_pos={0 0}, upload=20903]: Begin upload segment... Aug 8 05:50:41.341265508 (20h10m40.930610495s) [seg_pos={0 0}, upload=20903]: Done begin upload segment. Aug 8 05:50:41.341287290 (20h10m40.930632267s) [noise=true , address=104.36.82.37:4657 , piece_id=6G2JI22ZFKN72YYNJZ4Q3PK4ODRBF4QOK5OH3XNI245MOEV4INRA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341358447 (20h10m40.930703434s) [noise=true , address=64.49.13.155:4916 , piece_id=R4EDGKGU5O3XMIEDBT3P3YDZ6M5NDSW627JISIFRRYM3YFY7OJ7A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341670363 (20h10m40.93101535s) [noise=true , address=104.36.82.44:4873 , piece_id=OGMZZTN6R646OCIKFIN2ARH7HBXIYI4RG3RHOVEFGTGOS6EFLPFA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341830500 (20h10m40.931175487s) [noise=true , address=193.149.164.143:4696 , piece_id=FNRXKJGRXG64FVEF7U6WLJT56RBHEONLJF5FM3K7ZRBCQVBL3VFQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341990977 (20h10m40.931335954s) [noise=true , address=104.36.82.39:4735 , piece_id=VYEESGWFD57OTLITJU27YFV3IKI34JW7GANQ2U34PV6WAGMPEFXQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342205478 (20h10m40.931550465s) [noise=true , address=104.36.82.60:4348 , piece_id=DSQCOTEIOHDKJSUZYR7RQGXLT6A3FQNPBHZ36UKT3G56PNEWBKZA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342313615 (20h10m40.931658602s) [noise=true , address=104.36.82.36:4633 , piece_id=N6ZYWVZ7CODZ3SWA3T2KL6HWOPISACLE6YNECGDNL6S6NHP6TYZA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342583129 (20h10m40.931928117s) [noise=true , address=104.36.82.47:4529 , piece_id=UESMFD5UVKCQ4F5XKAG6OMNTA4BS6QV2BME5E7DMIJP7XWHJHT6A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342596976 (20h10m40.931941953s) [noise=true , address=104.36.82.61:4406 , piece_id=WQCH472JAJNEAGQGOF5LYU6RAUICVUOFXDTJC52NWFCEU43YTHEA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342935484 (20h10m40.932280471s) [noise=true , address=104.36.82.44:4881 , piece_id=JQKJCCUHCJSWLBDF5G5IEP2HAQJXH3FA6H7X4RNUH342SM6CNB5A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342953539 (20h10m40.932298526s) [noise=true , address=45.91.116.10:4092 , piece_id=FDHA5FCWTAFZ5N6AJA254W7QKGN3RGCGT7ZGWBIGLTI65DEIG4ZQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343204499 (20h10m40.932549486s) [noise=true , address=104.36.82.13:4202 , piece_id=GNTUDR6M4TV66KTCUMQKC33ESLZAQP4WK3PWS5CDQN5M6FE4ALQQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343223045 (20h10m40.932568032s) [noise=true , address=64.49.13.138:4481 , piece_id=HDNKCDGYH2LAFM2DRIW364W5XRSKF5XK7YZI47ATAAC5A6EBTOUQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343469105 (20h10m40.932814092s) [noise=true , address=64.49.13.140:4509 , piece_id=52T2SWYDXGGJ2IGMUAX5DJQZUFAQUHQTBW4NFC27RQQFLERI2EBQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343567834 (20h10m40.932912821s) [noise=true , address=104.36.82.23:4460 , piece_id=GKYZZOHC5J2FV2PWHI4IVTZV7FMVP2OFSJ2UOF24W5USG734RH7Q, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343687393 (20h10m40.93303237s) [noise=true , address=104.36.82.58:4273 , piece_id=WGPLZNLVUSYYJF7FJSBWAKRZ4LDAXSGBVWSTFRJ3KPBJIXOFSDGQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.344008046 (20h10m40.933353033s) [noise=true , address=104.36.82.43:4868 , piece_id=BM2WYHNTNNQAZHBSITN3ZIACMJLHLO6QACEZFCLYHODB4FYVYHNA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.345979839 (20h10m40.935324816s) [noise=true , address=104.36.82.20:4457 , piece_id=COVFTVTMO3DGUFVMZH633Q7RMZQRV7P2SRYOVJ2JZFP7RY5N7RHA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:42.438670912 (20h10m42.028015899s) [upload=20903]: Next returned nil segment Aug 8 05:50:42.438688716 (20h10m42.028033703s) [upload=20903]: Waiting for error group managing segments... Aug 8 05:50:42.778812377 (20h10m42.368157364s) [noise=true , address=193.149.164.143:4696 , piece_id=FNRXKJGRXG64FVEF7U6WLJT56RBHEONLJF5FM3K7ZRBCQVBL3VFQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.793688260 (20h10m42.383033237s) [noise=true , address=64.49.13.140:4509 , piece_id=52T2SWYDXGGJ2IGMUAX5DJQZUFAQUHQTBW4NFC27RQQFLERI2EBQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.814603478 (20h10m42.403948465s) [noise=true , address=64.49.13.155:4916 , piece_id=R4EDGKGU5O3XMIEDBT3P3YDZ6M5NDSW627JISIFRRYM3YFY7OJ7A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.846619684 (20h10m42.435964671s) [noise=true , address=64.49.13.138:4481 , piece_id=HDNKCDGYH2LAFM2DRIW364W5XRSKF5XK7YZI47ATAAC5A6EBTOUQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.248617890 (20h10m42.837962877s) [noise=true , address=104.36.82.47:4529 , piece_id=UESMFD5UVKCQ4F5XKAG6OMNTA4BS6QV2BME5E7DMIJP7XWHJHT6A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.252848605 (20h10m42.842193592s) [noise=true , address=104.36.82.39:4735 , piece_id=VYEESGWFD57OTLITJU27YFV3IKI34JW7GANQ2U34PV6WAGMPEFXQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.255650606 (20h10m42.844995593s) [noise=true , address=104.36.82.61:4406 , piece_id=WQCH472JAJNEAGQGOF5LYU6RAUICVUOFXDTJC52NWFCEU43YTHEA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.261140931 (20h10m42.850485918s) [noise=true , address=104.36.82.23:4460 , piece_id=GKYZZOHC5J2FV2PWHI4IVTZV7FMVP2OFSJ2UOF24W5USG734RH7Q, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.269129284 (20h10m42.858474261s) [noise=true , address=104.36.82.58:4273 , piece_id=WGPLZNLVUSYYJF7FJSBWAKRZ4LDAXSGBVWSTFRJ3KPBJIXOFSDGQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.274156393 (20h10m42.86350137s) [noise=true , address=104.36.82.43:4868 , piece_id=BM2WYHNTNNQAZHBSITN3ZIACMJLHLO6QACEZFCLYHODB4FYVYHNA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.313273526 (20h10m42.902618513s) [noise=true , address=45.91.116.10:4092 , piece_id=FDHA5FCWTAFZ5N6AJA254W7QKGN3RGCGT7ZGWBIGLTI65DEIG4ZQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.330724515 (20h10m42.920069502s) [noise=true , address=104.36.82.44:4881 , piece_id=JQKJCCUHCJSWLBDF5G5IEP2HAQJXH3FA6H7X4RNUH342SM6CNB5A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345245168 (20h10m42.934590155s) [noise=true , address=104.36.82.20:4457 , piece_id=COVFTVTMO3DGUFVMZH633Q7RMZQRV7P2SRYOVJ2JZFP7RY5N7RHA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345588405 (20h10m42.934933392s) [noise=true , address=104.36.82.60:4348 , piece_id=DSQCOTEIOHDKJSUZYR7RQGXLT6A3FQNPBHZ36UKT3G56PNEWBKZA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345621758 (20h10m42.934966745s) [seg_pos={0 0}, upload=20903]: Segment reached optimal threshold of 14 pieces. Aug 8 05:50:43.345774391 (20h10m42.935119378s) [noise=true , address=104.36.82.13:4202 , piece_id=GNTUDR6M4TV66KTCUMQKC33ESLZAQP4WK3PWS5CDQN5M6FE4ALQQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18wf5KnaR6WaR7MJivJkMJ7FejbuR6KnyvtRQgazNKfDb8fbsH): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345829917 (20h10m42.935174914s) [noise=true , address=104.36.82.36:4633 , piece_id=N6ZYWVZ7CODZ3SWA3T2KL6HWOPISACLE6YNECGDNL6S6NHP6TYZA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345878609 (20h10m42.935223607s) [noise=true , address=104.36.82.44:4873 , piece_id=OGMZZTN6R646OCIKFIN2ARH7HBXIYI4RG3RHOVEFGTGOS6EFLPFA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b5GdYtmYz9D1QW2z78W3Z2fWvMJGtrvrMJ1njbcqbtCDUdwHo): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345924307 (20h10m42.935269294s) [noise=true , address=104.36.82.37:4657 , piece_id=6G2JI22ZFKN72YYNJZ4Q3PK4ODRBF4QOK5OH3XNI245MOEV4INRA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345954214 (20h10m42.935299282s) [seg_pos={0 0}, upload=20903]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:50:43.346042142 (20h10m42.93538716s) [upload=20903]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:50:43.346050880 (20h10m42.935395897s) [upload=20903]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:50:43.643950132 (20h10m43.233295119s) [upload=20903]: Done uploading segments... Aug 8 05:50:43.643971202 (20h10m43.233316189s) [upload=20903]: Upload finished. err: <nil> Duration: 5.638013771s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 6.200013187s FAIL (2025-08-08 05:53:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.200035519s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [.....X...............X...X..........X......X.............X..] duration: 1.835125138s FAIL (2025-08-08 05:53:28 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== _ObjectCommit Aug 8 05:45:35.317184488 (20h5m34.906529475s) [upload=20811]: Done uploading segments... Aug 8 05:45:35.317202442 (20h5m34.906547429s) [upload=20811]: Upload finished. err: <nil> Aug 8 05:46:01.441656651 (20h6m1.031001648s) [upload=20820]: Starting upload Aug 8 05:46:01.441723649 (20h6m1.031068636s) [upload=20820]: Done starting upload Aug 8 05:46:01.441780508 (20h6m1.031125495s) [upload=20820]: Uploading segments... Aug 8 05:46:01.441873716 (20h6m1.031218703s) [upload=20820]: Got next segment. Inline: true Aug 8 05:46:01.441879027 (20h6m1.031224024s) [upload=20820]: Waiting for error group managing segments... Aug 8 05:46:01.441920596 (20h6m1.031265583s) [upload=20820]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:46:01.441926427 (20h6m1.031271414s) [upload=20820]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:46:01.441929072 (20h6m1.031274069s) [upload=20820]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:46:01.715339951 (20h6m1.304684948s) [upload=20820]: Done uploading segments... Aug 8 05:46:01.715363486 (20h6m1.304708483s) [upload=20820]: Upload finished. err: <nil> Aug 8 05:46:30.814289733 (20h6m30.40363472s) [upload=20825]: Starting upload Aug 8 05:46:30.814402789 (20h6m30.403747776s) [upload=20825]: Done starting upload Aug 8 05:46:30.814469807 (20h6m30.403814794s) [upload=20825]: Uploading segments... Aug 8 05:46:30.814503302 (20h6m30.403848289s) [upload=20825]: Got next segment. Inline: true Aug 8 05:46:30.814507149 (20h6m30.403852136s) [upload=20825]: Waiting for error group managing segments... Aug 8 05:46:30.814539130 (20h6m30.403884117s) [upload=20825]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:46:30.814543147 (20h6m30.403888134s) [upload=20825]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:46:30.814545893 (20h6m30.40389088s) [upload=20825]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:46:31.079785599 (20h6m30.669130586s) [upload=20825]: Done uploading segments... Aug 8 05:46:31.079802632 (20h6m30.669147619s) [upload=20825]: Upload finished. err: <nil> Aug 8 05:47:12.882345463 (20h7m12.47169044s) [upload=20838]: Starting upload Aug 8 05:47:12.882381172 (20h7m12.471726179s) [upload=20838]: Done starting upload Aug 8 05:47:12.882425195 (20h7m12.471770182s) [upload=20838]: Uploading segments... Aug 8 05:47:12.882453229 (20h7m12.471798216s) [upload=20838]: Got next segment. Inline: true Aug 8 05:47:12.882456685 (20h7m12.471801672s) [upload=20838]: Waiting for error group managing segments... Aug 8 05:47:12.882487545 (20h7m12.471832532s) [upload=20838]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:47:12.882491432 (20h7m12.47183642s) [upload=20838]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:47:12.882494017 (20h7m12.471838994s) [upload=20838]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:47:13.318462618 (20h7m12.907807606s) [upload=20838]: Done uploading segments... Aug 8 05:47:13.318481204 (20h7m12.907826191s) [upload=20838]: Upload finished. err: <nil> Aug 8 05:48:17.691657531 (20h8m17.281002518s) [upload=20856]: Starting upload Aug 8 05:48:17.691709179 (20h8m17.281054166s) [upload=20856]: Done starting upload Aug 8 05:48:17.691766710 (20h8m17.281111697s) [upload=20856]: Uploading segments... Aug 8 05:48:17.691802789 (20h8m17.281147776s) [upload=20856]: Got next segment. Inline: true Aug 8 05:48:17.691807738 (20h8m17.281152725s) [upload=20856]: Waiting for error group managing segments... Aug 8 05:48:17.691840431 (20h8m17.281185418s) [upload=20856]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:48:17.691844428 (20h8m17.281189415s) [upload=20856]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:48:17.691846712 (20h8m17.281191699s) [upload=20856]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:48:17.965025328 (20h8m17.554370315s) [upload=20856]: Done uploading segments... Aug 8 05:48:17.965043924 (20h8m17.554388911s) [upload=20856]: Upload finished. err: <nil> Aug 8 05:48:48.116229309 (20h8m47.705574296s) [upload=20866]: Starting upload Aug 8 05:48:48.116275538 (20h8m47.705620525s) [upload=20866]: Done starting upload Aug 8 05:48:48.116329812 (20h8m47.705674789s) [upload=20866]: Uploading segments... Aug 8 05:48:48.116361262 (20h8m47.705706249s) [upload=20866]: Got next segment. Inline: true Aug 8 05:48:48.116364939 (20h8m47.705709926s) [upload=20866]: Waiting for error group managing segments... Aug 8 05:48:48.116397010 (20h8m47.705741997s) [upload=20866]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:48:48.116400528 (20h8m47.705745505s) [upload=20866]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:48:48.116402822 (20h8m47.705747809s) [upload=20866]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:48:48.385497422 (20h8m47.974842409s) [upload=20866]: Done uploading segments... Aug 8 05:48:48.385516399 (20h8m47.974861386s) [upload=20866]: Upload finished. err: <nil> Aug 8 05:49:03.413885916 (20h9m3.003230903s) [upload=20875]: Starting upload Aug 8 05:49:03.413943406 (20h9m3.003288393s) [upload=20875]: Done starting upload Aug 8 05:49:03.413992931 (20h9m3.003337918s) [upload=20875]: Uploading segments... Aug 8 05:49:03.414026846 (20h9m3.003371833s) [upload=20875]: Got next segment. Inline: true Aug 8 05:49:03.414030522 (20h9m3.003375509s) [upload=20875]: Waiting for error group managing segments... Aug 8 05:49:03.414064968 (20h9m3.003409955s) [upload=20875]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:49:03.414068956 (20h9m3.003413933s) [upload=20875]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:49:03.414071261 (20h9m3.003416248s) [upload=20875]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:49:03.687532396 (20h9m3.276877383s) [upload=20875]: Done uploading segments... Aug 8 05:49:03.687559157 (20h9m3.276904194s) [upload=20875]: Upload finished. err: <nil> Aug 8 05:50:11.620858006 (20h10m11.210202993s) [upload=20891]: Starting upload Aug 8 05:50:11.620940003 (20h10m11.21028505s) [upload=20891]: Done starting upload Aug 8 05:50:11.621045826 (20h10m11.210390813s) [upload=20891]: Uploading segments... Aug 8 05:50:11.621132682 (20h10m11.210477659s) [upload=20891]: Got next segment. Inline: true Aug 8 05:50:11.621137571 (20h10m11.210482548s) [upload=20891]: Waiting for error group managing segments... Aug 8 05:50:11.621215971 (20h10m11.210560968s) [upload=20891]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:50:11.621224186 (20h10m11.210569214s) [upload=20891]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:50:11.621227904 (20h10m11.210572891s) [upload=20891]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:50:11.902419833 (20h10m11.49176482s) [upload=20891]: Done uploading segments... Aug 8 05:50:11.902443819 (20h10m11.491788826s) [upload=20891]: Upload finished. err: <nil> Aug 8 05:50:43.301715332 (20h10m42.891060319s) [upload=20904]: Starting upload Aug 8 05:50:43.301764246 (20h10m42.891109223s) [upload=20904]: Done starting upload Aug 8 05:50:43.301849319 (20h10m42.891194306s) [upload=20904]: Uploading segments... Aug 8 05:50:43.301881360 (20h10m42.891226347s) [upload=20904]: Got next segment. Inline: true Aug 8 05:50:43.301884586 (20h10m42.891229573s) [upload=20904]: Waiting for error group managing segments... Aug 8 05:50:43.301917438 (20h10m42.891262425s) [upload=20904]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:50:43.301921266 (20h10m42.891266253s) [upload=20904]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:50:43.301923800 (20h10m42.891268787s) [upload=20904]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:50:43.581330942 (20h10m43.170675929s) [upload=20904]: Done uploading segments... Aug 8 05:50:43.581348606 (20h10m43.170693594s) [upload=20904]: Upload finished. err: <nil> Aug 8 05:51:48.829995842 (20h11m48.419340859s) [upload=20917]: Starting upload Aug 8 05:51:48.830078530 (20h11m48.419423537s) [upload=20917]: Done starting upload Aug 8 05:51:48.830166959 (20h11m48.419511966s) [upload=20917]: Uploading segments... Aug 8 05:51:48.830198750 (20h11m48.419543727s) [upload=20917]: Got next segment. Inline: true Aug 8 05:51:48.830203038 (20h11m48.419548025s) [upload=20917]: Waiting for error group managing segments... Aug 8 05:51:48.830253845 (20h11m48.419598832s) [upload=20917]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:51:48.830263293 (20h11m48.41960828s) [upload=20917]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:51:48.830267131 (20h11m48.419612118s) [upload=20917]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:51:49.104016229 (20h11m48.693361216s) [upload=20917]: Done uploading segments... Aug 8 05:51:49.104034853 (20h11m48.693379831s) [upload=20917]: Upload finished. err: <nil> Aug 8 05:52:06.425779511 (20h12m6.015124498s) [upload=20924]: Starting upload Aug 8 05:52:06.426077070 (20h12m6.015422047s) [upload=20924]: Done starting upload Aug 8 05:52:06.426405829 (20h12m6.015750816s) [upload=20924]: Uploading segments... Aug 8 05:52:06.426449272 (20h12m6.015794259s) [upload=20924]: Got next segment. Inline: true Aug 8 05:52:06.426453941 (20h12m6.015798928s) [upload=20924]: Waiting for error group managing segments... Aug 8 05:52:06.426502244 (20h12m6.015847231s) [upload=20924]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:52:06.426507774 (20h12m6.015852761s) [upload=20924]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:52:06.426510529 (20h12m6.015855506s) [upload=20924]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:52:12.513554098 (20h12m12.102899085s) [upload=20924]: Done uploading segments... Aug 8 05:52:12.513577011 (20h12m12.102921998s) [upload=20924]: Upload finished. err: <nil> Duration: 1.835166227s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 5.973718503s FAIL (2025-08-08 05:53:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.973743982s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [.X............XX...............X.X.......................X..] duration: 6.099980171s FAIL (2025-08-08 05:52:47 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== ad finished. err: <nil> Aug 8 05:50:40.893567535 (20h10m40.482912522s) [upload=20903]: Starting upload Aug 8 05:50:40.893617581 (20h10m40.482962568s) [upload=20903]: Done starting upload Aug 8 05:50:40.893745836 (20h10m40.483090823s) [upload=20903]: Uploading segments... Aug 8 05:50:40.893860175 (20h10m40.483205162s) [upload=20903]: Got next segment. Inline: false Aug 8 05:50:40.893898729 (20h10m40.483243706s) [upload=20903]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:50:40.893904339 (20h10m40.483249326s) [upload=20903]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:50:41.341218008 (20h10m40.930562995s) [seg_pos={0 0}, upload=20903]: Begin upload segment... Aug 8 05:50:41.341265508 (20h10m40.930610495s) [seg_pos={0 0}, upload=20903]: Done begin upload segment. Aug 8 05:50:41.341287290 (20h10m40.930632267s) [noise=true , address=104.36.82.37:4657 , piece_id=6G2JI22ZFKN72YYNJZ4Q3PK4ODRBF4QOK5OH3XNI245MOEV4INRA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341358447 (20h10m40.930703434s) [noise=true , address=64.49.13.155:4916 , piece_id=R4EDGKGU5O3XMIEDBT3P3YDZ6M5NDSW627JISIFRRYM3YFY7OJ7A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341670363 (20h10m40.93101535s) [noise=true , address=104.36.82.44:4873 , piece_id=OGMZZTN6R646OCIKFIN2ARH7HBXIYI4RG3RHOVEFGTGOS6EFLPFA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341830500 (20h10m40.931175487s) [noise=true , address=193.149.164.143:4696 , piece_id=FNRXKJGRXG64FVEF7U6WLJT56RBHEONLJF5FM3K7ZRBCQVBL3VFQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341990977 (20h10m40.931335954s) [noise=true , address=104.36.82.39:4735 , piece_id=VYEESGWFD57OTLITJU27YFV3IKI34JW7GANQ2U34PV6WAGMPEFXQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342205478 (20h10m40.931550465s) [noise=true , address=104.36.82.60:4348 , piece_id=DSQCOTEIOHDKJSUZYR7RQGXLT6A3FQNPBHZ36UKT3G56PNEWBKZA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342313615 (20h10m40.931658602s) [noise=true , address=104.36.82.36:4633 , piece_id=N6ZYWVZ7CODZ3SWA3T2KL6HWOPISACLE6YNECGDNL6S6NHP6TYZA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342583129 (20h10m40.931928117s) [noise=true , address=104.36.82.47:4529 , piece_id=UESMFD5UVKCQ4F5XKAG6OMNTA4BS6QV2BME5E7DMIJP7XWHJHT6A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342596976 (20h10m40.931941953s) [noise=true , address=104.36.82.61:4406 , piece_id=WQCH472JAJNEAGQGOF5LYU6RAUICVUOFXDTJC52NWFCEU43YTHEA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342935484 (20h10m40.932280471s) [noise=true , address=104.36.82.44:4881 , piece_id=JQKJCCUHCJSWLBDF5G5IEP2HAQJXH3FA6H7X4RNUH342SM6CNB5A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342953539 (20h10m40.932298526s) [noise=true , address=45.91.116.10:4092 , piece_id=FDHA5FCWTAFZ5N6AJA254W7QKGN3RGCGT7ZGWBIGLTI65DEIG4ZQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343204499 (20h10m40.932549486s) [noise=true , address=104.36.82.13:4202 , piece_id=GNTUDR6M4TV66KTCUMQKC33ESLZAQP4WK3PWS5CDQN5M6FE4ALQQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343223045 (20h10m40.932568032s) [noise=true , address=64.49.13.138:4481 , piece_id=HDNKCDGYH2LAFM2DRIW364W5XRSKF5XK7YZI47ATAAC5A6EBTOUQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343469105 (20h10m40.932814092s) [noise=true , address=64.49.13.140:4509 , piece_id=52T2SWYDXGGJ2IGMUAX5DJQZUFAQUHQTBW4NFC27RQQFLERI2EBQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343567834 (20h10m40.932912821s) [noise=true , address=104.36.82.23:4460 , piece_id=GKYZZOHC5J2FV2PWHI4IVTZV7FMVP2OFSJ2UOF24W5USG734RH7Q, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343687393 (20h10m40.93303237s) [noise=true , address=104.36.82.58:4273 , piece_id=WGPLZNLVUSYYJF7FJSBWAKRZ4LDAXSGBVWSTFRJ3KPBJIXOFSDGQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.344008046 (20h10m40.933353033s) [noise=true , address=104.36.82.43:4868 , piece_id=BM2WYHNTNNQAZHBSITN3ZIACMJLHLO6QACEZFCLYHODB4FYVYHNA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.345979839 (20h10m40.935324816s) [noise=true , address=104.36.82.20:4457 , piece_id=COVFTVTMO3DGUFVMZH633Q7RMZQRV7P2SRYOVJ2JZFP7RY5N7RHA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:42.438670912 (20h10m42.028015899s) [upload=20903]: Next returned nil segment Aug 8 05:50:42.438688716 (20h10m42.028033703s) [upload=20903]: Waiting for error group managing segments... Aug 8 05:50:42.778812377 (20h10m42.368157364s) [noise=true , address=193.149.164.143:4696 , piece_id=FNRXKJGRXG64FVEF7U6WLJT56RBHEONLJF5FM3K7ZRBCQVBL3VFQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.793688260 (20h10m42.383033237s) [noise=true , address=64.49.13.140:4509 , piece_id=52T2SWYDXGGJ2IGMUAX5DJQZUFAQUHQTBW4NFC27RQQFLERI2EBQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.814603478 (20h10m42.403948465s) [noise=true , address=64.49.13.155:4916 , piece_id=R4EDGKGU5O3XMIEDBT3P3YDZ6M5NDSW627JISIFRRYM3YFY7OJ7A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.846619684 (20h10m42.435964671s) [noise=true , address=64.49.13.138:4481 , piece_id=HDNKCDGYH2LAFM2DRIW364W5XRSKF5XK7YZI47ATAAC5A6EBTOUQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.248617890 (20h10m42.837962877s) [noise=true , address=104.36.82.47:4529 , piece_id=UESMFD5UVKCQ4F5XKAG6OMNTA4BS6QV2BME5E7DMIJP7XWHJHT6A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.252848605 (20h10m42.842193592s) [noise=true , address=104.36.82.39:4735 , piece_id=VYEESGWFD57OTLITJU27YFV3IKI34JW7GANQ2U34PV6WAGMPEFXQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.255650606 (20h10m42.844995593s) [noise=true , address=104.36.82.61:4406 , piece_id=WQCH472JAJNEAGQGOF5LYU6RAUICVUOFXDTJC52NWFCEU43YTHEA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.261140931 (20h10m42.850485918s) [noise=true , address=104.36.82.23:4460 , piece_id=GKYZZOHC5J2FV2PWHI4IVTZV7FMVP2OFSJ2UOF24W5USG734RH7Q, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.269129284 (20h10m42.858474261s) [noise=true , address=104.36.82.58:4273 , piece_id=WGPLZNLVUSYYJF7FJSBWAKRZ4LDAXSGBVWSTFRJ3KPBJIXOFSDGQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.274156393 (20h10m42.86350137s) [noise=true , address=104.36.82.43:4868 , piece_id=BM2WYHNTNNQAZHBSITN3ZIACMJLHLO6QACEZFCLYHODB4FYVYHNA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.313273526 (20h10m42.902618513s) [noise=true , address=45.91.116.10:4092 , piece_id=FDHA5FCWTAFZ5N6AJA254W7QKGN3RGCGT7ZGWBIGLTI65DEIG4ZQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.330724515 (20h10m42.920069502s) [noise=true , address=104.36.82.44:4881 , piece_id=JQKJCCUHCJSWLBDF5G5IEP2HAQJXH3FA6H7X4RNUH342SM6CNB5A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345245168 (20h10m42.934590155s) [noise=true , address=104.36.82.20:4457 , piece_id=COVFTVTMO3DGUFVMZH633Q7RMZQRV7P2SRYOVJ2JZFP7RY5N7RHA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345588405 (20h10m42.934933392s) [noise=true , address=104.36.82.60:4348 , piece_id=DSQCOTEIOHDKJSUZYR7RQGXLT6A3FQNPBHZ36UKT3G56PNEWBKZA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345621758 (20h10m42.934966745s) [seg_pos={0 0}, upload=20903]: Segment reached optimal threshold of 14 pieces. Aug 8 05:50:43.345774391 (20h10m42.935119378s) [noise=true , address=104.36.82.13:4202 , piece_id=GNTUDR6M4TV66KTCUMQKC33ESLZAQP4WK3PWS5CDQN5M6FE4ALQQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18wf5KnaR6WaR7MJivJkMJ7FejbuR6KnyvtRQgazNKfDb8fbsH): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345829917 (20h10m42.935174914s) [noise=true , address=104.36.82.36:4633 , piece_id=N6ZYWVZ7CODZ3SWA3T2KL6HWOPISACLE6YNECGDNL6S6NHP6TYZA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345878609 (20h10m42.935223607s) [noise=true , address=104.36.82.44:4873 , piece_id=OGMZZTN6R646OCIKFIN2ARH7HBXIYI4RG3RHOVEFGTGOS6EFLPFA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b5GdYtmYz9D1QW2z78W3Z2fWvMJGtrvrMJ1njbcqbtCDUdwHo): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345924307 (20h10m42.935269294s) [noise=true , address=104.36.82.37:4657 , piece_id=6G2JI22ZFKN72YYNJZ4Q3PK4ODRBF4QOK5OH3XNI245MOEV4INRA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345954214 (20h10m42.935299282s) [seg_pos={0 0}, upload=20903]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:50:43.346042142 (20h10m42.93538716s) [upload=20903]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:50:43.346050880 (20h10m42.935395897s) [upload=20903]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:50:43.643950132 (20h10m43.233295119s) [upload=20903]: Done uploading segments... Aug 8 05:50:43.643971202 (20h10m43.233316189s) [upload=20903]: Upload finished. err: <nil> Duration: 6.100001981s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [......X...............X...X..........X......X.............X.] duration: 2.155856956s FAIL (2025-08-08 05:52:34 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== _ObjectCommit Aug 8 05:45:35.317184488 (20h5m34.906529475s) [upload=20811]: Done uploading segments... Aug 8 05:45:35.317202442 (20h5m34.906547429s) [upload=20811]: Upload finished. err: <nil> Aug 8 05:46:01.441656651 (20h6m1.031001648s) [upload=20820]: Starting upload Aug 8 05:46:01.441723649 (20h6m1.031068636s) [upload=20820]: Done starting upload Aug 8 05:46:01.441780508 (20h6m1.031125495s) [upload=20820]: Uploading segments... Aug 8 05:46:01.441873716 (20h6m1.031218703s) [upload=20820]: Got next segment. Inline: true Aug 8 05:46:01.441879027 (20h6m1.031224024s) [upload=20820]: Waiting for error group managing segments... Aug 8 05:46:01.441920596 (20h6m1.031265583s) [upload=20820]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:46:01.441926427 (20h6m1.031271414s) [upload=20820]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:46:01.441929072 (20h6m1.031274069s) [upload=20820]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:46:01.715339951 (20h6m1.304684948s) [upload=20820]: Done uploading segments... Aug 8 05:46:01.715363486 (20h6m1.304708483s) [upload=20820]: Upload finished. err: <nil> Aug 8 05:46:30.814289733 (20h6m30.40363472s) [upload=20825]: Starting upload Aug 8 05:46:30.814402789 (20h6m30.403747776s) [upload=20825]: Done starting upload Aug 8 05:46:30.814469807 (20h6m30.403814794s) [upload=20825]: Uploading segments... Aug 8 05:46:30.814503302 (20h6m30.403848289s) [upload=20825]: Got next segment. Inline: true Aug 8 05:46:30.814507149 (20h6m30.403852136s) [upload=20825]: Waiting for error group managing segments... Aug 8 05:46:30.814539130 (20h6m30.403884117s) [upload=20825]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:46:30.814543147 (20h6m30.403888134s) [upload=20825]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:46:30.814545893 (20h6m30.40389088s) [upload=20825]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:46:31.079785599 (20h6m30.669130586s) [upload=20825]: Done uploading segments... Aug 8 05:46:31.079802632 (20h6m30.669147619s) [upload=20825]: Upload finished. err: <nil> Aug 8 05:47:12.882345463 (20h7m12.47169044s) [upload=20838]: Starting upload Aug 8 05:47:12.882381172 (20h7m12.471726179s) [upload=20838]: Done starting upload Aug 8 05:47:12.882425195 (20h7m12.471770182s) [upload=20838]: Uploading segments... Aug 8 05:47:12.882453229 (20h7m12.471798216s) [upload=20838]: Got next segment. Inline: true Aug 8 05:47:12.882456685 (20h7m12.471801672s) [upload=20838]: Waiting for error group managing segments... Aug 8 05:47:12.882487545 (20h7m12.471832532s) [upload=20838]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:47:12.882491432 (20h7m12.47183642s) [upload=20838]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:47:12.882494017 (20h7m12.471838994s) [upload=20838]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:47:13.318462618 (20h7m12.907807606s) [upload=20838]: Done uploading segments... Aug 8 05:47:13.318481204 (20h7m12.907826191s) [upload=20838]: Upload finished. err: <nil> Aug 8 05:48:17.691657531 (20h8m17.281002518s) [upload=20856]: Starting upload Aug 8 05:48:17.691709179 (20h8m17.281054166s) [upload=20856]: Done starting upload Aug 8 05:48:17.691766710 (20h8m17.281111697s) [upload=20856]: Uploading segments... Aug 8 05:48:17.691802789 (20h8m17.281147776s) [upload=20856]: Got next segment. Inline: true Aug 8 05:48:17.691807738 (20h8m17.281152725s) [upload=20856]: Waiting for error group managing segments... Aug 8 05:48:17.691840431 (20h8m17.281185418s) [upload=20856]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:48:17.691844428 (20h8m17.281189415s) [upload=20856]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:48:17.691846712 (20h8m17.281191699s) [upload=20856]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:48:17.965025328 (20h8m17.554370315s) [upload=20856]: Done uploading segments... Aug 8 05:48:17.965043924 (20h8m17.554388911s) [upload=20856]: Upload finished. err: <nil> Aug 8 05:48:48.116229309 (20h8m47.705574296s) [upload=20866]: Starting upload Aug 8 05:48:48.116275538 (20h8m47.705620525s) [upload=20866]: Done starting upload Aug 8 05:48:48.116329812 (20h8m47.705674789s) [upload=20866]: Uploading segments... Aug 8 05:48:48.116361262 (20h8m47.705706249s) [upload=20866]: Got next segment. Inline: true Aug 8 05:48:48.116364939 (20h8m47.705709926s) [upload=20866]: Waiting for error group managing segments... Aug 8 05:48:48.116397010 (20h8m47.705741997s) [upload=20866]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:48:48.116400528 (20h8m47.705745505s) [upload=20866]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:48:48.116402822 (20h8m47.705747809s) [upload=20866]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:48:48.385497422 (20h8m47.974842409s) [upload=20866]: Done uploading segments... Aug 8 05:48:48.385516399 (20h8m47.974861386s) [upload=20866]: Upload finished. err: <nil> Aug 8 05:49:03.413885916 (20h9m3.003230903s) [upload=20875]: Starting upload Aug 8 05:49:03.413943406 (20h9m3.003288393s) [upload=20875]: Done starting upload Aug 8 05:49:03.413992931 (20h9m3.003337918s) [upload=20875]: Uploading segments... Aug 8 05:49:03.414026846 (20h9m3.003371833s) [upload=20875]: Got next segment. Inline: true Aug 8 05:49:03.414030522 (20h9m3.003375509s) [upload=20875]: Waiting for error group managing segments... Aug 8 05:49:03.414064968 (20h9m3.003409955s) [upload=20875]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:49:03.414068956 (20h9m3.003413933s) [upload=20875]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:49:03.414071261 (20h9m3.003416248s) [upload=20875]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:49:03.687532396 (20h9m3.276877383s) [upload=20875]: Done uploading segments... Aug 8 05:49:03.687559157 (20h9m3.276904194s) [upload=20875]: Upload finished. err: <nil> Aug 8 05:50:11.620858006 (20h10m11.210202993s) [upload=20891]: Starting upload Aug 8 05:50:11.620940003 (20h10m11.21028505s) [upload=20891]: Done starting upload Aug 8 05:50:11.621045826 (20h10m11.210390813s) [upload=20891]: Uploading segments... Aug 8 05:50:11.621132682 (20h10m11.210477659s) [upload=20891]: Got next segment. Inline: true Aug 8 05:50:11.621137571 (20h10m11.210482548s) [upload=20891]: Waiting for error group managing segments... Aug 8 05:50:11.621215971 (20h10m11.210560968s) [upload=20891]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:50:11.621224186 (20h10m11.210569214s) [upload=20891]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:50:11.621227904 (20h10m11.210572891s) [upload=20891]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:50:11.902419833 (20h10m11.49176482s) [upload=20891]: Done uploading segments... Aug 8 05:50:11.902443819 (20h10m11.491788826s) [upload=20891]: Upload finished. err: <nil> Aug 8 05:50:43.301715332 (20h10m42.891060319s) [upload=20904]: Starting upload Aug 8 05:50:43.301764246 (20h10m42.891109223s) [upload=20904]: Done starting upload Aug 8 05:50:43.301849319 (20h10m42.891194306s) [upload=20904]: Uploading segments... Aug 8 05:50:43.301881360 (20h10m42.891226347s) [upload=20904]: Got next segment. Inline: true Aug 8 05:50:43.301884586 (20h10m42.891229573s) [upload=20904]: Waiting for error group managing segments... Aug 8 05:50:43.301917438 (20h10m42.891262425s) [upload=20904]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:50:43.301921266 (20h10m42.891266253s) [upload=20904]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:50:43.301923800 (20h10m42.891268787s) [upload=20904]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:50:43.581330942 (20h10m43.170675929s) [upload=20904]: Done uploading segments... Aug 8 05:50:43.581348606 (20h10m43.170693594s) [upload=20904]: Upload finished. err: <nil> Aug 8 05:51:48.829995842 (20h11m48.419340859s) [upload=20917]: Starting upload Aug 8 05:51:48.830078530 (20h11m48.419423537s) [upload=20917]: Done starting upload Aug 8 05:51:48.830166959 (20h11m48.419511966s) [upload=20917]: Uploading segments... Aug 8 05:51:48.830198750 (20h11m48.419543727s) [upload=20917]: Got next segment. Inline: true Aug 8 05:51:48.830203038 (20h11m48.419548025s) [upload=20917]: Waiting for error group managing segments... Aug 8 05:51:48.830253845 (20h11m48.419598832s) [upload=20917]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:51:48.830263293 (20h11m48.41960828s) [upload=20917]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:51:48.830267131 (20h11m48.419612118s) [upload=20917]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:51:49.104016229 (20h11m48.693361216s) [upload=20917]: Done uploading segments... Aug 8 05:51:49.104034853 (20h11m48.693379831s) [upload=20917]: Upload finished. err: <nil> Aug 8 05:52:06.425779511 (20h12m6.015124498s) [upload=20924]: Starting upload Aug 8 05:52:06.426077070 (20h12m6.015422047s) [upload=20924]: Done starting upload Aug 8 05:52:06.426405829 (20h12m6.015750816s) [upload=20924]: Uploading segments... Aug 8 05:52:06.426449272 (20h12m6.015794259s) [upload=20924]: Got next segment. Inline: true Aug 8 05:52:06.426453941 (20h12m6.015798928s) [upload=20924]: Waiting for error group managing segments... Aug 8 05:52:06.426502244 (20h12m6.015847231s) [upload=20924]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:52:06.426507774 (20h12m6.015852761s) [upload=20924]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:52:06.426510529 (20h12m6.015855506s) [upload=20924]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:52:12.513554098 (20h12m12.102899085s) [upload=20924]: Done uploading segments... Aug 8 05:52:12.513577011 (20h12m12.102921998s) [upload=20924]: Upload finished. err: <nil> Duration: 2.155880452s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 9.221303549s FAIL (2025-08-08 05:52:15 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 9.221328076s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [.......X...............X...X..........X......X.............X] duration: 7.520634069s FAIL (2025-08-08 05:52:13 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== _ObjectCommit Aug 8 05:45:35.317184488 (20h5m34.906529475s) [upload=20811]: Done uploading segments... Aug 8 05:45:35.317202442 (20h5m34.906547429s) [upload=20811]: Upload finished. err: <nil> Aug 8 05:46:01.441656651 (20h6m1.031001648s) [upload=20820]: Starting upload Aug 8 05:46:01.441723649 (20h6m1.031068636s) [upload=20820]: Done starting upload Aug 8 05:46:01.441780508 (20h6m1.031125495s) [upload=20820]: Uploading segments... Aug 8 05:46:01.441873716 (20h6m1.031218703s) [upload=20820]: Got next segment. Inline: true Aug 8 05:46:01.441879027 (20h6m1.031224024s) [upload=20820]: Waiting for error group managing segments... Aug 8 05:46:01.441920596 (20h6m1.031265583s) [upload=20820]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:46:01.441926427 (20h6m1.031271414s) [upload=20820]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:46:01.441929072 (20h6m1.031274069s) [upload=20820]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:46:01.715339951 (20h6m1.304684948s) [upload=20820]: Done uploading segments... Aug 8 05:46:01.715363486 (20h6m1.304708483s) [upload=20820]: Upload finished. err: <nil> Aug 8 05:46:30.814289733 (20h6m30.40363472s) [upload=20825]: Starting upload Aug 8 05:46:30.814402789 (20h6m30.403747776s) [upload=20825]: Done starting upload Aug 8 05:46:30.814469807 (20h6m30.403814794s) [upload=20825]: Uploading segments... Aug 8 05:46:30.814503302 (20h6m30.403848289s) [upload=20825]: Got next segment. Inline: true Aug 8 05:46:30.814507149 (20h6m30.403852136s) [upload=20825]: Waiting for error group managing segments... Aug 8 05:46:30.814539130 (20h6m30.403884117s) [upload=20825]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:46:30.814543147 (20h6m30.403888134s) [upload=20825]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:46:30.814545893 (20h6m30.40389088s) [upload=20825]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:46:31.079785599 (20h6m30.669130586s) [upload=20825]: Done uploading segments... Aug 8 05:46:31.079802632 (20h6m30.669147619s) [upload=20825]: Upload finished. err: <nil> Aug 8 05:47:12.882345463 (20h7m12.47169044s) [upload=20838]: Starting upload Aug 8 05:47:12.882381172 (20h7m12.471726179s) [upload=20838]: Done starting upload Aug 8 05:47:12.882425195 (20h7m12.471770182s) [upload=20838]: Uploading segments... Aug 8 05:47:12.882453229 (20h7m12.471798216s) [upload=20838]: Got next segment. Inline: true Aug 8 05:47:12.882456685 (20h7m12.471801672s) [upload=20838]: Waiting for error group managing segments... Aug 8 05:47:12.882487545 (20h7m12.471832532s) [upload=20838]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:47:12.882491432 (20h7m12.47183642s) [upload=20838]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:47:12.882494017 (20h7m12.471838994s) [upload=20838]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:47:13.318462618 (20h7m12.907807606s) [upload=20838]: Done uploading segments... Aug 8 05:47:13.318481204 (20h7m12.907826191s) [upload=20838]: Upload finished. err: <nil> Aug 8 05:48:17.691657531 (20h8m17.281002518s) [upload=20856]: Starting upload Aug 8 05:48:17.691709179 (20h8m17.281054166s) [upload=20856]: Done starting upload Aug 8 05:48:17.691766710 (20h8m17.281111697s) [upload=20856]: Uploading segments... Aug 8 05:48:17.691802789 (20h8m17.281147776s) [upload=20856]: Got next segment. Inline: true Aug 8 05:48:17.691807738 (20h8m17.281152725s) [upload=20856]: Waiting for error group managing segments... Aug 8 05:48:17.691840431 (20h8m17.281185418s) [upload=20856]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:48:17.691844428 (20h8m17.281189415s) [upload=20856]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:48:17.691846712 (20h8m17.281191699s) [upload=20856]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:48:17.965025328 (20h8m17.554370315s) [upload=20856]: Done uploading segments... Aug 8 05:48:17.965043924 (20h8m17.554388911s) [upload=20856]: Upload finished. err: <nil> Aug 8 05:48:48.116229309 (20h8m47.705574296s) [upload=20866]: Starting upload Aug 8 05:48:48.116275538 (20h8m47.705620525s) [upload=20866]: Done starting upload Aug 8 05:48:48.116329812 (20h8m47.705674789s) [upload=20866]: Uploading segments... Aug 8 05:48:48.116361262 (20h8m47.705706249s) [upload=20866]: Got next segment. Inline: true Aug 8 05:48:48.116364939 (20h8m47.705709926s) [upload=20866]: Waiting for error group managing segments... Aug 8 05:48:48.116397010 (20h8m47.705741997s) [upload=20866]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:48:48.116400528 (20h8m47.705745505s) [upload=20866]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:48:48.116402822 (20h8m47.705747809s) [upload=20866]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:48:48.385497422 (20h8m47.974842409s) [upload=20866]: Done uploading segments... Aug 8 05:48:48.385516399 (20h8m47.974861386s) [upload=20866]: Upload finished. err: <nil> Aug 8 05:49:03.413885916 (20h9m3.003230903s) [upload=20875]: Starting upload Aug 8 05:49:03.413943406 (20h9m3.003288393s) [upload=20875]: Done starting upload Aug 8 05:49:03.413992931 (20h9m3.003337918s) [upload=20875]: Uploading segments... Aug 8 05:49:03.414026846 (20h9m3.003371833s) [upload=20875]: Got next segment. Inline: true Aug 8 05:49:03.414030522 (20h9m3.003375509s) [upload=20875]: Waiting for error group managing segments... Aug 8 05:49:03.414064968 (20h9m3.003409955s) [upload=20875]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:49:03.414068956 (20h9m3.003413933s) [upload=20875]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:49:03.414071261 (20h9m3.003416248s) [upload=20875]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:49:03.687532396 (20h9m3.276877383s) [upload=20875]: Done uploading segments... Aug 8 05:49:03.687559157 (20h9m3.276904194s) [upload=20875]: Upload finished. err: <nil> Aug 8 05:50:11.620858006 (20h10m11.210202993s) [upload=20891]: Starting upload Aug 8 05:50:11.620940003 (20h10m11.21028505s) [upload=20891]: Done starting upload Aug 8 05:50:11.621045826 (20h10m11.210390813s) [upload=20891]: Uploading segments... Aug 8 05:50:11.621132682 (20h10m11.210477659s) [upload=20891]: Got next segment. Inline: true Aug 8 05:50:11.621137571 (20h10m11.210482548s) [upload=20891]: Waiting for error group managing segments... Aug 8 05:50:11.621215971 (20h10m11.210560968s) [upload=20891]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:50:11.621224186 (20h10m11.210569214s) [upload=20891]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:50:11.621227904 (20h10m11.210572891s) [upload=20891]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:50:11.902419833 (20h10m11.49176482s) [upload=20891]: Done uploading segments... Aug 8 05:50:11.902443819 (20h10m11.491788826s) [upload=20891]: Upload finished. err: <nil> Aug 8 05:50:43.301715332 (20h10m42.891060319s) [upload=20904]: Starting upload Aug 8 05:50:43.301764246 (20h10m42.891109223s) [upload=20904]: Done starting upload Aug 8 05:50:43.301849319 (20h10m42.891194306s) [upload=20904]: Uploading segments... Aug 8 05:50:43.301881360 (20h10m42.891226347s) [upload=20904]: Got next segment. Inline: true Aug 8 05:50:43.301884586 (20h10m42.891229573s) [upload=20904]: Waiting for error group managing segments... Aug 8 05:50:43.301917438 (20h10m42.891262425s) [upload=20904]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:50:43.301921266 (20h10m42.891266253s) [upload=20904]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:50:43.301923800 (20h10m42.891268787s) [upload=20904]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:50:43.581330942 (20h10m43.170675929s) [upload=20904]: Done uploading segments... Aug 8 05:50:43.581348606 (20h10m43.170693594s) [upload=20904]: Upload finished. err: <nil> Aug 8 05:51:48.829995842 (20h11m48.419340859s) [upload=20917]: Starting upload Aug 8 05:51:48.830078530 (20h11m48.419423537s) [upload=20917]: Done starting upload Aug 8 05:51:48.830166959 (20h11m48.419511966s) [upload=20917]: Uploading segments... Aug 8 05:51:48.830198750 (20h11m48.419543727s) [upload=20917]: Got next segment. Inline: true Aug 8 05:51:48.830203038 (20h11m48.419548025s) [upload=20917]: Waiting for error group managing segments... Aug 8 05:51:48.830253845 (20h11m48.419598832s) [upload=20917]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:51:48.830263293 (20h11m48.41960828s) [upload=20917]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:51:48.830267131 (20h11m48.419612118s) [upload=20917]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:51:49.104016229 (20h11m48.693361216s) [upload=20917]: Done uploading segments... Aug 8 05:51:49.104034853 (20h11m48.693379831s) [upload=20917]: Upload finished. err: <nil> Aug 8 05:52:06.425779511 (20h12m6.015124498s) [upload=20924]: Starting upload Aug 8 05:52:06.426077070 (20h12m6.015422047s) [upload=20924]: Done starting upload Aug 8 05:52:06.426405829 (20h12m6.015750816s) [upload=20924]: Uploading segments... Aug 8 05:52:06.426449272 (20h12m6.015794259s) [upload=20924]: Got next segment. Inline: true Aug 8 05:52:06.426453941 (20h12m6.015798928s) [upload=20924]: Waiting for error group managing segments... Aug 8 05:52:06.426502244 (20h12m6.015847231s) [upload=20924]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:52:06.426507774 (20h12m6.015852761s) [upload=20924]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:52:06.426510529 (20h12m6.015855506s) [upload=20924]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:52:12.513554098 (20h12m12.102899085s) [upload=20924]: Done uploading segments... Aug 8 05:52:12.513577011 (20h12m12.102921998s) [upload=20924]: Upload finished. err: <nil> Duration: 7.520662351s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [........X...............X...X..........X......X.............] duration: 1.839563219s FAIL (2025-08-08 05:51:50 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 10201218 (19h54m43.199546205s) [upload=20622]: Done uploading segments... Aug 8 05:34:43.610217147 (19h54m43.199562135s) [upload=20622]: Upload finished. err: <nil> Aug 8 05:35:04.023055775 (19h55m3.612400762s) [upload=20630]: Starting upload Aug 8 05:35:04.023110239 (19h55m3.612455227s) [upload=20630]: Done starting upload Aug 8 05:35:04.023211963 (19h55m3.61255695s) [upload=20630]: Uploading segments... Aug 8 05:35:04.023253063 (19h55m3.61259806s) [upload=20630]: Got next segment. Inline: true Aug 8 05:35:04.023258142 (19h55m3.612603139s) [upload=20630]: Waiting for error group managing segments... Aug 8 05:35:04.023303700 (19h55m3.612648687s) [upload=20630]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:35:04.023307607 (19h55m3.612652594s) [upload=20630]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:35:04.023310082 (19h55m3.612655069s) [upload=20630]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:35:04.309190970 (19h55m3.898535957s) [upload=20630]: Done uploading segments... Aug 8 05:35:04.309209536 (19h55m3.898554523s) [upload=20630]: Upload finished. err: <nil> Aug 8 05:35:55.759534624 (19h55m55.348879611s) [upload=20645]: Starting upload Aug 8 05:35:55.759570612 (19h55m55.348915599s) [upload=20645]: Done starting upload Aug 8 05:35:55.759660394 (19h55m55.349005381s) [upload=20645]: Uploading segments... Aug 8 05:35:55.759699860 (19h55m55.349044857s) [upload=20645]: Got next segment. Inline: true Aug 8 05:35:55.759703707 (19h55m55.349048694s) [upload=20645]: Waiting for error group managing segments... Aug 8 05:35:55.759738624 (19h55m55.349083601s) [upload=20645]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:35:55.759743192 (19h55m55.349088189s) [upload=20645]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:35:55.759746088 (19h55m55.349091085s) [upload=20645]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:35:56.089922739 (19h55m55.679267726s) [upload=20645]: Done uploading segments... Aug 8 05:35:56.089940492 (19h55m55.679285469s) [upload=20645]: Upload finished. err: <nil> Aug 8 05:36:56.815438704 (19h56m56.404783681s) [upload=20663]: Starting upload Aug 8 05:36:56.815488349 (19h56m56.404833337s) [upload=20663]: Done starting upload Aug 8 05:36:56.815535940 (19h56m56.404880927s) [upload=20663]: Uploading segments... Aug 8 05:36:56.815564444 (19h56m56.404909431s) [upload=20663]: Got next segment. Inline: true Aug 8 05:36:56.815568403 (19h56m56.40491339s) [upload=20663]: Waiting for error group managing segments... Aug 8 05:36:56.815600274 (19h56m56.404945261s) [upload=20663]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:36:56.815603780 (19h56m56.404948767s) [upload=20663]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:36:56.815606074 (19h56m56.404951061s) [upload=20663]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:36:57.078410111 (19h56m56.667755098s) [upload=20663]: Done uploading segments... Aug 8 05:36:57.078426431 (19h56m56.667771418s) [upload=20663]: Upload finished. err: <nil> Aug 8 05:38:06.909129599 (19h58m6.498474596s) [upload=20681]: Starting upload Aug 8 05:38:06.909198019 (19h58m6.498543006s) [upload=20681]: Done starting upload Aug 8 05:38:06.909290978 (19h58m6.498635955s) [upload=20681]: Uploading segments... Aug 8 05:38:06.909411137 (19h58m6.498756134s) [upload=20681]: Got next segment. Inline: true Aug 8 05:38:06.909416046 (19h58m6.498761034s) [upload=20681]: Waiting for error group managing segments... Aug 8 05:38:06.909485530 (19h58m6.498830507s) [upload=20681]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:38:06.909490379 (19h58m6.498835366s) [upload=20681]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:38:06.909492794 (19h58m6.498837771s) [upload=20681]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:38:07.186451701 (19h58m6.775796688s) [upload=20681]: Done uploading segments... Aug 8 05:38:07.186466138 (19h58m6.775811126s) [upload=20681]: Upload finished. err: <nil> Aug 8 05:38:51.631280450 (19h58m51.220625437s) [upload=20695]: Starting upload Aug 8 05:38:51.631327119 (19h58m51.220672106s) [upload=20695]: Done starting upload Aug 8 05:38:51.631401071 (19h58m51.220746058s) [upload=20695]: Uploading segments... Aug 8 05:38:51.631451738 (19h58m51.220796725s) [upload=20695]: Got next segment. Inline: true Aug 8 05:38:51.631455435 (19h58m51.220800422s) [upload=20695]: Waiting for error group managing segments... Aug 8 05:38:51.631485964 (19h58m51.220830941s) [upload=20695]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:38:51.631490933 (19h58m51.22083592s) [upload=20695]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:38:51.631493668 (19h58m51.220838655s) [upload=20695]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:38:51.901791743 (19h58m51.49113673s) [upload=20695]: Done uploading segments... Aug 8 05:38:51.901835487 (19h58m51.491180494s) [upload=20695]: Upload finished. err: <nil> Aug 8 05:39:45.205339338 (19h59m44.794684325s) [upload=20707]: Starting upload Aug 8 05:39:45.205406076 (19h59m44.794751063s) [upload=20707]: Done starting upload Aug 8 05:39:45.205496880 (19h59m44.794841867s) [upload=20707]: Uploading segments... Aug 8 05:39:45.205625166 (19h59m44.794970153s) [upload=20707]: Got next segment. Inline: true Aug 8 05:39:45.205630365 (19h59m44.794975352s) [upload=20707]: Waiting for error group managing segments... Aug 8 05:39:45.205674851 (19h59m44.795019838s) [upload=20707]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:39:45.205679429 (19h59m44.795024416s) [upload=20707]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:39:45.205681944 (19h59m44.795026931s) [upload=20707]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:39:45.470453153 (19h59m45.059798141s) [upload=20707]: Done uploading segments... Aug 8 05:39:45.470483052 (19h59m45.059828039s) [upload=20707]: Upload finished. err: <nil> Aug 8 05:40:40.634971646 (20h0m40.224316633s) [upload=20725]: Starting upload Aug 8 05:40:40.635021973 (20h0m40.22436696s) [upload=20725]: Done starting upload Aug 8 05:40:40.635073371 (20h0m40.224418358s) [upload=20725]: Uploading segments... Aug 8 05:40:40.635109320 (20h0m40.224454317s) [upload=20725]: Got next segment. Inline: true Aug 8 05:40:40.635114109 (20h0m40.224459106s) [upload=20725]: Waiting for error group managing segments... Aug 8 05:40:40.635154256 (20h0m40.224499243s) [upload=20725]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:40:40.635158905 (20h0m40.224503892s) [upload=20725]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:40:40.635162011 (20h0m40.224506998s) [upload=20725]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:40:40.919405025 (20h0m40.508750012s) [upload=20725]: Done uploading segments... Aug 8 05:40:40.919423339 (20h0m40.508768327s) [upload=20725]: Upload finished. err: <nil> Aug 8 05:41:26.479553637 (20h1m26.068898624s) [upload=20738]: Starting upload Aug 8 05:41:26.479595988 (20h1m26.068940975s) [upload=20738]: Done starting upload Aug 8 05:41:26.479644641 (20h1m26.068989628s) [upload=20738]: Uploading segments... Aug 8 05:41:26.479675470 (20h1m26.069020457s) [upload=20738]: Got next segment. Inline: true Aug 8 05:41:26.479679057 (20h1m26.069024044s) [upload=20738]: Waiting for error group managing segments... Aug 8 05:41:26.479710107 (20h1m26.069055094s) [upload=20738]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:41:26.479715928 (20h1m26.069060915s) [upload=20738]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:41:26.479718944 (20h1m26.069063931s) [upload=20738]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:41:26.748601218 (20h1m26.337946225s) [upload=20738]: Done uploading segments... Aug 8 05:41:26.748655402 (20h1m26.338000409s) [upload=20738]: Upload finished. err: <nil> Aug 8 05:42:34.615249982 (20h2m34.204594969s) [upload=20757]: Starting upload Aug 8 05:42:34.615323192 (20h2m34.204668179s) [upload=20757]: Done starting upload Aug 8 05:42:34.615400751 (20h2m34.204745728s) [upload=20757]: Uploading segments... Aug 8 05:42:34.615497656 (20h2m34.204842643s) [upload=20757]: Got next segment. Inline: true Aug 8 05:42:34.615502204 (20h2m34.204847191s) [upload=20757]: Waiting for error group managing segments... Aug 8 05:42:34.615554224 (20h2m34.204899211s) [upload=20757]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:42:34.615559374 (20h2m34.204904361s) [upload=20757]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:42:34.615561968 (20h2m34.204906955s) [upload=20757]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:42:34.884231116 (20h2m34.473576093s) [upload=20757]: Done uploading segments... Aug 8 05:42:34.884249541 (20h2m34.473594528s) [upload=20757]: Upload finished. err: <nil> Aug 8 05:43:13.461917356 (20h3m13.051262343s) [upload=20769]: Starting upload Aug 8 05:43:13.461990796 (20h3m13.051335803s) [upload=20769]: Done starting upload Aug 8 05:43:13.462081540 (20h3m13.051426567s) [upload=20769]: Uploading segments... Aug 8 05:43:13.462134812 (20h3m13.051479819s) [upload=20769]: Got next segment. Inline: true Aug 8 05:43:13.462141565 (20h3m13.051486592s) [upload=20769]: Waiting for error group managing segments... Aug 8 05:43:13.462196560 (20h3m13.051541787s) [upload=20769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:43:13.462204294 (20h3m13.051549302s) [upload=20769]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:43:13.462210075 (20h3m13.051555062s) [upload=20769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:43:13.761162934 (20h3m13.350507921s) [upload=20769]: Done uploading segments... Aug 8 05:43:13.761180588 (20h3m13.350525575s) [upload=20769]: Upload finished. err: <nil> Duration: 1.83959549s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [..X............XX...............X.X.......................X.] duration: 5.552017658s FAIL (2025-08-08 05:51:43 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== ad finished. err: <nil> Aug 8 05:50:40.893567535 (20h10m40.482912522s) [upload=20903]: Starting upload Aug 8 05:50:40.893617581 (20h10m40.482962568s) [upload=20903]: Done starting upload Aug 8 05:50:40.893745836 (20h10m40.483090823s) [upload=20903]: Uploading segments... Aug 8 05:50:40.893860175 (20h10m40.483205162s) [upload=20903]: Got next segment. Inline: false Aug 8 05:50:40.893898729 (20h10m40.483243706s) [upload=20903]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:50:40.893904339 (20h10m40.483249326s) [upload=20903]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:50:41.341218008 (20h10m40.930562995s) [seg_pos={0 0}, upload=20903]: Begin upload segment... Aug 8 05:50:41.341265508 (20h10m40.930610495s) [seg_pos={0 0}, upload=20903]: Done begin upload segment. Aug 8 05:50:41.341287290 (20h10m40.930632267s) [noise=true , address=104.36.82.37:4657 , piece_id=6G2JI22ZFKN72YYNJZ4Q3PK4ODRBF4QOK5OH3XNI245MOEV4INRA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341358447 (20h10m40.930703434s) [noise=true , address=64.49.13.155:4916 , piece_id=R4EDGKGU5O3XMIEDBT3P3YDZ6M5NDSW627JISIFRRYM3YFY7OJ7A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341670363 (20h10m40.93101535s) [noise=true , address=104.36.82.44:4873 , piece_id=OGMZZTN6R646OCIKFIN2ARH7HBXIYI4RG3RHOVEFGTGOS6EFLPFA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341830500 (20h10m40.931175487s) [noise=true , address=193.149.164.143:4696 , piece_id=FNRXKJGRXG64FVEF7U6WLJT56RBHEONLJF5FM3K7ZRBCQVBL3VFQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341990977 (20h10m40.931335954s) [noise=true , address=104.36.82.39:4735 , piece_id=VYEESGWFD57OTLITJU27YFV3IKI34JW7GANQ2U34PV6WAGMPEFXQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342205478 (20h10m40.931550465s) [noise=true , address=104.36.82.60:4348 , piece_id=DSQCOTEIOHDKJSUZYR7RQGXLT6A3FQNPBHZ36UKT3G56PNEWBKZA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342313615 (20h10m40.931658602s) [noise=true , address=104.36.82.36:4633 , piece_id=N6ZYWVZ7CODZ3SWA3T2KL6HWOPISACLE6YNECGDNL6S6NHP6TYZA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342583129 (20h10m40.931928117s) [noise=true , address=104.36.82.47:4529 , piece_id=UESMFD5UVKCQ4F5XKAG6OMNTA4BS6QV2BME5E7DMIJP7XWHJHT6A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342596976 (20h10m40.931941953s) [noise=true , address=104.36.82.61:4406 , piece_id=WQCH472JAJNEAGQGOF5LYU6RAUICVUOFXDTJC52NWFCEU43YTHEA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342935484 (20h10m40.932280471s) [noise=true , address=104.36.82.44:4881 , piece_id=JQKJCCUHCJSWLBDF5G5IEP2HAQJXH3FA6H7X4RNUH342SM6CNB5A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342953539 (20h10m40.932298526s) [noise=true , address=45.91.116.10:4092 , piece_id=FDHA5FCWTAFZ5N6AJA254W7QKGN3RGCGT7ZGWBIGLTI65DEIG4ZQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343204499 (20h10m40.932549486s) [noise=true , address=104.36.82.13:4202 , piece_id=GNTUDR6M4TV66KTCUMQKC33ESLZAQP4WK3PWS5CDQN5M6FE4ALQQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343223045 (20h10m40.932568032s) [noise=true , address=64.49.13.138:4481 , piece_id=HDNKCDGYH2LAFM2DRIW364W5XRSKF5XK7YZI47ATAAC5A6EBTOUQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343469105 (20h10m40.932814092s) [noise=true , address=64.49.13.140:4509 , piece_id=52T2SWYDXGGJ2IGMUAX5DJQZUFAQUHQTBW4NFC27RQQFLERI2EBQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343567834 (20h10m40.932912821s) [noise=true , address=104.36.82.23:4460 , piece_id=GKYZZOHC5J2FV2PWHI4IVTZV7FMVP2OFSJ2UOF24W5USG734RH7Q, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343687393 (20h10m40.93303237s) [noise=true , address=104.36.82.58:4273 , piece_id=WGPLZNLVUSYYJF7FJSBWAKRZ4LDAXSGBVWSTFRJ3KPBJIXOFSDGQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.344008046 (20h10m40.933353033s) [noise=true , address=104.36.82.43:4868 , piece_id=BM2WYHNTNNQAZHBSITN3ZIACMJLHLO6QACEZFCLYHODB4FYVYHNA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.345979839 (20h10m40.935324816s) [noise=true , address=104.36.82.20:4457 , piece_id=COVFTVTMO3DGUFVMZH633Q7RMZQRV7P2SRYOVJ2JZFP7RY5N7RHA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:42.438670912 (20h10m42.028015899s) [upload=20903]: Next returned nil segment Aug 8 05:50:42.438688716 (20h10m42.028033703s) [upload=20903]: Waiting for error group managing segments... Aug 8 05:50:42.778812377 (20h10m42.368157364s) [noise=true , address=193.149.164.143:4696 , piece_id=FNRXKJGRXG64FVEF7U6WLJT56RBHEONLJF5FM3K7ZRBCQVBL3VFQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.793688260 (20h10m42.383033237s) [noise=true , address=64.49.13.140:4509 , piece_id=52T2SWYDXGGJ2IGMUAX5DJQZUFAQUHQTBW4NFC27RQQFLERI2EBQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.814603478 (20h10m42.403948465s) [noise=true , address=64.49.13.155:4916 , piece_id=R4EDGKGU5O3XMIEDBT3P3YDZ6M5NDSW627JISIFRRYM3YFY7OJ7A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.846619684 (20h10m42.435964671s) [noise=true , address=64.49.13.138:4481 , piece_id=HDNKCDGYH2LAFM2DRIW364W5XRSKF5XK7YZI47ATAAC5A6EBTOUQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.248617890 (20h10m42.837962877s) [noise=true , address=104.36.82.47:4529 , piece_id=UESMFD5UVKCQ4F5XKAG6OMNTA4BS6QV2BME5E7DMIJP7XWHJHT6A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.252848605 (20h10m42.842193592s) [noise=true , address=104.36.82.39:4735 , piece_id=VYEESGWFD57OTLITJU27YFV3IKI34JW7GANQ2U34PV6WAGMPEFXQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.255650606 (20h10m42.844995593s) [noise=true , address=104.36.82.61:4406 , piece_id=WQCH472JAJNEAGQGOF5LYU6RAUICVUOFXDTJC52NWFCEU43YTHEA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.261140931 (20h10m42.850485918s) [noise=true , address=104.36.82.23:4460 , piece_id=GKYZZOHC5J2FV2PWHI4IVTZV7FMVP2OFSJ2UOF24W5USG734RH7Q, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.269129284 (20h10m42.858474261s) [noise=true , address=104.36.82.58:4273 , piece_id=WGPLZNLVUSYYJF7FJSBWAKRZ4LDAXSGBVWSTFRJ3KPBJIXOFSDGQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.274156393 (20h10m42.86350137s) [noise=true , address=104.36.82.43:4868 , piece_id=BM2WYHNTNNQAZHBSITN3ZIACMJLHLO6QACEZFCLYHODB4FYVYHNA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.313273526 (20h10m42.902618513s) [noise=true , address=45.91.116.10:4092 , piece_id=FDHA5FCWTAFZ5N6AJA254W7QKGN3RGCGT7ZGWBIGLTI65DEIG4ZQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.330724515 (20h10m42.920069502s) [noise=true , address=104.36.82.44:4881 , piece_id=JQKJCCUHCJSWLBDF5G5IEP2HAQJXH3FA6H7X4RNUH342SM6CNB5A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345245168 (20h10m42.934590155s) [noise=true , address=104.36.82.20:4457 , piece_id=COVFTVTMO3DGUFVMZH633Q7RMZQRV7P2SRYOVJ2JZFP7RY5N7RHA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345588405 (20h10m42.934933392s) [noise=true , address=104.36.82.60:4348 , piece_id=DSQCOTEIOHDKJSUZYR7RQGXLT6A3FQNPBHZ36UKT3G56PNEWBKZA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345621758 (20h10m42.934966745s) [seg_pos={0 0}, upload=20903]: Segment reached optimal threshold of 14 pieces. Aug 8 05:50:43.345774391 (20h10m42.935119378s) [noise=true , address=104.36.82.13:4202 , piece_id=GNTUDR6M4TV66KTCUMQKC33ESLZAQP4WK3PWS5CDQN5M6FE4ALQQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18wf5KnaR6WaR7MJivJkMJ7FejbuR6KnyvtRQgazNKfDb8fbsH): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345829917 (20h10m42.935174914s) [noise=true , address=104.36.82.36:4633 , piece_id=N6ZYWVZ7CODZ3SWA3T2KL6HWOPISACLE6YNECGDNL6S6NHP6TYZA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345878609 (20h10m42.935223607s) [noise=true , address=104.36.82.44:4873 , piece_id=OGMZZTN6R646OCIKFIN2ARH7HBXIYI4RG3RHOVEFGTGOS6EFLPFA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b5GdYtmYz9D1QW2z78W3Z2fWvMJGtrvrMJ1njbcqbtCDUdwHo): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345924307 (20h10m42.935269294s) [noise=true , address=104.36.82.37:4657 , piece_id=6G2JI22ZFKN72YYNJZ4Q3PK4ODRBF4QOK5OH3XNI245MOEV4INRA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345954214 (20h10m42.935299282s) [seg_pos={0 0}, upload=20903]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:50:43.346042142 (20h10m42.93538716s) [upload=20903]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:50:43.346050880 (20h10m42.935395897s) [upload=20903]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:50:43.643950132 (20h10m43.233295119s) [upload=20903]: Done uploading segments... Aug 8 05:50:43.643971202 (20h10m43.233316189s) [upload=20903]: Upload finished. err: <nil> Duration: 5.552043439s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 6.041094074s FAIL (2025-08-08 05:51:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.041123069s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [...X............XX...............X.X.......................X] duration: 4.051435412s FAIL (2025-08-08 05:50:44 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== ad finished. err: <nil> Aug 8 05:50:40.893567535 (20h10m40.482912522s) [upload=20903]: Starting upload Aug 8 05:50:40.893617581 (20h10m40.482962568s) [upload=20903]: Done starting upload Aug 8 05:50:40.893745836 (20h10m40.483090823s) [upload=20903]: Uploading segments... Aug 8 05:50:40.893860175 (20h10m40.483205162s) [upload=20903]: Got next segment. Inline: false Aug 8 05:50:40.893898729 (20h10m40.483243706s) [upload=20903]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:50:40.893904339 (20h10m40.483249326s) [upload=20903]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:50:41.341218008 (20h10m40.930562995s) [seg_pos={0 0}, upload=20903]: Begin upload segment... Aug 8 05:50:41.341265508 (20h10m40.930610495s) [seg_pos={0 0}, upload=20903]: Done begin upload segment. Aug 8 05:50:41.341287290 (20h10m40.930632267s) [noise=true , address=104.36.82.37:4657 , piece_id=6G2JI22ZFKN72YYNJZ4Q3PK4ODRBF4QOK5OH3XNI245MOEV4INRA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341358447 (20h10m40.930703434s) [noise=true , address=64.49.13.155:4916 , piece_id=R4EDGKGU5O3XMIEDBT3P3YDZ6M5NDSW627JISIFRRYM3YFY7OJ7A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341670363 (20h10m40.93101535s) [noise=true , address=104.36.82.44:4873 , piece_id=OGMZZTN6R646OCIKFIN2ARH7HBXIYI4RG3RHOVEFGTGOS6EFLPFA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341830500 (20h10m40.931175487s) [noise=true , address=193.149.164.143:4696 , piece_id=FNRXKJGRXG64FVEF7U6WLJT56RBHEONLJF5FM3K7ZRBCQVBL3VFQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341990977 (20h10m40.931335954s) [noise=true , address=104.36.82.39:4735 , piece_id=VYEESGWFD57OTLITJU27YFV3IKI34JW7GANQ2U34PV6WAGMPEFXQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342205478 (20h10m40.931550465s) [noise=true , address=104.36.82.60:4348 , piece_id=DSQCOTEIOHDKJSUZYR7RQGXLT6A3FQNPBHZ36UKT3G56PNEWBKZA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342313615 (20h10m40.931658602s) [noise=true , address=104.36.82.36:4633 , piece_id=N6ZYWVZ7CODZ3SWA3T2KL6HWOPISACLE6YNECGDNL6S6NHP6TYZA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342583129 (20h10m40.931928117s) [noise=true , address=104.36.82.47:4529 , piece_id=UESMFD5UVKCQ4F5XKAG6OMNTA4BS6QV2BME5E7DMIJP7XWHJHT6A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342596976 (20h10m40.931941953s) [noise=true , address=104.36.82.61:4406 , piece_id=WQCH472JAJNEAGQGOF5LYU6RAUICVUOFXDTJC52NWFCEU43YTHEA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342935484 (20h10m40.932280471s) [noise=true , address=104.36.82.44:4881 , piece_id=JQKJCCUHCJSWLBDF5G5IEP2HAQJXH3FA6H7X4RNUH342SM6CNB5A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342953539 (20h10m40.932298526s) [noise=true , address=45.91.116.10:4092 , piece_id=FDHA5FCWTAFZ5N6AJA254W7QKGN3RGCGT7ZGWBIGLTI65DEIG4ZQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343204499 (20h10m40.932549486s) [noise=true , address=104.36.82.13:4202 , piece_id=GNTUDR6M4TV66KTCUMQKC33ESLZAQP4WK3PWS5CDQN5M6FE4ALQQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343223045 (20h10m40.932568032s) [noise=true , address=64.49.13.138:4481 , piece_id=HDNKCDGYH2LAFM2DRIW364W5XRSKF5XK7YZI47ATAAC5A6EBTOUQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343469105 (20h10m40.932814092s) [noise=true , address=64.49.13.140:4509 , piece_id=52T2SWYDXGGJ2IGMUAX5DJQZUFAQUHQTBW4NFC27RQQFLERI2EBQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343567834 (20h10m40.932912821s) [noise=true , address=104.36.82.23:4460 , piece_id=GKYZZOHC5J2FV2PWHI4IVTZV7FMVP2OFSJ2UOF24W5USG734RH7Q, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343687393 (20h10m40.93303237s) [noise=true , address=104.36.82.58:4273 , piece_id=WGPLZNLVUSYYJF7FJSBWAKRZ4LDAXSGBVWSTFRJ3KPBJIXOFSDGQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.344008046 (20h10m40.933353033s) [noise=true , address=104.36.82.43:4868 , piece_id=BM2WYHNTNNQAZHBSITN3ZIACMJLHLO6QACEZFCLYHODB4FYVYHNA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.345979839 (20h10m40.935324816s) [noise=true , address=104.36.82.20:4457 , piece_id=COVFTVTMO3DGUFVMZH633Q7RMZQRV7P2SRYOVJ2JZFP7RY5N7RHA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:42.438670912 (20h10m42.028015899s) [upload=20903]: Next returned nil segment Aug 8 05:50:42.438688716 (20h10m42.028033703s) [upload=20903]: Waiting for error group managing segments... Aug 8 05:50:42.778812377 (20h10m42.368157364s) [noise=true , address=193.149.164.143:4696 , piece_id=FNRXKJGRXG64FVEF7U6WLJT56RBHEONLJF5FM3K7ZRBCQVBL3VFQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.793688260 (20h10m42.383033237s) [noise=true , address=64.49.13.140:4509 , piece_id=52T2SWYDXGGJ2IGMUAX5DJQZUFAQUHQTBW4NFC27RQQFLERI2EBQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.814603478 (20h10m42.403948465s) [noise=true , address=64.49.13.155:4916 , piece_id=R4EDGKGU5O3XMIEDBT3P3YDZ6M5NDSW627JISIFRRYM3YFY7OJ7A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.846619684 (20h10m42.435964671s) [noise=true , address=64.49.13.138:4481 , piece_id=HDNKCDGYH2LAFM2DRIW364W5XRSKF5XK7YZI47ATAAC5A6EBTOUQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.248617890 (20h10m42.837962877s) [noise=true , address=104.36.82.47:4529 , piece_id=UESMFD5UVKCQ4F5XKAG6OMNTA4BS6QV2BME5E7DMIJP7XWHJHT6A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.252848605 (20h10m42.842193592s) [noise=true , address=104.36.82.39:4735 , piece_id=VYEESGWFD57OTLITJU27YFV3IKI34JW7GANQ2U34PV6WAGMPEFXQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.255650606 (20h10m42.844995593s) [noise=true , address=104.36.82.61:4406 , piece_id=WQCH472JAJNEAGQGOF5LYU6RAUICVUOFXDTJC52NWFCEU43YTHEA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.261140931 (20h10m42.850485918s) [noise=true , address=104.36.82.23:4460 , piece_id=GKYZZOHC5J2FV2PWHI4IVTZV7FMVP2OFSJ2UOF24W5USG734RH7Q, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.269129284 (20h10m42.858474261s) [noise=true , address=104.36.82.58:4273 , piece_id=WGPLZNLVUSYYJF7FJSBWAKRZ4LDAXSGBVWSTFRJ3KPBJIXOFSDGQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.274156393 (20h10m42.86350137s) [noise=true , address=104.36.82.43:4868 , piece_id=BM2WYHNTNNQAZHBSITN3ZIACMJLHLO6QACEZFCLYHODB4FYVYHNA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.313273526 (20h10m42.902618513s) [noise=true , address=45.91.116.10:4092 , piece_id=FDHA5FCWTAFZ5N6AJA254W7QKGN3RGCGT7ZGWBIGLTI65DEIG4ZQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.330724515 (20h10m42.920069502s) [noise=true , address=104.36.82.44:4881 , piece_id=JQKJCCUHCJSWLBDF5G5IEP2HAQJXH3FA6H7X4RNUH342SM6CNB5A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345245168 (20h10m42.934590155s) [noise=true , address=104.36.82.20:4457 , piece_id=COVFTVTMO3DGUFVMZH633Q7RMZQRV7P2SRYOVJ2JZFP7RY5N7RHA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345588405 (20h10m42.934933392s) [noise=true , address=104.36.82.60:4348 , piece_id=DSQCOTEIOHDKJSUZYR7RQGXLT6A3FQNPBHZ36UKT3G56PNEWBKZA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345621758 (20h10m42.934966745s) [seg_pos={0 0}, upload=20903]: Segment reached optimal threshold of 14 pieces. Aug 8 05:50:43.345774391 (20h10m42.935119378s) [noise=true , address=104.36.82.13:4202 , piece_id=GNTUDR6M4TV66KTCUMQKC33ESLZAQP4WK3PWS5CDQN5M6FE4ALQQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18wf5KnaR6WaR7MJivJkMJ7FejbuR6KnyvtRQgazNKfDb8fbsH): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345829917 (20h10m42.935174914s) [noise=true , address=104.36.82.36:4633 , piece_id=N6ZYWVZ7CODZ3SWA3T2KL6HWOPISACLE6YNECGDNL6S6NHP6TYZA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345878609 (20h10m42.935223607s) [noise=true , address=104.36.82.44:4873 , piece_id=OGMZZTN6R646OCIKFIN2ARH7HBXIYI4RG3RHOVEFGTGOS6EFLPFA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b5GdYtmYz9D1QW2z78W3Z2fWvMJGtrvrMJ1njbcqbtCDUdwHo): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345924307 (20h10m42.935269294s) [noise=true , address=104.36.82.37:4657 , piece_id=6G2JI22ZFKN72YYNJZ4Q3PK4ODRBF4QOK5OH3XNI245MOEV4INRA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345954214 (20h10m42.935299282s) [seg_pos={0 0}, upload=20903]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:50:43.346042142 (20h10m42.93538716s) [upload=20903]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:50:43.346050880 (20h10m42.935395897s) [upload=20903]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:50:43.643950132 (20h10m43.233295119s) [upload=20903]: Done uploading segments... Aug 8 05:50:43.643971202 (20h10m43.233316189s) [upload=20903]: Upload finished. err: <nil> Duration: 4.051456051s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.........X...............X...X..........X......X............] duration: 1.815901419s FAIL (2025-08-08 05:50:44 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 10201218 (19h54m43.199546205s) [upload=20622]: Done uploading segments... Aug 8 05:34:43.610217147 (19h54m43.199562135s) [upload=20622]: Upload finished. err: <nil> Aug 8 05:35:04.023055775 (19h55m3.612400762s) [upload=20630]: Starting upload Aug 8 05:35:04.023110239 (19h55m3.612455227s) [upload=20630]: Done starting upload Aug 8 05:35:04.023211963 (19h55m3.61255695s) [upload=20630]: Uploading segments... Aug 8 05:35:04.023253063 (19h55m3.61259806s) [upload=20630]: Got next segment. Inline: true Aug 8 05:35:04.023258142 (19h55m3.612603139s) [upload=20630]: Waiting for error group managing segments... Aug 8 05:35:04.023303700 (19h55m3.612648687s) [upload=20630]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:35:04.023307607 (19h55m3.612652594s) [upload=20630]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:35:04.023310082 (19h55m3.612655069s) [upload=20630]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:35:04.309190970 (19h55m3.898535957s) [upload=20630]: Done uploading segments... Aug 8 05:35:04.309209536 (19h55m3.898554523s) [upload=20630]: Upload finished. err: <nil> Aug 8 05:35:55.759534624 (19h55m55.348879611s) [upload=20645]: Starting upload Aug 8 05:35:55.759570612 (19h55m55.348915599s) [upload=20645]: Done starting upload Aug 8 05:35:55.759660394 (19h55m55.349005381s) [upload=20645]: Uploading segments... Aug 8 05:35:55.759699860 (19h55m55.349044857s) [upload=20645]: Got next segment. Inline: true Aug 8 05:35:55.759703707 (19h55m55.349048694s) [upload=20645]: Waiting for error group managing segments... Aug 8 05:35:55.759738624 (19h55m55.349083601s) [upload=20645]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:35:55.759743192 (19h55m55.349088189s) [upload=20645]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:35:55.759746088 (19h55m55.349091085s) [upload=20645]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:35:56.089922739 (19h55m55.679267726s) [upload=20645]: Done uploading segments... Aug 8 05:35:56.089940492 (19h55m55.679285469s) [upload=20645]: Upload finished. err: <nil> Aug 8 05:36:56.815438704 (19h56m56.404783681s) [upload=20663]: Starting upload Aug 8 05:36:56.815488349 (19h56m56.404833337s) [upload=20663]: Done starting upload Aug 8 05:36:56.815535940 (19h56m56.404880927s) [upload=20663]: Uploading segments... Aug 8 05:36:56.815564444 (19h56m56.404909431s) [upload=20663]: Got next segment. Inline: true Aug 8 05:36:56.815568403 (19h56m56.40491339s) [upload=20663]: Waiting for error group managing segments... Aug 8 05:36:56.815600274 (19h56m56.404945261s) [upload=20663]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:36:56.815603780 (19h56m56.404948767s) [upload=20663]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:36:56.815606074 (19h56m56.404951061s) [upload=20663]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:36:57.078410111 (19h56m56.667755098s) [upload=20663]: Done uploading segments... Aug 8 05:36:57.078426431 (19h56m56.667771418s) [upload=20663]: Upload finished. err: <nil> Aug 8 05:38:06.909129599 (19h58m6.498474596s) [upload=20681]: Starting upload Aug 8 05:38:06.909198019 (19h58m6.498543006s) [upload=20681]: Done starting upload Aug 8 05:38:06.909290978 (19h58m6.498635955s) [upload=20681]: Uploading segments... Aug 8 05:38:06.909411137 (19h58m6.498756134s) [upload=20681]: Got next segment. Inline: true Aug 8 05:38:06.909416046 (19h58m6.498761034s) [upload=20681]: Waiting for error group managing segments... Aug 8 05:38:06.909485530 (19h58m6.498830507s) [upload=20681]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:38:06.909490379 (19h58m6.498835366s) [upload=20681]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:38:06.909492794 (19h58m6.498837771s) [upload=20681]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:38:07.186451701 (19h58m6.775796688s) [upload=20681]: Done uploading segments... Aug 8 05:38:07.186466138 (19h58m6.775811126s) [upload=20681]: Upload finished. err: <nil> Aug 8 05:38:51.631280450 (19h58m51.220625437s) [upload=20695]: Starting upload Aug 8 05:38:51.631327119 (19h58m51.220672106s) [upload=20695]: Done starting upload Aug 8 05:38:51.631401071 (19h58m51.220746058s) [upload=20695]: Uploading segments... Aug 8 05:38:51.631451738 (19h58m51.220796725s) [upload=20695]: Got next segment. Inline: true Aug 8 05:38:51.631455435 (19h58m51.220800422s) [upload=20695]: Waiting for error group managing segments... Aug 8 05:38:51.631485964 (19h58m51.220830941s) [upload=20695]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:38:51.631490933 (19h58m51.22083592s) [upload=20695]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:38:51.631493668 (19h58m51.220838655s) [upload=20695]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:38:51.901791743 (19h58m51.49113673s) [upload=20695]: Done uploading segments... Aug 8 05:38:51.901835487 (19h58m51.491180494s) [upload=20695]: Upload finished. err: <nil> Aug 8 05:39:45.205339338 (19h59m44.794684325s) [upload=20707]: Starting upload Aug 8 05:39:45.205406076 (19h59m44.794751063s) [upload=20707]: Done starting upload Aug 8 05:39:45.205496880 (19h59m44.794841867s) [upload=20707]: Uploading segments... Aug 8 05:39:45.205625166 (19h59m44.794970153s) [upload=20707]: Got next segment. Inline: true Aug 8 05:39:45.205630365 (19h59m44.794975352s) [upload=20707]: Waiting for error group managing segments... Aug 8 05:39:45.205674851 (19h59m44.795019838s) [upload=20707]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:39:45.205679429 (19h59m44.795024416s) [upload=20707]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:39:45.205681944 (19h59m44.795026931s) [upload=20707]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:39:45.470453153 (19h59m45.059798141s) [upload=20707]: Done uploading segments... Aug 8 05:39:45.470483052 (19h59m45.059828039s) [upload=20707]: Upload finished. err: <nil> Aug 8 05:40:40.634971646 (20h0m40.224316633s) [upload=20725]: Starting upload Aug 8 05:40:40.635021973 (20h0m40.22436696s) [upload=20725]: Done starting upload Aug 8 05:40:40.635073371 (20h0m40.224418358s) [upload=20725]: Uploading segments... Aug 8 05:40:40.635109320 (20h0m40.224454317s) [upload=20725]: Got next segment. Inline: true Aug 8 05:40:40.635114109 (20h0m40.224459106s) [upload=20725]: Waiting for error group managing segments... Aug 8 05:40:40.635154256 (20h0m40.224499243s) [upload=20725]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:40:40.635158905 (20h0m40.224503892s) [upload=20725]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:40:40.635162011 (20h0m40.224506998s) [upload=20725]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:40:40.919405025 (20h0m40.508750012s) [upload=20725]: Done uploading segments... Aug 8 05:40:40.919423339 (20h0m40.508768327s) [upload=20725]: Upload finished. err: <nil> Aug 8 05:41:26.479553637 (20h1m26.068898624s) [upload=20738]: Starting upload Aug 8 05:41:26.479595988 (20h1m26.068940975s) [upload=20738]: Done starting upload Aug 8 05:41:26.479644641 (20h1m26.068989628s) [upload=20738]: Uploading segments... Aug 8 05:41:26.479675470 (20h1m26.069020457s) [upload=20738]: Got next segment. Inline: true Aug 8 05:41:26.479679057 (20h1m26.069024044s) [upload=20738]: Waiting for error group managing segments... Aug 8 05:41:26.479710107 (20h1m26.069055094s) [upload=20738]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:41:26.479715928 (20h1m26.069060915s) [upload=20738]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:41:26.479718944 (20h1m26.069063931s) [upload=20738]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:41:26.748601218 (20h1m26.337946225s) [upload=20738]: Done uploading segments... Aug 8 05:41:26.748655402 (20h1m26.338000409s) [upload=20738]: Upload finished. err: <nil> Aug 8 05:42:34.615249982 (20h2m34.204594969s) [upload=20757]: Starting upload Aug 8 05:42:34.615323192 (20h2m34.204668179s) [upload=20757]: Done starting upload Aug 8 05:42:34.615400751 (20h2m34.204745728s) [upload=20757]: Uploading segments... Aug 8 05:42:34.615497656 (20h2m34.204842643s) [upload=20757]: Got next segment. Inline: true Aug 8 05:42:34.615502204 (20h2m34.204847191s) [upload=20757]: Waiting for error group managing segments... Aug 8 05:42:34.615554224 (20h2m34.204899211s) [upload=20757]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:42:34.615559374 (20h2m34.204904361s) [upload=20757]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:42:34.615561968 (20h2m34.204906955s) [upload=20757]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:42:34.884231116 (20h2m34.473576093s) [upload=20757]: Done uploading segments... Aug 8 05:42:34.884249541 (20h2m34.473594528s) [upload=20757]: Upload finished. err: <nil> Aug 8 05:43:13.461917356 (20h3m13.051262343s) [upload=20769]: Starting upload Aug 8 05:43:13.461990796 (20h3m13.051335803s) [upload=20769]: Done starting upload Aug 8 05:43:13.462081540 (20h3m13.051426567s) [upload=20769]: Uploading segments... Aug 8 05:43:13.462134812 (20h3m13.051479819s) [upload=20769]: Got next segment. Inline: true Aug 8 05:43:13.462141565 (20h3m13.051486592s) [upload=20769]: Waiting for error group managing segments... Aug 8 05:43:13.462196560 (20h3m13.051541787s) [upload=20769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:43:13.462204294 (20h3m13.051549302s) [upload=20769]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:43:13.462210075 (20h3m13.051555062s) [upload=20769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:43:13.761162934 (20h3m13.350507921s) [upload=20769]: Done uploading segments... Aug 8 05:43:13.761180588 (20h3m13.350525575s) [upload=20769]: Upload finished. err: <nil> Duration: 1.815922218s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 5.957607739s FAIL (2025-08-08 05:50:26 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.957631436s edge gateway us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)