Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
6.131332702s
FAIL (2025-10-02 03:41:19 UTC)
orbiter warning: context deadline exceeded
Duration: 6.131371858s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
5.000204534s
FAIL (2025-10-02 03:41:02 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
3:25:49.162665554 (205h54m34.624758027s) [noise=true , address=81.171.14.70:4043 , piece_id=LJS6SD7LZGMNPZDAWRLBU4WWW3NYOVDHHPH4TGHZ62LZIRDDEANA, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.162930569 (205h54m34.625023052s) [noise=true , address=81.171.14.70:4029 , piece_id=SBO52O3XSTUPJBBHIP2JZBRLHGKZE3EUQVS2I6DXS6GYN6PB654Q, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163171368 (205h54m34.625263851s) [noise=true , address=185.167.204.205:4032 , piece_id=DGWOQKZCLYMSHG6JH5AT5QVL6KFESN5YUWSHIKJV2AYBW7H26BYQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163282509 (205h54m34.625374992s) [noise=true , address=185.167.204.205:4007 , piece_id=NEHAUNCJOZHAD46YI6AQCMQMV6JPTKWLF7G4H546LHALMZCL4ITQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163618950 (205h54m34.625711433s) [noise=true , address=185.167.204.206:4064 , piece_id=T737VKQXQZGTMHLKXN2S6WVHZ45VDMXWJQ3REYCLNDDXHQR2LJRA, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163969478 (205h54m34.626061951s) [noise=true , address=89.149.201.147:4002 , piece_id=RU4LRMQ6OSEP3BFACDQOHR4R6K4Q67OJ5LVUQFHED2B22PIJOYSQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.164309926 (205h54m34.626402399s) [noise=true , address=185.167.204.205:4009 , piece_id=2K3AA2UN7CDH5NVFKL4V5QP3G5BVDOBQ6WRN3MTXTT4NP3F3QOMQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.164696282 (205h54m34.626788765s) [noise=true , address=89.149.201.147:4023 , piece_id=HX3G4EGXC4OJA3EF2AQL35ERQIUPODOX47JFMLPUPCHZ2FQQT4QQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.165052590 (205h54m34.627145073s) [noise=true , address=89.149.201.147:4003 , piece_id=L4W3GWFS3AIVGHBYOLU6FR6IKNP3BOLLWV7ZVCVAWPN53EXU5GMQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.165421743 (205h54m34.627514226s) [noise=true , address=81.171.14.70:4030 , piece_id=XSNZDXHQD33YDT7VOETLAZE36RSMLN4S6LZQZR43FSFJ66VTKOEA, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.165746141 (205h54m34.627838624s) [noise=true , address=89.149.201.147:4008 , piece_id=WKPOJRTROWSMT2BPSSCPBSILIC3VAIBQDWFRSW6NMUQSN5BRE2PQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.167492466 (205h54m34.629584949s) [noise=true , address=81.171.14.70:4041 , piece_id=RTMFTIDLELSIKF6DX2MAEUM6NEARJOEFIEJ6KJYVCVGJLRKDVYNQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.994174141 (205h54m35.456266624s) [upload=181068]: Next returned nil segment
Oct 2 03:25:49.994197545 (205h54m35.456290028s) [upload=181068]: Waiting for error group managing segments...
Oct 2 03:25:50.378559942 (205h54m35.840652425s) [noise=true , address=81.171.14.70:4043 , piece_id=LJS6SD7LZGMNPZDAWRLBU4WWW3NYOVDHHPH4TGHZ62LZIRDDEANA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.383560535 (205h54m35.845653018s) [noise=true , address=81.171.14.70:4041 , piece_id=RTMFTIDLELSIKF6DX2MAEUM6NEARJOEFIEJ6KJYVCVGJLRKDVYNQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.388516662 (205h54m35.850609135s) [noise=true , address=81.171.14.70:4040 , piece_id=QXFFFGXCPRMBKPNQ2ABGJC26U6DYIJTAARBVCVLQFLIP54G4VFLA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.389043765 (205h54m35.851136238s) [noise=true , address=81.171.14.70:4032 , piece_id=IZTDRSZ74T75J3Y7MCNORWFXLFOXG35R52Y4VSNS2QZ3R3WBFJZQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.392483886 (205h54m35.854576369s) [noise=true , address=81.171.14.70:4027 , piece_id=TDKB4CVXHXQZNNMIJLV3YYVOZMV5CKSY37L4OWB3ZXIJDNJ2JDCQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.396373262 (205h54m35.858465745s) [noise=true , address=81.171.14.70:4042 , piece_id=3ZWKCWIMPFM2CXG3HJWDOMTEMKOSZ5TOONPGOCFC3GZKZ5QHFTBQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.431305560 (205h54m35.893398043s) [noise=true , address=89.149.201.147:4016 , piece_id=LX6HKBDREXIW7XNIWV33JEGPXFMUZOCW35IQULA4PUNJDWO42BQQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.442031504 (205h54m35.904123977s) [noise=true , address=81.171.14.70:4028 , piece_id=QZY7KXVFNXMVEVOBCFTABPK3E2HCVSVYRM4UVB7VJTFZOTNF27TA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.450391563 (205h54m35.912484046s) [noise=true , address=89.149.201.147:4017 , piece_id=EA7JQR35PARZLVG5CMCXITB6MLU55M6WWVQSZEGM6YJQZ2X2WUZA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.454381601 (205h54m35.916474074s) [noise=true , address=81.171.14.70:4029 , piece_id=SBO52O3XSTUPJBBHIP2JZBRLHGKZE3EUQVS2I6DXS6GYN6PB654Q, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.463104390 (205h54m35.925196873s) [noise=true , address=89.149.201.147:4003 , piece_id=L4W3GWFS3AIVGHBYOLU6FR6IKNP3BOLLWV7ZVCVAWPN53EXU5GMQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.471309365 (205h54m35.933401848s) [noise=true , address=81.171.14.70:4036 , piece_id=CFSIP7I4XJEYGBMBQD2UTJXPSNR44OGB7DWOWOWYFSWY6DAFPL3Q, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.486337891 (205h54m35.948430364s) [noise=true , address=89.149.201.147:4008 , piece_id=WKPOJRTROWSMT2BPSSCPBSILIC3VAIBQDWFRSW6NMUQSN5BRE2PQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.489526543 (205h54m35.951619026s) [noise=true , address=89.149.201.147:4006 , piece_id=VIEICP3IHAH2ALC7NSV2T6B7ZSSLIG4NHRTKLXNAR3VBRWR54OKQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.511383803 (205h54m35.973476286s) [noise=true , address=89.149.201.147:4007 , piece_id=GUALOJ23T6IETBGD6VGBH5USVZADA3HNRNJPONABQ7I7WVAZ3PUA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.533024491 (205h54m35.995116974s) [noise=true , address=89.149.201.147:4023 , piece_id=HX3G4EGXC4OJA3EF2AQL35ERQIUPODOX47JFMLPUPCHZ2FQQT4QQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.910819552 (205h54m36.372912025s) [noise=true , address=81.171.14.70:4030 , piece_id=XSNZDXHQD33YDT7VOETLAZE36RSMLN4S6LZQZR43FSFJ66VTKOEA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.990741449 (205h54m36.452833932s) [noise=true , address=89.149.201.147:4002 , piece_id=RU4LRMQ6OSEP3BFACDQOHR4R6K4Q67OJ5LVUQFHED2B22PIJOYSQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.064808246 (205h54m36.526900719s) [noise=true , address=185.167.204.206:4064 , piece_id=T737VKQXQZGTMHLKXN2S6WVHZ45VDMXWJQ3REYCLNDDXHQR2LJRA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.069475683 (205h54m36.531568166s) [noise=true , address=185.167.204.206:4060 , piece_id=TVGTJBCTMRXB2VB3PSLZ3NPWDAEZTCWYULAVFG4CAJX64KVR4MEA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.083150653 (205h54m36.545243136s) [noise=true , address=185.167.204.206:4039 , piece_id=YOD34HQMIBPSLP2IZ4U77CMQSOSAK5FTZSMVRSSEHG7DMVICR7HQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.100274620 (205h54m36.562367103s) [noise=true , address=185.167.204.205:4011 , piece_id=LAKZUADU7PCZBAIGSP72D7WGUZV46R5H5H76SNIQZU2I7DEBOZKA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.107345404 (205h54m36.569437887s) [noise=true , address=185.167.204.205:4006 , piece_id=LY4HTSEATOZWQJTBML5EVSBDICVKWS24MWWJAE7TRQ54ZTHW2IIA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.113594664 (205h54m36.575687147s) [noise=true , address=185.167.204.205:4007 , piece_id=NEHAUNCJOZHAD46YI6AQCMQMV6JPTKWLF7G4H546LHALMZCL4ITQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.117627584 (205h54m36.579720077s) [noise=true , address=185.167.204.205:4009 , piece_id=2K3AA2UN7CDH5NVFKL4V5QP3G5BVDOBQ6WRN3MTXTT4NP3F3QOMQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.137300514 (205h54m36.599392997s) [noise=true , address=185.167.204.205:4015 , piece_id=KXTFVE3Y7KRLF6XCLEENWN74J5PDDRMLBYLC2POUZFQFIXUBNHEQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.137330772 (205h54m36.599423245s) [seg_pos={0 0}, upload=181068]: Segment reached optimal threshold of 26 pieces.
Oct 2 03:25:51.137463375 (205h54m36.599555858s) [noise=true , address=185.167.204.206:4056 , piece_id=G6OE3IONUXYCMNMS53YTXQ2QH2AMF6NVVKPCA4QS3YTD7RLXQMCA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.137485887 (205h54m36.59957837s) [noise=true , address=185.167.204.205:4032 , piece_id=DGWOQKZCLYMSHG6JH5AT5QVL6KFESN5YUWSHIKJV2AYBW7H26BYQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN): protocol: expected piece hash; context canceled; EOF
Oct 2 03:25:51.137500836 (205h54m36.599593339s) [noise=true , address=185.167.204.205:4032 , piece_id=DGWOQKZCLYMSHG6JH5AT5QVL6KFESN5YUWSHIKJV2AYBW7H26BYQ, seg_pos={0 0}, upload=181068]: Long tail cancellation due to optimal threshold
Oct 2 03:25:51.137526445 (205h54m36.599618928s) [seg_pos={0 0}, upload=181068]: Done waiting for segment. successful: 27 optimal: 26 errs: <nil>
Oct 2 03:25:51.137622727 (205h54m36.59971521s) [upload=181068]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 2 03:25:51.137627978 (205h54m36.599720451s) [upload=181068]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 2 03:27:37.980270426 (205h56m23.442362909s) [upload=181068]: Done uploading segments...
Oct 2 03:27:37.980291567 (205h56m23.44238404s) [upload=181068]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.000300186s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
5.416292259s
FAIL (2025-10-02 03:40:22 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
3:25:49.162665554 (205h54m34.624758027s) [noise=true , address=81.171.14.70:4043 , piece_id=LJS6SD7LZGMNPZDAWRLBU4WWW3NYOVDHHPH4TGHZ62LZIRDDEANA, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.162930569 (205h54m34.625023052s) [noise=true , address=81.171.14.70:4029 , piece_id=SBO52O3XSTUPJBBHIP2JZBRLHGKZE3EUQVS2I6DXS6GYN6PB654Q, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163171368 (205h54m34.625263851s) [noise=true , address=185.167.204.205:4032 , piece_id=DGWOQKZCLYMSHG6JH5AT5QVL6KFESN5YUWSHIKJV2AYBW7H26BYQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163282509 (205h54m34.625374992s) [noise=true , address=185.167.204.205:4007 , piece_id=NEHAUNCJOZHAD46YI6AQCMQMV6JPTKWLF7G4H546LHALMZCL4ITQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163618950 (205h54m34.625711433s) [noise=true , address=185.167.204.206:4064 , piece_id=T737VKQXQZGTMHLKXN2S6WVHZ45VDMXWJQ3REYCLNDDXHQR2LJRA, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163969478 (205h54m34.626061951s) [noise=true , address=89.149.201.147:4002 , piece_id=RU4LRMQ6OSEP3BFACDQOHR4R6K4Q67OJ5LVUQFHED2B22PIJOYSQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.164309926 (205h54m34.626402399s) [noise=true , address=185.167.204.205:4009 , piece_id=2K3AA2UN7CDH5NVFKL4V5QP3G5BVDOBQ6WRN3MTXTT4NP3F3QOMQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.164696282 (205h54m34.626788765s) [noise=true , address=89.149.201.147:4023 , piece_id=HX3G4EGXC4OJA3EF2AQL35ERQIUPODOX47JFMLPUPCHZ2FQQT4QQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.165052590 (205h54m34.627145073s) [noise=true , address=89.149.201.147:4003 , piece_id=L4W3GWFS3AIVGHBYOLU6FR6IKNP3BOLLWV7ZVCVAWPN53EXU5GMQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.165421743 (205h54m34.627514226s) [noise=true , address=81.171.14.70:4030 , piece_id=XSNZDXHQD33YDT7VOETLAZE36RSMLN4S6LZQZR43FSFJ66VTKOEA, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.165746141 (205h54m34.627838624s) [noise=true , address=89.149.201.147:4008 , piece_id=WKPOJRTROWSMT2BPSSCPBSILIC3VAIBQDWFRSW6NMUQSN5BRE2PQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.167492466 (205h54m34.629584949s) [noise=true , address=81.171.14.70:4041 , piece_id=RTMFTIDLELSIKF6DX2MAEUM6NEARJOEFIEJ6KJYVCVGJLRKDVYNQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.994174141 (205h54m35.456266624s) [upload=181068]: Next returned nil segment
Oct 2 03:25:49.994197545 (205h54m35.456290028s) [upload=181068]: Waiting for error group managing segments...
Oct 2 03:25:50.378559942 (205h54m35.840652425s) [noise=true , address=81.171.14.70:4043 , piece_id=LJS6SD7LZGMNPZDAWRLBU4WWW3NYOVDHHPH4TGHZ62LZIRDDEANA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.383560535 (205h54m35.845653018s) [noise=true , address=81.171.14.70:4041 , piece_id=RTMFTIDLELSIKF6DX2MAEUM6NEARJOEFIEJ6KJYVCVGJLRKDVYNQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.388516662 (205h54m35.850609135s) [noise=true , address=81.171.14.70:4040 , piece_id=QXFFFGXCPRMBKPNQ2ABGJC26U6DYIJTAARBVCVLQFLIP54G4VFLA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.389043765 (205h54m35.851136238s) [noise=true , address=81.171.14.70:4032 , piece_id=IZTDRSZ74T75J3Y7MCNORWFXLFOXG35R52Y4VSNS2QZ3R3WBFJZQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.392483886 (205h54m35.854576369s) [noise=true , address=81.171.14.70:4027 , piece_id=TDKB4CVXHXQZNNMIJLV3YYVOZMV5CKSY37L4OWB3ZXIJDNJ2JDCQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.396373262 (205h54m35.858465745s) [noise=true , address=81.171.14.70:4042 , piece_id=3ZWKCWIMPFM2CXG3HJWDOMTEMKOSZ5TOONPGOCFC3GZKZ5QHFTBQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.431305560 (205h54m35.893398043s) [noise=true , address=89.149.201.147:4016 , piece_id=LX6HKBDREXIW7XNIWV33JEGPXFMUZOCW35IQULA4PUNJDWO42BQQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.442031504 (205h54m35.904123977s) [noise=true , address=81.171.14.70:4028 , piece_id=QZY7KXVFNXMVEVOBCFTABPK3E2HCVSVYRM4UVB7VJTFZOTNF27TA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.450391563 (205h54m35.912484046s) [noise=true , address=89.149.201.147:4017 , piece_id=EA7JQR35PARZLVG5CMCXITB6MLU55M6WWVQSZEGM6YJQZ2X2WUZA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.454381601 (205h54m35.916474074s) [noise=true , address=81.171.14.70:4029 , piece_id=SBO52O3XSTUPJBBHIP2JZBRLHGKZE3EUQVS2I6DXS6GYN6PB654Q, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.463104390 (205h54m35.925196873s) [noise=true , address=89.149.201.147:4003 , piece_id=L4W3GWFS3AIVGHBYOLU6FR6IKNP3BOLLWV7ZVCVAWPN53EXU5GMQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.471309365 (205h54m35.933401848s) [noise=true , address=81.171.14.70:4036 , piece_id=CFSIP7I4XJEYGBMBQD2UTJXPSNR44OGB7DWOWOWYFSWY6DAFPL3Q, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.486337891 (205h54m35.948430364s) [noise=true , address=89.149.201.147:4008 , piece_id=WKPOJRTROWSMT2BPSSCPBSILIC3VAIBQDWFRSW6NMUQSN5BRE2PQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.489526543 (205h54m35.951619026s) [noise=true , address=89.149.201.147:4006 , piece_id=VIEICP3IHAH2ALC7NSV2T6B7ZSSLIG4NHRTKLXNAR3VBRWR54OKQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.511383803 (205h54m35.973476286s) [noise=true , address=89.149.201.147:4007 , piece_id=GUALOJ23T6IETBGD6VGBH5USVZADA3HNRNJPONABQ7I7WVAZ3PUA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.533024491 (205h54m35.995116974s) [noise=true , address=89.149.201.147:4023 , piece_id=HX3G4EGXC4OJA3EF2AQL35ERQIUPODOX47JFMLPUPCHZ2FQQT4QQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.910819552 (205h54m36.372912025s) [noise=true , address=81.171.14.70:4030 , piece_id=XSNZDXHQD33YDT7VOETLAZE36RSMLN4S6LZQZR43FSFJ66VTKOEA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.990741449 (205h54m36.452833932s) [noise=true , address=89.149.201.147:4002 , piece_id=RU4LRMQ6OSEP3BFACDQOHR4R6K4Q67OJ5LVUQFHED2B22PIJOYSQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.064808246 (205h54m36.526900719s) [noise=true , address=185.167.204.206:4064 , piece_id=T737VKQXQZGTMHLKXN2S6WVHZ45VDMXWJQ3REYCLNDDXHQR2LJRA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.069475683 (205h54m36.531568166s) [noise=true , address=185.167.204.206:4060 , piece_id=TVGTJBCTMRXB2VB3PSLZ3NPWDAEZTCWYULAVFG4CAJX64KVR4MEA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.083150653 (205h54m36.545243136s) [noise=true , address=185.167.204.206:4039 , piece_id=YOD34HQMIBPSLP2IZ4U77CMQSOSAK5FTZSMVRSSEHG7DMVICR7HQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.100274620 (205h54m36.562367103s) [noise=true , address=185.167.204.205:4011 , piece_id=LAKZUADU7PCZBAIGSP72D7WGUZV46R5H5H76SNIQZU2I7DEBOZKA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.107345404 (205h54m36.569437887s) [noise=true , address=185.167.204.205:4006 , piece_id=LY4HTSEATOZWQJTBML5EVSBDICVKWS24MWWJAE7TRQ54ZTHW2IIA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.113594664 (205h54m36.575687147s) [noise=true , address=185.167.204.205:4007 , piece_id=NEHAUNCJOZHAD46YI6AQCMQMV6JPTKWLF7G4H546LHALMZCL4ITQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.117627584 (205h54m36.579720077s) [noise=true , address=185.167.204.205:4009 , piece_id=2K3AA2UN7CDH5NVFKL4V5QP3G5BVDOBQ6WRN3MTXTT4NP3F3QOMQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.137300514 (205h54m36.599392997s) [noise=true , address=185.167.204.205:4015 , piece_id=KXTFVE3Y7KRLF6XCLEENWN74J5PDDRMLBYLC2POUZFQFIXUBNHEQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.137330772 (205h54m36.599423245s) [seg_pos={0 0}, upload=181068]: Segment reached optimal threshold of 26 pieces.
Oct 2 03:25:51.137463375 (205h54m36.599555858s) [noise=true , address=185.167.204.206:4056 , piece_id=G6OE3IONUXYCMNMS53YTXQ2QH2AMF6NVVKPCA4QS3YTD7RLXQMCA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.137485887 (205h54m36.59957837s) [noise=true , address=185.167.204.205:4032 , piece_id=DGWOQKZCLYMSHG6JH5AT5QVL6KFESN5YUWSHIKJV2AYBW7H26BYQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN): protocol: expected piece hash; context canceled; EOF
Oct 2 03:25:51.137500836 (205h54m36.599593339s) [noise=true , address=185.167.204.205:4032 , piece_id=DGWOQKZCLYMSHG6JH5AT5QVL6KFESN5YUWSHIKJV2AYBW7H26BYQ, seg_pos={0 0}, upload=181068]: Long tail cancellation due to optimal threshold
Oct 2 03:25:51.137526445 (205h54m36.599618928s) [seg_pos={0 0}, upload=181068]: Done waiting for segment. successful: 27 optimal: 26 errs: <nil>
Oct 2 03:25:51.137622727 (205h54m36.59971521s) [upload=181068]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 2 03:25:51.137627978 (205h54m36.599720451s) [upload=181068]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 2 03:27:37.980270426 (205h56m23.442362909s) [upload=181068]: Done uploading segments...
Oct 2 03:27:37.980291567 (205h56m23.44238404s) [upload=181068]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.416326284s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
6.411975206s
FAIL (2025-10-02 03:40:22 UTC)
orbiter warning: context deadline exceeded
Duration: 6.412000004s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
6.158982052s
FAIL (2025-10-02 03:39:47 UTC)
orbiter warning: context deadline exceeded
Duration: 6.159041355s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
4.844861002s
FAIL (2025-10-02 03:39:23 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
3:25:49.162665554 (205h54m34.624758027s) [noise=true , address=81.171.14.70:4043 , piece_id=LJS6SD7LZGMNPZDAWRLBU4WWW3NYOVDHHPH4TGHZ62LZIRDDEANA, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.162930569 (205h54m34.625023052s) [noise=true , address=81.171.14.70:4029 , piece_id=SBO52O3XSTUPJBBHIP2JZBRLHGKZE3EUQVS2I6DXS6GYN6PB654Q, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163171368 (205h54m34.625263851s) [noise=true , address=185.167.204.205:4032 , piece_id=DGWOQKZCLYMSHG6JH5AT5QVL6KFESN5YUWSHIKJV2AYBW7H26BYQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163282509 (205h54m34.625374992s) [noise=true , address=185.167.204.205:4007 , piece_id=NEHAUNCJOZHAD46YI6AQCMQMV6JPTKWLF7G4H546LHALMZCL4ITQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163618950 (205h54m34.625711433s) [noise=true , address=185.167.204.206:4064 , piece_id=T737VKQXQZGTMHLKXN2S6WVHZ45VDMXWJQ3REYCLNDDXHQR2LJRA, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163969478 (205h54m34.626061951s) [noise=true , address=89.149.201.147:4002 , piece_id=RU4LRMQ6OSEP3BFACDQOHR4R6K4Q67OJ5LVUQFHED2B22PIJOYSQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.164309926 (205h54m34.626402399s) [noise=true , address=185.167.204.205:4009 , piece_id=2K3AA2UN7CDH5NVFKL4V5QP3G5BVDOBQ6WRN3MTXTT4NP3F3QOMQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.164696282 (205h54m34.626788765s) [noise=true , address=89.149.201.147:4023 , piece_id=HX3G4EGXC4OJA3EF2AQL35ERQIUPODOX47JFMLPUPCHZ2FQQT4QQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.165052590 (205h54m34.627145073s) [noise=true , address=89.149.201.147:4003 , piece_id=L4W3GWFS3AIVGHBYOLU6FR6IKNP3BOLLWV7ZVCVAWPN53EXU5GMQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.165421743 (205h54m34.627514226s) [noise=true , address=81.171.14.70:4030 , piece_id=XSNZDXHQD33YDT7VOETLAZE36RSMLN4S6LZQZR43FSFJ66VTKOEA, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.165746141 (205h54m34.627838624s) [noise=true , address=89.149.201.147:4008 , piece_id=WKPOJRTROWSMT2BPSSCPBSILIC3VAIBQDWFRSW6NMUQSN5BRE2PQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.167492466 (205h54m34.629584949s) [noise=true , address=81.171.14.70:4041 , piece_id=RTMFTIDLELSIKF6DX2MAEUM6NEARJOEFIEJ6KJYVCVGJLRKDVYNQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.994174141 (205h54m35.456266624s) [upload=181068]: Next returned nil segment
Oct 2 03:25:49.994197545 (205h54m35.456290028s) [upload=181068]: Waiting for error group managing segments...
Oct 2 03:25:50.378559942 (205h54m35.840652425s) [noise=true , address=81.171.14.70:4043 , piece_id=LJS6SD7LZGMNPZDAWRLBU4WWW3NYOVDHHPH4TGHZ62LZIRDDEANA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.383560535 (205h54m35.845653018s) [noise=true , address=81.171.14.70:4041 , piece_id=RTMFTIDLELSIKF6DX2MAEUM6NEARJOEFIEJ6KJYVCVGJLRKDVYNQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.388516662 (205h54m35.850609135s) [noise=true , address=81.171.14.70:4040 , piece_id=QXFFFGXCPRMBKPNQ2ABGJC26U6DYIJTAARBVCVLQFLIP54G4VFLA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.389043765 (205h54m35.851136238s) [noise=true , address=81.171.14.70:4032 , piece_id=IZTDRSZ74T75J3Y7MCNORWFXLFOXG35R52Y4VSNS2QZ3R3WBFJZQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.392483886 (205h54m35.854576369s) [noise=true , address=81.171.14.70:4027 , piece_id=TDKB4CVXHXQZNNMIJLV3YYVOZMV5CKSY37L4OWB3ZXIJDNJ2JDCQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.396373262 (205h54m35.858465745s) [noise=true , address=81.171.14.70:4042 , piece_id=3ZWKCWIMPFM2CXG3HJWDOMTEMKOSZ5TOONPGOCFC3GZKZ5QHFTBQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.431305560 (205h54m35.893398043s) [noise=true , address=89.149.201.147:4016 , piece_id=LX6HKBDREXIW7XNIWV33JEGPXFMUZOCW35IQULA4PUNJDWO42BQQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.442031504 (205h54m35.904123977s) [noise=true , address=81.171.14.70:4028 , piece_id=QZY7KXVFNXMVEVOBCFTABPK3E2HCVSVYRM4UVB7VJTFZOTNF27TA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.450391563 (205h54m35.912484046s) [noise=true , address=89.149.201.147:4017 , piece_id=EA7JQR35PARZLVG5CMCXITB6MLU55M6WWVQSZEGM6YJQZ2X2WUZA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.454381601 (205h54m35.916474074s) [noise=true , address=81.171.14.70:4029 , piece_id=SBO52O3XSTUPJBBHIP2JZBRLHGKZE3EUQVS2I6DXS6GYN6PB654Q, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.463104390 (205h54m35.925196873s) [noise=true , address=89.149.201.147:4003 , piece_id=L4W3GWFS3AIVGHBYOLU6FR6IKNP3BOLLWV7ZVCVAWPN53EXU5GMQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.471309365 (205h54m35.933401848s) [noise=true , address=81.171.14.70:4036 , piece_id=CFSIP7I4XJEYGBMBQD2UTJXPSNR44OGB7DWOWOWYFSWY6DAFPL3Q, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.486337891 (205h54m35.948430364s) [noise=true , address=89.149.201.147:4008 , piece_id=WKPOJRTROWSMT2BPSSCPBSILIC3VAIBQDWFRSW6NMUQSN5BRE2PQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.489526543 (205h54m35.951619026s) [noise=true , address=89.149.201.147:4006 , piece_id=VIEICP3IHAH2ALC7NSV2T6B7ZSSLIG4NHRTKLXNAR3VBRWR54OKQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.511383803 (205h54m35.973476286s) [noise=true , address=89.149.201.147:4007 , piece_id=GUALOJ23T6IETBGD6VGBH5USVZADA3HNRNJPONABQ7I7WVAZ3PUA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.533024491 (205h54m35.995116974s) [noise=true , address=89.149.201.147:4023 , piece_id=HX3G4EGXC4OJA3EF2AQL35ERQIUPODOX47JFMLPUPCHZ2FQQT4QQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.910819552 (205h54m36.372912025s) [noise=true , address=81.171.14.70:4030 , piece_id=XSNZDXHQD33YDT7VOETLAZE36RSMLN4S6LZQZR43FSFJ66VTKOEA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.990741449 (205h54m36.452833932s) [noise=true , address=89.149.201.147:4002 , piece_id=RU4LRMQ6OSEP3BFACDQOHR4R6K4Q67OJ5LVUQFHED2B22PIJOYSQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.064808246 (205h54m36.526900719s) [noise=true , address=185.167.204.206:4064 , piece_id=T737VKQXQZGTMHLKXN2S6WVHZ45VDMXWJQ3REYCLNDDXHQR2LJRA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.069475683 (205h54m36.531568166s) [noise=true , address=185.167.204.206:4060 , piece_id=TVGTJBCTMRXB2VB3PSLZ3NPWDAEZTCWYULAVFG4CAJX64KVR4MEA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.083150653 (205h54m36.545243136s) [noise=true , address=185.167.204.206:4039 , piece_id=YOD34HQMIBPSLP2IZ4U77CMQSOSAK5FTZSMVRSSEHG7DMVICR7HQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.100274620 (205h54m36.562367103s) [noise=true , address=185.167.204.205:4011 , piece_id=LAKZUADU7PCZBAIGSP72D7WGUZV46R5H5H76SNIQZU2I7DEBOZKA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.107345404 (205h54m36.569437887s) [noise=true , address=185.167.204.205:4006 , piece_id=LY4HTSEATOZWQJTBML5EVSBDICVKWS24MWWJAE7TRQ54ZTHW2IIA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.113594664 (205h54m36.575687147s) [noise=true , address=185.167.204.205:4007 , piece_id=NEHAUNCJOZHAD46YI6AQCMQMV6JPTKWLF7G4H546LHALMZCL4ITQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.117627584 (205h54m36.579720077s) [noise=true , address=185.167.204.205:4009 , piece_id=2K3AA2UN7CDH5NVFKL4V5QP3G5BVDOBQ6WRN3MTXTT4NP3F3QOMQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.137300514 (205h54m36.599392997s) [noise=true , address=185.167.204.205:4015 , piece_id=KXTFVE3Y7KRLF6XCLEENWN74J5PDDRMLBYLC2POUZFQFIXUBNHEQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.137330772 (205h54m36.599423245s) [seg_pos={0 0}, upload=181068]: Segment reached optimal threshold of 26 pieces.
Oct 2 03:25:51.137463375 (205h54m36.599555858s) [noise=true , address=185.167.204.206:4056 , piece_id=G6OE3IONUXYCMNMS53YTXQ2QH2AMF6NVVKPCA4QS3YTD7RLXQMCA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.137485887 (205h54m36.59957837s) [noise=true , address=185.167.204.205:4032 , piece_id=DGWOQKZCLYMSHG6JH5AT5QVL6KFESN5YUWSHIKJV2AYBW7H26BYQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN): protocol: expected piece hash; context canceled; EOF
Oct 2 03:25:51.137500836 (205h54m36.599593339s) [noise=true , address=185.167.204.205:4032 , piece_id=DGWOQKZCLYMSHG6JH5AT5QVL6KFESN5YUWSHIKJV2AYBW7H26BYQ, seg_pos={0 0}, upload=181068]: Long tail cancellation due to optimal threshold
Oct 2 03:25:51.137526445 (205h54m36.599618928s) [seg_pos={0 0}, upload=181068]: Done waiting for segment. successful: 27 optimal: 26 errs: <nil>
Oct 2 03:25:51.137622727 (205h54m36.59971521s) [upload=181068]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 2 03:25:51.137627978 (205h54m36.599720451s) [upload=181068]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 2 03:27:37.980270426 (205h56m23.442362909s) [upload=181068]: Done uploading segments...
Oct 2 03:27:37.980291567 (205h56m23.44238404s) [upload=181068]: Upload finished. err: metaclient: context deadline exceeded
Duration: 4.844892811s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
6.208323096s
FAIL (2025-10-02 03:39:23 UTC)
orbiter warning: context deadline exceeded
Duration: 6.208360969s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
6.193168248s
FAIL (2025-10-02 03:38:29 UTC)
orbiter warning: context deadline exceeded
Duration: 6.193215699s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
4.902284715s
FAIL (2025-10-02 03:38:18 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
3:25:49.162665554 (205h54m34.624758027s) [noise=true , address=81.171.14.70:4043 , piece_id=LJS6SD7LZGMNPZDAWRLBU4WWW3NYOVDHHPH4TGHZ62LZIRDDEANA, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.162930569 (205h54m34.625023052s) [noise=true , address=81.171.14.70:4029 , piece_id=SBO52O3XSTUPJBBHIP2JZBRLHGKZE3EUQVS2I6DXS6GYN6PB654Q, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163171368 (205h54m34.625263851s) [noise=true , address=185.167.204.205:4032 , piece_id=DGWOQKZCLYMSHG6JH5AT5QVL6KFESN5YUWSHIKJV2AYBW7H26BYQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163282509 (205h54m34.625374992s) [noise=true , address=185.167.204.205:4007 , piece_id=NEHAUNCJOZHAD46YI6AQCMQMV6JPTKWLF7G4H546LHALMZCL4ITQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163618950 (205h54m34.625711433s) [noise=true , address=185.167.204.206:4064 , piece_id=T737VKQXQZGTMHLKXN2S6WVHZ45VDMXWJQ3REYCLNDDXHQR2LJRA, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163969478 (205h54m34.626061951s) [noise=true , address=89.149.201.147:4002 , piece_id=RU4LRMQ6OSEP3BFACDQOHR4R6K4Q67OJ5LVUQFHED2B22PIJOYSQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.164309926 (205h54m34.626402399s) [noise=true , address=185.167.204.205:4009 , piece_id=2K3AA2UN7CDH5NVFKL4V5QP3G5BVDOBQ6WRN3MTXTT4NP3F3QOMQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.164696282 (205h54m34.626788765s) [noise=true , address=89.149.201.147:4023 , piece_id=HX3G4EGXC4OJA3EF2AQL35ERQIUPODOX47JFMLPUPCHZ2FQQT4QQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.165052590 (205h54m34.627145073s) [noise=true , address=89.149.201.147:4003 , piece_id=L4W3GWFS3AIVGHBYOLU6FR6IKNP3BOLLWV7ZVCVAWPN53EXU5GMQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.165421743 (205h54m34.627514226s) [noise=true , address=81.171.14.70:4030 , piece_id=XSNZDXHQD33YDT7VOETLAZE36RSMLN4S6LZQZR43FSFJ66VTKOEA, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.165746141 (205h54m34.627838624s) [noise=true , address=89.149.201.147:4008 , piece_id=WKPOJRTROWSMT2BPSSCPBSILIC3VAIBQDWFRSW6NMUQSN5BRE2PQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.167492466 (205h54m34.629584949s) [noise=true , address=81.171.14.70:4041 , piece_id=RTMFTIDLELSIKF6DX2MAEUM6NEARJOEFIEJ6KJYVCVGJLRKDVYNQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.994174141 (205h54m35.456266624s) [upload=181068]: Next returned nil segment
Oct 2 03:25:49.994197545 (205h54m35.456290028s) [upload=181068]: Waiting for error group managing segments...
Oct 2 03:25:50.378559942 (205h54m35.840652425s) [noise=true , address=81.171.14.70:4043 , piece_id=LJS6SD7LZGMNPZDAWRLBU4WWW3NYOVDHHPH4TGHZ62LZIRDDEANA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.383560535 (205h54m35.845653018s) [noise=true , address=81.171.14.70:4041 , piece_id=RTMFTIDLELSIKF6DX2MAEUM6NEARJOEFIEJ6KJYVCVGJLRKDVYNQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.388516662 (205h54m35.850609135s) [noise=true , address=81.171.14.70:4040 , piece_id=QXFFFGXCPRMBKPNQ2ABGJC26U6DYIJTAARBVCVLQFLIP54G4VFLA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.389043765 (205h54m35.851136238s) [noise=true , address=81.171.14.70:4032 , piece_id=IZTDRSZ74T75J3Y7MCNORWFXLFOXG35R52Y4VSNS2QZ3R3WBFJZQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.392483886 (205h54m35.854576369s) [noise=true , address=81.171.14.70:4027 , piece_id=TDKB4CVXHXQZNNMIJLV3YYVOZMV5CKSY37L4OWB3ZXIJDNJ2JDCQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.396373262 (205h54m35.858465745s) [noise=true , address=81.171.14.70:4042 , piece_id=3ZWKCWIMPFM2CXG3HJWDOMTEMKOSZ5TOONPGOCFC3GZKZ5QHFTBQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.431305560 (205h54m35.893398043s) [noise=true , address=89.149.201.147:4016 , piece_id=LX6HKBDREXIW7XNIWV33JEGPXFMUZOCW35IQULA4PUNJDWO42BQQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.442031504 (205h54m35.904123977s) [noise=true , address=81.171.14.70:4028 , piece_id=QZY7KXVFNXMVEVOBCFTABPK3E2HCVSVYRM4UVB7VJTFZOTNF27TA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.450391563 (205h54m35.912484046s) [noise=true , address=89.149.201.147:4017 , piece_id=EA7JQR35PARZLVG5CMCXITB6MLU55M6WWVQSZEGM6YJQZ2X2WUZA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.454381601 (205h54m35.916474074s) [noise=true , address=81.171.14.70:4029 , piece_id=SBO52O3XSTUPJBBHIP2JZBRLHGKZE3EUQVS2I6DXS6GYN6PB654Q, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.463104390 (205h54m35.925196873s) [noise=true , address=89.149.201.147:4003 , piece_id=L4W3GWFS3AIVGHBYOLU6FR6IKNP3BOLLWV7ZVCVAWPN53EXU5GMQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.471309365 (205h54m35.933401848s) [noise=true , address=81.171.14.70:4036 , piece_id=CFSIP7I4XJEYGBMBQD2UTJXPSNR44OGB7DWOWOWYFSWY6DAFPL3Q, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.486337891 (205h54m35.948430364s) [noise=true , address=89.149.201.147:4008 , piece_id=WKPOJRTROWSMT2BPSSCPBSILIC3VAIBQDWFRSW6NMUQSN5BRE2PQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.489526543 (205h54m35.951619026s) [noise=true , address=89.149.201.147:4006 , piece_id=VIEICP3IHAH2ALC7NSV2T6B7ZSSLIG4NHRTKLXNAR3VBRWR54OKQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.511383803 (205h54m35.973476286s) [noise=true , address=89.149.201.147:4007 , piece_id=GUALOJ23T6IETBGD6VGBH5USVZADA3HNRNJPONABQ7I7WVAZ3PUA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.533024491 (205h54m35.995116974s) [noise=true , address=89.149.201.147:4023 , piece_id=HX3G4EGXC4OJA3EF2AQL35ERQIUPODOX47JFMLPUPCHZ2FQQT4QQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.910819552 (205h54m36.372912025s) [noise=true , address=81.171.14.70:4030 , piece_id=XSNZDXHQD33YDT7VOETLAZE36RSMLN4S6LZQZR43FSFJ66VTKOEA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.990741449 (205h54m36.452833932s) [noise=true , address=89.149.201.147:4002 , piece_id=RU4LRMQ6OSEP3BFACDQOHR4R6K4Q67OJ5LVUQFHED2B22PIJOYSQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.064808246 (205h54m36.526900719s) [noise=true , address=185.167.204.206:4064 , piece_id=T737VKQXQZGTMHLKXN2S6WVHZ45VDMXWJQ3REYCLNDDXHQR2LJRA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.069475683 (205h54m36.531568166s) [noise=true , address=185.167.204.206:4060 , piece_id=TVGTJBCTMRXB2VB3PSLZ3NPWDAEZTCWYULAVFG4CAJX64KVR4MEA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.083150653 (205h54m36.545243136s) [noise=true , address=185.167.204.206:4039 , piece_id=YOD34HQMIBPSLP2IZ4U77CMQSOSAK5FTZSMVRSSEHG7DMVICR7HQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.100274620 (205h54m36.562367103s) [noise=true , address=185.167.204.205:4011 , piece_id=LAKZUADU7PCZBAIGSP72D7WGUZV46R5H5H76SNIQZU2I7DEBOZKA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.107345404 (205h54m36.569437887s) [noise=true , address=185.167.204.205:4006 , piece_id=LY4HTSEATOZWQJTBML5EVSBDICVKWS24MWWJAE7TRQ54ZTHW2IIA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.113594664 (205h54m36.575687147s) [noise=true , address=185.167.204.205:4007 , piece_id=NEHAUNCJOZHAD46YI6AQCMQMV6JPTKWLF7G4H546LHALMZCL4ITQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.117627584 (205h54m36.579720077s) [noise=true , address=185.167.204.205:4009 , piece_id=2K3AA2UN7CDH5NVFKL4V5QP3G5BVDOBQ6WRN3MTXTT4NP3F3QOMQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.137300514 (205h54m36.599392997s) [noise=true , address=185.167.204.205:4015 , piece_id=KXTFVE3Y7KRLF6XCLEENWN74J5PDDRMLBYLC2POUZFQFIXUBNHEQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.137330772 (205h54m36.599423245s) [seg_pos={0 0}, upload=181068]: Segment reached optimal threshold of 26 pieces.
Oct 2 03:25:51.137463375 (205h54m36.599555858s) [noise=true , address=185.167.204.206:4056 , piece_id=G6OE3IONUXYCMNMS53YTXQ2QH2AMF6NVVKPCA4QS3YTD7RLXQMCA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.137485887 (205h54m36.59957837s) [noise=true , address=185.167.204.205:4032 , piece_id=DGWOQKZCLYMSHG6JH5AT5QVL6KFESN5YUWSHIKJV2AYBW7H26BYQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN): protocol: expected piece hash; context canceled; EOF
Oct 2 03:25:51.137500836 (205h54m36.599593339s) [noise=true , address=185.167.204.205:4032 , piece_id=DGWOQKZCLYMSHG6JH5AT5QVL6KFESN5YUWSHIKJV2AYBW7H26BYQ, seg_pos={0 0}, upload=181068]: Long tail cancellation due to optimal threshold
Oct 2 03:25:51.137526445 (205h54m36.599618928s) [seg_pos={0 0}, upload=181068]: Done waiting for segment. successful: 27 optimal: 26 errs: <nil>
Oct 2 03:25:51.137622727 (205h54m36.59971521s) [upload=181068]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 2 03:25:51.137627978 (205h54m36.599720451s) [upload=181068]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 2 03:27:37.980270426 (205h56m23.442362909s) [upload=181068]: Done uploading segments...
Oct 2 03:27:37.980291567 (205h56m23.44238404s) [upload=181068]: Upload finished. err: metaclient: context deadline exceeded
Duration: 4.902325062s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
6.154479015s
FAIL (2025-10-02 03:37:34 UTC)
orbiter warning: context deadline exceeded
Duration: 6.15450727s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
4.924840898s
FAIL (2025-10-02 03:37:07 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
3:25:49.162665554 (205h54m34.624758027s) [noise=true , address=81.171.14.70:4043 , piece_id=LJS6SD7LZGMNPZDAWRLBU4WWW3NYOVDHHPH4TGHZ62LZIRDDEANA, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.162930569 (205h54m34.625023052s) [noise=true , address=81.171.14.70:4029 , piece_id=SBO52O3XSTUPJBBHIP2JZBRLHGKZE3EUQVS2I6DXS6GYN6PB654Q, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163171368 (205h54m34.625263851s) [noise=true , address=185.167.204.205:4032 , piece_id=DGWOQKZCLYMSHG6JH5AT5QVL6KFESN5YUWSHIKJV2AYBW7H26BYQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163282509 (205h54m34.625374992s) [noise=true , address=185.167.204.205:4007 , piece_id=NEHAUNCJOZHAD46YI6AQCMQMV6JPTKWLF7G4H546LHALMZCL4ITQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163618950 (205h54m34.625711433s) [noise=true , address=185.167.204.206:4064 , piece_id=T737VKQXQZGTMHLKXN2S6WVHZ45VDMXWJQ3REYCLNDDXHQR2LJRA, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163969478 (205h54m34.626061951s) [noise=true , address=89.149.201.147:4002 , piece_id=RU4LRMQ6OSEP3BFACDQOHR4R6K4Q67OJ5LVUQFHED2B22PIJOYSQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.164309926 (205h54m34.626402399s) [noise=true , address=185.167.204.205:4009 , piece_id=2K3AA2UN7CDH5NVFKL4V5QP3G5BVDOBQ6WRN3MTXTT4NP3F3QOMQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.164696282 (205h54m34.626788765s) [noise=true , address=89.149.201.147:4023 , piece_id=HX3G4EGXC4OJA3EF2AQL35ERQIUPODOX47JFMLPUPCHZ2FQQT4QQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.165052590 (205h54m34.627145073s) [noise=true , address=89.149.201.147:4003 , piece_id=L4W3GWFS3AIVGHBYOLU6FR6IKNP3BOLLWV7ZVCVAWPN53EXU5GMQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.165421743 (205h54m34.627514226s) [noise=true , address=81.171.14.70:4030 , piece_id=XSNZDXHQD33YDT7VOETLAZE36RSMLN4S6LZQZR43FSFJ66VTKOEA, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.165746141 (205h54m34.627838624s) [noise=true , address=89.149.201.147:4008 , piece_id=WKPOJRTROWSMT2BPSSCPBSILIC3VAIBQDWFRSW6NMUQSN5BRE2PQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.167492466 (205h54m34.629584949s) [noise=true , address=81.171.14.70:4041 , piece_id=RTMFTIDLELSIKF6DX2MAEUM6NEARJOEFIEJ6KJYVCVGJLRKDVYNQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.994174141 (205h54m35.456266624s) [upload=181068]: Next returned nil segment
Oct 2 03:25:49.994197545 (205h54m35.456290028s) [upload=181068]: Waiting for error group managing segments...
Oct 2 03:25:50.378559942 (205h54m35.840652425s) [noise=true , address=81.171.14.70:4043 , piece_id=LJS6SD7LZGMNPZDAWRLBU4WWW3NYOVDHHPH4TGHZ62LZIRDDEANA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.383560535 (205h54m35.845653018s) [noise=true , address=81.171.14.70:4041 , piece_id=RTMFTIDLELSIKF6DX2MAEUM6NEARJOEFIEJ6KJYVCVGJLRKDVYNQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.388516662 (205h54m35.850609135s) [noise=true , address=81.171.14.70:4040 , piece_id=QXFFFGXCPRMBKPNQ2ABGJC26U6DYIJTAARBVCVLQFLIP54G4VFLA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.389043765 (205h54m35.851136238s) [noise=true , address=81.171.14.70:4032 , piece_id=IZTDRSZ74T75J3Y7MCNORWFXLFOXG35R52Y4VSNS2QZ3R3WBFJZQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.392483886 (205h54m35.854576369s) [noise=true , address=81.171.14.70:4027 , piece_id=TDKB4CVXHXQZNNMIJLV3YYVOZMV5CKSY37L4OWB3ZXIJDNJ2JDCQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.396373262 (205h54m35.858465745s) [noise=true , address=81.171.14.70:4042 , piece_id=3ZWKCWIMPFM2CXG3HJWDOMTEMKOSZ5TOONPGOCFC3GZKZ5QHFTBQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.431305560 (205h54m35.893398043s) [noise=true , address=89.149.201.147:4016 , piece_id=LX6HKBDREXIW7XNIWV33JEGPXFMUZOCW35IQULA4PUNJDWO42BQQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.442031504 (205h54m35.904123977s) [noise=true , address=81.171.14.70:4028 , piece_id=QZY7KXVFNXMVEVOBCFTABPK3E2HCVSVYRM4UVB7VJTFZOTNF27TA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.450391563 (205h54m35.912484046s) [noise=true , address=89.149.201.147:4017 , piece_id=EA7JQR35PARZLVG5CMCXITB6MLU55M6WWVQSZEGM6YJQZ2X2WUZA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.454381601 (205h54m35.916474074s) [noise=true , address=81.171.14.70:4029 , piece_id=SBO52O3XSTUPJBBHIP2JZBRLHGKZE3EUQVS2I6DXS6GYN6PB654Q, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.463104390 (205h54m35.925196873s) [noise=true , address=89.149.201.147:4003 , piece_id=L4W3GWFS3AIVGHBYOLU6FR6IKNP3BOLLWV7ZVCVAWPN53EXU5GMQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.471309365 (205h54m35.933401848s) [noise=true , address=81.171.14.70:4036 , piece_id=CFSIP7I4XJEYGBMBQD2UTJXPSNR44OGB7DWOWOWYFSWY6DAFPL3Q, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.486337891 (205h54m35.948430364s) [noise=true , address=89.149.201.147:4008 , piece_id=WKPOJRTROWSMT2BPSSCPBSILIC3VAIBQDWFRSW6NMUQSN5BRE2PQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.489526543 (205h54m35.951619026s) [noise=true , address=89.149.201.147:4006 , piece_id=VIEICP3IHAH2ALC7NSV2T6B7ZSSLIG4NHRTKLXNAR3VBRWR54OKQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.511383803 (205h54m35.973476286s) [noise=true , address=89.149.201.147:4007 , piece_id=GUALOJ23T6IETBGD6VGBH5USVZADA3HNRNJPONABQ7I7WVAZ3PUA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.533024491 (205h54m35.995116974s) [noise=true , address=89.149.201.147:4023 , piece_id=HX3G4EGXC4OJA3EF2AQL35ERQIUPODOX47JFMLPUPCHZ2FQQT4QQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.910819552 (205h54m36.372912025s) [noise=true , address=81.171.14.70:4030 , piece_id=XSNZDXHQD33YDT7VOETLAZE36RSMLN4S6LZQZR43FSFJ66VTKOEA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.990741449 (205h54m36.452833932s) [noise=true , address=89.149.201.147:4002 , piece_id=RU4LRMQ6OSEP3BFACDQOHR4R6K4Q67OJ5LVUQFHED2B22PIJOYSQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.064808246 (205h54m36.526900719s) [noise=true , address=185.167.204.206:4064 , piece_id=T737VKQXQZGTMHLKXN2S6WVHZ45VDMXWJQ3REYCLNDDXHQR2LJRA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.069475683 (205h54m36.531568166s) [noise=true , address=185.167.204.206:4060 , piece_id=TVGTJBCTMRXB2VB3PSLZ3NPWDAEZTCWYULAVFG4CAJX64KVR4MEA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.083150653 (205h54m36.545243136s) [noise=true , address=185.167.204.206:4039 , piece_id=YOD34HQMIBPSLP2IZ4U77CMQSOSAK5FTZSMVRSSEHG7DMVICR7HQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.100274620 (205h54m36.562367103s) [noise=true , address=185.167.204.205:4011 , piece_id=LAKZUADU7PCZBAIGSP72D7WGUZV46R5H5H76SNIQZU2I7DEBOZKA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.107345404 (205h54m36.569437887s) [noise=true , address=185.167.204.205:4006 , piece_id=LY4HTSEATOZWQJTBML5EVSBDICVKWS24MWWJAE7TRQ54ZTHW2IIA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.113594664 (205h54m36.575687147s) [noise=true , address=185.167.204.205:4007 , piece_id=NEHAUNCJOZHAD46YI6AQCMQMV6JPTKWLF7G4H546LHALMZCL4ITQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.117627584 (205h54m36.579720077s) [noise=true , address=185.167.204.205:4009 , piece_id=2K3AA2UN7CDH5NVFKL4V5QP3G5BVDOBQ6WRN3MTXTT4NP3F3QOMQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.137300514 (205h54m36.599392997s) [noise=true , address=185.167.204.205:4015 , piece_id=KXTFVE3Y7KRLF6XCLEENWN74J5PDDRMLBYLC2POUZFQFIXUBNHEQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.137330772 (205h54m36.599423245s) [seg_pos={0 0}, upload=181068]: Segment reached optimal threshold of 26 pieces.
Oct 2 03:25:51.137463375 (205h54m36.599555858s) [noise=true , address=185.167.204.206:4056 , piece_id=G6OE3IONUXYCMNMS53YTXQ2QH2AMF6NVVKPCA4QS3YTD7RLXQMCA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.137485887 (205h54m36.59957837s) [noise=true , address=185.167.204.205:4032 , piece_id=DGWOQKZCLYMSHG6JH5AT5QVL6KFESN5YUWSHIKJV2AYBW7H26BYQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN): protocol: expected piece hash; context canceled; EOF
Oct 2 03:25:51.137500836 (205h54m36.599593339s) [noise=true , address=185.167.204.205:4032 , piece_id=DGWOQKZCLYMSHG6JH5AT5QVL6KFESN5YUWSHIKJV2AYBW7H26BYQ, seg_pos={0 0}, upload=181068]: Long tail cancellation due to optimal threshold
Oct 2 03:25:51.137526445 (205h54m36.599618928s) [seg_pos={0 0}, upload=181068]: Done waiting for segment. successful: 27 optimal: 26 errs: <nil>
Oct 2 03:25:51.137622727 (205h54m36.59971521s) [upload=181068]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 2 03:25:51.137627978 (205h54m36.599720451s) [upload=181068]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 2 03:27:37.980270426 (205h56m23.442362909s) [upload=181068]: Done uploading segments...
Oct 2 03:27:37.980291567 (205h56m23.44238404s) [upload=181068]: Upload finished. err: metaclient: context deadline exceeded
Duration: 4.924861587s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
4.866819274s
FAIL (2025-10-02 03:36:32 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
3:25:49.162665554 (205h54m34.624758027s) [noise=true , address=81.171.14.70:4043 , piece_id=LJS6SD7LZGMNPZDAWRLBU4WWW3NYOVDHHPH4TGHZ62LZIRDDEANA, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.162930569 (205h54m34.625023052s) [noise=true , address=81.171.14.70:4029 , piece_id=SBO52O3XSTUPJBBHIP2JZBRLHGKZE3EUQVS2I6DXS6GYN6PB654Q, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163171368 (205h54m34.625263851s) [noise=true , address=185.167.204.205:4032 , piece_id=DGWOQKZCLYMSHG6JH5AT5QVL6KFESN5YUWSHIKJV2AYBW7H26BYQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163282509 (205h54m34.625374992s) [noise=true , address=185.167.204.205:4007 , piece_id=NEHAUNCJOZHAD46YI6AQCMQMV6JPTKWLF7G4H546LHALMZCL4ITQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163618950 (205h54m34.625711433s) [noise=true , address=185.167.204.206:4064 , piece_id=T737VKQXQZGTMHLKXN2S6WVHZ45VDMXWJQ3REYCLNDDXHQR2LJRA, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163969478 (205h54m34.626061951s) [noise=true , address=89.149.201.147:4002 , piece_id=RU4LRMQ6OSEP3BFACDQOHR4R6K4Q67OJ5LVUQFHED2B22PIJOYSQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.164309926 (205h54m34.626402399s) [noise=true , address=185.167.204.205:4009 , piece_id=2K3AA2UN7CDH5NVFKL4V5QP3G5BVDOBQ6WRN3MTXTT4NP3F3QOMQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.164696282 (205h54m34.626788765s) [noise=true , address=89.149.201.147:4023 , piece_id=HX3G4EGXC4OJA3EF2AQL35ERQIUPODOX47JFMLPUPCHZ2FQQT4QQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.165052590 (205h54m34.627145073s) [noise=true , address=89.149.201.147:4003 , piece_id=L4W3GWFS3AIVGHBYOLU6FR6IKNP3BOLLWV7ZVCVAWPN53EXU5GMQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.165421743 (205h54m34.627514226s) [noise=true , address=81.171.14.70:4030 , piece_id=XSNZDXHQD33YDT7VOETLAZE36RSMLN4S6LZQZR43FSFJ66VTKOEA, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.165746141 (205h54m34.627838624s) [noise=true , address=89.149.201.147:4008 , piece_id=WKPOJRTROWSMT2BPSSCPBSILIC3VAIBQDWFRSW6NMUQSN5BRE2PQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.167492466 (205h54m34.629584949s) [noise=true , address=81.171.14.70:4041 , piece_id=RTMFTIDLELSIKF6DX2MAEUM6NEARJOEFIEJ6KJYVCVGJLRKDVYNQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.994174141 (205h54m35.456266624s) [upload=181068]: Next returned nil segment
Oct 2 03:25:49.994197545 (205h54m35.456290028s) [upload=181068]: Waiting for error group managing segments...
Oct 2 03:25:50.378559942 (205h54m35.840652425s) [noise=true , address=81.171.14.70:4043 , piece_id=LJS6SD7LZGMNPZDAWRLBU4WWW3NYOVDHHPH4TGHZ62LZIRDDEANA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.383560535 (205h54m35.845653018s) [noise=true , address=81.171.14.70:4041 , piece_id=RTMFTIDLELSIKF6DX2MAEUM6NEARJOEFIEJ6KJYVCVGJLRKDVYNQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.388516662 (205h54m35.850609135s) [noise=true , address=81.171.14.70:4040 , piece_id=QXFFFGXCPRMBKPNQ2ABGJC26U6DYIJTAARBVCVLQFLIP54G4VFLA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.389043765 (205h54m35.851136238s) [noise=true , address=81.171.14.70:4032 , piece_id=IZTDRSZ74T75J3Y7MCNORWFXLFOXG35R52Y4VSNS2QZ3R3WBFJZQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.392483886 (205h54m35.854576369s) [noise=true , address=81.171.14.70:4027 , piece_id=TDKB4CVXHXQZNNMIJLV3YYVOZMV5CKSY37L4OWB3ZXIJDNJ2JDCQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.396373262 (205h54m35.858465745s) [noise=true , address=81.171.14.70:4042 , piece_id=3ZWKCWIMPFM2CXG3HJWDOMTEMKOSZ5TOONPGOCFC3GZKZ5QHFTBQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.431305560 (205h54m35.893398043s) [noise=true , address=89.149.201.147:4016 , piece_id=LX6HKBDREXIW7XNIWV33JEGPXFMUZOCW35IQULA4PUNJDWO42BQQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.442031504 (205h54m35.904123977s) [noise=true , address=81.171.14.70:4028 , piece_id=QZY7KXVFNXMVEVOBCFTABPK3E2HCVSVYRM4UVB7VJTFZOTNF27TA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.450391563 (205h54m35.912484046s) [noise=true , address=89.149.201.147:4017 , piece_id=EA7JQR35PARZLVG5CMCXITB6MLU55M6WWVQSZEGM6YJQZ2X2WUZA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.454381601 (205h54m35.916474074s) [noise=true , address=81.171.14.70:4029 , piece_id=SBO52O3XSTUPJBBHIP2JZBRLHGKZE3EUQVS2I6DXS6GYN6PB654Q, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.463104390 (205h54m35.925196873s) [noise=true , address=89.149.201.147:4003 , piece_id=L4W3GWFS3AIVGHBYOLU6FR6IKNP3BOLLWV7ZVCVAWPN53EXU5GMQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.471309365 (205h54m35.933401848s) [noise=true , address=81.171.14.70:4036 , piece_id=CFSIP7I4XJEYGBMBQD2UTJXPSNR44OGB7DWOWOWYFSWY6DAFPL3Q, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.486337891 (205h54m35.948430364s) [noise=true , address=89.149.201.147:4008 , piece_id=WKPOJRTROWSMT2BPSSCPBSILIC3VAIBQDWFRSW6NMUQSN5BRE2PQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.489526543 (205h54m35.951619026s) [noise=true , address=89.149.201.147:4006 , piece_id=VIEICP3IHAH2ALC7NSV2T6B7ZSSLIG4NHRTKLXNAR3VBRWR54OKQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.511383803 (205h54m35.973476286s) [noise=true , address=89.149.201.147:4007 , piece_id=GUALOJ23T6IETBGD6VGBH5USVZADA3HNRNJPONABQ7I7WVAZ3PUA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.533024491 (205h54m35.995116974s) [noise=true , address=89.149.201.147:4023 , piece_id=HX3G4EGXC4OJA3EF2AQL35ERQIUPODOX47JFMLPUPCHZ2FQQT4QQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.910819552 (205h54m36.372912025s) [noise=true , address=81.171.14.70:4030 , piece_id=XSNZDXHQD33YDT7VOETLAZE36RSMLN4S6LZQZR43FSFJ66VTKOEA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.990741449 (205h54m36.452833932s) [noise=true , address=89.149.201.147:4002 , piece_id=RU4LRMQ6OSEP3BFACDQOHR4R6K4Q67OJ5LVUQFHED2B22PIJOYSQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.064808246 (205h54m36.526900719s) [noise=true , address=185.167.204.206:4064 , piece_id=T737VKQXQZGTMHLKXN2S6WVHZ45VDMXWJQ3REYCLNDDXHQR2LJRA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.069475683 (205h54m36.531568166s) [noise=true , address=185.167.204.206:4060 , piece_id=TVGTJBCTMRXB2VB3PSLZ3NPWDAEZTCWYULAVFG4CAJX64KVR4MEA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.083150653 (205h54m36.545243136s) [noise=true , address=185.167.204.206:4039 , piece_id=YOD34HQMIBPSLP2IZ4U77CMQSOSAK5FTZSMVRSSEHG7DMVICR7HQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.100274620 (205h54m36.562367103s) [noise=true , address=185.167.204.205:4011 , piece_id=LAKZUADU7PCZBAIGSP72D7WGUZV46R5H5H76SNIQZU2I7DEBOZKA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.107345404 (205h54m36.569437887s) [noise=true , address=185.167.204.205:4006 , piece_id=LY4HTSEATOZWQJTBML5EVSBDICVKWS24MWWJAE7TRQ54ZTHW2IIA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.113594664 (205h54m36.575687147s) [noise=true , address=185.167.204.205:4007 , piece_id=NEHAUNCJOZHAD46YI6AQCMQMV6JPTKWLF7G4H546LHALMZCL4ITQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.117627584 (205h54m36.579720077s) [noise=true , address=185.167.204.205:4009 , piece_id=2K3AA2UN7CDH5NVFKL4V5QP3G5BVDOBQ6WRN3MTXTT4NP3F3QOMQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.137300514 (205h54m36.599392997s) [noise=true , address=185.167.204.205:4015 , piece_id=KXTFVE3Y7KRLF6XCLEENWN74J5PDDRMLBYLC2POUZFQFIXUBNHEQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.137330772 (205h54m36.599423245s) [seg_pos={0 0}, upload=181068]: Segment reached optimal threshold of 26 pieces.
Oct 2 03:25:51.137463375 (205h54m36.599555858s) [noise=true , address=185.167.204.206:4056 , piece_id=G6OE3IONUXYCMNMS53YTXQ2QH2AMF6NVVKPCA4QS3YTD7RLXQMCA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.137485887 (205h54m36.59957837s) [noise=true , address=185.167.204.205:4032 , piece_id=DGWOQKZCLYMSHG6JH5AT5QVL6KFESN5YUWSHIKJV2AYBW7H26BYQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN): protocol: expected piece hash; context canceled; EOF
Oct 2 03:25:51.137500836 (205h54m36.599593339s) [noise=true , address=185.167.204.205:4032 , piece_id=DGWOQKZCLYMSHG6JH5AT5QVL6KFESN5YUWSHIKJV2AYBW7H26BYQ, seg_pos={0 0}, upload=181068]: Long tail cancellation due to optimal threshold
Oct 2 03:25:51.137526445 (205h54m36.599618928s) [seg_pos={0 0}, upload=181068]: Done waiting for segment. successful: 27 optimal: 26 errs: <nil>
Oct 2 03:25:51.137622727 (205h54m36.59971521s) [upload=181068]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 2 03:25:51.137627978 (205h54m36.599720451s) [upload=181068]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 2 03:27:37.980270426 (205h56m23.442362909s) [upload=181068]: Done uploading segments...
Oct 2 03:27:37.980291567 (205h56m23.44238404s) [upload=181068]: Upload finished. err: metaclient: context deadline exceeded
Duration: 4.866848961s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
6.140312s
FAIL (2025-10-02 03:36:20 UTC)
orbiter warning: context deadline exceeded
Duration: 6.140340232s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
4.85185065s
FAIL (2025-10-02 03:35:58 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
3:25:49.162665554 (205h54m34.624758027s) [noise=true , address=81.171.14.70:4043 , piece_id=LJS6SD7LZGMNPZDAWRLBU4WWW3NYOVDHHPH4TGHZ62LZIRDDEANA, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.162930569 (205h54m34.625023052s) [noise=true , address=81.171.14.70:4029 , piece_id=SBO52O3XSTUPJBBHIP2JZBRLHGKZE3EUQVS2I6DXS6GYN6PB654Q, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163171368 (205h54m34.625263851s) [noise=true , address=185.167.204.205:4032 , piece_id=DGWOQKZCLYMSHG6JH5AT5QVL6KFESN5YUWSHIKJV2AYBW7H26BYQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163282509 (205h54m34.625374992s) [noise=true , address=185.167.204.205:4007 , piece_id=NEHAUNCJOZHAD46YI6AQCMQMV6JPTKWLF7G4H546LHALMZCL4ITQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163618950 (205h54m34.625711433s) [noise=true , address=185.167.204.206:4064 , piece_id=T737VKQXQZGTMHLKXN2S6WVHZ45VDMXWJQ3REYCLNDDXHQR2LJRA, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163969478 (205h54m34.626061951s) [noise=true , address=89.149.201.147:4002 , piece_id=RU4LRMQ6OSEP3BFACDQOHR4R6K4Q67OJ5LVUQFHED2B22PIJOYSQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.164309926 (205h54m34.626402399s) [noise=true , address=185.167.204.205:4009 , piece_id=2K3AA2UN7CDH5NVFKL4V5QP3G5BVDOBQ6WRN3MTXTT4NP3F3QOMQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.164696282 (205h54m34.626788765s) [noise=true , address=89.149.201.147:4023 , piece_id=HX3G4EGXC4OJA3EF2AQL35ERQIUPODOX47JFMLPUPCHZ2FQQT4QQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.165052590 (205h54m34.627145073s) [noise=true , address=89.149.201.147:4003 , piece_id=L4W3GWFS3AIVGHBYOLU6FR6IKNP3BOLLWV7ZVCVAWPN53EXU5GMQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.165421743 (205h54m34.627514226s) [noise=true , address=81.171.14.70:4030 , piece_id=XSNZDXHQD33YDT7VOETLAZE36RSMLN4S6LZQZR43FSFJ66VTKOEA, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.165746141 (205h54m34.627838624s) [noise=true , address=89.149.201.147:4008 , piece_id=WKPOJRTROWSMT2BPSSCPBSILIC3VAIBQDWFRSW6NMUQSN5BRE2PQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.167492466 (205h54m34.629584949s) [noise=true , address=81.171.14.70:4041 , piece_id=RTMFTIDLELSIKF6DX2MAEUM6NEARJOEFIEJ6KJYVCVGJLRKDVYNQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.994174141 (205h54m35.456266624s) [upload=181068]: Next returned nil segment
Oct 2 03:25:49.994197545 (205h54m35.456290028s) [upload=181068]: Waiting for error group managing segments...
Oct 2 03:25:50.378559942 (205h54m35.840652425s) [noise=true , address=81.171.14.70:4043 , piece_id=LJS6SD7LZGMNPZDAWRLBU4WWW3NYOVDHHPH4TGHZ62LZIRDDEANA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.383560535 (205h54m35.845653018s) [noise=true , address=81.171.14.70:4041 , piece_id=RTMFTIDLELSIKF6DX2MAEUM6NEARJOEFIEJ6KJYVCVGJLRKDVYNQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.388516662 (205h54m35.850609135s) [noise=true , address=81.171.14.70:4040 , piece_id=QXFFFGXCPRMBKPNQ2ABGJC26U6DYIJTAARBVCVLQFLIP54G4VFLA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.389043765 (205h54m35.851136238s) [noise=true , address=81.171.14.70:4032 , piece_id=IZTDRSZ74T75J3Y7MCNORWFXLFOXG35R52Y4VSNS2QZ3R3WBFJZQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.392483886 (205h54m35.854576369s) [noise=true , address=81.171.14.70:4027 , piece_id=TDKB4CVXHXQZNNMIJLV3YYVOZMV5CKSY37L4OWB3ZXIJDNJ2JDCQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.396373262 (205h54m35.858465745s) [noise=true , address=81.171.14.70:4042 , piece_id=3ZWKCWIMPFM2CXG3HJWDOMTEMKOSZ5TOONPGOCFC3GZKZ5QHFTBQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.431305560 (205h54m35.893398043s) [noise=true , address=89.149.201.147:4016 , piece_id=LX6HKBDREXIW7XNIWV33JEGPXFMUZOCW35IQULA4PUNJDWO42BQQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.442031504 (205h54m35.904123977s) [noise=true , address=81.171.14.70:4028 , piece_id=QZY7KXVFNXMVEVOBCFTABPK3E2HCVSVYRM4UVB7VJTFZOTNF27TA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.450391563 (205h54m35.912484046s) [noise=true , address=89.149.201.147:4017 , piece_id=EA7JQR35PARZLVG5CMCXITB6MLU55M6WWVQSZEGM6YJQZ2X2WUZA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.454381601 (205h54m35.916474074s) [noise=true , address=81.171.14.70:4029 , piece_id=SBO52O3XSTUPJBBHIP2JZBRLHGKZE3EUQVS2I6DXS6GYN6PB654Q, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.463104390 (205h54m35.925196873s) [noise=true , address=89.149.201.147:4003 , piece_id=L4W3GWFS3AIVGHBYOLU6FR6IKNP3BOLLWV7ZVCVAWPN53EXU5GMQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.471309365 (205h54m35.933401848s) [noise=true , address=81.171.14.70:4036 , piece_id=CFSIP7I4XJEYGBMBQD2UTJXPSNR44OGB7DWOWOWYFSWY6DAFPL3Q, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.486337891 (205h54m35.948430364s) [noise=true , address=89.149.201.147:4008 , piece_id=WKPOJRTROWSMT2BPSSCPBSILIC3VAIBQDWFRSW6NMUQSN5BRE2PQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.489526543 (205h54m35.951619026s) [noise=true , address=89.149.201.147:4006 , piece_id=VIEICP3IHAH2ALC7NSV2T6B7ZSSLIG4NHRTKLXNAR3VBRWR54OKQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.511383803 (205h54m35.973476286s) [noise=true , address=89.149.201.147:4007 , piece_id=GUALOJ23T6IETBGD6VGBH5USVZADA3HNRNJPONABQ7I7WVAZ3PUA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.533024491 (205h54m35.995116974s) [noise=true , address=89.149.201.147:4023 , piece_id=HX3G4EGXC4OJA3EF2AQL35ERQIUPODOX47JFMLPUPCHZ2FQQT4QQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.910819552 (205h54m36.372912025s) [noise=true , address=81.171.14.70:4030 , piece_id=XSNZDXHQD33YDT7VOETLAZE36RSMLN4S6LZQZR43FSFJ66VTKOEA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.990741449 (205h54m36.452833932s) [noise=true , address=89.149.201.147:4002 , piece_id=RU4LRMQ6OSEP3BFACDQOHR4R6K4Q67OJ5LVUQFHED2B22PIJOYSQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.064808246 (205h54m36.526900719s) [noise=true , address=185.167.204.206:4064 , piece_id=T737VKQXQZGTMHLKXN2S6WVHZ45VDMXWJQ3REYCLNDDXHQR2LJRA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.069475683 (205h54m36.531568166s) [noise=true , address=185.167.204.206:4060 , piece_id=TVGTJBCTMRXB2VB3PSLZ3NPWDAEZTCWYULAVFG4CAJX64KVR4MEA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.083150653 (205h54m36.545243136s) [noise=true , address=185.167.204.206:4039 , piece_id=YOD34HQMIBPSLP2IZ4U77CMQSOSAK5FTZSMVRSSEHG7DMVICR7HQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.100274620 (205h54m36.562367103s) [noise=true , address=185.167.204.205:4011 , piece_id=LAKZUADU7PCZBAIGSP72D7WGUZV46R5H5H76SNIQZU2I7DEBOZKA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.107345404 (205h54m36.569437887s) [noise=true , address=185.167.204.205:4006 , piece_id=LY4HTSEATOZWQJTBML5EVSBDICVKWS24MWWJAE7TRQ54ZTHW2IIA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.113594664 (205h54m36.575687147s) [noise=true , address=185.167.204.205:4007 , piece_id=NEHAUNCJOZHAD46YI6AQCMQMV6JPTKWLF7G4H546LHALMZCL4ITQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.117627584 (205h54m36.579720077s) [noise=true , address=185.167.204.205:4009 , piece_id=2K3AA2UN7CDH5NVFKL4V5QP3G5BVDOBQ6WRN3MTXTT4NP3F3QOMQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.137300514 (205h54m36.599392997s) [noise=true , address=185.167.204.205:4015 , piece_id=KXTFVE3Y7KRLF6XCLEENWN74J5PDDRMLBYLC2POUZFQFIXUBNHEQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.137330772 (205h54m36.599423245s) [seg_pos={0 0}, upload=181068]: Segment reached optimal threshold of 26 pieces.
Oct 2 03:25:51.137463375 (205h54m36.599555858s) [noise=true , address=185.167.204.206:4056 , piece_id=G6OE3IONUXYCMNMS53YTXQ2QH2AMF6NVVKPCA4QS3YTD7RLXQMCA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.137485887 (205h54m36.59957837s) [noise=true , address=185.167.204.205:4032 , piece_id=DGWOQKZCLYMSHG6JH5AT5QVL6KFESN5YUWSHIKJV2AYBW7H26BYQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN): protocol: expected piece hash; context canceled; EOF
Oct 2 03:25:51.137500836 (205h54m36.599593339s) [noise=true , address=185.167.204.205:4032 , piece_id=DGWOQKZCLYMSHG6JH5AT5QVL6KFESN5YUWSHIKJV2AYBW7H26BYQ, seg_pos={0 0}, upload=181068]: Long tail cancellation due to optimal threshold
Oct 2 03:25:51.137526445 (205h54m36.599618928s) [seg_pos={0 0}, upload=181068]: Done waiting for segment. successful: 27 optimal: 26 errs: <nil>
Oct 2 03:25:51.137622727 (205h54m36.59971521s) [upload=181068]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 2 03:25:51.137627978 (205h54m36.599720451s) [upload=181068]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 2 03:27:37.980270426 (205h56m23.442362909s) [upload=181068]: Done uploading segments...
Oct 2 03:27:37.980291567 (205h56m23.44238404s) [upload=181068]: Upload finished. err: metaclient: context deadline exceeded
Duration: 4.85188692s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
6.043423065s
FAIL (2025-10-02 03:35:32 UTC)
orbiter warning: context deadline exceeded
Duration: 6.043451759s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
4.986285497s
FAIL (2025-10-02 03:35:02 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
3:25:49.162665554 (205h54m34.624758027s) [noise=true , address=81.171.14.70:4043 , piece_id=LJS6SD7LZGMNPZDAWRLBU4WWW3NYOVDHHPH4TGHZ62LZIRDDEANA, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.162930569 (205h54m34.625023052s) [noise=true , address=81.171.14.70:4029 , piece_id=SBO52O3XSTUPJBBHIP2JZBRLHGKZE3EUQVS2I6DXS6GYN6PB654Q, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163171368 (205h54m34.625263851s) [noise=true , address=185.167.204.205:4032 , piece_id=DGWOQKZCLYMSHG6JH5AT5QVL6KFESN5YUWSHIKJV2AYBW7H26BYQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163282509 (205h54m34.625374992s) [noise=true , address=185.167.204.205:4007 , piece_id=NEHAUNCJOZHAD46YI6AQCMQMV6JPTKWLF7G4H546LHALMZCL4ITQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163618950 (205h54m34.625711433s) [noise=true , address=185.167.204.206:4064 , piece_id=T737VKQXQZGTMHLKXN2S6WVHZ45VDMXWJQ3REYCLNDDXHQR2LJRA, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163969478 (205h54m34.626061951s) [noise=true , address=89.149.201.147:4002 , piece_id=RU4LRMQ6OSEP3BFACDQOHR4R6K4Q67OJ5LVUQFHED2B22PIJOYSQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.164309926 (205h54m34.626402399s) [noise=true , address=185.167.204.205:4009 , piece_id=2K3AA2UN7CDH5NVFKL4V5QP3G5BVDOBQ6WRN3MTXTT4NP3F3QOMQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.164696282 (205h54m34.626788765s) [noise=true , address=89.149.201.147:4023 , piece_id=HX3G4EGXC4OJA3EF2AQL35ERQIUPODOX47JFMLPUPCHZ2FQQT4QQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.165052590 (205h54m34.627145073s) [noise=true , address=89.149.201.147:4003 , piece_id=L4W3GWFS3AIVGHBYOLU6FR6IKNP3BOLLWV7ZVCVAWPN53EXU5GMQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.165421743 (205h54m34.627514226s) [noise=true , address=81.171.14.70:4030 , piece_id=XSNZDXHQD33YDT7VOETLAZE36RSMLN4S6LZQZR43FSFJ66VTKOEA, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.165746141 (205h54m34.627838624s) [noise=true , address=89.149.201.147:4008 , piece_id=WKPOJRTROWSMT2BPSSCPBSILIC3VAIBQDWFRSW6NMUQSN5BRE2PQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.167492466 (205h54m34.629584949s) [noise=true , address=81.171.14.70:4041 , piece_id=RTMFTIDLELSIKF6DX2MAEUM6NEARJOEFIEJ6KJYVCVGJLRKDVYNQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.994174141 (205h54m35.456266624s) [upload=181068]: Next returned nil segment
Oct 2 03:25:49.994197545 (205h54m35.456290028s) [upload=181068]: Waiting for error group managing segments...
Oct 2 03:25:50.378559942 (205h54m35.840652425s) [noise=true , address=81.171.14.70:4043 , piece_id=LJS6SD7LZGMNPZDAWRLBU4WWW3NYOVDHHPH4TGHZ62LZIRDDEANA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.383560535 (205h54m35.845653018s) [noise=true , address=81.171.14.70:4041 , piece_id=RTMFTIDLELSIKF6DX2MAEUM6NEARJOEFIEJ6KJYVCVGJLRKDVYNQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.388516662 (205h54m35.850609135s) [noise=true , address=81.171.14.70:4040 , piece_id=QXFFFGXCPRMBKPNQ2ABGJC26U6DYIJTAARBVCVLQFLIP54G4VFLA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.389043765 (205h54m35.851136238s) [noise=true , address=81.171.14.70:4032 , piece_id=IZTDRSZ74T75J3Y7MCNORWFXLFOXG35R52Y4VSNS2QZ3R3WBFJZQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.392483886 (205h54m35.854576369s) [noise=true , address=81.171.14.70:4027 , piece_id=TDKB4CVXHXQZNNMIJLV3YYVOZMV5CKSY37L4OWB3ZXIJDNJ2JDCQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.396373262 (205h54m35.858465745s) [noise=true , address=81.171.14.70:4042 , piece_id=3ZWKCWIMPFM2CXG3HJWDOMTEMKOSZ5TOONPGOCFC3GZKZ5QHFTBQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.431305560 (205h54m35.893398043s) [noise=true , address=89.149.201.147:4016 , piece_id=LX6HKBDREXIW7XNIWV33JEGPXFMUZOCW35IQULA4PUNJDWO42BQQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.442031504 (205h54m35.904123977s) [noise=true , address=81.171.14.70:4028 , piece_id=QZY7KXVFNXMVEVOBCFTABPK3E2HCVSVYRM4UVB7VJTFZOTNF27TA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.450391563 (205h54m35.912484046s) [noise=true , address=89.149.201.147:4017 , piece_id=EA7JQR35PARZLVG5CMCXITB6MLU55M6WWVQSZEGM6YJQZ2X2WUZA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.454381601 (205h54m35.916474074s) [noise=true , address=81.171.14.70:4029 , piece_id=SBO52O3XSTUPJBBHIP2JZBRLHGKZE3EUQVS2I6DXS6GYN6PB654Q, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.463104390 (205h54m35.925196873s) [noise=true , address=89.149.201.147:4003 , piece_id=L4W3GWFS3AIVGHBYOLU6FR6IKNP3BOLLWV7ZVCVAWPN53EXU5GMQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.471309365 (205h54m35.933401848s) [noise=true , address=81.171.14.70:4036 , piece_id=CFSIP7I4XJEYGBMBQD2UTJXPSNR44OGB7DWOWOWYFSWY6DAFPL3Q, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.486337891 (205h54m35.948430364s) [noise=true , address=89.149.201.147:4008 , piece_id=WKPOJRTROWSMT2BPSSCPBSILIC3VAIBQDWFRSW6NMUQSN5BRE2PQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.489526543 (205h54m35.951619026s) [noise=true , address=89.149.201.147:4006 , piece_id=VIEICP3IHAH2ALC7NSV2T6B7ZSSLIG4NHRTKLXNAR3VBRWR54OKQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.511383803 (205h54m35.973476286s) [noise=true , address=89.149.201.147:4007 , piece_id=GUALOJ23T6IETBGD6VGBH5USVZADA3HNRNJPONABQ7I7WVAZ3PUA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.533024491 (205h54m35.995116974s) [noise=true , address=89.149.201.147:4023 , piece_id=HX3G4EGXC4OJA3EF2AQL35ERQIUPODOX47JFMLPUPCHZ2FQQT4QQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.910819552 (205h54m36.372912025s) [noise=true , address=81.171.14.70:4030 , piece_id=XSNZDXHQD33YDT7VOETLAZE36RSMLN4S6LZQZR43FSFJ66VTKOEA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.990741449 (205h54m36.452833932s) [noise=true , address=89.149.201.147:4002 , piece_id=RU4LRMQ6OSEP3BFACDQOHR4R6K4Q67OJ5LVUQFHED2B22PIJOYSQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.064808246 (205h54m36.526900719s) [noise=true , address=185.167.204.206:4064 , piece_id=T737VKQXQZGTMHLKXN2S6WVHZ45VDMXWJQ3REYCLNDDXHQR2LJRA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.069475683 (205h54m36.531568166s) [noise=true , address=185.167.204.206:4060 , piece_id=TVGTJBCTMRXB2VB3PSLZ3NPWDAEZTCWYULAVFG4CAJX64KVR4MEA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.083150653 (205h54m36.545243136s) [noise=true , address=185.167.204.206:4039 , piece_id=YOD34HQMIBPSLP2IZ4U77CMQSOSAK5FTZSMVRSSEHG7DMVICR7HQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.100274620 (205h54m36.562367103s) [noise=true , address=185.167.204.205:4011 , piece_id=LAKZUADU7PCZBAIGSP72D7WGUZV46R5H5H76SNIQZU2I7DEBOZKA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.107345404 (205h54m36.569437887s) [noise=true , address=185.167.204.205:4006 , piece_id=LY4HTSEATOZWQJTBML5EVSBDICVKWS24MWWJAE7TRQ54ZTHW2IIA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.113594664 (205h54m36.575687147s) [noise=true , address=185.167.204.205:4007 , piece_id=NEHAUNCJOZHAD46YI6AQCMQMV6JPTKWLF7G4H546LHALMZCL4ITQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.117627584 (205h54m36.579720077s) [noise=true , address=185.167.204.205:4009 , piece_id=2K3AA2UN7CDH5NVFKL4V5QP3G5BVDOBQ6WRN3MTXTT4NP3F3QOMQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.137300514 (205h54m36.599392997s) [noise=true , address=185.167.204.205:4015 , piece_id=KXTFVE3Y7KRLF6XCLEENWN74J5PDDRMLBYLC2POUZFQFIXUBNHEQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.137330772 (205h54m36.599423245s) [seg_pos={0 0}, upload=181068]: Segment reached optimal threshold of 26 pieces.
Oct 2 03:25:51.137463375 (205h54m36.599555858s) [noise=true , address=185.167.204.206:4056 , piece_id=G6OE3IONUXYCMNMS53YTXQ2QH2AMF6NVVKPCA4QS3YTD7RLXQMCA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.137485887 (205h54m36.59957837s) [noise=true , address=185.167.204.205:4032 , piece_id=DGWOQKZCLYMSHG6JH5AT5QVL6KFESN5YUWSHIKJV2AYBW7H26BYQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN): protocol: expected piece hash; context canceled; EOF
Oct 2 03:25:51.137500836 (205h54m36.599593339s) [noise=true , address=185.167.204.205:4032 , piece_id=DGWOQKZCLYMSHG6JH5AT5QVL6KFESN5YUWSHIKJV2AYBW7H26BYQ, seg_pos={0 0}, upload=181068]: Long tail cancellation due to optimal threshold
Oct 2 03:25:51.137526445 (205h54m36.599618928s) [seg_pos={0 0}, upload=181068]: Done waiting for segment. successful: 27 optimal: 26 errs: <nil>
Oct 2 03:25:51.137622727 (205h54m36.59971521s) [upload=181068]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 2 03:25:51.137627978 (205h54m36.599720451s) [upload=181068]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 2 03:27:37.980270426 (205h56m23.442362909s) [upload=181068]: Done uploading segments...
Oct 2 03:27:37.980291567 (205h56m23.44238404s) [upload=181068]: Upload finished. err: metaclient: context deadline exceeded
Duration: 4.986315405s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
6.23046684s
FAIL (2025-10-02 03:34:42 UTC)
orbiter warning: context deadline exceeded
Duration: 6.230577991s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
6.196857263s
FAIL (2025-10-02 03:34:19 UTC)
orbiter warning: context deadline exceeded
Duration: 6.196890396s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
4.988442586s
FAIL (2025-10-02 03:33:57 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
3:25:49.162665554 (205h54m34.624758027s) [noise=true , address=81.171.14.70:4043 , piece_id=LJS6SD7LZGMNPZDAWRLBU4WWW3NYOVDHHPH4TGHZ62LZIRDDEANA, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.162930569 (205h54m34.625023052s) [noise=true , address=81.171.14.70:4029 , piece_id=SBO52O3XSTUPJBBHIP2JZBRLHGKZE3EUQVS2I6DXS6GYN6PB654Q, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163171368 (205h54m34.625263851s) [noise=true , address=185.167.204.205:4032 , piece_id=DGWOQKZCLYMSHG6JH5AT5QVL6KFESN5YUWSHIKJV2AYBW7H26BYQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163282509 (205h54m34.625374992s) [noise=true , address=185.167.204.205:4007 , piece_id=NEHAUNCJOZHAD46YI6AQCMQMV6JPTKWLF7G4H546LHALMZCL4ITQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163618950 (205h54m34.625711433s) [noise=true , address=185.167.204.206:4064 , piece_id=T737VKQXQZGTMHLKXN2S6WVHZ45VDMXWJQ3REYCLNDDXHQR2LJRA, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163969478 (205h54m34.626061951s) [noise=true , address=89.149.201.147:4002 , piece_id=RU4LRMQ6OSEP3BFACDQOHR4R6K4Q67OJ5LVUQFHED2B22PIJOYSQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.164309926 (205h54m34.626402399s) [noise=true , address=185.167.204.205:4009 , piece_id=2K3AA2UN7CDH5NVFKL4V5QP3G5BVDOBQ6WRN3MTXTT4NP3F3QOMQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.164696282 (205h54m34.626788765s) [noise=true , address=89.149.201.147:4023 , piece_id=HX3G4EGXC4OJA3EF2AQL35ERQIUPODOX47JFMLPUPCHZ2FQQT4QQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.165052590 (205h54m34.627145073s) [noise=true , address=89.149.201.147:4003 , piece_id=L4W3GWFS3AIVGHBYOLU6FR6IKNP3BOLLWV7ZVCVAWPN53EXU5GMQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.165421743 (205h54m34.627514226s) [noise=true , address=81.171.14.70:4030 , piece_id=XSNZDXHQD33YDT7VOETLAZE36RSMLN4S6LZQZR43FSFJ66VTKOEA, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.165746141 (205h54m34.627838624s) [noise=true , address=89.149.201.147:4008 , piece_id=WKPOJRTROWSMT2BPSSCPBSILIC3VAIBQDWFRSW6NMUQSN5BRE2PQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.167492466 (205h54m34.629584949s) [noise=true , address=81.171.14.70:4041 , piece_id=RTMFTIDLELSIKF6DX2MAEUM6NEARJOEFIEJ6KJYVCVGJLRKDVYNQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.994174141 (205h54m35.456266624s) [upload=181068]: Next returned nil segment
Oct 2 03:25:49.994197545 (205h54m35.456290028s) [upload=181068]: Waiting for error group managing segments...
Oct 2 03:25:50.378559942 (205h54m35.840652425s) [noise=true , address=81.171.14.70:4043 , piece_id=LJS6SD7LZGMNPZDAWRLBU4WWW3NYOVDHHPH4TGHZ62LZIRDDEANA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.383560535 (205h54m35.845653018s) [noise=true , address=81.171.14.70:4041 , piece_id=RTMFTIDLELSIKF6DX2MAEUM6NEARJOEFIEJ6KJYVCVGJLRKDVYNQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.388516662 (205h54m35.850609135s) [noise=true , address=81.171.14.70:4040 , piece_id=QXFFFGXCPRMBKPNQ2ABGJC26U6DYIJTAARBVCVLQFLIP54G4VFLA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.389043765 (205h54m35.851136238s) [noise=true , address=81.171.14.70:4032 , piece_id=IZTDRSZ74T75J3Y7MCNORWFXLFOXG35R52Y4VSNS2QZ3R3WBFJZQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.392483886 (205h54m35.854576369s) [noise=true , address=81.171.14.70:4027 , piece_id=TDKB4CVXHXQZNNMIJLV3YYVOZMV5CKSY37L4OWB3ZXIJDNJ2JDCQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.396373262 (205h54m35.858465745s) [noise=true , address=81.171.14.70:4042 , piece_id=3ZWKCWIMPFM2CXG3HJWDOMTEMKOSZ5TOONPGOCFC3GZKZ5QHFTBQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.431305560 (205h54m35.893398043s) [noise=true , address=89.149.201.147:4016 , piece_id=LX6HKBDREXIW7XNIWV33JEGPXFMUZOCW35IQULA4PUNJDWO42BQQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.442031504 (205h54m35.904123977s) [noise=true , address=81.171.14.70:4028 , piece_id=QZY7KXVFNXMVEVOBCFTABPK3E2HCVSVYRM4UVB7VJTFZOTNF27TA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.450391563 (205h54m35.912484046s) [noise=true , address=89.149.201.147:4017 , piece_id=EA7JQR35PARZLVG5CMCXITB6MLU55M6WWVQSZEGM6YJQZ2X2WUZA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.454381601 (205h54m35.916474074s) [noise=true , address=81.171.14.70:4029 , piece_id=SBO52O3XSTUPJBBHIP2JZBRLHGKZE3EUQVS2I6DXS6GYN6PB654Q, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.463104390 (205h54m35.925196873s) [noise=true , address=89.149.201.147:4003 , piece_id=L4W3GWFS3AIVGHBYOLU6FR6IKNP3BOLLWV7ZVCVAWPN53EXU5GMQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.471309365 (205h54m35.933401848s) [noise=true , address=81.171.14.70:4036 , piece_id=CFSIP7I4XJEYGBMBQD2UTJXPSNR44OGB7DWOWOWYFSWY6DAFPL3Q, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.486337891 (205h54m35.948430364s) [noise=true , address=89.149.201.147:4008 , piece_id=WKPOJRTROWSMT2BPSSCPBSILIC3VAIBQDWFRSW6NMUQSN5BRE2PQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.489526543 (205h54m35.951619026s) [noise=true , address=89.149.201.147:4006 , piece_id=VIEICP3IHAH2ALC7NSV2T6B7ZSSLIG4NHRTKLXNAR3VBRWR54OKQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.511383803 (205h54m35.973476286s) [noise=true , address=89.149.201.147:4007 , piece_id=GUALOJ23T6IETBGD6VGBH5USVZADA3HNRNJPONABQ7I7WVAZ3PUA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.533024491 (205h54m35.995116974s) [noise=true , address=89.149.201.147:4023 , piece_id=HX3G4EGXC4OJA3EF2AQL35ERQIUPODOX47JFMLPUPCHZ2FQQT4QQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.910819552 (205h54m36.372912025s) [noise=true , address=81.171.14.70:4030 , piece_id=XSNZDXHQD33YDT7VOETLAZE36RSMLN4S6LZQZR43FSFJ66VTKOEA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.990741449 (205h54m36.452833932s) [noise=true , address=89.149.201.147:4002 , piece_id=RU4LRMQ6OSEP3BFACDQOHR4R6K4Q67OJ5LVUQFHED2B22PIJOYSQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.064808246 (205h54m36.526900719s) [noise=true , address=185.167.204.206:4064 , piece_id=T737VKQXQZGTMHLKXN2S6WVHZ45VDMXWJQ3REYCLNDDXHQR2LJRA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.069475683 (205h54m36.531568166s) [noise=true , address=185.167.204.206:4060 , piece_id=TVGTJBCTMRXB2VB3PSLZ3NPWDAEZTCWYULAVFG4CAJX64KVR4MEA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.083150653 (205h54m36.545243136s) [noise=true , address=185.167.204.206:4039 , piece_id=YOD34HQMIBPSLP2IZ4U77CMQSOSAK5FTZSMVRSSEHG7DMVICR7HQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.100274620 (205h54m36.562367103s) [noise=true , address=185.167.204.205:4011 , piece_id=LAKZUADU7PCZBAIGSP72D7WGUZV46R5H5H76SNIQZU2I7DEBOZKA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.107345404 (205h54m36.569437887s) [noise=true , address=185.167.204.205:4006 , piece_id=LY4HTSEATOZWQJTBML5EVSBDICVKWS24MWWJAE7TRQ54ZTHW2IIA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.113594664 (205h54m36.575687147s) [noise=true , address=185.167.204.205:4007 , piece_id=NEHAUNCJOZHAD46YI6AQCMQMV6JPTKWLF7G4H546LHALMZCL4ITQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.117627584 (205h54m36.579720077s) [noise=true , address=185.167.204.205:4009 , piece_id=2K3AA2UN7CDH5NVFKL4V5QP3G5BVDOBQ6WRN3MTXTT4NP3F3QOMQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.137300514 (205h54m36.599392997s) [noise=true , address=185.167.204.205:4015 , piece_id=KXTFVE3Y7KRLF6XCLEENWN74J5PDDRMLBYLC2POUZFQFIXUBNHEQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.137330772 (205h54m36.599423245s) [seg_pos={0 0}, upload=181068]: Segment reached optimal threshold of 26 pieces.
Oct 2 03:25:51.137463375 (205h54m36.599555858s) [noise=true , address=185.167.204.206:4056 , piece_id=G6OE3IONUXYCMNMS53YTXQ2QH2AMF6NVVKPCA4QS3YTD7RLXQMCA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.137485887 (205h54m36.59957837s) [noise=true , address=185.167.204.205:4032 , piece_id=DGWOQKZCLYMSHG6JH5AT5QVL6KFESN5YUWSHIKJV2AYBW7H26BYQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN): protocol: expected piece hash; context canceled; EOF
Oct 2 03:25:51.137500836 (205h54m36.599593339s) [noise=true , address=185.167.204.205:4032 , piece_id=DGWOQKZCLYMSHG6JH5AT5QVL6KFESN5YUWSHIKJV2AYBW7H26BYQ, seg_pos={0 0}, upload=181068]: Long tail cancellation due to optimal threshold
Oct 2 03:25:51.137526445 (205h54m36.599618928s) [seg_pos={0 0}, upload=181068]: Done waiting for segment. successful: 27 optimal: 26 errs: <nil>
Oct 2 03:25:51.137622727 (205h54m36.59971521s) [upload=181068]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 2 03:25:51.137627978 (205h54m36.599720451s) [upload=181068]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 2 03:27:37.980270426 (205h56m23.442362909s) [upload=181068]: Done uploading segments...
Oct 2 03:27:37.980291567 (205h56m23.44238404s) [upload=181068]: Upload finished. err: metaclient: context deadline exceeded
Duration: 4.988488313s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
4.946418216s
FAIL (2025-10-02 03:33:29 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
3:25:49.162665554 (205h54m34.624758027s) [noise=true , address=81.171.14.70:4043 , piece_id=LJS6SD7LZGMNPZDAWRLBU4WWW3NYOVDHHPH4TGHZ62LZIRDDEANA, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.162930569 (205h54m34.625023052s) [noise=true , address=81.171.14.70:4029 , piece_id=SBO52O3XSTUPJBBHIP2JZBRLHGKZE3EUQVS2I6DXS6GYN6PB654Q, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163171368 (205h54m34.625263851s) [noise=true , address=185.167.204.205:4032 , piece_id=DGWOQKZCLYMSHG6JH5AT5QVL6KFESN5YUWSHIKJV2AYBW7H26BYQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163282509 (205h54m34.625374992s) [noise=true , address=185.167.204.205:4007 , piece_id=NEHAUNCJOZHAD46YI6AQCMQMV6JPTKWLF7G4H546LHALMZCL4ITQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163618950 (205h54m34.625711433s) [noise=true , address=185.167.204.206:4064 , piece_id=T737VKQXQZGTMHLKXN2S6WVHZ45VDMXWJQ3REYCLNDDXHQR2LJRA, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163969478 (205h54m34.626061951s) [noise=true , address=89.149.201.147:4002 , piece_id=RU4LRMQ6OSEP3BFACDQOHR4R6K4Q67OJ5LVUQFHED2B22PIJOYSQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.164309926 (205h54m34.626402399s) [noise=true , address=185.167.204.205:4009 , piece_id=2K3AA2UN7CDH5NVFKL4V5QP3G5BVDOBQ6WRN3MTXTT4NP3F3QOMQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.164696282 (205h54m34.626788765s) [noise=true , address=89.149.201.147:4023 , piece_id=HX3G4EGXC4OJA3EF2AQL35ERQIUPODOX47JFMLPUPCHZ2FQQT4QQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.165052590 (205h54m34.627145073s) [noise=true , address=89.149.201.147:4003 , piece_id=L4W3GWFS3AIVGHBYOLU6FR6IKNP3BOLLWV7ZVCVAWPN53EXU5GMQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.165421743 (205h54m34.627514226s) [noise=true , address=81.171.14.70:4030 , piece_id=XSNZDXHQD33YDT7VOETLAZE36RSMLN4S6LZQZR43FSFJ66VTKOEA, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.165746141 (205h54m34.627838624s) [noise=true , address=89.149.201.147:4008 , piece_id=WKPOJRTROWSMT2BPSSCPBSILIC3VAIBQDWFRSW6NMUQSN5BRE2PQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.167492466 (205h54m34.629584949s) [noise=true , address=81.171.14.70:4041 , piece_id=RTMFTIDLELSIKF6DX2MAEUM6NEARJOEFIEJ6KJYVCVGJLRKDVYNQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.994174141 (205h54m35.456266624s) [upload=181068]: Next returned nil segment
Oct 2 03:25:49.994197545 (205h54m35.456290028s) [upload=181068]: Waiting for error group managing segments...
Oct 2 03:25:50.378559942 (205h54m35.840652425s) [noise=true , address=81.171.14.70:4043 , piece_id=LJS6SD7LZGMNPZDAWRLBU4WWW3NYOVDHHPH4TGHZ62LZIRDDEANA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.383560535 (205h54m35.845653018s) [noise=true , address=81.171.14.70:4041 , piece_id=RTMFTIDLELSIKF6DX2MAEUM6NEARJOEFIEJ6KJYVCVGJLRKDVYNQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.388516662 (205h54m35.850609135s) [noise=true , address=81.171.14.70:4040 , piece_id=QXFFFGXCPRMBKPNQ2ABGJC26U6DYIJTAARBVCVLQFLIP54G4VFLA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.389043765 (205h54m35.851136238s) [noise=true , address=81.171.14.70:4032 , piece_id=IZTDRSZ74T75J3Y7MCNORWFXLFOXG35R52Y4VSNS2QZ3R3WBFJZQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.392483886 (205h54m35.854576369s) [noise=true , address=81.171.14.70:4027 , piece_id=TDKB4CVXHXQZNNMIJLV3YYVOZMV5CKSY37L4OWB3ZXIJDNJ2JDCQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.396373262 (205h54m35.858465745s) [noise=true , address=81.171.14.70:4042 , piece_id=3ZWKCWIMPFM2CXG3HJWDOMTEMKOSZ5TOONPGOCFC3GZKZ5QHFTBQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.431305560 (205h54m35.893398043s) [noise=true , address=89.149.201.147:4016 , piece_id=LX6HKBDREXIW7XNIWV33JEGPXFMUZOCW35IQULA4PUNJDWO42BQQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.442031504 (205h54m35.904123977s) [noise=true , address=81.171.14.70:4028 , piece_id=QZY7KXVFNXMVEVOBCFTABPK3E2HCVSVYRM4UVB7VJTFZOTNF27TA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.450391563 (205h54m35.912484046s) [noise=true , address=89.149.201.147:4017 , piece_id=EA7JQR35PARZLVG5CMCXITB6MLU55M6WWVQSZEGM6YJQZ2X2WUZA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.454381601 (205h54m35.916474074s) [noise=true , address=81.171.14.70:4029 , piece_id=SBO52O3XSTUPJBBHIP2JZBRLHGKZE3EUQVS2I6DXS6GYN6PB654Q, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.463104390 (205h54m35.925196873s) [noise=true , address=89.149.201.147:4003 , piece_id=L4W3GWFS3AIVGHBYOLU6FR6IKNP3BOLLWV7ZVCVAWPN53EXU5GMQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.471309365 (205h54m35.933401848s) [noise=true , address=81.171.14.70:4036 , piece_id=CFSIP7I4XJEYGBMBQD2UTJXPSNR44OGB7DWOWOWYFSWY6DAFPL3Q, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.486337891 (205h54m35.948430364s) [noise=true , address=89.149.201.147:4008 , piece_id=WKPOJRTROWSMT2BPSSCPBSILIC3VAIBQDWFRSW6NMUQSN5BRE2PQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.489526543 (205h54m35.951619026s) [noise=true , address=89.149.201.147:4006 , piece_id=VIEICP3IHAH2ALC7NSV2T6B7ZSSLIG4NHRTKLXNAR3VBRWR54OKQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.511383803 (205h54m35.973476286s) [noise=true , address=89.149.201.147:4007 , piece_id=GUALOJ23T6IETBGD6VGBH5USVZADA3HNRNJPONABQ7I7WVAZ3PUA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.533024491 (205h54m35.995116974s) [noise=true , address=89.149.201.147:4023 , piece_id=HX3G4EGXC4OJA3EF2AQL35ERQIUPODOX47JFMLPUPCHZ2FQQT4QQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.910819552 (205h54m36.372912025s) [noise=true , address=81.171.14.70:4030 , piece_id=XSNZDXHQD33YDT7VOETLAZE36RSMLN4S6LZQZR43FSFJ66VTKOEA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.990741449 (205h54m36.452833932s) [noise=true , address=89.149.201.147:4002 , piece_id=RU4LRMQ6OSEP3BFACDQOHR4R6K4Q67OJ5LVUQFHED2B22PIJOYSQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.064808246 (205h54m36.526900719s) [noise=true , address=185.167.204.206:4064 , piece_id=T737VKQXQZGTMHLKXN2S6WVHZ45VDMXWJQ3REYCLNDDXHQR2LJRA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.069475683 (205h54m36.531568166s) [noise=true , address=185.167.204.206:4060 , piece_id=TVGTJBCTMRXB2VB3PSLZ3NPWDAEZTCWYULAVFG4CAJX64KVR4MEA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.083150653 (205h54m36.545243136s) [noise=true , address=185.167.204.206:4039 , piece_id=YOD34HQMIBPSLP2IZ4U77CMQSOSAK5FTZSMVRSSEHG7DMVICR7HQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.100274620 (205h54m36.562367103s) [noise=true , address=185.167.204.205:4011 , piece_id=LAKZUADU7PCZBAIGSP72D7WGUZV46R5H5H76SNIQZU2I7DEBOZKA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.107345404 (205h54m36.569437887s) [noise=true , address=185.167.204.205:4006 , piece_id=LY4HTSEATOZWQJTBML5EVSBDICVKWS24MWWJAE7TRQ54ZTHW2IIA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.113594664 (205h54m36.575687147s) [noise=true , address=185.167.204.205:4007 , piece_id=NEHAUNCJOZHAD46YI6AQCMQMV6JPTKWLF7G4H546LHALMZCL4ITQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.117627584 (205h54m36.579720077s) [noise=true , address=185.167.204.205:4009 , piece_id=2K3AA2UN7CDH5NVFKL4V5QP3G5BVDOBQ6WRN3MTXTT4NP3F3QOMQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.137300514 (205h54m36.599392997s) [noise=true , address=185.167.204.205:4015 , piece_id=KXTFVE3Y7KRLF6XCLEENWN74J5PDDRMLBYLC2POUZFQFIXUBNHEQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.137330772 (205h54m36.599423245s) [seg_pos={0 0}, upload=181068]: Segment reached optimal threshold of 26 pieces.
Oct 2 03:25:51.137463375 (205h54m36.599555858s) [noise=true , address=185.167.204.206:4056 , piece_id=G6OE3IONUXYCMNMS53YTXQ2QH2AMF6NVVKPCA4QS3YTD7RLXQMCA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.137485887 (205h54m36.59957837s) [noise=true , address=185.167.204.205:4032 , piece_id=DGWOQKZCLYMSHG6JH5AT5QVL6KFESN5YUWSHIKJV2AYBW7H26BYQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN): protocol: expected piece hash; context canceled; EOF
Oct 2 03:25:51.137500836 (205h54m36.599593339s) [noise=true , address=185.167.204.205:4032 , piece_id=DGWOQKZCLYMSHG6JH5AT5QVL6KFESN5YUWSHIKJV2AYBW7H26BYQ, seg_pos={0 0}, upload=181068]: Long tail cancellation due to optimal threshold
Oct 2 03:25:51.137526445 (205h54m36.599618928s) [seg_pos={0 0}, upload=181068]: Done waiting for segment. successful: 27 optimal: 26 errs: <nil>
Oct 2 03:25:51.137622727 (205h54m36.59971521s) [upload=181068]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 2 03:25:51.137627978 (205h54m36.599720451s) [upload=181068]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 2 03:27:37.980270426 (205h56m23.442362909s) [upload=181068]: Done uploading segments...
Oct 2 03:27:37.980291567 (205h56m23.44238404s) [upload=181068]: Upload finished. err: metaclient: context deadline exceeded
Duration: 4.946451319s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
6.496467285s
FAIL (2025-10-02 03:33:25 UTC)
orbiter warning: context deadline exceeded
Duration: 6.496494426s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
4.884443303s
FAIL (2025-10-02 03:32:48 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
3:25:49.162665554 (205h54m34.624758027s) [noise=true , address=81.171.14.70:4043 , piece_id=LJS6SD7LZGMNPZDAWRLBU4WWW3NYOVDHHPH4TGHZ62LZIRDDEANA, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.162930569 (205h54m34.625023052s) [noise=true , address=81.171.14.70:4029 , piece_id=SBO52O3XSTUPJBBHIP2JZBRLHGKZE3EUQVS2I6DXS6GYN6PB654Q, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163171368 (205h54m34.625263851s) [noise=true , address=185.167.204.205:4032 , piece_id=DGWOQKZCLYMSHG6JH5AT5QVL6KFESN5YUWSHIKJV2AYBW7H26BYQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163282509 (205h54m34.625374992s) [noise=true , address=185.167.204.205:4007 , piece_id=NEHAUNCJOZHAD46YI6AQCMQMV6JPTKWLF7G4H546LHALMZCL4ITQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163618950 (205h54m34.625711433s) [noise=true , address=185.167.204.206:4064 , piece_id=T737VKQXQZGTMHLKXN2S6WVHZ45VDMXWJQ3REYCLNDDXHQR2LJRA, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163969478 (205h54m34.626061951s) [noise=true , address=89.149.201.147:4002 , piece_id=RU4LRMQ6OSEP3BFACDQOHR4R6K4Q67OJ5LVUQFHED2B22PIJOYSQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.164309926 (205h54m34.626402399s) [noise=true , address=185.167.204.205:4009 , piece_id=2K3AA2UN7CDH5NVFKL4V5QP3G5BVDOBQ6WRN3MTXTT4NP3F3QOMQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.164696282 (205h54m34.626788765s) [noise=true , address=89.149.201.147:4023 , piece_id=HX3G4EGXC4OJA3EF2AQL35ERQIUPODOX47JFMLPUPCHZ2FQQT4QQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.165052590 (205h54m34.627145073s) [noise=true , address=89.149.201.147:4003 , piece_id=L4W3GWFS3AIVGHBYOLU6FR6IKNP3BOLLWV7ZVCVAWPN53EXU5GMQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.165421743 (205h54m34.627514226s) [noise=true , address=81.171.14.70:4030 , piece_id=XSNZDXHQD33YDT7VOETLAZE36RSMLN4S6LZQZR43FSFJ66VTKOEA, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.165746141 (205h54m34.627838624s) [noise=true , address=89.149.201.147:4008 , piece_id=WKPOJRTROWSMT2BPSSCPBSILIC3VAIBQDWFRSW6NMUQSN5BRE2PQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.167492466 (205h54m34.629584949s) [noise=true , address=81.171.14.70:4041 , piece_id=RTMFTIDLELSIKF6DX2MAEUM6NEARJOEFIEJ6KJYVCVGJLRKDVYNQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.994174141 (205h54m35.456266624s) [upload=181068]: Next returned nil segment
Oct 2 03:25:49.994197545 (205h54m35.456290028s) [upload=181068]: Waiting for error group managing segments...
Oct 2 03:25:50.378559942 (205h54m35.840652425s) [noise=true , address=81.171.14.70:4043 , piece_id=LJS6SD7LZGMNPZDAWRLBU4WWW3NYOVDHHPH4TGHZ62LZIRDDEANA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.383560535 (205h54m35.845653018s) [noise=true , address=81.171.14.70:4041 , piece_id=RTMFTIDLELSIKF6DX2MAEUM6NEARJOEFIEJ6KJYVCVGJLRKDVYNQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.388516662 (205h54m35.850609135s) [noise=true , address=81.171.14.70:4040 , piece_id=QXFFFGXCPRMBKPNQ2ABGJC26U6DYIJTAARBVCVLQFLIP54G4VFLA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.389043765 (205h54m35.851136238s) [noise=true , address=81.171.14.70:4032 , piece_id=IZTDRSZ74T75J3Y7MCNORWFXLFOXG35R52Y4VSNS2QZ3R3WBFJZQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.392483886 (205h54m35.854576369s) [noise=true , address=81.171.14.70:4027 , piece_id=TDKB4CVXHXQZNNMIJLV3YYVOZMV5CKSY37L4OWB3ZXIJDNJ2JDCQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.396373262 (205h54m35.858465745s) [noise=true , address=81.171.14.70:4042 , piece_id=3ZWKCWIMPFM2CXG3HJWDOMTEMKOSZ5TOONPGOCFC3GZKZ5QHFTBQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.431305560 (205h54m35.893398043s) [noise=true , address=89.149.201.147:4016 , piece_id=LX6HKBDREXIW7XNIWV33JEGPXFMUZOCW35IQULA4PUNJDWO42BQQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.442031504 (205h54m35.904123977s) [noise=true , address=81.171.14.70:4028 , piece_id=QZY7KXVFNXMVEVOBCFTABPK3E2HCVSVYRM4UVB7VJTFZOTNF27TA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.450391563 (205h54m35.912484046s) [noise=true , address=89.149.201.147:4017 , piece_id=EA7JQR35PARZLVG5CMCXITB6MLU55M6WWVQSZEGM6YJQZ2X2WUZA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.454381601 (205h54m35.916474074s) [noise=true , address=81.171.14.70:4029 , piece_id=SBO52O3XSTUPJBBHIP2JZBRLHGKZE3EUQVS2I6DXS6GYN6PB654Q, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.463104390 (205h54m35.925196873s) [noise=true , address=89.149.201.147:4003 , piece_id=L4W3GWFS3AIVGHBYOLU6FR6IKNP3BOLLWV7ZVCVAWPN53EXU5GMQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.471309365 (205h54m35.933401848s) [noise=true , address=81.171.14.70:4036 , piece_id=CFSIP7I4XJEYGBMBQD2UTJXPSNR44OGB7DWOWOWYFSWY6DAFPL3Q, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.486337891 (205h54m35.948430364s) [noise=true , address=89.149.201.147:4008 , piece_id=WKPOJRTROWSMT2BPSSCPBSILIC3VAIBQDWFRSW6NMUQSN5BRE2PQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.489526543 (205h54m35.951619026s) [noise=true , address=89.149.201.147:4006 , piece_id=VIEICP3IHAH2ALC7NSV2T6B7ZSSLIG4NHRTKLXNAR3VBRWR54OKQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.511383803 (205h54m35.973476286s) [noise=true , address=89.149.201.147:4007 , piece_id=GUALOJ23T6IETBGD6VGBH5USVZADA3HNRNJPONABQ7I7WVAZ3PUA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.533024491 (205h54m35.995116974s) [noise=true , address=89.149.201.147:4023 , piece_id=HX3G4EGXC4OJA3EF2AQL35ERQIUPODOX47JFMLPUPCHZ2FQQT4QQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.910819552 (205h54m36.372912025s) [noise=true , address=81.171.14.70:4030 , piece_id=XSNZDXHQD33YDT7VOETLAZE36RSMLN4S6LZQZR43FSFJ66VTKOEA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.990741449 (205h54m36.452833932s) [noise=true , address=89.149.201.147:4002 , piece_id=RU4LRMQ6OSEP3BFACDQOHR4R6K4Q67OJ5LVUQFHED2B22PIJOYSQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.064808246 (205h54m36.526900719s) [noise=true , address=185.167.204.206:4064 , piece_id=T737VKQXQZGTMHLKXN2S6WVHZ45VDMXWJQ3REYCLNDDXHQR2LJRA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.069475683 (205h54m36.531568166s) [noise=true , address=185.167.204.206:4060 , piece_id=TVGTJBCTMRXB2VB3PSLZ3NPWDAEZTCWYULAVFG4CAJX64KVR4MEA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.083150653 (205h54m36.545243136s) [noise=true , address=185.167.204.206:4039 , piece_id=YOD34HQMIBPSLP2IZ4U77CMQSOSAK5FTZSMVRSSEHG7DMVICR7HQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.100274620 (205h54m36.562367103s) [noise=true , address=185.167.204.205:4011 , piece_id=LAKZUADU7PCZBAIGSP72D7WGUZV46R5H5H76SNIQZU2I7DEBOZKA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.107345404 (205h54m36.569437887s) [noise=true , address=185.167.204.205:4006 , piece_id=LY4HTSEATOZWQJTBML5EVSBDICVKWS24MWWJAE7TRQ54ZTHW2IIA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.113594664 (205h54m36.575687147s) [noise=true , address=185.167.204.205:4007 , piece_id=NEHAUNCJOZHAD46YI6AQCMQMV6JPTKWLF7G4H546LHALMZCL4ITQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.117627584 (205h54m36.579720077s) [noise=true , address=185.167.204.205:4009 , piece_id=2K3AA2UN7CDH5NVFKL4V5QP3G5BVDOBQ6WRN3MTXTT4NP3F3QOMQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.137300514 (205h54m36.599392997s) [noise=true , address=185.167.204.205:4015 , piece_id=KXTFVE3Y7KRLF6XCLEENWN74J5PDDRMLBYLC2POUZFQFIXUBNHEQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.137330772 (205h54m36.599423245s) [seg_pos={0 0}, upload=181068]: Segment reached optimal threshold of 26 pieces.
Oct 2 03:25:51.137463375 (205h54m36.599555858s) [noise=true , address=185.167.204.206:4056 , piece_id=G6OE3IONUXYCMNMS53YTXQ2QH2AMF6NVVKPCA4QS3YTD7RLXQMCA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.137485887 (205h54m36.59957837s) [noise=true , address=185.167.204.205:4032 , piece_id=DGWOQKZCLYMSHG6JH5AT5QVL6KFESN5YUWSHIKJV2AYBW7H26BYQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN): protocol: expected piece hash; context canceled; EOF
Oct 2 03:25:51.137500836 (205h54m36.599593339s) [noise=true , address=185.167.204.205:4032 , piece_id=DGWOQKZCLYMSHG6JH5AT5QVL6KFESN5YUWSHIKJV2AYBW7H26BYQ, seg_pos={0 0}, upload=181068]: Long tail cancellation due to optimal threshold
Oct 2 03:25:51.137526445 (205h54m36.599618928s) [seg_pos={0 0}, upload=181068]: Done waiting for segment. successful: 27 optimal: 26 errs: <nil>
Oct 2 03:25:51.137622727 (205h54m36.59971521s) [upload=181068]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 2 03:25:51.137627978 (205h54m36.599720451s) [upload=181068]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 2 03:27:37.980270426 (205h56m23.442362909s) [upload=181068]: Done uploading segments...
Oct 2 03:27:37.980291567 (205h56m23.44238404s) [upload=181068]: Upload finished. err: metaclient: context deadline exceeded
Duration: 4.884466998s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
6.109132358s
FAIL (2025-10-02 03:32:47 UTC)
orbiter warning: context deadline exceeded
Duration: 6.109162946s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
4.850525186s
FAIL (2025-10-02 03:32:17 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
3:25:49.162665554 (205h54m34.624758027s) [noise=true , address=81.171.14.70:4043 , piece_id=LJS6SD7LZGMNPZDAWRLBU4WWW3NYOVDHHPH4TGHZ62LZIRDDEANA, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.162930569 (205h54m34.625023052s) [noise=true , address=81.171.14.70:4029 , piece_id=SBO52O3XSTUPJBBHIP2JZBRLHGKZE3EUQVS2I6DXS6GYN6PB654Q, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163171368 (205h54m34.625263851s) [noise=true , address=185.167.204.205:4032 , piece_id=DGWOQKZCLYMSHG6JH5AT5QVL6KFESN5YUWSHIKJV2AYBW7H26BYQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163282509 (205h54m34.625374992s) [noise=true , address=185.167.204.205:4007 , piece_id=NEHAUNCJOZHAD46YI6AQCMQMV6JPTKWLF7G4H546LHALMZCL4ITQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163618950 (205h54m34.625711433s) [noise=true , address=185.167.204.206:4064 , piece_id=T737VKQXQZGTMHLKXN2S6WVHZ45VDMXWJQ3REYCLNDDXHQR2LJRA, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163969478 (205h54m34.626061951s) [noise=true , address=89.149.201.147:4002 , piece_id=RU4LRMQ6OSEP3BFACDQOHR4R6K4Q67OJ5LVUQFHED2B22PIJOYSQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.164309926 (205h54m34.626402399s) [noise=true , address=185.167.204.205:4009 , piece_id=2K3AA2UN7CDH5NVFKL4V5QP3G5BVDOBQ6WRN3MTXTT4NP3F3QOMQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.164696282 (205h54m34.626788765s) [noise=true , address=89.149.201.147:4023 , piece_id=HX3G4EGXC4OJA3EF2AQL35ERQIUPODOX47JFMLPUPCHZ2FQQT4QQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.165052590 (205h54m34.627145073s) [noise=true , address=89.149.201.147:4003 , piece_id=L4W3GWFS3AIVGHBYOLU6FR6IKNP3BOLLWV7ZVCVAWPN53EXU5GMQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.165421743 (205h54m34.627514226s) [noise=true , address=81.171.14.70:4030 , piece_id=XSNZDXHQD33YDT7VOETLAZE36RSMLN4S6LZQZR43FSFJ66VTKOEA, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.165746141 (205h54m34.627838624s) [noise=true , address=89.149.201.147:4008 , piece_id=WKPOJRTROWSMT2BPSSCPBSILIC3VAIBQDWFRSW6NMUQSN5BRE2PQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.167492466 (205h54m34.629584949s) [noise=true , address=81.171.14.70:4041 , piece_id=RTMFTIDLELSIKF6DX2MAEUM6NEARJOEFIEJ6KJYVCVGJLRKDVYNQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.994174141 (205h54m35.456266624s) [upload=181068]: Next returned nil segment
Oct 2 03:25:49.994197545 (205h54m35.456290028s) [upload=181068]: Waiting for error group managing segments...
Oct 2 03:25:50.378559942 (205h54m35.840652425s) [noise=true , address=81.171.14.70:4043 , piece_id=LJS6SD7LZGMNPZDAWRLBU4WWW3NYOVDHHPH4TGHZ62LZIRDDEANA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.383560535 (205h54m35.845653018s) [noise=true , address=81.171.14.70:4041 , piece_id=RTMFTIDLELSIKF6DX2MAEUM6NEARJOEFIEJ6KJYVCVGJLRKDVYNQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.388516662 (205h54m35.850609135s) [noise=true , address=81.171.14.70:4040 , piece_id=QXFFFGXCPRMBKPNQ2ABGJC26U6DYIJTAARBVCVLQFLIP54G4VFLA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.389043765 (205h54m35.851136238s) [noise=true , address=81.171.14.70:4032 , piece_id=IZTDRSZ74T75J3Y7MCNORWFXLFOXG35R52Y4VSNS2QZ3R3WBFJZQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.392483886 (205h54m35.854576369s) [noise=true , address=81.171.14.70:4027 , piece_id=TDKB4CVXHXQZNNMIJLV3YYVOZMV5CKSY37L4OWB3ZXIJDNJ2JDCQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.396373262 (205h54m35.858465745s) [noise=true , address=81.171.14.70:4042 , piece_id=3ZWKCWIMPFM2CXG3HJWDOMTEMKOSZ5TOONPGOCFC3GZKZ5QHFTBQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.431305560 (205h54m35.893398043s) [noise=true , address=89.149.201.147:4016 , piece_id=LX6HKBDREXIW7XNIWV33JEGPXFMUZOCW35IQULA4PUNJDWO42BQQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.442031504 (205h54m35.904123977s) [noise=true , address=81.171.14.70:4028 , piece_id=QZY7KXVFNXMVEVOBCFTABPK3E2HCVSVYRM4UVB7VJTFZOTNF27TA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.450391563 (205h54m35.912484046s) [noise=true , address=89.149.201.147:4017 , piece_id=EA7JQR35PARZLVG5CMCXITB6MLU55M6WWVQSZEGM6YJQZ2X2WUZA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.454381601 (205h54m35.916474074s) [noise=true , address=81.171.14.70:4029 , piece_id=SBO52O3XSTUPJBBHIP2JZBRLHGKZE3EUQVS2I6DXS6GYN6PB654Q, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.463104390 (205h54m35.925196873s) [noise=true , address=89.149.201.147:4003 , piece_id=L4W3GWFS3AIVGHBYOLU6FR6IKNP3BOLLWV7ZVCVAWPN53EXU5GMQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.471309365 (205h54m35.933401848s) [noise=true , address=81.171.14.70:4036 , piece_id=CFSIP7I4XJEYGBMBQD2UTJXPSNR44OGB7DWOWOWYFSWY6DAFPL3Q, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.486337891 (205h54m35.948430364s) [noise=true , address=89.149.201.147:4008 , piece_id=WKPOJRTROWSMT2BPSSCPBSILIC3VAIBQDWFRSW6NMUQSN5BRE2PQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.489526543 (205h54m35.951619026s) [noise=true , address=89.149.201.147:4006 , piece_id=VIEICP3IHAH2ALC7NSV2T6B7ZSSLIG4NHRTKLXNAR3VBRWR54OKQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.511383803 (205h54m35.973476286s) [noise=true , address=89.149.201.147:4007 , piece_id=GUALOJ23T6IETBGD6VGBH5USVZADA3HNRNJPONABQ7I7WVAZ3PUA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.533024491 (205h54m35.995116974s) [noise=true , address=89.149.201.147:4023 , piece_id=HX3G4EGXC4OJA3EF2AQL35ERQIUPODOX47JFMLPUPCHZ2FQQT4QQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.910819552 (205h54m36.372912025s) [noise=true , address=81.171.14.70:4030 , piece_id=XSNZDXHQD33YDT7VOETLAZE36RSMLN4S6LZQZR43FSFJ66VTKOEA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.990741449 (205h54m36.452833932s) [noise=true , address=89.149.201.147:4002 , piece_id=RU4LRMQ6OSEP3BFACDQOHR4R6K4Q67OJ5LVUQFHED2B22PIJOYSQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.064808246 (205h54m36.526900719s) [noise=true , address=185.167.204.206:4064 , piece_id=T737VKQXQZGTMHLKXN2S6WVHZ45VDMXWJQ3REYCLNDDXHQR2LJRA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.069475683 (205h54m36.531568166s) [noise=true , address=185.167.204.206:4060 , piece_id=TVGTJBCTMRXB2VB3PSLZ3NPWDAEZTCWYULAVFG4CAJX64KVR4MEA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.083150653 (205h54m36.545243136s) [noise=true , address=185.167.204.206:4039 , piece_id=YOD34HQMIBPSLP2IZ4U77CMQSOSAK5FTZSMVRSSEHG7DMVICR7HQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.100274620 (205h54m36.562367103s) [noise=true , address=185.167.204.205:4011 , piece_id=LAKZUADU7PCZBAIGSP72D7WGUZV46R5H5H76SNIQZU2I7DEBOZKA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.107345404 (205h54m36.569437887s) [noise=true , address=185.167.204.205:4006 , piece_id=LY4HTSEATOZWQJTBML5EVSBDICVKWS24MWWJAE7TRQ54ZTHW2IIA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.113594664 (205h54m36.575687147s) [noise=true , address=185.167.204.205:4007 , piece_id=NEHAUNCJOZHAD46YI6AQCMQMV6JPTKWLF7G4H546LHALMZCL4ITQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.117627584 (205h54m36.579720077s) [noise=true , address=185.167.204.205:4009 , piece_id=2K3AA2UN7CDH5NVFKL4V5QP3G5BVDOBQ6WRN3MTXTT4NP3F3QOMQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.137300514 (205h54m36.599392997s) [noise=true , address=185.167.204.205:4015 , piece_id=KXTFVE3Y7KRLF6XCLEENWN74J5PDDRMLBYLC2POUZFQFIXUBNHEQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.137330772 (205h54m36.599423245s) [seg_pos={0 0}, upload=181068]: Segment reached optimal threshold of 26 pieces.
Oct 2 03:25:51.137463375 (205h54m36.599555858s) [noise=true , address=185.167.204.206:4056 , piece_id=G6OE3IONUXYCMNMS53YTXQ2QH2AMF6NVVKPCA4QS3YTD7RLXQMCA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.137485887 (205h54m36.59957837s) [noise=true , address=185.167.204.205:4032 , piece_id=DGWOQKZCLYMSHG6JH5AT5QVL6KFESN5YUWSHIKJV2AYBW7H26BYQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN): protocol: expected piece hash; context canceled; EOF
Oct 2 03:25:51.137500836 (205h54m36.599593339s) [noise=true , address=185.167.204.205:4032 , piece_id=DGWOQKZCLYMSHG6JH5AT5QVL6KFESN5YUWSHIKJV2AYBW7H26BYQ, seg_pos={0 0}, upload=181068]: Long tail cancellation due to optimal threshold
Oct 2 03:25:51.137526445 (205h54m36.599618928s) [seg_pos={0 0}, upload=181068]: Done waiting for segment. successful: 27 optimal: 26 errs: <nil>
Oct 2 03:25:51.137622727 (205h54m36.59971521s) [upload=181068]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 2 03:25:51.137627978 (205h54m36.599720451s) [upload=181068]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 2 03:27:37.980270426 (205h56m23.442362909s) [upload=181068]: Done uploading segments...
Oct 2 03:27:37.980291567 (205h56m23.44238404s) [upload=181068]: Upload finished. err: metaclient: context deadline exceeded
Duration: 4.850555494s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
6.336991232s
FAIL (2025-10-02 03:32:13 UTC)
orbiter warning: context deadline exceeded
Duration: 6.337025627s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
6.37111887s
FAIL (2025-10-02 03:31:50 UTC)
orbiter warning: context deadline exceeded
Duration: 6.371144978s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
4.868653396s
FAIL (2025-10-02 03:31:15 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
3:25:49.162665554 (205h54m34.624758027s) [noise=true , address=81.171.14.70:4043 , piece_id=LJS6SD7LZGMNPZDAWRLBU4WWW3NYOVDHHPH4TGHZ62LZIRDDEANA, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.162930569 (205h54m34.625023052s) [noise=true , address=81.171.14.70:4029 , piece_id=SBO52O3XSTUPJBBHIP2JZBRLHGKZE3EUQVS2I6DXS6GYN6PB654Q, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163171368 (205h54m34.625263851s) [noise=true , address=185.167.204.205:4032 , piece_id=DGWOQKZCLYMSHG6JH5AT5QVL6KFESN5YUWSHIKJV2AYBW7H26BYQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163282509 (205h54m34.625374992s) [noise=true , address=185.167.204.205:4007 , piece_id=NEHAUNCJOZHAD46YI6AQCMQMV6JPTKWLF7G4H546LHALMZCL4ITQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163618950 (205h54m34.625711433s) [noise=true , address=185.167.204.206:4064 , piece_id=T737VKQXQZGTMHLKXN2S6WVHZ45VDMXWJQ3REYCLNDDXHQR2LJRA, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163969478 (205h54m34.626061951s) [noise=true , address=89.149.201.147:4002 , piece_id=RU4LRMQ6OSEP3BFACDQOHR4R6K4Q67OJ5LVUQFHED2B22PIJOYSQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.164309926 (205h54m34.626402399s) [noise=true , address=185.167.204.205:4009 , piece_id=2K3AA2UN7CDH5NVFKL4V5QP3G5BVDOBQ6WRN3MTXTT4NP3F3QOMQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.164696282 (205h54m34.626788765s) [noise=true , address=89.149.201.147:4023 , piece_id=HX3G4EGXC4OJA3EF2AQL35ERQIUPODOX47JFMLPUPCHZ2FQQT4QQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.165052590 (205h54m34.627145073s) [noise=true , address=89.149.201.147:4003 , piece_id=L4W3GWFS3AIVGHBYOLU6FR6IKNP3BOLLWV7ZVCVAWPN53EXU5GMQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.165421743 (205h54m34.627514226s) [noise=true , address=81.171.14.70:4030 , piece_id=XSNZDXHQD33YDT7VOETLAZE36RSMLN4S6LZQZR43FSFJ66VTKOEA, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.165746141 (205h54m34.627838624s) [noise=true , address=89.149.201.147:4008 , piece_id=WKPOJRTROWSMT2BPSSCPBSILIC3VAIBQDWFRSW6NMUQSN5BRE2PQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.167492466 (205h54m34.629584949s) [noise=true , address=81.171.14.70:4041 , piece_id=RTMFTIDLELSIKF6DX2MAEUM6NEARJOEFIEJ6KJYVCVGJLRKDVYNQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.994174141 (205h54m35.456266624s) [upload=181068]: Next returned nil segment
Oct 2 03:25:49.994197545 (205h54m35.456290028s) [upload=181068]: Waiting for error group managing segments...
Oct 2 03:25:50.378559942 (205h54m35.840652425s) [noise=true , address=81.171.14.70:4043 , piece_id=LJS6SD7LZGMNPZDAWRLBU4WWW3NYOVDHHPH4TGHZ62LZIRDDEANA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.383560535 (205h54m35.845653018s) [noise=true , address=81.171.14.70:4041 , piece_id=RTMFTIDLELSIKF6DX2MAEUM6NEARJOEFIEJ6KJYVCVGJLRKDVYNQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.388516662 (205h54m35.850609135s) [noise=true , address=81.171.14.70:4040 , piece_id=QXFFFGXCPRMBKPNQ2ABGJC26U6DYIJTAARBVCVLQFLIP54G4VFLA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.389043765 (205h54m35.851136238s) [noise=true , address=81.171.14.70:4032 , piece_id=IZTDRSZ74T75J3Y7MCNORWFXLFOXG35R52Y4VSNS2QZ3R3WBFJZQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.392483886 (205h54m35.854576369s) [noise=true , address=81.171.14.70:4027 , piece_id=TDKB4CVXHXQZNNMIJLV3YYVOZMV5CKSY37L4OWB3ZXIJDNJ2JDCQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.396373262 (205h54m35.858465745s) [noise=true , address=81.171.14.70:4042 , piece_id=3ZWKCWIMPFM2CXG3HJWDOMTEMKOSZ5TOONPGOCFC3GZKZ5QHFTBQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.431305560 (205h54m35.893398043s) [noise=true , address=89.149.201.147:4016 , piece_id=LX6HKBDREXIW7XNIWV33JEGPXFMUZOCW35IQULA4PUNJDWO42BQQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.442031504 (205h54m35.904123977s) [noise=true , address=81.171.14.70:4028 , piece_id=QZY7KXVFNXMVEVOBCFTABPK3E2HCVSVYRM4UVB7VJTFZOTNF27TA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.450391563 (205h54m35.912484046s) [noise=true , address=89.149.201.147:4017 , piece_id=EA7JQR35PARZLVG5CMCXITB6MLU55M6WWVQSZEGM6YJQZ2X2WUZA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.454381601 (205h54m35.916474074s) [noise=true , address=81.171.14.70:4029 , piece_id=SBO52O3XSTUPJBBHIP2JZBRLHGKZE3EUQVS2I6DXS6GYN6PB654Q, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.463104390 (205h54m35.925196873s) [noise=true , address=89.149.201.147:4003 , piece_id=L4W3GWFS3AIVGHBYOLU6FR6IKNP3BOLLWV7ZVCVAWPN53EXU5GMQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.471309365 (205h54m35.933401848s) [noise=true , address=81.171.14.70:4036 , piece_id=CFSIP7I4XJEYGBMBQD2UTJXPSNR44OGB7DWOWOWYFSWY6DAFPL3Q, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.486337891 (205h54m35.948430364s) [noise=true , address=89.149.201.147:4008 , piece_id=WKPOJRTROWSMT2BPSSCPBSILIC3VAIBQDWFRSW6NMUQSN5BRE2PQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.489526543 (205h54m35.951619026s) [noise=true , address=89.149.201.147:4006 , piece_id=VIEICP3IHAH2ALC7NSV2T6B7ZSSLIG4NHRTKLXNAR3VBRWR54OKQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.511383803 (205h54m35.973476286s) [noise=true , address=89.149.201.147:4007 , piece_id=GUALOJ23T6IETBGD6VGBH5USVZADA3HNRNJPONABQ7I7WVAZ3PUA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.533024491 (205h54m35.995116974s) [noise=true , address=89.149.201.147:4023 , piece_id=HX3G4EGXC4OJA3EF2AQL35ERQIUPODOX47JFMLPUPCHZ2FQQT4QQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.910819552 (205h54m36.372912025s) [noise=true , address=81.171.14.70:4030 , piece_id=XSNZDXHQD33YDT7VOETLAZE36RSMLN4S6LZQZR43FSFJ66VTKOEA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.990741449 (205h54m36.452833932s) [noise=true , address=89.149.201.147:4002 , piece_id=RU4LRMQ6OSEP3BFACDQOHR4R6K4Q67OJ5LVUQFHED2B22PIJOYSQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.064808246 (205h54m36.526900719s) [noise=true , address=185.167.204.206:4064 , piece_id=T737VKQXQZGTMHLKXN2S6WVHZ45VDMXWJQ3REYCLNDDXHQR2LJRA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.069475683 (205h54m36.531568166s) [noise=true , address=185.167.204.206:4060 , piece_id=TVGTJBCTMRXB2VB3PSLZ3NPWDAEZTCWYULAVFG4CAJX64KVR4MEA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.083150653 (205h54m36.545243136s) [noise=true , address=185.167.204.206:4039 , piece_id=YOD34HQMIBPSLP2IZ4U77CMQSOSAK5FTZSMVRSSEHG7DMVICR7HQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.100274620 (205h54m36.562367103s) [noise=true , address=185.167.204.205:4011 , piece_id=LAKZUADU7PCZBAIGSP72D7WGUZV46R5H5H76SNIQZU2I7DEBOZKA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.107345404 (205h54m36.569437887s) [noise=true , address=185.167.204.205:4006 , piece_id=LY4HTSEATOZWQJTBML5EVSBDICVKWS24MWWJAE7TRQ54ZTHW2IIA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.113594664 (205h54m36.575687147s) [noise=true , address=185.167.204.205:4007 , piece_id=NEHAUNCJOZHAD46YI6AQCMQMV6JPTKWLF7G4H546LHALMZCL4ITQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.117627584 (205h54m36.579720077s) [noise=true , address=185.167.204.205:4009 , piece_id=2K3AA2UN7CDH5NVFKL4V5QP3G5BVDOBQ6WRN3MTXTT4NP3F3QOMQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.137300514 (205h54m36.599392997s) [noise=true , address=185.167.204.205:4015 , piece_id=KXTFVE3Y7KRLF6XCLEENWN74J5PDDRMLBYLC2POUZFQFIXUBNHEQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.137330772 (205h54m36.599423245s) [seg_pos={0 0}, upload=181068]: Segment reached optimal threshold of 26 pieces.
Oct 2 03:25:51.137463375 (205h54m36.599555858s) [noise=true , address=185.167.204.206:4056 , piece_id=G6OE3IONUXYCMNMS53YTXQ2QH2AMF6NVVKPCA4QS3YTD7RLXQMCA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.137485887 (205h54m36.59957837s) [noise=true , address=185.167.204.205:4032 , piece_id=DGWOQKZCLYMSHG6JH5AT5QVL6KFESN5YUWSHIKJV2AYBW7H26BYQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN): protocol: expected piece hash; context canceled; EOF
Oct 2 03:25:51.137500836 (205h54m36.599593339s) [noise=true , address=185.167.204.205:4032 , piece_id=DGWOQKZCLYMSHG6JH5AT5QVL6KFESN5YUWSHIKJV2AYBW7H26BYQ, seg_pos={0 0}, upload=181068]: Long tail cancellation due to optimal threshold
Oct 2 03:25:51.137526445 (205h54m36.599618928s) [seg_pos={0 0}, upload=181068]: Done waiting for segment. successful: 27 optimal: 26 errs: <nil>
Oct 2 03:25:51.137622727 (205h54m36.59971521s) [upload=181068]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 2 03:25:51.137627978 (205h54m36.599720451s) [upload=181068]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 2 03:27:37.980270426 (205h56m23.442362909s) [upload=181068]: Done uploading segments...
Oct 2 03:27:37.980291567 (205h56m23.44238404s) [upload=181068]: Upload finished. err: metaclient: context deadline exceeded
Duration: 4.868689275s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
6.071187132s
FAIL (2025-10-02 03:30:39 UTC)
orbiter warning: context deadline exceeded
Duration: 6.071290089s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
4.921833542s
FAIL (2025-10-02 03:30:12 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
3:25:49.162665554 (205h54m34.624758027s) [noise=true , address=81.171.14.70:4043 , piece_id=LJS6SD7LZGMNPZDAWRLBU4WWW3NYOVDHHPH4TGHZ62LZIRDDEANA, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.162930569 (205h54m34.625023052s) [noise=true , address=81.171.14.70:4029 , piece_id=SBO52O3XSTUPJBBHIP2JZBRLHGKZE3EUQVS2I6DXS6GYN6PB654Q, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163171368 (205h54m34.625263851s) [noise=true , address=185.167.204.205:4032 , piece_id=DGWOQKZCLYMSHG6JH5AT5QVL6KFESN5YUWSHIKJV2AYBW7H26BYQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163282509 (205h54m34.625374992s) [noise=true , address=185.167.204.205:4007 , piece_id=NEHAUNCJOZHAD46YI6AQCMQMV6JPTKWLF7G4H546LHALMZCL4ITQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163618950 (205h54m34.625711433s) [noise=true , address=185.167.204.206:4064 , piece_id=T737VKQXQZGTMHLKXN2S6WVHZ45VDMXWJQ3REYCLNDDXHQR2LJRA, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163969478 (205h54m34.626061951s) [noise=true , address=89.149.201.147:4002 , piece_id=RU4LRMQ6OSEP3BFACDQOHR4R6K4Q67OJ5LVUQFHED2B22PIJOYSQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.164309926 (205h54m34.626402399s) [noise=true , address=185.167.204.205:4009 , piece_id=2K3AA2UN7CDH5NVFKL4V5QP3G5BVDOBQ6WRN3MTXTT4NP3F3QOMQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.164696282 (205h54m34.626788765s) [noise=true , address=89.149.201.147:4023 , piece_id=HX3G4EGXC4OJA3EF2AQL35ERQIUPODOX47JFMLPUPCHZ2FQQT4QQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.165052590 (205h54m34.627145073s) [noise=true , address=89.149.201.147:4003 , piece_id=L4W3GWFS3AIVGHBYOLU6FR6IKNP3BOLLWV7ZVCVAWPN53EXU5GMQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.165421743 (205h54m34.627514226s) [noise=true , address=81.171.14.70:4030 , piece_id=XSNZDXHQD33YDT7VOETLAZE36RSMLN4S6LZQZR43FSFJ66VTKOEA, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.165746141 (205h54m34.627838624s) [noise=true , address=89.149.201.147:4008 , piece_id=WKPOJRTROWSMT2BPSSCPBSILIC3VAIBQDWFRSW6NMUQSN5BRE2PQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.167492466 (205h54m34.629584949s) [noise=true , address=81.171.14.70:4041 , piece_id=RTMFTIDLELSIKF6DX2MAEUM6NEARJOEFIEJ6KJYVCVGJLRKDVYNQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.994174141 (205h54m35.456266624s) [upload=181068]: Next returned nil segment
Oct 2 03:25:49.994197545 (205h54m35.456290028s) [upload=181068]: Waiting for error group managing segments...
Oct 2 03:25:50.378559942 (205h54m35.840652425s) [noise=true , address=81.171.14.70:4043 , piece_id=LJS6SD7LZGMNPZDAWRLBU4WWW3NYOVDHHPH4TGHZ62LZIRDDEANA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.383560535 (205h54m35.845653018s) [noise=true , address=81.171.14.70:4041 , piece_id=RTMFTIDLELSIKF6DX2MAEUM6NEARJOEFIEJ6KJYVCVGJLRKDVYNQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.388516662 (205h54m35.850609135s) [noise=true , address=81.171.14.70:4040 , piece_id=QXFFFGXCPRMBKPNQ2ABGJC26U6DYIJTAARBVCVLQFLIP54G4VFLA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.389043765 (205h54m35.851136238s) [noise=true , address=81.171.14.70:4032 , piece_id=IZTDRSZ74T75J3Y7MCNORWFXLFOXG35R52Y4VSNS2QZ3R3WBFJZQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.392483886 (205h54m35.854576369s) [noise=true , address=81.171.14.70:4027 , piece_id=TDKB4CVXHXQZNNMIJLV3YYVOZMV5CKSY37L4OWB3ZXIJDNJ2JDCQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.396373262 (205h54m35.858465745s) [noise=true , address=81.171.14.70:4042 , piece_id=3ZWKCWIMPFM2CXG3HJWDOMTEMKOSZ5TOONPGOCFC3GZKZ5QHFTBQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.431305560 (205h54m35.893398043s) [noise=true , address=89.149.201.147:4016 , piece_id=LX6HKBDREXIW7XNIWV33JEGPXFMUZOCW35IQULA4PUNJDWO42BQQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.442031504 (205h54m35.904123977s) [noise=true , address=81.171.14.70:4028 , piece_id=QZY7KXVFNXMVEVOBCFTABPK3E2HCVSVYRM4UVB7VJTFZOTNF27TA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.450391563 (205h54m35.912484046s) [noise=true , address=89.149.201.147:4017 , piece_id=EA7JQR35PARZLVG5CMCXITB6MLU55M6WWVQSZEGM6YJQZ2X2WUZA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.454381601 (205h54m35.916474074s) [noise=true , address=81.171.14.70:4029 , piece_id=SBO52O3XSTUPJBBHIP2JZBRLHGKZE3EUQVS2I6DXS6GYN6PB654Q, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.463104390 (205h54m35.925196873s) [noise=true , address=89.149.201.147:4003 , piece_id=L4W3GWFS3AIVGHBYOLU6FR6IKNP3BOLLWV7ZVCVAWPN53EXU5GMQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.471309365 (205h54m35.933401848s) [noise=true , address=81.171.14.70:4036 , piece_id=CFSIP7I4XJEYGBMBQD2UTJXPSNR44OGB7DWOWOWYFSWY6DAFPL3Q, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.486337891 (205h54m35.948430364s) [noise=true , address=89.149.201.147:4008 , piece_id=WKPOJRTROWSMT2BPSSCPBSILIC3VAIBQDWFRSW6NMUQSN5BRE2PQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.489526543 (205h54m35.951619026s) [noise=true , address=89.149.201.147:4006 , piece_id=VIEICP3IHAH2ALC7NSV2T6B7ZSSLIG4NHRTKLXNAR3VBRWR54OKQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.511383803 (205h54m35.973476286s) [noise=true , address=89.149.201.147:4007 , piece_id=GUALOJ23T6IETBGD6VGBH5USVZADA3HNRNJPONABQ7I7WVAZ3PUA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.533024491 (205h54m35.995116974s) [noise=true , address=89.149.201.147:4023 , piece_id=HX3G4EGXC4OJA3EF2AQL35ERQIUPODOX47JFMLPUPCHZ2FQQT4QQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.910819552 (205h54m36.372912025s) [noise=true , address=81.171.14.70:4030 , piece_id=XSNZDXHQD33YDT7VOETLAZE36RSMLN4S6LZQZR43FSFJ66VTKOEA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.990741449 (205h54m36.452833932s) [noise=true , address=89.149.201.147:4002 , piece_id=RU4LRMQ6OSEP3BFACDQOHR4R6K4Q67OJ5LVUQFHED2B22PIJOYSQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.064808246 (205h54m36.526900719s) [noise=true , address=185.167.204.206:4064 , piece_id=T737VKQXQZGTMHLKXN2S6WVHZ45VDMXWJQ3REYCLNDDXHQR2LJRA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.069475683 (205h54m36.531568166s) [noise=true , address=185.167.204.206:4060 , piece_id=TVGTJBCTMRXB2VB3PSLZ3NPWDAEZTCWYULAVFG4CAJX64KVR4MEA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.083150653 (205h54m36.545243136s) [noise=true , address=185.167.204.206:4039 , piece_id=YOD34HQMIBPSLP2IZ4U77CMQSOSAK5FTZSMVRSSEHG7DMVICR7HQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.100274620 (205h54m36.562367103s) [noise=true , address=185.167.204.205:4011 , piece_id=LAKZUADU7PCZBAIGSP72D7WGUZV46R5H5H76SNIQZU2I7DEBOZKA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.107345404 (205h54m36.569437887s) [noise=true , address=185.167.204.205:4006 , piece_id=LY4HTSEATOZWQJTBML5EVSBDICVKWS24MWWJAE7TRQ54ZTHW2IIA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.113594664 (205h54m36.575687147s) [noise=true , address=185.167.204.205:4007 , piece_id=NEHAUNCJOZHAD46YI6AQCMQMV6JPTKWLF7G4H546LHALMZCL4ITQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.117627584 (205h54m36.579720077s) [noise=true , address=185.167.204.205:4009 , piece_id=2K3AA2UN7CDH5NVFKL4V5QP3G5BVDOBQ6WRN3MTXTT4NP3F3QOMQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.137300514 (205h54m36.599392997s) [noise=true , address=185.167.204.205:4015 , piece_id=KXTFVE3Y7KRLF6XCLEENWN74J5PDDRMLBYLC2POUZFQFIXUBNHEQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.137330772 (205h54m36.599423245s) [seg_pos={0 0}, upload=181068]: Segment reached optimal threshold of 26 pieces.
Oct 2 03:25:51.137463375 (205h54m36.599555858s) [noise=true , address=185.167.204.206:4056 , piece_id=G6OE3IONUXYCMNMS53YTXQ2QH2AMF6NVVKPCA4QS3YTD7RLXQMCA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.137485887 (205h54m36.59957837s) [noise=true , address=185.167.204.205:4032 , piece_id=DGWOQKZCLYMSHG6JH5AT5QVL6KFESN5YUWSHIKJV2AYBW7H26BYQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN): protocol: expected piece hash; context canceled; EOF
Oct 2 03:25:51.137500836 (205h54m36.599593339s) [noise=true , address=185.167.204.205:4032 , piece_id=DGWOQKZCLYMSHG6JH5AT5QVL6KFESN5YUWSHIKJV2AYBW7H26BYQ, seg_pos={0 0}, upload=181068]: Long tail cancellation due to optimal threshold
Oct 2 03:25:51.137526445 (205h54m36.599618928s) [seg_pos={0 0}, upload=181068]: Done waiting for segment. successful: 27 optimal: 26 errs: <nil>
Oct 2 03:25:51.137622727 (205h54m36.59971521s) [upload=181068]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 2 03:25:51.137627978 (205h54m36.599720451s) [upload=181068]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 2 03:27:37.980270426 (205h56m23.442362909s) [upload=181068]: Done uploading segments...
Oct 2 03:27:37.980291567 (205h56m23.44238404s) [upload=181068]: Upload finished. err: metaclient: context deadline exceeded
Duration: 4.921868148s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
6.862142238s
FAIL (2025-10-02 03:30:08 UTC)
orbiter warning: context deadline exceeded
Duration: 6.86216403s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
6.058332736s
FAIL (2025-10-02 03:29:48 UTC)
orbiter warning: context deadline exceeded
Duration: 6.058359015s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
4.840648289s
FAIL (2025-10-02 03:29:24 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
3:25:49.162665554 (205h54m34.624758027s) [noise=true , address=81.171.14.70:4043 , piece_id=LJS6SD7LZGMNPZDAWRLBU4WWW3NYOVDHHPH4TGHZ62LZIRDDEANA, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.162930569 (205h54m34.625023052s) [noise=true , address=81.171.14.70:4029 , piece_id=SBO52O3XSTUPJBBHIP2JZBRLHGKZE3EUQVS2I6DXS6GYN6PB654Q, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163171368 (205h54m34.625263851s) [noise=true , address=185.167.204.205:4032 , piece_id=DGWOQKZCLYMSHG6JH5AT5QVL6KFESN5YUWSHIKJV2AYBW7H26BYQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163282509 (205h54m34.625374992s) [noise=true , address=185.167.204.205:4007 , piece_id=NEHAUNCJOZHAD46YI6AQCMQMV6JPTKWLF7G4H546LHALMZCL4ITQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163618950 (205h54m34.625711433s) [noise=true , address=185.167.204.206:4064 , piece_id=T737VKQXQZGTMHLKXN2S6WVHZ45VDMXWJQ3REYCLNDDXHQR2LJRA, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163969478 (205h54m34.626061951s) [noise=true , address=89.149.201.147:4002 , piece_id=RU4LRMQ6OSEP3BFACDQOHR4R6K4Q67OJ5LVUQFHED2B22PIJOYSQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.164309926 (205h54m34.626402399s) [noise=true , address=185.167.204.205:4009 , piece_id=2K3AA2UN7CDH5NVFKL4V5QP3G5BVDOBQ6WRN3MTXTT4NP3F3QOMQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.164696282 (205h54m34.626788765s) [noise=true , address=89.149.201.147:4023 , piece_id=HX3G4EGXC4OJA3EF2AQL35ERQIUPODOX47JFMLPUPCHZ2FQQT4QQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.165052590 (205h54m34.627145073s) [noise=true , address=89.149.201.147:4003 , piece_id=L4W3GWFS3AIVGHBYOLU6FR6IKNP3BOLLWV7ZVCVAWPN53EXU5GMQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.165421743 (205h54m34.627514226s) [noise=true , address=81.171.14.70:4030 , piece_id=XSNZDXHQD33YDT7VOETLAZE36RSMLN4S6LZQZR43FSFJ66VTKOEA, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.165746141 (205h54m34.627838624s) [noise=true , address=89.149.201.147:4008 , piece_id=WKPOJRTROWSMT2BPSSCPBSILIC3VAIBQDWFRSW6NMUQSN5BRE2PQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.167492466 (205h54m34.629584949s) [noise=true , address=81.171.14.70:4041 , piece_id=RTMFTIDLELSIKF6DX2MAEUM6NEARJOEFIEJ6KJYVCVGJLRKDVYNQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.994174141 (205h54m35.456266624s) [upload=181068]: Next returned nil segment
Oct 2 03:25:49.994197545 (205h54m35.456290028s) [upload=181068]: Waiting for error group managing segments...
Oct 2 03:25:50.378559942 (205h54m35.840652425s) [noise=true , address=81.171.14.70:4043 , piece_id=LJS6SD7LZGMNPZDAWRLBU4WWW3NYOVDHHPH4TGHZ62LZIRDDEANA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.383560535 (205h54m35.845653018s) [noise=true , address=81.171.14.70:4041 , piece_id=RTMFTIDLELSIKF6DX2MAEUM6NEARJOEFIEJ6KJYVCVGJLRKDVYNQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.388516662 (205h54m35.850609135s) [noise=true , address=81.171.14.70:4040 , piece_id=QXFFFGXCPRMBKPNQ2ABGJC26U6DYIJTAARBVCVLQFLIP54G4VFLA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.389043765 (205h54m35.851136238s) [noise=true , address=81.171.14.70:4032 , piece_id=IZTDRSZ74T75J3Y7MCNORWFXLFOXG35R52Y4VSNS2QZ3R3WBFJZQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.392483886 (205h54m35.854576369s) [noise=true , address=81.171.14.70:4027 , piece_id=TDKB4CVXHXQZNNMIJLV3YYVOZMV5CKSY37L4OWB3ZXIJDNJ2JDCQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.396373262 (205h54m35.858465745s) [noise=true , address=81.171.14.70:4042 , piece_id=3ZWKCWIMPFM2CXG3HJWDOMTEMKOSZ5TOONPGOCFC3GZKZ5QHFTBQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.431305560 (205h54m35.893398043s) [noise=true , address=89.149.201.147:4016 , piece_id=LX6HKBDREXIW7XNIWV33JEGPXFMUZOCW35IQULA4PUNJDWO42BQQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.442031504 (205h54m35.904123977s) [noise=true , address=81.171.14.70:4028 , piece_id=QZY7KXVFNXMVEVOBCFTABPK3E2HCVSVYRM4UVB7VJTFZOTNF27TA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.450391563 (205h54m35.912484046s) [noise=true , address=89.149.201.147:4017 , piece_id=EA7JQR35PARZLVG5CMCXITB6MLU55M6WWVQSZEGM6YJQZ2X2WUZA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.454381601 (205h54m35.916474074s) [noise=true , address=81.171.14.70:4029 , piece_id=SBO52O3XSTUPJBBHIP2JZBRLHGKZE3EUQVS2I6DXS6GYN6PB654Q, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.463104390 (205h54m35.925196873s) [noise=true , address=89.149.201.147:4003 , piece_id=L4W3GWFS3AIVGHBYOLU6FR6IKNP3BOLLWV7ZVCVAWPN53EXU5GMQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.471309365 (205h54m35.933401848s) [noise=true , address=81.171.14.70:4036 , piece_id=CFSIP7I4XJEYGBMBQD2UTJXPSNR44OGB7DWOWOWYFSWY6DAFPL3Q, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.486337891 (205h54m35.948430364s) [noise=true , address=89.149.201.147:4008 , piece_id=WKPOJRTROWSMT2BPSSCPBSILIC3VAIBQDWFRSW6NMUQSN5BRE2PQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.489526543 (205h54m35.951619026s) [noise=true , address=89.149.201.147:4006 , piece_id=VIEICP3IHAH2ALC7NSV2T6B7ZSSLIG4NHRTKLXNAR3VBRWR54OKQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.511383803 (205h54m35.973476286s) [noise=true , address=89.149.201.147:4007 , piece_id=GUALOJ23T6IETBGD6VGBH5USVZADA3HNRNJPONABQ7I7WVAZ3PUA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.533024491 (205h54m35.995116974s) [noise=true , address=89.149.201.147:4023 , piece_id=HX3G4EGXC4OJA3EF2AQL35ERQIUPODOX47JFMLPUPCHZ2FQQT4QQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.910819552 (205h54m36.372912025s) [noise=true , address=81.171.14.70:4030 , piece_id=XSNZDXHQD33YDT7VOETLAZE36RSMLN4S6LZQZR43FSFJ66VTKOEA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.990741449 (205h54m36.452833932s) [noise=true , address=89.149.201.147:4002 , piece_id=RU4LRMQ6OSEP3BFACDQOHR4R6K4Q67OJ5LVUQFHED2B22PIJOYSQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.064808246 (205h54m36.526900719s) [noise=true , address=185.167.204.206:4064 , piece_id=T737VKQXQZGTMHLKXN2S6WVHZ45VDMXWJQ3REYCLNDDXHQR2LJRA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.069475683 (205h54m36.531568166s) [noise=true , address=185.167.204.206:4060 , piece_id=TVGTJBCTMRXB2VB3PSLZ3NPWDAEZTCWYULAVFG4CAJX64KVR4MEA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.083150653 (205h54m36.545243136s) [noise=true , address=185.167.204.206:4039 , piece_id=YOD34HQMIBPSLP2IZ4U77CMQSOSAK5FTZSMVRSSEHG7DMVICR7HQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.100274620 (205h54m36.562367103s) [noise=true , address=185.167.204.205:4011 , piece_id=LAKZUADU7PCZBAIGSP72D7WGUZV46R5H5H76SNIQZU2I7DEBOZKA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.107345404 (205h54m36.569437887s) [noise=true , address=185.167.204.205:4006 , piece_id=LY4HTSEATOZWQJTBML5EVSBDICVKWS24MWWJAE7TRQ54ZTHW2IIA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.113594664 (205h54m36.575687147s) [noise=true , address=185.167.204.205:4007 , piece_id=NEHAUNCJOZHAD46YI6AQCMQMV6JPTKWLF7G4H546LHALMZCL4ITQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.117627584 (205h54m36.579720077s) [noise=true , address=185.167.204.205:4009 , piece_id=2K3AA2UN7CDH5NVFKL4V5QP3G5BVDOBQ6WRN3MTXTT4NP3F3QOMQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.137300514 (205h54m36.599392997s) [noise=true , address=185.167.204.205:4015 , piece_id=KXTFVE3Y7KRLF6XCLEENWN74J5PDDRMLBYLC2POUZFQFIXUBNHEQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.137330772 (205h54m36.599423245s) [seg_pos={0 0}, upload=181068]: Segment reached optimal threshold of 26 pieces.
Oct 2 03:25:51.137463375 (205h54m36.599555858s) [noise=true , address=185.167.204.206:4056 , piece_id=G6OE3IONUXYCMNMS53YTXQ2QH2AMF6NVVKPCA4QS3YTD7RLXQMCA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.137485887 (205h54m36.59957837s) [noise=true , address=185.167.204.205:4032 , piece_id=DGWOQKZCLYMSHG6JH5AT5QVL6KFESN5YUWSHIKJV2AYBW7H26BYQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN): protocol: expected piece hash; context canceled; EOF
Oct 2 03:25:51.137500836 (205h54m36.599593339s) [noise=true , address=185.167.204.205:4032 , piece_id=DGWOQKZCLYMSHG6JH5AT5QVL6KFESN5YUWSHIKJV2AYBW7H26BYQ, seg_pos={0 0}, upload=181068]: Long tail cancellation due to optimal threshold
Oct 2 03:25:51.137526445 (205h54m36.599618928s) [seg_pos={0 0}, upload=181068]: Done waiting for segment. successful: 27 optimal: 26 errs: <nil>
Oct 2 03:25:51.137622727 (205h54m36.59971521s) [upload=181068]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 2 03:25:51.137627978 (205h54m36.599720451s) [upload=181068]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 2 03:27:37.980270426 (205h56m23.442362909s) [upload=181068]: Done uploading segments...
Oct 2 03:27:37.980291567 (205h56m23.44238404s) [upload=181068]: Upload finished. err: metaclient: context deadline exceeded
Duration: 4.840683577s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
6.064858823s
FAIL (2025-10-02 03:28:59 UTC)
orbiter warning: context deadline exceeded
Duration: 6.064890582s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
4.969074285s
FAIL (2025-10-02 03:28:29 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
3:25:49.162665554 (205h54m34.624758027s) [noise=true , address=81.171.14.70:4043 , piece_id=LJS6SD7LZGMNPZDAWRLBU4WWW3NYOVDHHPH4TGHZ62LZIRDDEANA, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.162930569 (205h54m34.625023052s) [noise=true , address=81.171.14.70:4029 , piece_id=SBO52O3XSTUPJBBHIP2JZBRLHGKZE3EUQVS2I6DXS6GYN6PB654Q, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163171368 (205h54m34.625263851s) [noise=true , address=185.167.204.205:4032 , piece_id=DGWOQKZCLYMSHG6JH5AT5QVL6KFESN5YUWSHIKJV2AYBW7H26BYQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163282509 (205h54m34.625374992s) [noise=true , address=185.167.204.205:4007 , piece_id=NEHAUNCJOZHAD46YI6AQCMQMV6JPTKWLF7G4H546LHALMZCL4ITQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163618950 (205h54m34.625711433s) [noise=true , address=185.167.204.206:4064 , piece_id=T737VKQXQZGTMHLKXN2S6WVHZ45VDMXWJQ3REYCLNDDXHQR2LJRA, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163969478 (205h54m34.626061951s) [noise=true , address=89.149.201.147:4002 , piece_id=RU4LRMQ6OSEP3BFACDQOHR4R6K4Q67OJ5LVUQFHED2B22PIJOYSQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.164309926 (205h54m34.626402399s) [noise=true , address=185.167.204.205:4009 , piece_id=2K3AA2UN7CDH5NVFKL4V5QP3G5BVDOBQ6WRN3MTXTT4NP3F3QOMQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.164696282 (205h54m34.626788765s) [noise=true , address=89.149.201.147:4023 , piece_id=HX3G4EGXC4OJA3EF2AQL35ERQIUPODOX47JFMLPUPCHZ2FQQT4QQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.165052590 (205h54m34.627145073s) [noise=true , address=89.149.201.147:4003 , piece_id=L4W3GWFS3AIVGHBYOLU6FR6IKNP3BOLLWV7ZVCVAWPN53EXU5GMQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.165421743 (205h54m34.627514226s) [noise=true , address=81.171.14.70:4030 , piece_id=XSNZDXHQD33YDT7VOETLAZE36RSMLN4S6LZQZR43FSFJ66VTKOEA, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.165746141 (205h54m34.627838624s) [noise=true , address=89.149.201.147:4008 , piece_id=WKPOJRTROWSMT2BPSSCPBSILIC3VAIBQDWFRSW6NMUQSN5BRE2PQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.167492466 (205h54m34.629584949s) [noise=true , address=81.171.14.70:4041 , piece_id=RTMFTIDLELSIKF6DX2MAEUM6NEARJOEFIEJ6KJYVCVGJLRKDVYNQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.994174141 (205h54m35.456266624s) [upload=181068]: Next returned nil segment
Oct 2 03:25:49.994197545 (205h54m35.456290028s) [upload=181068]: Waiting for error group managing segments...
Oct 2 03:25:50.378559942 (205h54m35.840652425s) [noise=true , address=81.171.14.70:4043 , piece_id=LJS6SD7LZGMNPZDAWRLBU4WWW3NYOVDHHPH4TGHZ62LZIRDDEANA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.383560535 (205h54m35.845653018s) [noise=true , address=81.171.14.70:4041 , piece_id=RTMFTIDLELSIKF6DX2MAEUM6NEARJOEFIEJ6KJYVCVGJLRKDVYNQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.388516662 (205h54m35.850609135s) [noise=true , address=81.171.14.70:4040 , piece_id=QXFFFGXCPRMBKPNQ2ABGJC26U6DYIJTAARBVCVLQFLIP54G4VFLA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.389043765 (205h54m35.851136238s) [noise=true , address=81.171.14.70:4032 , piece_id=IZTDRSZ74T75J3Y7MCNORWFXLFOXG35R52Y4VSNS2QZ3R3WBFJZQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.392483886 (205h54m35.854576369s) [noise=true , address=81.171.14.70:4027 , piece_id=TDKB4CVXHXQZNNMIJLV3YYVOZMV5CKSY37L4OWB3ZXIJDNJ2JDCQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.396373262 (205h54m35.858465745s) [noise=true , address=81.171.14.70:4042 , piece_id=3ZWKCWIMPFM2CXG3HJWDOMTEMKOSZ5TOONPGOCFC3GZKZ5QHFTBQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.431305560 (205h54m35.893398043s) [noise=true , address=89.149.201.147:4016 , piece_id=LX6HKBDREXIW7XNIWV33JEGPXFMUZOCW35IQULA4PUNJDWO42BQQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.442031504 (205h54m35.904123977s) [noise=true , address=81.171.14.70:4028 , piece_id=QZY7KXVFNXMVEVOBCFTABPK3E2HCVSVYRM4UVB7VJTFZOTNF27TA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.450391563 (205h54m35.912484046s) [noise=true , address=89.149.201.147:4017 , piece_id=EA7JQR35PARZLVG5CMCXITB6MLU55M6WWVQSZEGM6YJQZ2X2WUZA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.454381601 (205h54m35.916474074s) [noise=true , address=81.171.14.70:4029 , piece_id=SBO52O3XSTUPJBBHIP2JZBRLHGKZE3EUQVS2I6DXS6GYN6PB654Q, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.463104390 (205h54m35.925196873s) [noise=true , address=89.149.201.147:4003 , piece_id=L4W3GWFS3AIVGHBYOLU6FR6IKNP3BOLLWV7ZVCVAWPN53EXU5GMQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.471309365 (205h54m35.933401848s) [noise=true , address=81.171.14.70:4036 , piece_id=CFSIP7I4XJEYGBMBQD2UTJXPSNR44OGB7DWOWOWYFSWY6DAFPL3Q, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.486337891 (205h54m35.948430364s) [noise=true , address=89.149.201.147:4008 , piece_id=WKPOJRTROWSMT2BPSSCPBSILIC3VAIBQDWFRSW6NMUQSN5BRE2PQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.489526543 (205h54m35.951619026s) [noise=true , address=89.149.201.147:4006 , piece_id=VIEICP3IHAH2ALC7NSV2T6B7ZSSLIG4NHRTKLXNAR3VBRWR54OKQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.511383803 (205h54m35.973476286s) [noise=true , address=89.149.201.147:4007 , piece_id=GUALOJ23T6IETBGD6VGBH5USVZADA3HNRNJPONABQ7I7WVAZ3PUA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.533024491 (205h54m35.995116974s) [noise=true , address=89.149.201.147:4023 , piece_id=HX3G4EGXC4OJA3EF2AQL35ERQIUPODOX47JFMLPUPCHZ2FQQT4QQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.910819552 (205h54m36.372912025s) [noise=true , address=81.171.14.70:4030 , piece_id=XSNZDXHQD33YDT7VOETLAZE36RSMLN4S6LZQZR43FSFJ66VTKOEA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.990741449 (205h54m36.452833932s) [noise=true , address=89.149.201.147:4002 , piece_id=RU4LRMQ6OSEP3BFACDQOHR4R6K4Q67OJ5LVUQFHED2B22PIJOYSQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.064808246 (205h54m36.526900719s) [noise=true , address=185.167.204.206:4064 , piece_id=T737VKQXQZGTMHLKXN2S6WVHZ45VDMXWJQ3REYCLNDDXHQR2LJRA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.069475683 (205h54m36.531568166s) [noise=true , address=185.167.204.206:4060 , piece_id=TVGTJBCTMRXB2VB3PSLZ3NPWDAEZTCWYULAVFG4CAJX64KVR4MEA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.083150653 (205h54m36.545243136s) [noise=true , address=185.167.204.206:4039 , piece_id=YOD34HQMIBPSLP2IZ4U77CMQSOSAK5FTZSMVRSSEHG7DMVICR7HQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.100274620 (205h54m36.562367103s) [noise=true , address=185.167.204.205:4011 , piece_id=LAKZUADU7PCZBAIGSP72D7WGUZV46R5H5H76SNIQZU2I7DEBOZKA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.107345404 (205h54m36.569437887s) [noise=true , address=185.167.204.205:4006 , piece_id=LY4HTSEATOZWQJTBML5EVSBDICVKWS24MWWJAE7TRQ54ZTHW2IIA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.113594664 (205h54m36.575687147s) [noise=true , address=185.167.204.205:4007 , piece_id=NEHAUNCJOZHAD46YI6AQCMQMV6JPTKWLF7G4H546LHALMZCL4ITQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.117627584 (205h54m36.579720077s) [noise=true , address=185.167.204.205:4009 , piece_id=2K3AA2UN7CDH5NVFKL4V5QP3G5BVDOBQ6WRN3MTXTT4NP3F3QOMQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.137300514 (205h54m36.599392997s) [noise=true , address=185.167.204.205:4015 , piece_id=KXTFVE3Y7KRLF6XCLEENWN74J5PDDRMLBYLC2POUZFQFIXUBNHEQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.137330772 (205h54m36.599423245s) [seg_pos={0 0}, upload=181068]: Segment reached optimal threshold of 26 pieces.
Oct 2 03:25:51.137463375 (205h54m36.599555858s) [noise=true , address=185.167.204.206:4056 , piece_id=G6OE3IONUXYCMNMS53YTXQ2QH2AMF6NVVKPCA4QS3YTD7RLXQMCA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.137485887 (205h54m36.59957837s) [noise=true , address=185.167.204.205:4032 , piece_id=DGWOQKZCLYMSHG6JH5AT5QVL6KFESN5YUWSHIKJV2AYBW7H26BYQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN): protocol: expected piece hash; context canceled; EOF
Oct 2 03:25:51.137500836 (205h54m36.599593339s) [noise=true , address=185.167.204.205:4032 , piece_id=DGWOQKZCLYMSHG6JH5AT5QVL6KFESN5YUWSHIKJV2AYBW7H26BYQ, seg_pos={0 0}, upload=181068]: Long tail cancellation due to optimal threshold
Oct 2 03:25:51.137526445 (205h54m36.599618928s) [seg_pos={0 0}, upload=181068]: Done waiting for segment. successful: 27 optimal: 26 errs: <nil>
Oct 2 03:25:51.137622727 (205h54m36.59971521s) [upload=181068]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 2 03:25:51.137627978 (205h54m36.599720451s) [upload=181068]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 2 03:27:37.980270426 (205h56m23.442362909s) [upload=181068]: Done uploading segments...
Oct 2 03:27:37.980291567 (205h56m23.44238404s) [upload=181068]: Upload finished. err: metaclient: context deadline exceeded
Duration: 4.969121243s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
6.386048748s
FAIL (2025-10-02 03:28:07 UTC)
orbiter warning: context deadline exceeded
Duration: 6.386078495s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
4.876355944s
FAIL (2025-10-02 03:27:43 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
3:25:49.162665554 (205h54m34.624758027s) [noise=true , address=81.171.14.70:4043 , piece_id=LJS6SD7LZGMNPZDAWRLBU4WWW3NYOVDHHPH4TGHZ62LZIRDDEANA, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.162930569 (205h54m34.625023052s) [noise=true , address=81.171.14.70:4029 , piece_id=SBO52O3XSTUPJBBHIP2JZBRLHGKZE3EUQVS2I6DXS6GYN6PB654Q, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163171368 (205h54m34.625263851s) [noise=true , address=185.167.204.205:4032 , piece_id=DGWOQKZCLYMSHG6JH5AT5QVL6KFESN5YUWSHIKJV2AYBW7H26BYQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163282509 (205h54m34.625374992s) [noise=true , address=185.167.204.205:4007 , piece_id=NEHAUNCJOZHAD46YI6AQCMQMV6JPTKWLF7G4H546LHALMZCL4ITQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163618950 (205h54m34.625711433s) [noise=true , address=185.167.204.206:4064 , piece_id=T737VKQXQZGTMHLKXN2S6WVHZ45VDMXWJQ3REYCLNDDXHQR2LJRA, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163969478 (205h54m34.626061951s) [noise=true , address=89.149.201.147:4002 , piece_id=RU4LRMQ6OSEP3BFACDQOHR4R6K4Q67OJ5LVUQFHED2B22PIJOYSQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.164309926 (205h54m34.626402399s) [noise=true , address=185.167.204.205:4009 , piece_id=2K3AA2UN7CDH5NVFKL4V5QP3G5BVDOBQ6WRN3MTXTT4NP3F3QOMQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.164696282 (205h54m34.626788765s) [noise=true , address=89.149.201.147:4023 , piece_id=HX3G4EGXC4OJA3EF2AQL35ERQIUPODOX47JFMLPUPCHZ2FQQT4QQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.165052590 (205h54m34.627145073s) [noise=true , address=89.149.201.147:4003 , piece_id=L4W3GWFS3AIVGHBYOLU6FR6IKNP3BOLLWV7ZVCVAWPN53EXU5GMQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.165421743 (205h54m34.627514226s) [noise=true , address=81.171.14.70:4030 , piece_id=XSNZDXHQD33YDT7VOETLAZE36RSMLN4S6LZQZR43FSFJ66VTKOEA, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.165746141 (205h54m34.627838624s) [noise=true , address=89.149.201.147:4008 , piece_id=WKPOJRTROWSMT2BPSSCPBSILIC3VAIBQDWFRSW6NMUQSN5BRE2PQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.167492466 (205h54m34.629584949s) [noise=true , address=81.171.14.70:4041 , piece_id=RTMFTIDLELSIKF6DX2MAEUM6NEARJOEFIEJ6KJYVCVGJLRKDVYNQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.994174141 (205h54m35.456266624s) [upload=181068]: Next returned nil segment
Oct 2 03:25:49.994197545 (205h54m35.456290028s) [upload=181068]: Waiting for error group managing segments...
Oct 2 03:25:50.378559942 (205h54m35.840652425s) [noise=true , address=81.171.14.70:4043 , piece_id=LJS6SD7LZGMNPZDAWRLBU4WWW3NYOVDHHPH4TGHZ62LZIRDDEANA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.383560535 (205h54m35.845653018s) [noise=true , address=81.171.14.70:4041 , piece_id=RTMFTIDLELSIKF6DX2MAEUM6NEARJOEFIEJ6KJYVCVGJLRKDVYNQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.388516662 (205h54m35.850609135s) [noise=true , address=81.171.14.70:4040 , piece_id=QXFFFGXCPRMBKPNQ2ABGJC26U6DYIJTAARBVCVLQFLIP54G4VFLA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.389043765 (205h54m35.851136238s) [noise=true , address=81.171.14.70:4032 , piece_id=IZTDRSZ74T75J3Y7MCNORWFXLFOXG35R52Y4VSNS2QZ3R3WBFJZQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.392483886 (205h54m35.854576369s) [noise=true , address=81.171.14.70:4027 , piece_id=TDKB4CVXHXQZNNMIJLV3YYVOZMV5CKSY37L4OWB3ZXIJDNJ2JDCQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.396373262 (205h54m35.858465745s) [noise=true , address=81.171.14.70:4042 , piece_id=3ZWKCWIMPFM2CXG3HJWDOMTEMKOSZ5TOONPGOCFC3GZKZ5QHFTBQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.431305560 (205h54m35.893398043s) [noise=true , address=89.149.201.147:4016 , piece_id=LX6HKBDREXIW7XNIWV33JEGPXFMUZOCW35IQULA4PUNJDWO42BQQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.442031504 (205h54m35.904123977s) [noise=true , address=81.171.14.70:4028 , piece_id=QZY7KXVFNXMVEVOBCFTABPK3E2HCVSVYRM4UVB7VJTFZOTNF27TA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.450391563 (205h54m35.912484046s) [noise=true , address=89.149.201.147:4017 , piece_id=EA7JQR35PARZLVG5CMCXITB6MLU55M6WWVQSZEGM6YJQZ2X2WUZA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.454381601 (205h54m35.916474074s) [noise=true , address=81.171.14.70:4029 , piece_id=SBO52O3XSTUPJBBHIP2JZBRLHGKZE3EUQVS2I6DXS6GYN6PB654Q, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.463104390 (205h54m35.925196873s) [noise=true , address=89.149.201.147:4003 , piece_id=L4W3GWFS3AIVGHBYOLU6FR6IKNP3BOLLWV7ZVCVAWPN53EXU5GMQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.471309365 (205h54m35.933401848s) [noise=true , address=81.171.14.70:4036 , piece_id=CFSIP7I4XJEYGBMBQD2UTJXPSNR44OGB7DWOWOWYFSWY6DAFPL3Q, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.486337891 (205h54m35.948430364s) [noise=true , address=89.149.201.147:4008 , piece_id=WKPOJRTROWSMT2BPSSCPBSILIC3VAIBQDWFRSW6NMUQSN5BRE2PQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.489526543 (205h54m35.951619026s) [noise=true , address=89.149.201.147:4006 , piece_id=VIEICP3IHAH2ALC7NSV2T6B7ZSSLIG4NHRTKLXNAR3VBRWR54OKQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.511383803 (205h54m35.973476286s) [noise=true , address=89.149.201.147:4007 , piece_id=GUALOJ23T6IETBGD6VGBH5USVZADA3HNRNJPONABQ7I7WVAZ3PUA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.533024491 (205h54m35.995116974s) [noise=true , address=89.149.201.147:4023 , piece_id=HX3G4EGXC4OJA3EF2AQL35ERQIUPODOX47JFMLPUPCHZ2FQQT4QQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.910819552 (205h54m36.372912025s) [noise=true , address=81.171.14.70:4030 , piece_id=XSNZDXHQD33YDT7VOETLAZE36RSMLN4S6LZQZR43FSFJ66VTKOEA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.990741449 (205h54m36.452833932s) [noise=true , address=89.149.201.147:4002 , piece_id=RU4LRMQ6OSEP3BFACDQOHR4R6K4Q67OJ5LVUQFHED2B22PIJOYSQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.064808246 (205h54m36.526900719s) [noise=true , address=185.167.204.206:4064 , piece_id=T737VKQXQZGTMHLKXN2S6WVHZ45VDMXWJQ3REYCLNDDXHQR2LJRA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.069475683 (205h54m36.531568166s) [noise=true , address=185.167.204.206:4060 , piece_id=TVGTJBCTMRXB2VB3PSLZ3NPWDAEZTCWYULAVFG4CAJX64KVR4MEA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.083150653 (205h54m36.545243136s) [noise=true , address=185.167.204.206:4039 , piece_id=YOD34HQMIBPSLP2IZ4U77CMQSOSAK5FTZSMVRSSEHG7DMVICR7HQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.100274620 (205h54m36.562367103s) [noise=true , address=185.167.204.205:4011 , piece_id=LAKZUADU7PCZBAIGSP72D7WGUZV46R5H5H76SNIQZU2I7DEBOZKA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.107345404 (205h54m36.569437887s) [noise=true , address=185.167.204.205:4006 , piece_id=LY4HTSEATOZWQJTBML5EVSBDICVKWS24MWWJAE7TRQ54ZTHW2IIA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.113594664 (205h54m36.575687147s) [noise=true , address=185.167.204.205:4007 , piece_id=NEHAUNCJOZHAD46YI6AQCMQMV6JPTKWLF7G4H546LHALMZCL4ITQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.117627584 (205h54m36.579720077s) [noise=true , address=185.167.204.205:4009 , piece_id=2K3AA2UN7CDH5NVFKL4V5QP3G5BVDOBQ6WRN3MTXTT4NP3F3QOMQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.137300514 (205h54m36.599392997s) [noise=true , address=185.167.204.205:4015 , piece_id=KXTFVE3Y7KRLF6XCLEENWN74J5PDDRMLBYLC2POUZFQFIXUBNHEQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.137330772 (205h54m36.599423245s) [seg_pos={0 0}, upload=181068]: Segment reached optimal threshold of 26 pieces.
Oct 2 03:25:51.137463375 (205h54m36.599555858s) [noise=true , address=185.167.204.206:4056 , piece_id=G6OE3IONUXYCMNMS53YTXQ2QH2AMF6NVVKPCA4QS3YTD7RLXQMCA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.137485887 (205h54m36.59957837s) [noise=true , address=185.167.204.205:4032 , piece_id=DGWOQKZCLYMSHG6JH5AT5QVL6KFESN5YUWSHIKJV2AYBW7H26BYQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN): protocol: expected piece hash; context canceled; EOF
Oct 2 03:25:51.137500836 (205h54m36.599593339s) [noise=true , address=185.167.204.205:4032 , piece_id=DGWOQKZCLYMSHG6JH5AT5QVL6KFESN5YUWSHIKJV2AYBW7H26BYQ, seg_pos={0 0}, upload=181068]: Long tail cancellation due to optimal threshold
Oct 2 03:25:51.137526445 (205h54m36.599618928s) [seg_pos={0 0}, upload=181068]: Done waiting for segment. successful: 27 optimal: 26 errs: <nil>
Oct 2 03:25:51.137622727 (205h54m36.59971521s) [upload=181068]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 2 03:25:51.137627978 (205h54m36.599720451s) [upload=181068]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 2 03:27:37.980270426 (205h56m23.442362909s) [upload=181068]: Done uploading segments...
Oct 2 03:27:37.980291567 (205h56m23.44238404s) [upload=181068]: Upload finished. err: metaclient: context deadline exceeded
Duration: 4.876375081s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
1m49.519763532s
FAIL (2025-10-02 03:27:38 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
3:25:49.162665554 (205h54m34.624758027s) [noise=true , address=81.171.14.70:4043 , piece_id=LJS6SD7LZGMNPZDAWRLBU4WWW3NYOVDHHPH4TGHZ62LZIRDDEANA, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.162930569 (205h54m34.625023052s) [noise=true , address=81.171.14.70:4029 , piece_id=SBO52O3XSTUPJBBHIP2JZBRLHGKZE3EUQVS2I6DXS6GYN6PB654Q, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163171368 (205h54m34.625263851s) [noise=true , address=185.167.204.205:4032 , piece_id=DGWOQKZCLYMSHG6JH5AT5QVL6KFESN5YUWSHIKJV2AYBW7H26BYQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163282509 (205h54m34.625374992s) [noise=true , address=185.167.204.205:4007 , piece_id=NEHAUNCJOZHAD46YI6AQCMQMV6JPTKWLF7G4H546LHALMZCL4ITQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163618950 (205h54m34.625711433s) [noise=true , address=185.167.204.206:4064 , piece_id=T737VKQXQZGTMHLKXN2S6WVHZ45VDMXWJQ3REYCLNDDXHQR2LJRA, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.163969478 (205h54m34.626061951s) [noise=true , address=89.149.201.147:4002 , piece_id=RU4LRMQ6OSEP3BFACDQOHR4R6K4Q67OJ5LVUQFHED2B22PIJOYSQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.164309926 (205h54m34.626402399s) [noise=true , address=185.167.204.205:4009 , piece_id=2K3AA2UN7CDH5NVFKL4V5QP3G5BVDOBQ6WRN3MTXTT4NP3F3QOMQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.164696282 (205h54m34.626788765s) [noise=true , address=89.149.201.147:4023 , piece_id=HX3G4EGXC4OJA3EF2AQL35ERQIUPODOX47JFMLPUPCHZ2FQQT4QQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.165052590 (205h54m34.627145073s) [noise=true , address=89.149.201.147:4003 , piece_id=L4W3GWFS3AIVGHBYOLU6FR6IKNP3BOLLWV7ZVCVAWPN53EXU5GMQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.165421743 (205h54m34.627514226s) [noise=true , address=81.171.14.70:4030 , piece_id=XSNZDXHQD33YDT7VOETLAZE36RSMLN4S6LZQZR43FSFJ66VTKOEA, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.165746141 (205h54m34.627838624s) [noise=true , address=89.149.201.147:4008 , piece_id=WKPOJRTROWSMT2BPSSCPBSILIC3VAIBQDWFRSW6NMUQSN5BRE2PQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.167492466 (205h54m34.629584949s) [noise=true , address=81.171.14.70:4041 , piece_id=RTMFTIDLELSIKF6DX2MAEUM6NEARJOEFIEJ6KJYVCVGJLRKDVYNQ, seg_pos={0 0}, upload=181068]: Uploading piece...
Oct 2 03:25:49.994174141 (205h54m35.456266624s) [upload=181068]: Next returned nil segment
Oct 2 03:25:49.994197545 (205h54m35.456290028s) [upload=181068]: Waiting for error group managing segments...
Oct 2 03:25:50.378559942 (205h54m35.840652425s) [noise=true , address=81.171.14.70:4043 , piece_id=LJS6SD7LZGMNPZDAWRLBU4WWW3NYOVDHHPH4TGHZ62LZIRDDEANA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.383560535 (205h54m35.845653018s) [noise=true , address=81.171.14.70:4041 , piece_id=RTMFTIDLELSIKF6DX2MAEUM6NEARJOEFIEJ6KJYVCVGJLRKDVYNQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.388516662 (205h54m35.850609135s) [noise=true , address=81.171.14.70:4040 , piece_id=QXFFFGXCPRMBKPNQ2ABGJC26U6DYIJTAARBVCVLQFLIP54G4VFLA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.389043765 (205h54m35.851136238s) [noise=true , address=81.171.14.70:4032 , piece_id=IZTDRSZ74T75J3Y7MCNORWFXLFOXG35R52Y4VSNS2QZ3R3WBFJZQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.392483886 (205h54m35.854576369s) [noise=true , address=81.171.14.70:4027 , piece_id=TDKB4CVXHXQZNNMIJLV3YYVOZMV5CKSY37L4OWB3ZXIJDNJ2JDCQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.396373262 (205h54m35.858465745s) [noise=true , address=81.171.14.70:4042 , piece_id=3ZWKCWIMPFM2CXG3HJWDOMTEMKOSZ5TOONPGOCFC3GZKZ5QHFTBQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.431305560 (205h54m35.893398043s) [noise=true , address=89.149.201.147:4016 , piece_id=LX6HKBDREXIW7XNIWV33JEGPXFMUZOCW35IQULA4PUNJDWO42BQQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.442031504 (205h54m35.904123977s) [noise=true , address=81.171.14.70:4028 , piece_id=QZY7KXVFNXMVEVOBCFTABPK3E2HCVSVYRM4UVB7VJTFZOTNF27TA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.450391563 (205h54m35.912484046s) [noise=true , address=89.149.201.147:4017 , piece_id=EA7JQR35PARZLVG5CMCXITB6MLU55M6WWVQSZEGM6YJQZ2X2WUZA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.454381601 (205h54m35.916474074s) [noise=true , address=81.171.14.70:4029 , piece_id=SBO52O3XSTUPJBBHIP2JZBRLHGKZE3EUQVS2I6DXS6GYN6PB654Q, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.463104390 (205h54m35.925196873s) [noise=true , address=89.149.201.147:4003 , piece_id=L4W3GWFS3AIVGHBYOLU6FR6IKNP3BOLLWV7ZVCVAWPN53EXU5GMQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.471309365 (205h54m35.933401848s) [noise=true , address=81.171.14.70:4036 , piece_id=CFSIP7I4XJEYGBMBQD2UTJXPSNR44OGB7DWOWOWYFSWY6DAFPL3Q, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.486337891 (205h54m35.948430364s) [noise=true , address=89.149.201.147:4008 , piece_id=WKPOJRTROWSMT2BPSSCPBSILIC3VAIBQDWFRSW6NMUQSN5BRE2PQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.489526543 (205h54m35.951619026s) [noise=true , address=89.149.201.147:4006 , piece_id=VIEICP3IHAH2ALC7NSV2T6B7ZSSLIG4NHRTKLXNAR3VBRWR54OKQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.511383803 (205h54m35.973476286s) [noise=true , address=89.149.201.147:4007 , piece_id=GUALOJ23T6IETBGD6VGBH5USVZADA3HNRNJPONABQ7I7WVAZ3PUA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.533024491 (205h54m35.995116974s) [noise=true , address=89.149.201.147:4023 , piece_id=HX3G4EGXC4OJA3EF2AQL35ERQIUPODOX47JFMLPUPCHZ2FQQT4QQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.910819552 (205h54m36.372912025s) [noise=true , address=81.171.14.70:4030 , piece_id=XSNZDXHQD33YDT7VOETLAZE36RSMLN4S6LZQZR43FSFJ66VTKOEA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:50.990741449 (205h54m36.452833932s) [noise=true , address=89.149.201.147:4002 , piece_id=RU4LRMQ6OSEP3BFACDQOHR4R6K4Q67OJ5LVUQFHED2B22PIJOYSQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.064808246 (205h54m36.526900719s) [noise=true , address=185.167.204.206:4064 , piece_id=T737VKQXQZGTMHLKXN2S6WVHZ45VDMXWJQ3REYCLNDDXHQR2LJRA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.069475683 (205h54m36.531568166s) [noise=true , address=185.167.204.206:4060 , piece_id=TVGTJBCTMRXB2VB3PSLZ3NPWDAEZTCWYULAVFG4CAJX64KVR4MEA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.083150653 (205h54m36.545243136s) [noise=true , address=185.167.204.206:4039 , piece_id=YOD34HQMIBPSLP2IZ4U77CMQSOSAK5FTZSMVRSSEHG7DMVICR7HQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.100274620 (205h54m36.562367103s) [noise=true , address=185.167.204.205:4011 , piece_id=LAKZUADU7PCZBAIGSP72D7WGUZV46R5H5H76SNIQZU2I7DEBOZKA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.107345404 (205h54m36.569437887s) [noise=true , address=185.167.204.205:4006 , piece_id=LY4HTSEATOZWQJTBML5EVSBDICVKWS24MWWJAE7TRQ54ZTHW2IIA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.113594664 (205h54m36.575687147s) [noise=true , address=185.167.204.205:4007 , piece_id=NEHAUNCJOZHAD46YI6AQCMQMV6JPTKWLF7G4H546LHALMZCL4ITQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.117627584 (205h54m36.579720077s) [noise=true , address=185.167.204.205:4009 , piece_id=2K3AA2UN7CDH5NVFKL4V5QP3G5BVDOBQ6WRN3MTXTT4NP3F3QOMQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.137300514 (205h54m36.599392997s) [noise=true , address=185.167.204.205:4015 , piece_id=KXTFVE3Y7KRLF6XCLEENWN74J5PDDRMLBYLC2POUZFQFIXUBNHEQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.137330772 (205h54m36.599423245s) [seg_pos={0 0}, upload=181068]: Segment reached optimal threshold of 26 pieces.
Oct 2 03:25:51.137463375 (205h54m36.599555858s) [noise=true , address=185.167.204.206:4056 , piece_id=G6OE3IONUXYCMNMS53YTXQ2QH2AMF6NVVKPCA4QS3YTD7RLXQMCA, seg_pos={0 0}, upload=181068]: Done uploading piece. err: <nil>
Oct 2 03:25:51.137485887 (205h54m36.59957837s) [noise=true , address=185.167.204.205:4032 , piece_id=DGWOQKZCLYMSHG6JH5AT5QVL6KFESN5YUWSHIKJV2AYBW7H26BYQ, seg_pos={0 0}, upload=181068]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN): protocol: expected piece hash; context canceled; EOF
Oct 2 03:25:51.137500836 (205h54m36.599593339s) [noise=true , address=185.167.204.205:4032 , piece_id=DGWOQKZCLYMSHG6JH5AT5QVL6KFESN5YUWSHIKJV2AYBW7H26BYQ, seg_pos={0 0}, upload=181068]: Long tail cancellation due to optimal threshold
Oct 2 03:25:51.137526445 (205h54m36.599618928s) [seg_pos={0 0}, upload=181068]: Done waiting for segment. successful: 27 optimal: 26 errs: <nil>
Oct 2 03:25:51.137622727 (205h54m36.59971521s) [upload=181068]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 2 03:25:51.137627978 (205h54m36.599720451s) [upload=181068]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 2 03:27:37.980270426 (205h56m23.442362909s) [upload=181068]: Done uploading segments...
Oct 2 03:27:37.980291567 (205h56m23.44238404s) [upload=181068]: Upload finished. err: metaclient: context deadline exceeded
Duration: 1m49.519799168s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
6.471961581s
FAIL (2025-10-02 03:27:07 UTC)
orbiter warning: context deadline exceeded
Duration: 6.471995897s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
6.264714587s
FAIL (2025-10-02 03:26:40 UTC)
orbiter warning: context deadline exceeded
Duration: 6.264742492s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
6.206001645s
FAIL (2025-10-02 03:26:05 UTC)
orbiter warning: context deadline exceeded
Duration: 6.206030691s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
6.649376322s
FAIL (2025-10-02 03:24:52 UTC)
orbiter warning: context deadline exceeded
Duration: 6.649413683s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
6.314777072s
FAIL (2025-10-02 03:24:25 UTC)
orbiter warning: context deadline exceeded
Duration: 6.314811277s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
6.502012753s
FAIL (2025-10-02 03:24:09 UTC)
orbiter warning: context deadline exceeded
Duration: 6.502060975s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
2.176366364s
FAIL (2025-10-02 03:23:51 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 2.176381043s
core
uplink
us1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
6.787544018s
FAIL (2025-10-02 03:23:21 UTC)
orbiter warning: context deadline exceeded
Duration: 6.787573224s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
2.062067017s
FAIL (2025-10-02 03:23:07 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 2.062095141s
core
uplink
us1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
6.078266695s
FAIL (2025-10-02 03:22:27 UTC)
orbiter warning: context deadline exceeded
Duration: 6.078290491s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
2.217350465s
FAIL (2025-10-02 03:22:00 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 2.217379349s
core
uplink
us1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
6.219350601s
FAIL (2025-10-02 03:21:19 UTC)
orbiter warning: context deadline exceeded
Duration: 6.219379628s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
2.104356783s
FAIL (2025-10-02 03:21:02 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 2.104439151s
core
uplink
us1
|