Orbiter History

checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.........................................................X..] duration: 3.311746559s trace: https://jaeger.dev.storj.io/trace/7dea6a2fc27239eb FAIL (2025-11-20 08:43:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.311776807s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..........................................................X.] duration: 3.334100027s trace: https://jaeger.dev.storj.io/trace/7dea6a2fc27239eb FAIL (2025-11-20 08:42:43 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.334134983s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...........................................................X] duration: 5.001126175s trace: https://jaeger.dev.storj.io/trace/7dea6a2fc27239eb FAIL (2025-11-20 08:41:48 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001158035s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 5.874983443s trace: https://jaeger.dev.storj.io/trace/29eebe057654c99d FAIL (2025-11-20 08:16:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Nov 20 07:31:19.629873593 (263h27m18.181344064s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.633306430 (263h27m18.184776891s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.636780656 (263h27m18.188251117s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.639327946 (263h27m18.190798397s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.641216883 (263h27m18.192687334s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.645856578 (263h27m18.197327039s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.651699423 (263h27m18.203169894s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.653098288 (263h27m18.204568749s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.656601418 (263h27m18.208071899s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.659046414 (263h27m18.210516875s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:20.448435324 (263h27m18.999905785s) [upload=232059]: Next returned nil segment Nov 20 07:31:20.448449921 (263h27m18.999920373s) [upload=232059]: Waiting for error group managing segments... Nov 20 07:31:20.840686863 (263h27m19.392157314s) [noise=true , address=185.167.204.206:4047 , piece_id=AOJHHOC6D4ES5PSABO5CPOA6FFMQCWJSJC4SYRR4TBGE3ZW6WVYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.840944473 (263h27m19.392414934s) [noise=true , address=185.167.204.205:4009 , piece_id=PHZYFRVS7TV7P2TSPX7MMZ3H63VUEUNYLTDKYIRC7PA7YJ2MGJXQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.841171586 (263h27m19.392642047s) [noise=true , address=185.167.204.206:4061 , piece_id=ND4H2MBLMA7TRKNRPKWRV35RW7JBWOQ4W3TDUST35KQSUFMTUJVQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.845413794 (263h27m19.396884255s) [noise=true , address=185.167.204.206:4054 , piece_id=2FKWZRLJAX6LEUNCRXNH4R3MZ6DNY3VHVZ5JK5QEJZ76KD5EDRAA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.846588840 (263h27m19.398059302s) [noise=true , address=185.167.204.206:4072 , piece_id=25EIWSZDRFORHSBI6DXITGLG4JE3YNY6WWUOH4CIRASABTDW6CLA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.848580414 (263h27m19.400050875s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.849535923 (263h27m19.401006414s) [noise=true , address=185.167.204.206:4053 , piece_id=WOHYIAC6PUGDO7LH3WUAC6AZGDPGMSXQPYKFGFOJWRZMP7EFZWRQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853075914 (263h27m19.404546375s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853778040 (263h27m19.405248491s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.869053197 (263h27m19.420523658s) [noise=true , address=185.167.204.206:4058 , piece_id=SISDILWJPPH4JOHOTL3GKS6LEG3DSVWBSU6IWHZU5R3LCX57CE5A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.884471807 (263h27m19.435942268s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.891395812 (263h27m19.442866273s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.407423253 (263h27m19.958893714s) [noise=true , address=81.171.14.70:4046 , piece_id=OHLJUIVJXEARMXSQJAVQHNOUOFT3UMOWA2E2HOZBJD2CETJ6AVWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.434063861 (263h27m19.985534322s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.458913289 (263h27m20.01038375s) [noise=true , address=81.171.14.70:4027 , piece_id=26ZOOIR73NY4PAJQ3WSAU4ZCXMVYEOJDWSTS4PIDHHYVRPRJF44A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.480425362 (263h27m20.031895813s) [noise=true , address=81.171.14.70:4033 , piece_id=VVU5PQACV4GKY45RPB2C3NWUBYEX7ECQZN4W336ZYULO2CQHQSYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.487065786 (263h27m20.038536237s) [noise=true , address=81.171.14.70:4032 , piece_id=2NLDGLW73R6LJ7XNNAJYRTVPLCCSMOAHGBKIKI7TEOKI4L2T6XWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.504477020 (263h27m20.055947481s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.891152100 (263h27m20.442622561s) [noise=true , address=81.171.14.70:4031 , piece_id=JWMOD7NPWBUIK2ZQAER3YFMZQNDXZKFP345L66NVGKV7EKI7DLOQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.903537184 (263h27m20.455007645s) [noise=true , address=81.171.14.70:4034 , piece_id=K2P6O2RPHOR433TRB7YFBTJSLEY623J7CRMAM77KOZMQKMOLLHZA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.931241638 (263h27m20.482712109s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.939822769 (263h27m20.49129323s) [noise=true , address=81.171.14.70:4029 , piece_id=WXAQ7CIDAZMB2J2GHSMZ532DAMVAJRBNRP3VT7YSY4HJLGZDBX6Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.042469878 (263h27m20.593940339s) [noise=true , address=89.149.201.147:4005 , piece_id=7NYFIWT6B2AO3XCWMMI4TZYM7NROZRLMOLJTKMZYIMCNS6PKIYIQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.044590426 (263h27m20.596060887s) [noise=true , address=89.149.201.147:4020 , piece_id=SSNUBTKK3UIRO2TQY4CIEMM5DRSPC4RUXUEFDYCHK7FOSIHU5S7A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.081767748 (263h27m20.633238209s) [noise=true , address=89.149.201.147:4008 , piece_id=2NUEBJBDOHBC3YOEX53YH3SHG6XK5WI6WTNEJITLXZKDWLLOSARQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133782203 (263h27m20.685252664s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133874820 (263h27m20.685345281s) [seg_pos={0 0}, upload=232059]: Segment reached optimal threshold of 26 pieces. Nov 20 07:31:22.134328153 (263h27m20.685798624s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134338482 (263h27m20.685808943s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134362959 (263h27m20.68583342s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134385041 (263h27m20.685855502s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134417913 (263h27m20.685888364s) [seg_pos={0 0}, upload=232059]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 07:31:22.134530067 (263h27m20.686000528s) [upload=232059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 07:31:22.134536409 (263h27m20.68600687s) [upload=232059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 07:33:08.217836685 (263h29m6.769307177s) [upload=232059]: Done uploading segments... Nov 20 07:33:08.217918711 (263h29m6.769389162s) [upload=232059]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.875004154s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 5.797537111s trace: https://jaeger.dev.storj.io/trace/29eebe057654c99d FAIL (2025-11-20 08:15:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Nov 20 07:31:19.629873593 (263h27m18.181344064s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.633306430 (263h27m18.184776891s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.636780656 (263h27m18.188251117s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.639327946 (263h27m18.190798397s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.641216883 (263h27m18.192687334s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.645856578 (263h27m18.197327039s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.651699423 (263h27m18.203169894s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.653098288 (263h27m18.204568749s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.656601418 (263h27m18.208071899s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.659046414 (263h27m18.210516875s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:20.448435324 (263h27m18.999905785s) [upload=232059]: Next returned nil segment Nov 20 07:31:20.448449921 (263h27m18.999920373s) [upload=232059]: Waiting for error group managing segments... Nov 20 07:31:20.840686863 (263h27m19.392157314s) [noise=true , address=185.167.204.206:4047 , piece_id=AOJHHOC6D4ES5PSABO5CPOA6FFMQCWJSJC4SYRR4TBGE3ZW6WVYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.840944473 (263h27m19.392414934s) [noise=true , address=185.167.204.205:4009 , piece_id=PHZYFRVS7TV7P2TSPX7MMZ3H63VUEUNYLTDKYIRC7PA7YJ2MGJXQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.841171586 (263h27m19.392642047s) [noise=true , address=185.167.204.206:4061 , piece_id=ND4H2MBLMA7TRKNRPKWRV35RW7JBWOQ4W3TDUST35KQSUFMTUJVQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.845413794 (263h27m19.396884255s) [noise=true , address=185.167.204.206:4054 , piece_id=2FKWZRLJAX6LEUNCRXNH4R3MZ6DNY3VHVZ5JK5QEJZ76KD5EDRAA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.846588840 (263h27m19.398059302s) [noise=true , address=185.167.204.206:4072 , piece_id=25EIWSZDRFORHSBI6DXITGLG4JE3YNY6WWUOH4CIRASABTDW6CLA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.848580414 (263h27m19.400050875s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.849535923 (263h27m19.401006414s) [noise=true , address=185.167.204.206:4053 , piece_id=WOHYIAC6PUGDO7LH3WUAC6AZGDPGMSXQPYKFGFOJWRZMP7EFZWRQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853075914 (263h27m19.404546375s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853778040 (263h27m19.405248491s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.869053197 (263h27m19.420523658s) [noise=true , address=185.167.204.206:4058 , piece_id=SISDILWJPPH4JOHOTL3GKS6LEG3DSVWBSU6IWHZU5R3LCX57CE5A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.884471807 (263h27m19.435942268s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.891395812 (263h27m19.442866273s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.407423253 (263h27m19.958893714s) [noise=true , address=81.171.14.70:4046 , piece_id=OHLJUIVJXEARMXSQJAVQHNOUOFT3UMOWA2E2HOZBJD2CETJ6AVWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.434063861 (263h27m19.985534322s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.458913289 (263h27m20.01038375s) [noise=true , address=81.171.14.70:4027 , piece_id=26ZOOIR73NY4PAJQ3WSAU4ZCXMVYEOJDWSTS4PIDHHYVRPRJF44A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.480425362 (263h27m20.031895813s) [noise=true , address=81.171.14.70:4033 , piece_id=VVU5PQACV4GKY45RPB2C3NWUBYEX7ECQZN4W336ZYULO2CQHQSYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.487065786 (263h27m20.038536237s) [noise=true , address=81.171.14.70:4032 , piece_id=2NLDGLW73R6LJ7XNNAJYRTVPLCCSMOAHGBKIKI7TEOKI4L2T6XWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.504477020 (263h27m20.055947481s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.891152100 (263h27m20.442622561s) [noise=true , address=81.171.14.70:4031 , piece_id=JWMOD7NPWBUIK2ZQAER3YFMZQNDXZKFP345L66NVGKV7EKI7DLOQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.903537184 (263h27m20.455007645s) [noise=true , address=81.171.14.70:4034 , piece_id=K2P6O2RPHOR433TRB7YFBTJSLEY623J7CRMAM77KOZMQKMOLLHZA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.931241638 (263h27m20.482712109s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.939822769 (263h27m20.49129323s) [noise=true , address=81.171.14.70:4029 , piece_id=WXAQ7CIDAZMB2J2GHSMZ532DAMVAJRBNRP3VT7YSY4HJLGZDBX6Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.042469878 (263h27m20.593940339s) [noise=true , address=89.149.201.147:4005 , piece_id=7NYFIWT6B2AO3XCWMMI4TZYM7NROZRLMOLJTKMZYIMCNS6PKIYIQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.044590426 (263h27m20.596060887s) [noise=true , address=89.149.201.147:4020 , piece_id=SSNUBTKK3UIRO2TQY4CIEMM5DRSPC4RUXUEFDYCHK7FOSIHU5S7A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.081767748 (263h27m20.633238209s) [noise=true , address=89.149.201.147:4008 , piece_id=2NUEBJBDOHBC3YOEX53YH3SHG6XK5WI6WTNEJITLXZKDWLLOSARQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133782203 (263h27m20.685252664s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133874820 (263h27m20.685345281s) [seg_pos={0 0}, upload=232059]: Segment reached optimal threshold of 26 pieces. Nov 20 07:31:22.134328153 (263h27m20.685798624s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134338482 (263h27m20.685808943s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134362959 (263h27m20.68583342s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134385041 (263h27m20.685855502s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134417913 (263h27m20.685888364s) [seg_pos={0 0}, upload=232059]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 07:31:22.134530067 (263h27m20.686000528s) [upload=232059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 07:31:22.134536409 (263h27m20.68600687s) [upload=232059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 07:33:08.217836685 (263h29m6.769307177s) [upload=232059]: Done uploading segments... Nov 20 07:33:08.217918711 (263h29m6.769389162s) [upload=232059]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.797560696s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 5.342740234s trace: https://jaeger.dev.storj.io/trace/29eebe057654c99d FAIL (2025-11-20 08:14:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Nov 20 07:31:19.629873593 (263h27m18.181344064s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.633306430 (263h27m18.184776891s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.636780656 (263h27m18.188251117s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.639327946 (263h27m18.190798397s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.641216883 (263h27m18.192687334s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.645856578 (263h27m18.197327039s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.651699423 (263h27m18.203169894s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.653098288 (263h27m18.204568749s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.656601418 (263h27m18.208071899s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.659046414 (263h27m18.210516875s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:20.448435324 (263h27m18.999905785s) [upload=232059]: Next returned nil segment Nov 20 07:31:20.448449921 (263h27m18.999920373s) [upload=232059]: Waiting for error group managing segments... Nov 20 07:31:20.840686863 (263h27m19.392157314s) [noise=true , address=185.167.204.206:4047 , piece_id=AOJHHOC6D4ES5PSABO5CPOA6FFMQCWJSJC4SYRR4TBGE3ZW6WVYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.840944473 (263h27m19.392414934s) [noise=true , address=185.167.204.205:4009 , piece_id=PHZYFRVS7TV7P2TSPX7MMZ3H63VUEUNYLTDKYIRC7PA7YJ2MGJXQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.841171586 (263h27m19.392642047s) [noise=true , address=185.167.204.206:4061 , piece_id=ND4H2MBLMA7TRKNRPKWRV35RW7JBWOQ4W3TDUST35KQSUFMTUJVQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.845413794 (263h27m19.396884255s) [noise=true , address=185.167.204.206:4054 , piece_id=2FKWZRLJAX6LEUNCRXNH4R3MZ6DNY3VHVZ5JK5QEJZ76KD5EDRAA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.846588840 (263h27m19.398059302s) [noise=true , address=185.167.204.206:4072 , piece_id=25EIWSZDRFORHSBI6DXITGLG4JE3YNY6WWUOH4CIRASABTDW6CLA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.848580414 (263h27m19.400050875s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.849535923 (263h27m19.401006414s) [noise=true , address=185.167.204.206:4053 , piece_id=WOHYIAC6PUGDO7LH3WUAC6AZGDPGMSXQPYKFGFOJWRZMP7EFZWRQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853075914 (263h27m19.404546375s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853778040 (263h27m19.405248491s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.869053197 (263h27m19.420523658s) [noise=true , address=185.167.204.206:4058 , piece_id=SISDILWJPPH4JOHOTL3GKS6LEG3DSVWBSU6IWHZU5R3LCX57CE5A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.884471807 (263h27m19.435942268s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.891395812 (263h27m19.442866273s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.407423253 (263h27m19.958893714s) [noise=true , address=81.171.14.70:4046 , piece_id=OHLJUIVJXEARMXSQJAVQHNOUOFT3UMOWA2E2HOZBJD2CETJ6AVWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.434063861 (263h27m19.985534322s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.458913289 (263h27m20.01038375s) [noise=true , address=81.171.14.70:4027 , piece_id=26ZOOIR73NY4PAJQ3WSAU4ZCXMVYEOJDWSTS4PIDHHYVRPRJF44A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.480425362 (263h27m20.031895813s) [noise=true , address=81.171.14.70:4033 , piece_id=VVU5PQACV4GKY45RPB2C3NWUBYEX7ECQZN4W336ZYULO2CQHQSYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.487065786 (263h27m20.038536237s) [noise=true , address=81.171.14.70:4032 , piece_id=2NLDGLW73R6LJ7XNNAJYRTVPLCCSMOAHGBKIKI7TEOKI4L2T6XWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.504477020 (263h27m20.055947481s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.891152100 (263h27m20.442622561s) [noise=true , address=81.171.14.70:4031 , piece_id=JWMOD7NPWBUIK2ZQAER3YFMZQNDXZKFP345L66NVGKV7EKI7DLOQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.903537184 (263h27m20.455007645s) [noise=true , address=81.171.14.70:4034 , piece_id=K2P6O2RPHOR433TRB7YFBTJSLEY623J7CRMAM77KOZMQKMOLLHZA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.931241638 (263h27m20.482712109s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.939822769 (263h27m20.49129323s) [noise=true , address=81.171.14.70:4029 , piece_id=WXAQ7CIDAZMB2J2GHSMZ532DAMVAJRBNRP3VT7YSY4HJLGZDBX6Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.042469878 (263h27m20.593940339s) [noise=true , address=89.149.201.147:4005 , piece_id=7NYFIWT6B2AO3XCWMMI4TZYM7NROZRLMOLJTKMZYIMCNS6PKIYIQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.044590426 (263h27m20.596060887s) [noise=true , address=89.149.201.147:4020 , piece_id=SSNUBTKK3UIRO2TQY4CIEMM5DRSPC4RUXUEFDYCHK7FOSIHU5S7A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.081767748 (263h27m20.633238209s) [noise=true , address=89.149.201.147:4008 , piece_id=2NUEBJBDOHBC3YOEX53YH3SHG6XK5WI6WTNEJITLXZKDWLLOSARQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133782203 (263h27m20.685252664s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133874820 (263h27m20.685345281s) [seg_pos={0 0}, upload=232059]: Segment reached optimal threshold of 26 pieces. Nov 20 07:31:22.134328153 (263h27m20.685798624s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134338482 (263h27m20.685808943s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134362959 (263h27m20.68583342s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134385041 (263h27m20.685855502s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134417913 (263h27m20.685888364s) [seg_pos={0 0}, upload=232059]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 07:31:22.134530067 (263h27m20.686000528s) [upload=232059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 07:31:22.134536409 (263h27m20.68600687s) [upload=232059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 07:33:08.217836685 (263h29m6.769307177s) [upload=232059]: Done uploading segments... Nov 20 07:33:08.217918711 (263h29m6.769389162s) [upload=232059]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.342764389s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 5.765908157s trace: https://jaeger.dev.storj.io/trace/29eebe057654c99d FAIL (2025-11-20 08:14:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Nov 20 07:31:19.629873593 (263h27m18.181344064s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.633306430 (263h27m18.184776891s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.636780656 (263h27m18.188251117s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.639327946 (263h27m18.190798397s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.641216883 (263h27m18.192687334s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.645856578 (263h27m18.197327039s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.651699423 (263h27m18.203169894s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.653098288 (263h27m18.204568749s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.656601418 (263h27m18.208071899s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.659046414 (263h27m18.210516875s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:20.448435324 (263h27m18.999905785s) [upload=232059]: Next returned nil segment Nov 20 07:31:20.448449921 (263h27m18.999920373s) [upload=232059]: Waiting for error group managing segments... Nov 20 07:31:20.840686863 (263h27m19.392157314s) [noise=true , address=185.167.204.206:4047 , piece_id=AOJHHOC6D4ES5PSABO5CPOA6FFMQCWJSJC4SYRR4TBGE3ZW6WVYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.840944473 (263h27m19.392414934s) [noise=true , address=185.167.204.205:4009 , piece_id=PHZYFRVS7TV7P2TSPX7MMZ3H63VUEUNYLTDKYIRC7PA7YJ2MGJXQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.841171586 (263h27m19.392642047s) [noise=true , address=185.167.204.206:4061 , piece_id=ND4H2MBLMA7TRKNRPKWRV35RW7JBWOQ4W3TDUST35KQSUFMTUJVQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.845413794 (263h27m19.396884255s) [noise=true , address=185.167.204.206:4054 , piece_id=2FKWZRLJAX6LEUNCRXNH4R3MZ6DNY3VHVZ5JK5QEJZ76KD5EDRAA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.846588840 (263h27m19.398059302s) [noise=true , address=185.167.204.206:4072 , piece_id=25EIWSZDRFORHSBI6DXITGLG4JE3YNY6WWUOH4CIRASABTDW6CLA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.848580414 (263h27m19.400050875s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.849535923 (263h27m19.401006414s) [noise=true , address=185.167.204.206:4053 , piece_id=WOHYIAC6PUGDO7LH3WUAC6AZGDPGMSXQPYKFGFOJWRZMP7EFZWRQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853075914 (263h27m19.404546375s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853778040 (263h27m19.405248491s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.869053197 (263h27m19.420523658s) [noise=true , address=185.167.204.206:4058 , piece_id=SISDILWJPPH4JOHOTL3GKS6LEG3DSVWBSU6IWHZU5R3LCX57CE5A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.884471807 (263h27m19.435942268s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.891395812 (263h27m19.442866273s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.407423253 (263h27m19.958893714s) [noise=true , address=81.171.14.70:4046 , piece_id=OHLJUIVJXEARMXSQJAVQHNOUOFT3UMOWA2E2HOZBJD2CETJ6AVWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.434063861 (263h27m19.985534322s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.458913289 (263h27m20.01038375s) [noise=true , address=81.171.14.70:4027 , piece_id=26ZOOIR73NY4PAJQ3WSAU4ZCXMVYEOJDWSTS4PIDHHYVRPRJF44A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.480425362 (263h27m20.031895813s) [noise=true , address=81.171.14.70:4033 , piece_id=VVU5PQACV4GKY45RPB2C3NWUBYEX7ECQZN4W336ZYULO2CQHQSYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.487065786 (263h27m20.038536237s) [noise=true , address=81.171.14.70:4032 , piece_id=2NLDGLW73R6LJ7XNNAJYRTVPLCCSMOAHGBKIKI7TEOKI4L2T6XWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.504477020 (263h27m20.055947481s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.891152100 (263h27m20.442622561s) [noise=true , address=81.171.14.70:4031 , piece_id=JWMOD7NPWBUIK2ZQAER3YFMZQNDXZKFP345L66NVGKV7EKI7DLOQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.903537184 (263h27m20.455007645s) [noise=true , address=81.171.14.70:4034 , piece_id=K2P6O2RPHOR433TRB7YFBTJSLEY623J7CRMAM77KOZMQKMOLLHZA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.931241638 (263h27m20.482712109s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.939822769 (263h27m20.49129323s) [noise=true , address=81.171.14.70:4029 , piece_id=WXAQ7CIDAZMB2J2GHSMZ532DAMVAJRBNRP3VT7YSY4HJLGZDBX6Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.042469878 (263h27m20.593940339s) [noise=true , address=89.149.201.147:4005 , piece_id=7NYFIWT6B2AO3XCWMMI4TZYM7NROZRLMOLJTKMZYIMCNS6PKIYIQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.044590426 (263h27m20.596060887s) [noise=true , address=89.149.201.147:4020 , piece_id=SSNUBTKK3UIRO2TQY4CIEMM5DRSPC4RUXUEFDYCHK7FOSIHU5S7A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.081767748 (263h27m20.633238209s) [noise=true , address=89.149.201.147:4008 , piece_id=2NUEBJBDOHBC3YOEX53YH3SHG6XK5WI6WTNEJITLXZKDWLLOSARQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133782203 (263h27m20.685252664s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133874820 (263h27m20.685345281s) [seg_pos={0 0}, upload=232059]: Segment reached optimal threshold of 26 pieces. Nov 20 07:31:22.134328153 (263h27m20.685798624s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134338482 (263h27m20.685808943s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134362959 (263h27m20.68583342s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134385041 (263h27m20.685855502s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134417913 (263h27m20.685888364s) [seg_pos={0 0}, upload=232059]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 07:31:22.134530067 (263h27m20.686000528s) [upload=232059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 07:31:22.134536409 (263h27m20.68600687s) [upload=232059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 07:33:08.217836685 (263h29m6.769307177s) [upload=232059]: Done uploading segments... Nov 20 07:33:08.217918711 (263h29m6.769389162s) [upload=232059]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.765940958s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 5.723922653s trace: https://jaeger.dev.storj.io/trace/29eebe057654c99d FAIL (2025-11-20 08:13:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Nov 20 07:31:19.629873593 (263h27m18.181344064s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.633306430 (263h27m18.184776891s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.636780656 (263h27m18.188251117s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.639327946 (263h27m18.190798397s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.641216883 (263h27m18.192687334s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.645856578 (263h27m18.197327039s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.651699423 (263h27m18.203169894s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.653098288 (263h27m18.204568749s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.656601418 (263h27m18.208071899s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.659046414 (263h27m18.210516875s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:20.448435324 (263h27m18.999905785s) [upload=232059]: Next returned nil segment Nov 20 07:31:20.448449921 (263h27m18.999920373s) [upload=232059]: Waiting for error group managing segments... Nov 20 07:31:20.840686863 (263h27m19.392157314s) [noise=true , address=185.167.204.206:4047 , piece_id=AOJHHOC6D4ES5PSABO5CPOA6FFMQCWJSJC4SYRR4TBGE3ZW6WVYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.840944473 (263h27m19.392414934s) [noise=true , address=185.167.204.205:4009 , piece_id=PHZYFRVS7TV7P2TSPX7MMZ3H63VUEUNYLTDKYIRC7PA7YJ2MGJXQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.841171586 (263h27m19.392642047s) [noise=true , address=185.167.204.206:4061 , piece_id=ND4H2MBLMA7TRKNRPKWRV35RW7JBWOQ4W3TDUST35KQSUFMTUJVQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.845413794 (263h27m19.396884255s) [noise=true , address=185.167.204.206:4054 , piece_id=2FKWZRLJAX6LEUNCRXNH4R3MZ6DNY3VHVZ5JK5QEJZ76KD5EDRAA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.846588840 (263h27m19.398059302s) [noise=true , address=185.167.204.206:4072 , piece_id=25EIWSZDRFORHSBI6DXITGLG4JE3YNY6WWUOH4CIRASABTDW6CLA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.848580414 (263h27m19.400050875s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.849535923 (263h27m19.401006414s) [noise=true , address=185.167.204.206:4053 , piece_id=WOHYIAC6PUGDO7LH3WUAC6AZGDPGMSXQPYKFGFOJWRZMP7EFZWRQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853075914 (263h27m19.404546375s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853778040 (263h27m19.405248491s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.869053197 (263h27m19.420523658s) [noise=true , address=185.167.204.206:4058 , piece_id=SISDILWJPPH4JOHOTL3GKS6LEG3DSVWBSU6IWHZU5R3LCX57CE5A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.884471807 (263h27m19.435942268s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.891395812 (263h27m19.442866273s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.407423253 (263h27m19.958893714s) [noise=true , address=81.171.14.70:4046 , piece_id=OHLJUIVJXEARMXSQJAVQHNOUOFT3UMOWA2E2HOZBJD2CETJ6AVWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.434063861 (263h27m19.985534322s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.458913289 (263h27m20.01038375s) [noise=true , address=81.171.14.70:4027 , piece_id=26ZOOIR73NY4PAJQ3WSAU4ZCXMVYEOJDWSTS4PIDHHYVRPRJF44A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.480425362 (263h27m20.031895813s) [noise=true , address=81.171.14.70:4033 , piece_id=VVU5PQACV4GKY45RPB2C3NWUBYEX7ECQZN4W336ZYULO2CQHQSYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.487065786 (263h27m20.038536237s) [noise=true , address=81.171.14.70:4032 , piece_id=2NLDGLW73R6LJ7XNNAJYRTVPLCCSMOAHGBKIKI7TEOKI4L2T6XWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.504477020 (263h27m20.055947481s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.891152100 (263h27m20.442622561s) [noise=true , address=81.171.14.70:4031 , piece_id=JWMOD7NPWBUIK2ZQAER3YFMZQNDXZKFP345L66NVGKV7EKI7DLOQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.903537184 (263h27m20.455007645s) [noise=true , address=81.171.14.70:4034 , piece_id=K2P6O2RPHOR433TRB7YFBTJSLEY623J7CRMAM77KOZMQKMOLLHZA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.931241638 (263h27m20.482712109s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.939822769 (263h27m20.49129323s) [noise=true , address=81.171.14.70:4029 , piece_id=WXAQ7CIDAZMB2J2GHSMZ532DAMVAJRBNRP3VT7YSY4HJLGZDBX6Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.042469878 (263h27m20.593940339s) [noise=true , address=89.149.201.147:4005 , piece_id=7NYFIWT6B2AO3XCWMMI4TZYM7NROZRLMOLJTKMZYIMCNS6PKIYIQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.044590426 (263h27m20.596060887s) [noise=true , address=89.149.201.147:4020 , piece_id=SSNUBTKK3UIRO2TQY4CIEMM5DRSPC4RUXUEFDYCHK7FOSIHU5S7A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.081767748 (263h27m20.633238209s) [noise=true , address=89.149.201.147:4008 , piece_id=2NUEBJBDOHBC3YOEX53YH3SHG6XK5WI6WTNEJITLXZKDWLLOSARQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133782203 (263h27m20.685252664s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133874820 (263h27m20.685345281s) [seg_pos={0 0}, upload=232059]: Segment reached optimal threshold of 26 pieces. Nov 20 07:31:22.134328153 (263h27m20.685798624s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134338482 (263h27m20.685808943s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134362959 (263h27m20.68583342s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134385041 (263h27m20.685855502s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134417913 (263h27m20.685888364s) [seg_pos={0 0}, upload=232059]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 07:31:22.134530067 (263h27m20.686000528s) [upload=232059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 07:31:22.134536409 (263h27m20.68600687s) [upload=232059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 07:33:08.217836685 (263h29m6.769307177s) [upload=232059]: Done uploading segments... Nov 20 07:33:08.217918711 (263h29m6.769389162s) [upload=232059]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.723956776s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 5.548120142s trace: https://jaeger.dev.storj.io/trace/29eebe057654c99d FAIL (2025-11-20 08:12:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Nov 20 07:31:19.629873593 (263h27m18.181344064s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.633306430 (263h27m18.184776891s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.636780656 (263h27m18.188251117s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.639327946 (263h27m18.190798397s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.641216883 (263h27m18.192687334s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.645856578 (263h27m18.197327039s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.651699423 (263h27m18.203169894s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.653098288 (263h27m18.204568749s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.656601418 (263h27m18.208071899s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.659046414 (263h27m18.210516875s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:20.448435324 (263h27m18.999905785s) [upload=232059]: Next returned nil segment Nov 20 07:31:20.448449921 (263h27m18.999920373s) [upload=232059]: Waiting for error group managing segments... Nov 20 07:31:20.840686863 (263h27m19.392157314s) [noise=true , address=185.167.204.206:4047 , piece_id=AOJHHOC6D4ES5PSABO5CPOA6FFMQCWJSJC4SYRR4TBGE3ZW6WVYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.840944473 (263h27m19.392414934s) [noise=true , address=185.167.204.205:4009 , piece_id=PHZYFRVS7TV7P2TSPX7MMZ3H63VUEUNYLTDKYIRC7PA7YJ2MGJXQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.841171586 (263h27m19.392642047s) [noise=true , address=185.167.204.206:4061 , piece_id=ND4H2MBLMA7TRKNRPKWRV35RW7JBWOQ4W3TDUST35KQSUFMTUJVQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.845413794 (263h27m19.396884255s) [noise=true , address=185.167.204.206:4054 , piece_id=2FKWZRLJAX6LEUNCRXNH4R3MZ6DNY3VHVZ5JK5QEJZ76KD5EDRAA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.846588840 (263h27m19.398059302s) [noise=true , address=185.167.204.206:4072 , piece_id=25EIWSZDRFORHSBI6DXITGLG4JE3YNY6WWUOH4CIRASABTDW6CLA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.848580414 (263h27m19.400050875s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.849535923 (263h27m19.401006414s) [noise=true , address=185.167.204.206:4053 , piece_id=WOHYIAC6PUGDO7LH3WUAC6AZGDPGMSXQPYKFGFOJWRZMP7EFZWRQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853075914 (263h27m19.404546375s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853778040 (263h27m19.405248491s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.869053197 (263h27m19.420523658s) [noise=true , address=185.167.204.206:4058 , piece_id=SISDILWJPPH4JOHOTL3GKS6LEG3DSVWBSU6IWHZU5R3LCX57CE5A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.884471807 (263h27m19.435942268s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.891395812 (263h27m19.442866273s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.407423253 (263h27m19.958893714s) [noise=true , address=81.171.14.70:4046 , piece_id=OHLJUIVJXEARMXSQJAVQHNOUOFT3UMOWA2E2HOZBJD2CETJ6AVWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.434063861 (263h27m19.985534322s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.458913289 (263h27m20.01038375s) [noise=true , address=81.171.14.70:4027 , piece_id=26ZOOIR73NY4PAJQ3WSAU4ZCXMVYEOJDWSTS4PIDHHYVRPRJF44A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.480425362 (263h27m20.031895813s) [noise=true , address=81.171.14.70:4033 , piece_id=VVU5PQACV4GKY45RPB2C3NWUBYEX7ECQZN4W336ZYULO2CQHQSYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.487065786 (263h27m20.038536237s) [noise=true , address=81.171.14.70:4032 , piece_id=2NLDGLW73R6LJ7XNNAJYRTVPLCCSMOAHGBKIKI7TEOKI4L2T6XWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.504477020 (263h27m20.055947481s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.891152100 (263h27m20.442622561s) [noise=true , address=81.171.14.70:4031 , piece_id=JWMOD7NPWBUIK2ZQAER3YFMZQNDXZKFP345L66NVGKV7EKI7DLOQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.903537184 (263h27m20.455007645s) [noise=true , address=81.171.14.70:4034 , piece_id=K2P6O2RPHOR433TRB7YFBTJSLEY623J7CRMAM77KOZMQKMOLLHZA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.931241638 (263h27m20.482712109s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.939822769 (263h27m20.49129323s) [noise=true , address=81.171.14.70:4029 , piece_id=WXAQ7CIDAZMB2J2GHSMZ532DAMVAJRBNRP3VT7YSY4HJLGZDBX6Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.042469878 (263h27m20.593940339s) [noise=true , address=89.149.201.147:4005 , piece_id=7NYFIWT6B2AO3XCWMMI4TZYM7NROZRLMOLJTKMZYIMCNS6PKIYIQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.044590426 (263h27m20.596060887s) [noise=true , address=89.149.201.147:4020 , piece_id=SSNUBTKK3UIRO2TQY4CIEMM5DRSPC4RUXUEFDYCHK7FOSIHU5S7A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.081767748 (263h27m20.633238209s) [noise=true , address=89.149.201.147:4008 , piece_id=2NUEBJBDOHBC3YOEX53YH3SHG6XK5WI6WTNEJITLXZKDWLLOSARQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133782203 (263h27m20.685252664s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133874820 (263h27m20.685345281s) [seg_pos={0 0}, upload=232059]: Segment reached optimal threshold of 26 pieces. Nov 20 07:31:22.134328153 (263h27m20.685798624s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134338482 (263h27m20.685808943s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134362959 (263h27m20.68583342s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134385041 (263h27m20.685855502s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134417913 (263h27m20.685888364s) [seg_pos={0 0}, upload=232059]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 07:31:22.134530067 (263h27m20.686000528s) [upload=232059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 07:31:22.134536409 (263h27m20.68600687s) [upload=232059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 07:33:08.217836685 (263h29m6.769307177s) [upload=232059]: Done uploading segments... Nov 20 07:33:08.217918711 (263h29m6.769389162s) [upload=232059]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.548144707s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 5.73362262s trace: https://jaeger.dev.storj.io/trace/29eebe057654c99d FAIL (2025-11-20 08:12:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Nov 20 07:31:19.629873593 (263h27m18.181344064s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.633306430 (263h27m18.184776891s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.636780656 (263h27m18.188251117s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.639327946 (263h27m18.190798397s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.641216883 (263h27m18.192687334s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.645856578 (263h27m18.197327039s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.651699423 (263h27m18.203169894s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.653098288 (263h27m18.204568749s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.656601418 (263h27m18.208071899s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.659046414 (263h27m18.210516875s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:20.448435324 (263h27m18.999905785s) [upload=232059]: Next returned nil segment Nov 20 07:31:20.448449921 (263h27m18.999920373s) [upload=232059]: Waiting for error group managing segments... Nov 20 07:31:20.840686863 (263h27m19.392157314s) [noise=true , address=185.167.204.206:4047 , piece_id=AOJHHOC6D4ES5PSABO5CPOA6FFMQCWJSJC4SYRR4TBGE3ZW6WVYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.840944473 (263h27m19.392414934s) [noise=true , address=185.167.204.205:4009 , piece_id=PHZYFRVS7TV7P2TSPX7MMZ3H63VUEUNYLTDKYIRC7PA7YJ2MGJXQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.841171586 (263h27m19.392642047s) [noise=true , address=185.167.204.206:4061 , piece_id=ND4H2MBLMA7TRKNRPKWRV35RW7JBWOQ4W3TDUST35KQSUFMTUJVQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.845413794 (263h27m19.396884255s) [noise=true , address=185.167.204.206:4054 , piece_id=2FKWZRLJAX6LEUNCRXNH4R3MZ6DNY3VHVZ5JK5QEJZ76KD5EDRAA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.846588840 (263h27m19.398059302s) [noise=true , address=185.167.204.206:4072 , piece_id=25EIWSZDRFORHSBI6DXITGLG4JE3YNY6WWUOH4CIRASABTDW6CLA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.848580414 (263h27m19.400050875s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.849535923 (263h27m19.401006414s) [noise=true , address=185.167.204.206:4053 , piece_id=WOHYIAC6PUGDO7LH3WUAC6AZGDPGMSXQPYKFGFOJWRZMP7EFZWRQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853075914 (263h27m19.404546375s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853778040 (263h27m19.405248491s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.869053197 (263h27m19.420523658s) [noise=true , address=185.167.204.206:4058 , piece_id=SISDILWJPPH4JOHOTL3GKS6LEG3DSVWBSU6IWHZU5R3LCX57CE5A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.884471807 (263h27m19.435942268s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.891395812 (263h27m19.442866273s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.407423253 (263h27m19.958893714s) [noise=true , address=81.171.14.70:4046 , piece_id=OHLJUIVJXEARMXSQJAVQHNOUOFT3UMOWA2E2HOZBJD2CETJ6AVWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.434063861 (263h27m19.985534322s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.458913289 (263h27m20.01038375s) [noise=true , address=81.171.14.70:4027 , piece_id=26ZOOIR73NY4PAJQ3WSAU4ZCXMVYEOJDWSTS4PIDHHYVRPRJF44A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.480425362 (263h27m20.031895813s) [noise=true , address=81.171.14.70:4033 , piece_id=VVU5PQACV4GKY45RPB2C3NWUBYEX7ECQZN4W336ZYULO2CQHQSYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.487065786 (263h27m20.038536237s) [noise=true , address=81.171.14.70:4032 , piece_id=2NLDGLW73R6LJ7XNNAJYRTVPLCCSMOAHGBKIKI7TEOKI4L2T6XWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.504477020 (263h27m20.055947481s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.891152100 (263h27m20.442622561s) [noise=true , address=81.171.14.70:4031 , piece_id=JWMOD7NPWBUIK2ZQAER3YFMZQNDXZKFP345L66NVGKV7EKI7DLOQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.903537184 (263h27m20.455007645s) [noise=true , address=81.171.14.70:4034 , piece_id=K2P6O2RPHOR433TRB7YFBTJSLEY623J7CRMAM77KOZMQKMOLLHZA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.931241638 (263h27m20.482712109s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.939822769 (263h27m20.49129323s) [noise=true , address=81.171.14.70:4029 , piece_id=WXAQ7CIDAZMB2J2GHSMZ532DAMVAJRBNRP3VT7YSY4HJLGZDBX6Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.042469878 (263h27m20.593940339s) [noise=true , address=89.149.201.147:4005 , piece_id=7NYFIWT6B2AO3XCWMMI4TZYM7NROZRLMOLJTKMZYIMCNS6PKIYIQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.044590426 (263h27m20.596060887s) [noise=true , address=89.149.201.147:4020 , piece_id=SSNUBTKK3UIRO2TQY4CIEMM5DRSPC4RUXUEFDYCHK7FOSIHU5S7A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.081767748 (263h27m20.633238209s) [noise=true , address=89.149.201.147:4008 , piece_id=2NUEBJBDOHBC3YOEX53YH3SHG6XK5WI6WTNEJITLXZKDWLLOSARQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133782203 (263h27m20.685252664s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133874820 (263h27m20.685345281s) [seg_pos={0 0}, upload=232059]: Segment reached optimal threshold of 26 pieces. Nov 20 07:31:22.134328153 (263h27m20.685798624s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134338482 (263h27m20.685808943s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134362959 (263h27m20.68583342s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134385041 (263h27m20.685855502s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134417913 (263h27m20.685888364s) [seg_pos={0 0}, upload=232059]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 07:31:22.134530067 (263h27m20.686000528s) [upload=232059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 07:31:22.134536409 (263h27m20.68600687s) [upload=232059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 07:33:08.217836685 (263h29m6.769307177s) [upload=232059]: Done uploading segments... Nov 20 07:33:08.217918711 (263h29m6.769389162s) [upload=232059]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.733697511s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 5.815182208s trace: https://jaeger.dev.storj.io/trace/29eebe057654c99d FAIL (2025-11-20 08:12:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Nov 20 07:31:19.629873593 (263h27m18.181344064s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.633306430 (263h27m18.184776891s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.636780656 (263h27m18.188251117s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.639327946 (263h27m18.190798397s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.641216883 (263h27m18.192687334s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.645856578 (263h27m18.197327039s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.651699423 (263h27m18.203169894s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.653098288 (263h27m18.204568749s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.656601418 (263h27m18.208071899s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.659046414 (263h27m18.210516875s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:20.448435324 (263h27m18.999905785s) [upload=232059]: Next returned nil segment Nov 20 07:31:20.448449921 (263h27m18.999920373s) [upload=232059]: Waiting for error group managing segments... Nov 20 07:31:20.840686863 (263h27m19.392157314s) [noise=true , address=185.167.204.206:4047 , piece_id=AOJHHOC6D4ES5PSABO5CPOA6FFMQCWJSJC4SYRR4TBGE3ZW6WVYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.840944473 (263h27m19.392414934s) [noise=true , address=185.167.204.205:4009 , piece_id=PHZYFRVS7TV7P2TSPX7MMZ3H63VUEUNYLTDKYIRC7PA7YJ2MGJXQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.841171586 (263h27m19.392642047s) [noise=true , address=185.167.204.206:4061 , piece_id=ND4H2MBLMA7TRKNRPKWRV35RW7JBWOQ4W3TDUST35KQSUFMTUJVQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.845413794 (263h27m19.396884255s) [noise=true , address=185.167.204.206:4054 , piece_id=2FKWZRLJAX6LEUNCRXNH4R3MZ6DNY3VHVZ5JK5QEJZ76KD5EDRAA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.846588840 (263h27m19.398059302s) [noise=true , address=185.167.204.206:4072 , piece_id=25EIWSZDRFORHSBI6DXITGLG4JE3YNY6WWUOH4CIRASABTDW6CLA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.848580414 (263h27m19.400050875s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.849535923 (263h27m19.401006414s) [noise=true , address=185.167.204.206:4053 , piece_id=WOHYIAC6PUGDO7LH3WUAC6AZGDPGMSXQPYKFGFOJWRZMP7EFZWRQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853075914 (263h27m19.404546375s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853778040 (263h27m19.405248491s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.869053197 (263h27m19.420523658s) [noise=true , address=185.167.204.206:4058 , piece_id=SISDILWJPPH4JOHOTL3GKS6LEG3DSVWBSU6IWHZU5R3LCX57CE5A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.884471807 (263h27m19.435942268s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.891395812 (263h27m19.442866273s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.407423253 (263h27m19.958893714s) [noise=true , address=81.171.14.70:4046 , piece_id=OHLJUIVJXEARMXSQJAVQHNOUOFT3UMOWA2E2HOZBJD2CETJ6AVWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.434063861 (263h27m19.985534322s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.458913289 (263h27m20.01038375s) [noise=true , address=81.171.14.70:4027 , piece_id=26ZOOIR73NY4PAJQ3WSAU4ZCXMVYEOJDWSTS4PIDHHYVRPRJF44A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.480425362 (263h27m20.031895813s) [noise=true , address=81.171.14.70:4033 , piece_id=VVU5PQACV4GKY45RPB2C3NWUBYEX7ECQZN4W336ZYULO2CQHQSYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.487065786 (263h27m20.038536237s) [noise=true , address=81.171.14.70:4032 , piece_id=2NLDGLW73R6LJ7XNNAJYRTVPLCCSMOAHGBKIKI7TEOKI4L2T6XWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.504477020 (263h27m20.055947481s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.891152100 (263h27m20.442622561s) [noise=true , address=81.171.14.70:4031 , piece_id=JWMOD7NPWBUIK2ZQAER3YFMZQNDXZKFP345L66NVGKV7EKI7DLOQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.903537184 (263h27m20.455007645s) [noise=true , address=81.171.14.70:4034 , piece_id=K2P6O2RPHOR433TRB7YFBTJSLEY623J7CRMAM77KOZMQKMOLLHZA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.931241638 (263h27m20.482712109s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.939822769 (263h27m20.49129323s) [noise=true , address=81.171.14.70:4029 , piece_id=WXAQ7CIDAZMB2J2GHSMZ532DAMVAJRBNRP3VT7YSY4HJLGZDBX6Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.042469878 (263h27m20.593940339s) [noise=true , address=89.149.201.147:4005 , piece_id=7NYFIWT6B2AO3XCWMMI4TZYM7NROZRLMOLJTKMZYIMCNS6PKIYIQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.044590426 (263h27m20.596060887s) [noise=true , address=89.149.201.147:4020 , piece_id=SSNUBTKK3UIRO2TQY4CIEMM5DRSPC4RUXUEFDYCHK7FOSIHU5S7A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.081767748 (263h27m20.633238209s) [noise=true , address=89.149.201.147:4008 , piece_id=2NUEBJBDOHBC3YOEX53YH3SHG6XK5WI6WTNEJITLXZKDWLLOSARQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133782203 (263h27m20.685252664s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133874820 (263h27m20.685345281s) [seg_pos={0 0}, upload=232059]: Segment reached optimal threshold of 26 pieces. Nov 20 07:31:22.134328153 (263h27m20.685798624s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134338482 (263h27m20.685808943s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134362959 (263h27m20.68583342s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134385041 (263h27m20.685855502s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134417913 (263h27m20.685888364s) [seg_pos={0 0}, upload=232059]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 07:31:22.134530067 (263h27m20.686000528s) [upload=232059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 07:31:22.134536409 (263h27m20.68600687s) [upload=232059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 07:33:08.217836685 (263h29m6.769307177s) [upload=232059]: Done uploading segments... Nov 20 07:33:08.217918711 (263h29m6.769389162s) [upload=232059]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.815228637s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 5.747251915s trace: https://jaeger.dev.storj.io/trace/29eebe057654c99d FAIL (2025-11-20 08:11:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Nov 20 07:31:19.629873593 (263h27m18.181344064s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.633306430 (263h27m18.184776891s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.636780656 (263h27m18.188251117s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.639327946 (263h27m18.190798397s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.641216883 (263h27m18.192687334s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.645856578 (263h27m18.197327039s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.651699423 (263h27m18.203169894s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.653098288 (263h27m18.204568749s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.656601418 (263h27m18.208071899s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.659046414 (263h27m18.210516875s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:20.448435324 (263h27m18.999905785s) [upload=232059]: Next returned nil segment Nov 20 07:31:20.448449921 (263h27m18.999920373s) [upload=232059]: Waiting for error group managing segments... Nov 20 07:31:20.840686863 (263h27m19.392157314s) [noise=true , address=185.167.204.206:4047 , piece_id=AOJHHOC6D4ES5PSABO5CPOA6FFMQCWJSJC4SYRR4TBGE3ZW6WVYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.840944473 (263h27m19.392414934s) [noise=true , address=185.167.204.205:4009 , piece_id=PHZYFRVS7TV7P2TSPX7MMZ3H63VUEUNYLTDKYIRC7PA7YJ2MGJXQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.841171586 (263h27m19.392642047s) [noise=true , address=185.167.204.206:4061 , piece_id=ND4H2MBLMA7TRKNRPKWRV35RW7JBWOQ4W3TDUST35KQSUFMTUJVQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.845413794 (263h27m19.396884255s) [noise=true , address=185.167.204.206:4054 , piece_id=2FKWZRLJAX6LEUNCRXNH4R3MZ6DNY3VHVZ5JK5QEJZ76KD5EDRAA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.846588840 (263h27m19.398059302s) [noise=true , address=185.167.204.206:4072 , piece_id=25EIWSZDRFORHSBI6DXITGLG4JE3YNY6WWUOH4CIRASABTDW6CLA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.848580414 (263h27m19.400050875s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.849535923 (263h27m19.401006414s) [noise=true , address=185.167.204.206:4053 , piece_id=WOHYIAC6PUGDO7LH3WUAC6AZGDPGMSXQPYKFGFOJWRZMP7EFZWRQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853075914 (263h27m19.404546375s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853778040 (263h27m19.405248491s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.869053197 (263h27m19.420523658s) [noise=true , address=185.167.204.206:4058 , piece_id=SISDILWJPPH4JOHOTL3GKS6LEG3DSVWBSU6IWHZU5R3LCX57CE5A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.884471807 (263h27m19.435942268s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.891395812 (263h27m19.442866273s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.407423253 (263h27m19.958893714s) [noise=true , address=81.171.14.70:4046 , piece_id=OHLJUIVJXEARMXSQJAVQHNOUOFT3UMOWA2E2HOZBJD2CETJ6AVWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.434063861 (263h27m19.985534322s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.458913289 (263h27m20.01038375s) [noise=true , address=81.171.14.70:4027 , piece_id=26ZOOIR73NY4PAJQ3WSAU4ZCXMVYEOJDWSTS4PIDHHYVRPRJF44A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.480425362 (263h27m20.031895813s) [noise=true , address=81.171.14.70:4033 , piece_id=VVU5PQACV4GKY45RPB2C3NWUBYEX7ECQZN4W336ZYULO2CQHQSYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.487065786 (263h27m20.038536237s) [noise=true , address=81.171.14.70:4032 , piece_id=2NLDGLW73R6LJ7XNNAJYRTVPLCCSMOAHGBKIKI7TEOKI4L2T6XWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.504477020 (263h27m20.055947481s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.891152100 (263h27m20.442622561s) [noise=true , address=81.171.14.70:4031 , piece_id=JWMOD7NPWBUIK2ZQAER3YFMZQNDXZKFP345L66NVGKV7EKI7DLOQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.903537184 (263h27m20.455007645s) [noise=true , address=81.171.14.70:4034 , piece_id=K2P6O2RPHOR433TRB7YFBTJSLEY623J7CRMAM77KOZMQKMOLLHZA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.931241638 (263h27m20.482712109s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.939822769 (263h27m20.49129323s) [noise=true , address=81.171.14.70:4029 , piece_id=WXAQ7CIDAZMB2J2GHSMZ532DAMVAJRBNRP3VT7YSY4HJLGZDBX6Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.042469878 (263h27m20.593940339s) [noise=true , address=89.149.201.147:4005 , piece_id=7NYFIWT6B2AO3XCWMMI4TZYM7NROZRLMOLJTKMZYIMCNS6PKIYIQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.044590426 (263h27m20.596060887s) [noise=true , address=89.149.201.147:4020 , piece_id=SSNUBTKK3UIRO2TQY4CIEMM5DRSPC4RUXUEFDYCHK7FOSIHU5S7A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.081767748 (263h27m20.633238209s) [noise=true , address=89.149.201.147:4008 , piece_id=2NUEBJBDOHBC3YOEX53YH3SHG6XK5WI6WTNEJITLXZKDWLLOSARQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133782203 (263h27m20.685252664s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133874820 (263h27m20.685345281s) [seg_pos={0 0}, upload=232059]: Segment reached optimal threshold of 26 pieces. Nov 20 07:31:22.134328153 (263h27m20.685798624s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134338482 (263h27m20.685808943s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134362959 (263h27m20.68583342s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134385041 (263h27m20.685855502s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134417913 (263h27m20.685888364s) [seg_pos={0 0}, upload=232059]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 07:31:22.134530067 (263h27m20.686000528s) [upload=232059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 07:31:22.134536409 (263h27m20.68600687s) [upload=232059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 07:33:08.217836685 (263h29m6.769307177s) [upload=232059]: Done uploading segments... Nov 20 07:33:08.217918711 (263h29m6.769389162s) [upload=232059]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.747285047s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 5.761683837s trace: https://jaeger.dev.storj.io/trace/29eebe057654c99d FAIL (2025-11-20 08:10:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Nov 20 07:31:19.629873593 (263h27m18.181344064s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.633306430 (263h27m18.184776891s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.636780656 (263h27m18.188251117s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.639327946 (263h27m18.190798397s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.641216883 (263h27m18.192687334s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.645856578 (263h27m18.197327039s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.651699423 (263h27m18.203169894s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.653098288 (263h27m18.204568749s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.656601418 (263h27m18.208071899s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.659046414 (263h27m18.210516875s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:20.448435324 (263h27m18.999905785s) [upload=232059]: Next returned nil segment Nov 20 07:31:20.448449921 (263h27m18.999920373s) [upload=232059]: Waiting for error group managing segments... Nov 20 07:31:20.840686863 (263h27m19.392157314s) [noise=true , address=185.167.204.206:4047 , piece_id=AOJHHOC6D4ES5PSABO5CPOA6FFMQCWJSJC4SYRR4TBGE3ZW6WVYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.840944473 (263h27m19.392414934s) [noise=true , address=185.167.204.205:4009 , piece_id=PHZYFRVS7TV7P2TSPX7MMZ3H63VUEUNYLTDKYIRC7PA7YJ2MGJXQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.841171586 (263h27m19.392642047s) [noise=true , address=185.167.204.206:4061 , piece_id=ND4H2MBLMA7TRKNRPKWRV35RW7JBWOQ4W3TDUST35KQSUFMTUJVQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.845413794 (263h27m19.396884255s) [noise=true , address=185.167.204.206:4054 , piece_id=2FKWZRLJAX6LEUNCRXNH4R3MZ6DNY3VHVZ5JK5QEJZ76KD5EDRAA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.846588840 (263h27m19.398059302s) [noise=true , address=185.167.204.206:4072 , piece_id=25EIWSZDRFORHSBI6DXITGLG4JE3YNY6WWUOH4CIRASABTDW6CLA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.848580414 (263h27m19.400050875s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.849535923 (263h27m19.401006414s) [noise=true , address=185.167.204.206:4053 , piece_id=WOHYIAC6PUGDO7LH3WUAC6AZGDPGMSXQPYKFGFOJWRZMP7EFZWRQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853075914 (263h27m19.404546375s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853778040 (263h27m19.405248491s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.869053197 (263h27m19.420523658s) [noise=true , address=185.167.204.206:4058 , piece_id=SISDILWJPPH4JOHOTL3GKS6LEG3DSVWBSU6IWHZU5R3LCX57CE5A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.884471807 (263h27m19.435942268s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.891395812 (263h27m19.442866273s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.407423253 (263h27m19.958893714s) [noise=true , address=81.171.14.70:4046 , piece_id=OHLJUIVJXEARMXSQJAVQHNOUOFT3UMOWA2E2HOZBJD2CETJ6AVWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.434063861 (263h27m19.985534322s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.458913289 (263h27m20.01038375s) [noise=true , address=81.171.14.70:4027 , piece_id=26ZOOIR73NY4PAJQ3WSAU4ZCXMVYEOJDWSTS4PIDHHYVRPRJF44A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.480425362 (263h27m20.031895813s) [noise=true , address=81.171.14.70:4033 , piece_id=VVU5PQACV4GKY45RPB2C3NWUBYEX7ECQZN4W336ZYULO2CQHQSYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.487065786 (263h27m20.038536237s) [noise=true , address=81.171.14.70:4032 , piece_id=2NLDGLW73R6LJ7XNNAJYRTVPLCCSMOAHGBKIKI7TEOKI4L2T6XWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.504477020 (263h27m20.055947481s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.891152100 (263h27m20.442622561s) [noise=true , address=81.171.14.70:4031 , piece_id=JWMOD7NPWBUIK2ZQAER3YFMZQNDXZKFP345L66NVGKV7EKI7DLOQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.903537184 (263h27m20.455007645s) [noise=true , address=81.171.14.70:4034 , piece_id=K2P6O2RPHOR433TRB7YFBTJSLEY623J7CRMAM77KOZMQKMOLLHZA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.931241638 (263h27m20.482712109s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.939822769 (263h27m20.49129323s) [noise=true , address=81.171.14.70:4029 , piece_id=WXAQ7CIDAZMB2J2GHSMZ532DAMVAJRBNRP3VT7YSY4HJLGZDBX6Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.042469878 (263h27m20.593940339s) [noise=true , address=89.149.201.147:4005 , piece_id=7NYFIWT6B2AO3XCWMMI4TZYM7NROZRLMOLJTKMZYIMCNS6PKIYIQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.044590426 (263h27m20.596060887s) [noise=true , address=89.149.201.147:4020 , piece_id=SSNUBTKK3UIRO2TQY4CIEMM5DRSPC4RUXUEFDYCHK7FOSIHU5S7A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.081767748 (263h27m20.633238209s) [noise=true , address=89.149.201.147:4008 , piece_id=2NUEBJBDOHBC3YOEX53YH3SHG6XK5WI6WTNEJITLXZKDWLLOSARQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133782203 (263h27m20.685252664s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133874820 (263h27m20.685345281s) [seg_pos={0 0}, upload=232059]: Segment reached optimal threshold of 26 pieces. Nov 20 07:31:22.134328153 (263h27m20.685798624s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134338482 (263h27m20.685808943s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134362959 (263h27m20.68583342s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134385041 (263h27m20.685855502s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134417913 (263h27m20.685888364s) [seg_pos={0 0}, upload=232059]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 07:31:22.134530067 (263h27m20.686000528s) [upload=232059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 07:31:22.134536409 (263h27m20.68600687s) [upload=232059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 07:33:08.217836685 (263h29m6.769307177s) [upload=232059]: Done uploading segments... Nov 20 07:33:08.217918711 (263h29m6.769389162s) [upload=232059]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.761710819s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 5.728251564s trace: https://jaeger.dev.storj.io/trace/29eebe057654c99d FAIL (2025-11-20 08:09:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Nov 20 07:31:19.629873593 (263h27m18.181344064s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.633306430 (263h27m18.184776891s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.636780656 (263h27m18.188251117s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.639327946 (263h27m18.190798397s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.641216883 (263h27m18.192687334s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.645856578 (263h27m18.197327039s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.651699423 (263h27m18.203169894s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.653098288 (263h27m18.204568749s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.656601418 (263h27m18.208071899s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.659046414 (263h27m18.210516875s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:20.448435324 (263h27m18.999905785s) [upload=232059]: Next returned nil segment Nov 20 07:31:20.448449921 (263h27m18.999920373s) [upload=232059]: Waiting for error group managing segments... Nov 20 07:31:20.840686863 (263h27m19.392157314s) [noise=true , address=185.167.204.206:4047 , piece_id=AOJHHOC6D4ES5PSABO5CPOA6FFMQCWJSJC4SYRR4TBGE3ZW6WVYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.840944473 (263h27m19.392414934s) [noise=true , address=185.167.204.205:4009 , piece_id=PHZYFRVS7TV7P2TSPX7MMZ3H63VUEUNYLTDKYIRC7PA7YJ2MGJXQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.841171586 (263h27m19.392642047s) [noise=true , address=185.167.204.206:4061 , piece_id=ND4H2MBLMA7TRKNRPKWRV35RW7JBWOQ4W3TDUST35KQSUFMTUJVQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.845413794 (263h27m19.396884255s) [noise=true , address=185.167.204.206:4054 , piece_id=2FKWZRLJAX6LEUNCRXNH4R3MZ6DNY3VHVZ5JK5QEJZ76KD5EDRAA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.846588840 (263h27m19.398059302s) [noise=true , address=185.167.204.206:4072 , piece_id=25EIWSZDRFORHSBI6DXITGLG4JE3YNY6WWUOH4CIRASABTDW6CLA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.848580414 (263h27m19.400050875s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.849535923 (263h27m19.401006414s) [noise=true , address=185.167.204.206:4053 , piece_id=WOHYIAC6PUGDO7LH3WUAC6AZGDPGMSXQPYKFGFOJWRZMP7EFZWRQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853075914 (263h27m19.404546375s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853778040 (263h27m19.405248491s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.869053197 (263h27m19.420523658s) [noise=true , address=185.167.204.206:4058 , piece_id=SISDILWJPPH4JOHOTL3GKS6LEG3DSVWBSU6IWHZU5R3LCX57CE5A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.884471807 (263h27m19.435942268s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.891395812 (263h27m19.442866273s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.407423253 (263h27m19.958893714s) [noise=true , address=81.171.14.70:4046 , piece_id=OHLJUIVJXEARMXSQJAVQHNOUOFT3UMOWA2E2HOZBJD2CETJ6AVWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.434063861 (263h27m19.985534322s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.458913289 (263h27m20.01038375s) [noise=true , address=81.171.14.70:4027 , piece_id=26ZOOIR73NY4PAJQ3WSAU4ZCXMVYEOJDWSTS4PIDHHYVRPRJF44A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.480425362 (263h27m20.031895813s) [noise=true , address=81.171.14.70:4033 , piece_id=VVU5PQACV4GKY45RPB2C3NWUBYEX7ECQZN4W336ZYULO2CQHQSYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.487065786 (263h27m20.038536237s) [noise=true , address=81.171.14.70:4032 , piece_id=2NLDGLW73R6LJ7XNNAJYRTVPLCCSMOAHGBKIKI7TEOKI4L2T6XWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.504477020 (263h27m20.055947481s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.891152100 (263h27m20.442622561s) [noise=true , address=81.171.14.70:4031 , piece_id=JWMOD7NPWBUIK2ZQAER3YFMZQNDXZKFP345L66NVGKV7EKI7DLOQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.903537184 (263h27m20.455007645s) [noise=true , address=81.171.14.70:4034 , piece_id=K2P6O2RPHOR433TRB7YFBTJSLEY623J7CRMAM77KOZMQKMOLLHZA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.931241638 (263h27m20.482712109s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.939822769 (263h27m20.49129323s) [noise=true , address=81.171.14.70:4029 , piece_id=WXAQ7CIDAZMB2J2GHSMZ532DAMVAJRBNRP3VT7YSY4HJLGZDBX6Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.042469878 (263h27m20.593940339s) [noise=true , address=89.149.201.147:4005 , piece_id=7NYFIWT6B2AO3XCWMMI4TZYM7NROZRLMOLJTKMZYIMCNS6PKIYIQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.044590426 (263h27m20.596060887s) [noise=true , address=89.149.201.147:4020 , piece_id=SSNUBTKK3UIRO2TQY4CIEMM5DRSPC4RUXUEFDYCHK7FOSIHU5S7A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.081767748 (263h27m20.633238209s) [noise=true , address=89.149.201.147:4008 , piece_id=2NUEBJBDOHBC3YOEX53YH3SHG6XK5WI6WTNEJITLXZKDWLLOSARQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133782203 (263h27m20.685252664s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133874820 (263h27m20.685345281s) [seg_pos={0 0}, upload=232059]: Segment reached optimal threshold of 26 pieces. Nov 20 07:31:22.134328153 (263h27m20.685798624s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134338482 (263h27m20.685808943s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134362959 (263h27m20.68583342s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134385041 (263h27m20.685855502s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134417913 (263h27m20.685888364s) [seg_pos={0 0}, upload=232059]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 07:31:22.134530067 (263h27m20.686000528s) [upload=232059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 07:31:22.134536409 (263h27m20.68600687s) [upload=232059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 07:33:08.217836685 (263h29m6.769307177s) [upload=232059]: Done uploading segments... Nov 20 07:33:08.217918711 (263h29m6.769389162s) [upload=232059]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.728283276s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 5.907834503s trace: https://jaeger.dev.storj.io/trace/29eebe057654c99d FAIL (2025-11-20 08:08:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Nov 20 07:31:19.629873593 (263h27m18.181344064s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.633306430 (263h27m18.184776891s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.636780656 (263h27m18.188251117s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.639327946 (263h27m18.190798397s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.641216883 (263h27m18.192687334s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.645856578 (263h27m18.197327039s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.651699423 (263h27m18.203169894s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.653098288 (263h27m18.204568749s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.656601418 (263h27m18.208071899s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.659046414 (263h27m18.210516875s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:20.448435324 (263h27m18.999905785s) [upload=232059]: Next returned nil segment Nov 20 07:31:20.448449921 (263h27m18.999920373s) [upload=232059]: Waiting for error group managing segments... Nov 20 07:31:20.840686863 (263h27m19.392157314s) [noise=true , address=185.167.204.206:4047 , piece_id=AOJHHOC6D4ES5PSABO5CPOA6FFMQCWJSJC4SYRR4TBGE3ZW6WVYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.840944473 (263h27m19.392414934s) [noise=true , address=185.167.204.205:4009 , piece_id=PHZYFRVS7TV7P2TSPX7MMZ3H63VUEUNYLTDKYIRC7PA7YJ2MGJXQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.841171586 (263h27m19.392642047s) [noise=true , address=185.167.204.206:4061 , piece_id=ND4H2MBLMA7TRKNRPKWRV35RW7JBWOQ4W3TDUST35KQSUFMTUJVQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.845413794 (263h27m19.396884255s) [noise=true , address=185.167.204.206:4054 , piece_id=2FKWZRLJAX6LEUNCRXNH4R3MZ6DNY3VHVZ5JK5QEJZ76KD5EDRAA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.846588840 (263h27m19.398059302s) [noise=true , address=185.167.204.206:4072 , piece_id=25EIWSZDRFORHSBI6DXITGLG4JE3YNY6WWUOH4CIRASABTDW6CLA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.848580414 (263h27m19.400050875s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.849535923 (263h27m19.401006414s) [noise=true , address=185.167.204.206:4053 , piece_id=WOHYIAC6PUGDO7LH3WUAC6AZGDPGMSXQPYKFGFOJWRZMP7EFZWRQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853075914 (263h27m19.404546375s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853778040 (263h27m19.405248491s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.869053197 (263h27m19.420523658s) [noise=true , address=185.167.204.206:4058 , piece_id=SISDILWJPPH4JOHOTL3GKS6LEG3DSVWBSU6IWHZU5R3LCX57CE5A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.884471807 (263h27m19.435942268s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.891395812 (263h27m19.442866273s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.407423253 (263h27m19.958893714s) [noise=true , address=81.171.14.70:4046 , piece_id=OHLJUIVJXEARMXSQJAVQHNOUOFT3UMOWA2E2HOZBJD2CETJ6AVWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.434063861 (263h27m19.985534322s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.458913289 (263h27m20.01038375s) [noise=true , address=81.171.14.70:4027 , piece_id=26ZOOIR73NY4PAJQ3WSAU4ZCXMVYEOJDWSTS4PIDHHYVRPRJF44A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.480425362 (263h27m20.031895813s) [noise=true , address=81.171.14.70:4033 , piece_id=VVU5PQACV4GKY45RPB2C3NWUBYEX7ECQZN4W336ZYULO2CQHQSYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.487065786 (263h27m20.038536237s) [noise=true , address=81.171.14.70:4032 , piece_id=2NLDGLW73R6LJ7XNNAJYRTVPLCCSMOAHGBKIKI7TEOKI4L2T6XWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.504477020 (263h27m20.055947481s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.891152100 (263h27m20.442622561s) [noise=true , address=81.171.14.70:4031 , piece_id=JWMOD7NPWBUIK2ZQAER3YFMZQNDXZKFP345L66NVGKV7EKI7DLOQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.903537184 (263h27m20.455007645s) [noise=true , address=81.171.14.70:4034 , piece_id=K2P6O2RPHOR433TRB7YFBTJSLEY623J7CRMAM77KOZMQKMOLLHZA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.931241638 (263h27m20.482712109s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.939822769 (263h27m20.49129323s) [noise=true , address=81.171.14.70:4029 , piece_id=WXAQ7CIDAZMB2J2GHSMZ532DAMVAJRBNRP3VT7YSY4HJLGZDBX6Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.042469878 (263h27m20.593940339s) [noise=true , address=89.149.201.147:4005 , piece_id=7NYFIWT6B2AO3XCWMMI4TZYM7NROZRLMOLJTKMZYIMCNS6PKIYIQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.044590426 (263h27m20.596060887s) [noise=true , address=89.149.201.147:4020 , piece_id=SSNUBTKK3UIRO2TQY4CIEMM5DRSPC4RUXUEFDYCHK7FOSIHU5S7A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.081767748 (263h27m20.633238209s) [noise=true , address=89.149.201.147:4008 , piece_id=2NUEBJBDOHBC3YOEX53YH3SHG6XK5WI6WTNEJITLXZKDWLLOSARQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133782203 (263h27m20.685252664s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133874820 (263h27m20.685345281s) [seg_pos={0 0}, upload=232059]: Segment reached optimal threshold of 26 pieces. Nov 20 07:31:22.134328153 (263h27m20.685798624s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134338482 (263h27m20.685808943s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134362959 (263h27m20.68583342s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134385041 (263h27m20.685855502s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134417913 (263h27m20.685888364s) [seg_pos={0 0}, upload=232059]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 07:31:22.134530067 (263h27m20.686000528s) [upload=232059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 07:31:22.134536409 (263h27m20.68600687s) [upload=232059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 07:33:08.217836685 (263h29m6.769307177s) [upload=232059]: Done uploading segments... Nov 20 07:33:08.217918711 (263h29m6.769389162s) [upload=232059]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.907866765s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 5.730492771s trace: https://jaeger.dev.storj.io/trace/29eebe057654c99d FAIL (2025-11-20 08:07:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Nov 20 07:31:19.629873593 (263h27m18.181344064s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.633306430 (263h27m18.184776891s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.636780656 (263h27m18.188251117s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.639327946 (263h27m18.190798397s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.641216883 (263h27m18.192687334s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.645856578 (263h27m18.197327039s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.651699423 (263h27m18.203169894s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.653098288 (263h27m18.204568749s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.656601418 (263h27m18.208071899s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.659046414 (263h27m18.210516875s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:20.448435324 (263h27m18.999905785s) [upload=232059]: Next returned nil segment Nov 20 07:31:20.448449921 (263h27m18.999920373s) [upload=232059]: Waiting for error group managing segments... Nov 20 07:31:20.840686863 (263h27m19.392157314s) [noise=true , address=185.167.204.206:4047 , piece_id=AOJHHOC6D4ES5PSABO5CPOA6FFMQCWJSJC4SYRR4TBGE3ZW6WVYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.840944473 (263h27m19.392414934s) [noise=true , address=185.167.204.205:4009 , piece_id=PHZYFRVS7TV7P2TSPX7MMZ3H63VUEUNYLTDKYIRC7PA7YJ2MGJXQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.841171586 (263h27m19.392642047s) [noise=true , address=185.167.204.206:4061 , piece_id=ND4H2MBLMA7TRKNRPKWRV35RW7JBWOQ4W3TDUST35KQSUFMTUJVQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.845413794 (263h27m19.396884255s) [noise=true , address=185.167.204.206:4054 , piece_id=2FKWZRLJAX6LEUNCRXNH4R3MZ6DNY3VHVZ5JK5QEJZ76KD5EDRAA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.846588840 (263h27m19.398059302s) [noise=true , address=185.167.204.206:4072 , piece_id=25EIWSZDRFORHSBI6DXITGLG4JE3YNY6WWUOH4CIRASABTDW6CLA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.848580414 (263h27m19.400050875s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.849535923 (263h27m19.401006414s) [noise=true , address=185.167.204.206:4053 , piece_id=WOHYIAC6PUGDO7LH3WUAC6AZGDPGMSXQPYKFGFOJWRZMP7EFZWRQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853075914 (263h27m19.404546375s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853778040 (263h27m19.405248491s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.869053197 (263h27m19.420523658s) [noise=true , address=185.167.204.206:4058 , piece_id=SISDILWJPPH4JOHOTL3GKS6LEG3DSVWBSU6IWHZU5R3LCX57CE5A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.884471807 (263h27m19.435942268s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.891395812 (263h27m19.442866273s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.407423253 (263h27m19.958893714s) [noise=true , address=81.171.14.70:4046 , piece_id=OHLJUIVJXEARMXSQJAVQHNOUOFT3UMOWA2E2HOZBJD2CETJ6AVWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.434063861 (263h27m19.985534322s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.458913289 (263h27m20.01038375s) [noise=true , address=81.171.14.70:4027 , piece_id=26ZOOIR73NY4PAJQ3WSAU4ZCXMVYEOJDWSTS4PIDHHYVRPRJF44A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.480425362 (263h27m20.031895813s) [noise=true , address=81.171.14.70:4033 , piece_id=VVU5PQACV4GKY45RPB2C3NWUBYEX7ECQZN4W336ZYULO2CQHQSYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.487065786 (263h27m20.038536237s) [noise=true , address=81.171.14.70:4032 , piece_id=2NLDGLW73R6LJ7XNNAJYRTVPLCCSMOAHGBKIKI7TEOKI4L2T6XWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.504477020 (263h27m20.055947481s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.891152100 (263h27m20.442622561s) [noise=true , address=81.171.14.70:4031 , piece_id=JWMOD7NPWBUIK2ZQAER3YFMZQNDXZKFP345L66NVGKV7EKI7DLOQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.903537184 (263h27m20.455007645s) [noise=true , address=81.171.14.70:4034 , piece_id=K2P6O2RPHOR433TRB7YFBTJSLEY623J7CRMAM77KOZMQKMOLLHZA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.931241638 (263h27m20.482712109s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.939822769 (263h27m20.49129323s) [noise=true , address=81.171.14.70:4029 , piece_id=WXAQ7CIDAZMB2J2GHSMZ532DAMVAJRBNRP3VT7YSY4HJLGZDBX6Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.042469878 (263h27m20.593940339s) [noise=true , address=89.149.201.147:4005 , piece_id=7NYFIWT6B2AO3XCWMMI4TZYM7NROZRLMOLJTKMZYIMCNS6PKIYIQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.044590426 (263h27m20.596060887s) [noise=true , address=89.149.201.147:4020 , piece_id=SSNUBTKK3UIRO2TQY4CIEMM5DRSPC4RUXUEFDYCHK7FOSIHU5S7A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.081767748 (263h27m20.633238209s) [noise=true , address=89.149.201.147:4008 , piece_id=2NUEBJBDOHBC3YOEX53YH3SHG6XK5WI6WTNEJITLXZKDWLLOSARQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133782203 (263h27m20.685252664s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133874820 (263h27m20.685345281s) [seg_pos={0 0}, upload=232059]: Segment reached optimal threshold of 26 pieces. Nov 20 07:31:22.134328153 (263h27m20.685798624s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134338482 (263h27m20.685808943s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134362959 (263h27m20.68583342s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134385041 (263h27m20.685855502s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134417913 (263h27m20.685888364s) [seg_pos={0 0}, upload=232059]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 07:31:22.134530067 (263h27m20.686000528s) [upload=232059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 07:31:22.134536409 (263h27m20.68600687s) [upload=232059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 07:33:08.217836685 (263h29m6.769307177s) [upload=232059]: Done uploading segments... Nov 20 07:33:08.217918711 (263h29m6.769389162s) [upload=232059]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.730524533s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 6.264558409s trace: https://jaeger.dev.storj.io/trace/29eebe057654c99d FAIL (2025-11-20 08:06:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Nov 20 07:31:19.629873593 (263h27m18.181344064s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.633306430 (263h27m18.184776891s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.636780656 (263h27m18.188251117s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.639327946 (263h27m18.190798397s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.641216883 (263h27m18.192687334s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.645856578 (263h27m18.197327039s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.651699423 (263h27m18.203169894s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.653098288 (263h27m18.204568749s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.656601418 (263h27m18.208071899s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.659046414 (263h27m18.210516875s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:20.448435324 (263h27m18.999905785s) [upload=232059]: Next returned nil segment Nov 20 07:31:20.448449921 (263h27m18.999920373s) [upload=232059]: Waiting for error group managing segments... Nov 20 07:31:20.840686863 (263h27m19.392157314s) [noise=true , address=185.167.204.206:4047 , piece_id=AOJHHOC6D4ES5PSABO5CPOA6FFMQCWJSJC4SYRR4TBGE3ZW6WVYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.840944473 (263h27m19.392414934s) [noise=true , address=185.167.204.205:4009 , piece_id=PHZYFRVS7TV7P2TSPX7MMZ3H63VUEUNYLTDKYIRC7PA7YJ2MGJXQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.841171586 (263h27m19.392642047s) [noise=true , address=185.167.204.206:4061 , piece_id=ND4H2MBLMA7TRKNRPKWRV35RW7JBWOQ4W3TDUST35KQSUFMTUJVQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.845413794 (263h27m19.396884255s) [noise=true , address=185.167.204.206:4054 , piece_id=2FKWZRLJAX6LEUNCRXNH4R3MZ6DNY3VHVZ5JK5QEJZ76KD5EDRAA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.846588840 (263h27m19.398059302s) [noise=true , address=185.167.204.206:4072 , piece_id=25EIWSZDRFORHSBI6DXITGLG4JE3YNY6WWUOH4CIRASABTDW6CLA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.848580414 (263h27m19.400050875s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.849535923 (263h27m19.401006414s) [noise=true , address=185.167.204.206:4053 , piece_id=WOHYIAC6PUGDO7LH3WUAC6AZGDPGMSXQPYKFGFOJWRZMP7EFZWRQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853075914 (263h27m19.404546375s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853778040 (263h27m19.405248491s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.869053197 (263h27m19.420523658s) [noise=true , address=185.167.204.206:4058 , piece_id=SISDILWJPPH4JOHOTL3GKS6LEG3DSVWBSU6IWHZU5R3LCX57CE5A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.884471807 (263h27m19.435942268s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.891395812 (263h27m19.442866273s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.407423253 (263h27m19.958893714s) [noise=true , address=81.171.14.70:4046 , piece_id=OHLJUIVJXEARMXSQJAVQHNOUOFT3UMOWA2E2HOZBJD2CETJ6AVWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.434063861 (263h27m19.985534322s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.458913289 (263h27m20.01038375s) [noise=true , address=81.171.14.70:4027 , piece_id=26ZOOIR73NY4PAJQ3WSAU4ZCXMVYEOJDWSTS4PIDHHYVRPRJF44A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.480425362 (263h27m20.031895813s) [noise=true , address=81.171.14.70:4033 , piece_id=VVU5PQACV4GKY45RPB2C3NWUBYEX7ECQZN4W336ZYULO2CQHQSYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.487065786 (263h27m20.038536237s) [noise=true , address=81.171.14.70:4032 , piece_id=2NLDGLW73R6LJ7XNNAJYRTVPLCCSMOAHGBKIKI7TEOKI4L2T6XWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.504477020 (263h27m20.055947481s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.891152100 (263h27m20.442622561s) [noise=true , address=81.171.14.70:4031 , piece_id=JWMOD7NPWBUIK2ZQAER3YFMZQNDXZKFP345L66NVGKV7EKI7DLOQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.903537184 (263h27m20.455007645s) [noise=true , address=81.171.14.70:4034 , piece_id=K2P6O2RPHOR433TRB7YFBTJSLEY623J7CRMAM77KOZMQKMOLLHZA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.931241638 (263h27m20.482712109s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.939822769 (263h27m20.49129323s) [noise=true , address=81.171.14.70:4029 , piece_id=WXAQ7CIDAZMB2J2GHSMZ532DAMVAJRBNRP3VT7YSY4HJLGZDBX6Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.042469878 (263h27m20.593940339s) [noise=true , address=89.149.201.147:4005 , piece_id=7NYFIWT6B2AO3XCWMMI4TZYM7NROZRLMOLJTKMZYIMCNS6PKIYIQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.044590426 (263h27m20.596060887s) [noise=true , address=89.149.201.147:4020 , piece_id=SSNUBTKK3UIRO2TQY4CIEMM5DRSPC4RUXUEFDYCHK7FOSIHU5S7A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.081767748 (263h27m20.633238209s) [noise=true , address=89.149.201.147:4008 , piece_id=2NUEBJBDOHBC3YOEX53YH3SHG6XK5WI6WTNEJITLXZKDWLLOSARQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133782203 (263h27m20.685252664s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133874820 (263h27m20.685345281s) [seg_pos={0 0}, upload=232059]: Segment reached optimal threshold of 26 pieces. Nov 20 07:31:22.134328153 (263h27m20.685798624s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134338482 (263h27m20.685808943s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134362959 (263h27m20.68583342s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134385041 (263h27m20.685855502s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134417913 (263h27m20.685888364s) [seg_pos={0 0}, upload=232059]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 07:31:22.134530067 (263h27m20.686000528s) [upload=232059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 07:31:22.134536409 (263h27m20.68600687s) [upload=232059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 07:33:08.217836685 (263h29m6.769307177s) [upload=232059]: Done uploading segments... Nov 20 07:33:08.217918711 (263h29m6.769389162s) [upload=232059]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.264581482s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 5.766107111s trace: https://jaeger.dev.storj.io/trace/29eebe057654c99d FAIL (2025-11-20 08:06:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Nov 20 07:31:19.629873593 (263h27m18.181344064s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.633306430 (263h27m18.184776891s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.636780656 (263h27m18.188251117s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.639327946 (263h27m18.190798397s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.641216883 (263h27m18.192687334s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.645856578 (263h27m18.197327039s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.651699423 (263h27m18.203169894s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.653098288 (263h27m18.204568749s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.656601418 (263h27m18.208071899s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.659046414 (263h27m18.210516875s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:20.448435324 (263h27m18.999905785s) [upload=232059]: Next returned nil segment Nov 20 07:31:20.448449921 (263h27m18.999920373s) [upload=232059]: Waiting for error group managing segments... Nov 20 07:31:20.840686863 (263h27m19.392157314s) [noise=true , address=185.167.204.206:4047 , piece_id=AOJHHOC6D4ES5PSABO5CPOA6FFMQCWJSJC4SYRR4TBGE3ZW6WVYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.840944473 (263h27m19.392414934s) [noise=true , address=185.167.204.205:4009 , piece_id=PHZYFRVS7TV7P2TSPX7MMZ3H63VUEUNYLTDKYIRC7PA7YJ2MGJXQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.841171586 (263h27m19.392642047s) [noise=true , address=185.167.204.206:4061 , piece_id=ND4H2MBLMA7TRKNRPKWRV35RW7JBWOQ4W3TDUST35KQSUFMTUJVQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.845413794 (263h27m19.396884255s) [noise=true , address=185.167.204.206:4054 , piece_id=2FKWZRLJAX6LEUNCRXNH4R3MZ6DNY3VHVZ5JK5QEJZ76KD5EDRAA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.846588840 (263h27m19.398059302s) [noise=true , address=185.167.204.206:4072 , piece_id=25EIWSZDRFORHSBI6DXITGLG4JE3YNY6WWUOH4CIRASABTDW6CLA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.848580414 (263h27m19.400050875s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.849535923 (263h27m19.401006414s) [noise=true , address=185.167.204.206:4053 , piece_id=WOHYIAC6PUGDO7LH3WUAC6AZGDPGMSXQPYKFGFOJWRZMP7EFZWRQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853075914 (263h27m19.404546375s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853778040 (263h27m19.405248491s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.869053197 (263h27m19.420523658s) [noise=true , address=185.167.204.206:4058 , piece_id=SISDILWJPPH4JOHOTL3GKS6LEG3DSVWBSU6IWHZU5R3LCX57CE5A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.884471807 (263h27m19.435942268s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.891395812 (263h27m19.442866273s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.407423253 (263h27m19.958893714s) [noise=true , address=81.171.14.70:4046 , piece_id=OHLJUIVJXEARMXSQJAVQHNOUOFT3UMOWA2E2HOZBJD2CETJ6AVWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.434063861 (263h27m19.985534322s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.458913289 (263h27m20.01038375s) [noise=true , address=81.171.14.70:4027 , piece_id=26ZOOIR73NY4PAJQ3WSAU4ZCXMVYEOJDWSTS4PIDHHYVRPRJF44A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.480425362 (263h27m20.031895813s) [noise=true , address=81.171.14.70:4033 , piece_id=VVU5PQACV4GKY45RPB2C3NWUBYEX7ECQZN4W336ZYULO2CQHQSYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.487065786 (263h27m20.038536237s) [noise=true , address=81.171.14.70:4032 , piece_id=2NLDGLW73R6LJ7XNNAJYRTVPLCCSMOAHGBKIKI7TEOKI4L2T6XWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.504477020 (263h27m20.055947481s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.891152100 (263h27m20.442622561s) [noise=true , address=81.171.14.70:4031 , piece_id=JWMOD7NPWBUIK2ZQAER3YFMZQNDXZKFP345L66NVGKV7EKI7DLOQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.903537184 (263h27m20.455007645s) [noise=true , address=81.171.14.70:4034 , piece_id=K2P6O2RPHOR433TRB7YFBTJSLEY623J7CRMAM77KOZMQKMOLLHZA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.931241638 (263h27m20.482712109s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.939822769 (263h27m20.49129323s) [noise=true , address=81.171.14.70:4029 , piece_id=WXAQ7CIDAZMB2J2GHSMZ532DAMVAJRBNRP3VT7YSY4HJLGZDBX6Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.042469878 (263h27m20.593940339s) [noise=true , address=89.149.201.147:4005 , piece_id=7NYFIWT6B2AO3XCWMMI4TZYM7NROZRLMOLJTKMZYIMCNS6PKIYIQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.044590426 (263h27m20.596060887s) [noise=true , address=89.149.201.147:4020 , piece_id=SSNUBTKK3UIRO2TQY4CIEMM5DRSPC4RUXUEFDYCHK7FOSIHU5S7A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.081767748 (263h27m20.633238209s) [noise=true , address=89.149.201.147:4008 , piece_id=2NUEBJBDOHBC3YOEX53YH3SHG6XK5WI6WTNEJITLXZKDWLLOSARQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133782203 (263h27m20.685252664s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133874820 (263h27m20.685345281s) [seg_pos={0 0}, upload=232059]: Segment reached optimal threshold of 26 pieces. Nov 20 07:31:22.134328153 (263h27m20.685798624s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134338482 (263h27m20.685808943s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134362959 (263h27m20.68583342s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134385041 (263h27m20.685855502s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134417913 (263h27m20.685888364s) [seg_pos={0 0}, upload=232059]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 07:31:22.134530067 (263h27m20.686000528s) [upload=232059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 07:31:22.134536409 (263h27m20.68600687s) [upload=232059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 07:33:08.217836685 (263h29m6.769307177s) [upload=232059]: Done uploading segments... Nov 20 07:33:08.217918711 (263h29m6.769389162s) [upload=232059]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.766137399s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 6.29187901s trace: https://jaeger.dev.storj.io/trace/29eebe057654c99d FAIL (2025-11-20 08:04:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Nov 20 07:31:19.629873593 (263h27m18.181344064s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.633306430 (263h27m18.184776891s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.636780656 (263h27m18.188251117s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.639327946 (263h27m18.190798397s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.641216883 (263h27m18.192687334s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.645856578 (263h27m18.197327039s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.651699423 (263h27m18.203169894s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.653098288 (263h27m18.204568749s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.656601418 (263h27m18.208071899s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.659046414 (263h27m18.210516875s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:20.448435324 (263h27m18.999905785s) [upload=232059]: Next returned nil segment Nov 20 07:31:20.448449921 (263h27m18.999920373s) [upload=232059]: Waiting for error group managing segments... Nov 20 07:31:20.840686863 (263h27m19.392157314s) [noise=true , address=185.167.204.206:4047 , piece_id=AOJHHOC6D4ES5PSABO5CPOA6FFMQCWJSJC4SYRR4TBGE3ZW6WVYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.840944473 (263h27m19.392414934s) [noise=true , address=185.167.204.205:4009 , piece_id=PHZYFRVS7TV7P2TSPX7MMZ3H63VUEUNYLTDKYIRC7PA7YJ2MGJXQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.841171586 (263h27m19.392642047s) [noise=true , address=185.167.204.206:4061 , piece_id=ND4H2MBLMA7TRKNRPKWRV35RW7JBWOQ4W3TDUST35KQSUFMTUJVQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.845413794 (263h27m19.396884255s) [noise=true , address=185.167.204.206:4054 , piece_id=2FKWZRLJAX6LEUNCRXNH4R3MZ6DNY3VHVZ5JK5QEJZ76KD5EDRAA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.846588840 (263h27m19.398059302s) [noise=true , address=185.167.204.206:4072 , piece_id=25EIWSZDRFORHSBI6DXITGLG4JE3YNY6WWUOH4CIRASABTDW6CLA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.848580414 (263h27m19.400050875s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.849535923 (263h27m19.401006414s) [noise=true , address=185.167.204.206:4053 , piece_id=WOHYIAC6PUGDO7LH3WUAC6AZGDPGMSXQPYKFGFOJWRZMP7EFZWRQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853075914 (263h27m19.404546375s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853778040 (263h27m19.405248491s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.869053197 (263h27m19.420523658s) [noise=true , address=185.167.204.206:4058 , piece_id=SISDILWJPPH4JOHOTL3GKS6LEG3DSVWBSU6IWHZU5R3LCX57CE5A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.884471807 (263h27m19.435942268s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.891395812 (263h27m19.442866273s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.407423253 (263h27m19.958893714s) [noise=true , address=81.171.14.70:4046 , piece_id=OHLJUIVJXEARMXSQJAVQHNOUOFT3UMOWA2E2HOZBJD2CETJ6AVWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.434063861 (263h27m19.985534322s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.458913289 (263h27m20.01038375s) [noise=true , address=81.171.14.70:4027 , piece_id=26ZOOIR73NY4PAJQ3WSAU4ZCXMVYEOJDWSTS4PIDHHYVRPRJF44A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.480425362 (263h27m20.031895813s) [noise=true , address=81.171.14.70:4033 , piece_id=VVU5PQACV4GKY45RPB2C3NWUBYEX7ECQZN4W336ZYULO2CQHQSYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.487065786 (263h27m20.038536237s) [noise=true , address=81.171.14.70:4032 , piece_id=2NLDGLW73R6LJ7XNNAJYRTVPLCCSMOAHGBKIKI7TEOKI4L2T6XWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.504477020 (263h27m20.055947481s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.891152100 (263h27m20.442622561s) [noise=true , address=81.171.14.70:4031 , piece_id=JWMOD7NPWBUIK2ZQAER3YFMZQNDXZKFP345L66NVGKV7EKI7DLOQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.903537184 (263h27m20.455007645s) [noise=true , address=81.171.14.70:4034 , piece_id=K2P6O2RPHOR433TRB7YFBTJSLEY623J7CRMAM77KOZMQKMOLLHZA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.931241638 (263h27m20.482712109s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.939822769 (263h27m20.49129323s) [noise=true , address=81.171.14.70:4029 , piece_id=WXAQ7CIDAZMB2J2GHSMZ532DAMVAJRBNRP3VT7YSY4HJLGZDBX6Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.042469878 (263h27m20.593940339s) [noise=true , address=89.149.201.147:4005 , piece_id=7NYFIWT6B2AO3XCWMMI4TZYM7NROZRLMOLJTKMZYIMCNS6PKIYIQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.044590426 (263h27m20.596060887s) [noise=true , address=89.149.201.147:4020 , piece_id=SSNUBTKK3UIRO2TQY4CIEMM5DRSPC4RUXUEFDYCHK7FOSIHU5S7A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.081767748 (263h27m20.633238209s) [noise=true , address=89.149.201.147:4008 , piece_id=2NUEBJBDOHBC3YOEX53YH3SHG6XK5WI6WTNEJITLXZKDWLLOSARQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133782203 (263h27m20.685252664s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133874820 (263h27m20.685345281s) [seg_pos={0 0}, upload=232059]: Segment reached optimal threshold of 26 pieces. Nov 20 07:31:22.134328153 (263h27m20.685798624s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134338482 (263h27m20.685808943s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134362959 (263h27m20.68583342s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134385041 (263h27m20.685855502s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134417913 (263h27m20.685888364s) [seg_pos={0 0}, upload=232059]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 07:31:22.134530067 (263h27m20.686000528s) [upload=232059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 07:31:22.134536409 (263h27m20.68600687s) [upload=232059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 07:33:08.217836685 (263h29m6.769307177s) [upload=232059]: Done uploading segments... Nov 20 07:33:08.217918711 (263h29m6.769389162s) [upload=232059]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.292006553s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 6.492102395s trace: https://jaeger.dev.storj.io/trace/29eebe057654c99d FAIL (2025-11-20 08:04:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Nov 20 07:31:19.629873593 (263h27m18.181344064s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.633306430 (263h27m18.184776891s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.636780656 (263h27m18.188251117s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.639327946 (263h27m18.190798397s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.641216883 (263h27m18.192687334s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.645856578 (263h27m18.197327039s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.651699423 (263h27m18.203169894s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.653098288 (263h27m18.204568749s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.656601418 (263h27m18.208071899s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.659046414 (263h27m18.210516875s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:20.448435324 (263h27m18.999905785s) [upload=232059]: Next returned nil segment Nov 20 07:31:20.448449921 (263h27m18.999920373s) [upload=232059]: Waiting for error group managing segments... Nov 20 07:31:20.840686863 (263h27m19.392157314s) [noise=true , address=185.167.204.206:4047 , piece_id=AOJHHOC6D4ES5PSABO5CPOA6FFMQCWJSJC4SYRR4TBGE3ZW6WVYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.840944473 (263h27m19.392414934s) [noise=true , address=185.167.204.205:4009 , piece_id=PHZYFRVS7TV7P2TSPX7MMZ3H63VUEUNYLTDKYIRC7PA7YJ2MGJXQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.841171586 (263h27m19.392642047s) [noise=true , address=185.167.204.206:4061 , piece_id=ND4H2MBLMA7TRKNRPKWRV35RW7JBWOQ4W3TDUST35KQSUFMTUJVQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.845413794 (263h27m19.396884255s) [noise=true , address=185.167.204.206:4054 , piece_id=2FKWZRLJAX6LEUNCRXNH4R3MZ6DNY3VHVZ5JK5QEJZ76KD5EDRAA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.846588840 (263h27m19.398059302s) [noise=true , address=185.167.204.206:4072 , piece_id=25EIWSZDRFORHSBI6DXITGLG4JE3YNY6WWUOH4CIRASABTDW6CLA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.848580414 (263h27m19.400050875s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.849535923 (263h27m19.401006414s) [noise=true , address=185.167.204.206:4053 , piece_id=WOHYIAC6PUGDO7LH3WUAC6AZGDPGMSXQPYKFGFOJWRZMP7EFZWRQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853075914 (263h27m19.404546375s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853778040 (263h27m19.405248491s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.869053197 (263h27m19.420523658s) [noise=true , address=185.167.204.206:4058 , piece_id=SISDILWJPPH4JOHOTL3GKS6LEG3DSVWBSU6IWHZU5R3LCX57CE5A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.884471807 (263h27m19.435942268s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.891395812 (263h27m19.442866273s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.407423253 (263h27m19.958893714s) [noise=true , address=81.171.14.70:4046 , piece_id=OHLJUIVJXEARMXSQJAVQHNOUOFT3UMOWA2E2HOZBJD2CETJ6AVWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.434063861 (263h27m19.985534322s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.458913289 (263h27m20.01038375s) [noise=true , address=81.171.14.70:4027 , piece_id=26ZOOIR73NY4PAJQ3WSAU4ZCXMVYEOJDWSTS4PIDHHYVRPRJF44A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.480425362 (263h27m20.031895813s) [noise=true , address=81.171.14.70:4033 , piece_id=VVU5PQACV4GKY45RPB2C3NWUBYEX7ECQZN4W336ZYULO2CQHQSYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.487065786 (263h27m20.038536237s) [noise=true , address=81.171.14.70:4032 , piece_id=2NLDGLW73R6LJ7XNNAJYRTVPLCCSMOAHGBKIKI7TEOKI4L2T6XWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.504477020 (263h27m20.055947481s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.891152100 (263h27m20.442622561s) [noise=true , address=81.171.14.70:4031 , piece_id=JWMOD7NPWBUIK2ZQAER3YFMZQNDXZKFP345L66NVGKV7EKI7DLOQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.903537184 (263h27m20.455007645s) [noise=true , address=81.171.14.70:4034 , piece_id=K2P6O2RPHOR433TRB7YFBTJSLEY623J7CRMAM77KOZMQKMOLLHZA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.931241638 (263h27m20.482712109s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.939822769 (263h27m20.49129323s) [noise=true , address=81.171.14.70:4029 , piece_id=WXAQ7CIDAZMB2J2GHSMZ532DAMVAJRBNRP3VT7YSY4HJLGZDBX6Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.042469878 (263h27m20.593940339s) [noise=true , address=89.149.201.147:4005 , piece_id=7NYFIWT6B2AO3XCWMMI4TZYM7NROZRLMOLJTKMZYIMCNS6PKIYIQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.044590426 (263h27m20.596060887s) [noise=true , address=89.149.201.147:4020 , piece_id=SSNUBTKK3UIRO2TQY4CIEMM5DRSPC4RUXUEFDYCHK7FOSIHU5S7A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.081767748 (263h27m20.633238209s) [noise=true , address=89.149.201.147:4008 , piece_id=2NUEBJBDOHBC3YOEX53YH3SHG6XK5WI6WTNEJITLXZKDWLLOSARQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133782203 (263h27m20.685252664s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133874820 (263h27m20.685345281s) [seg_pos={0 0}, upload=232059]: Segment reached optimal threshold of 26 pieces. Nov 20 07:31:22.134328153 (263h27m20.685798624s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134338482 (263h27m20.685808943s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134362959 (263h27m20.68583342s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134385041 (263h27m20.685855502s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134417913 (263h27m20.685888364s) [seg_pos={0 0}, upload=232059]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 07:31:22.134530067 (263h27m20.686000528s) [upload=232059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 07:31:22.134536409 (263h27m20.68600687s) [upload=232059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 07:33:08.217836685 (263h29m6.769307177s) [upload=232059]: Done uploading segments... Nov 20 07:33:08.217918711 (263h29m6.769389162s) [upload=232059]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.492137361s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 5.772086126s trace: https://jaeger.dev.storj.io/trace/29eebe057654c99d FAIL (2025-11-20 08:03:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Nov 20 07:31:19.629873593 (263h27m18.181344064s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.633306430 (263h27m18.184776891s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.636780656 (263h27m18.188251117s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.639327946 (263h27m18.190798397s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.641216883 (263h27m18.192687334s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.645856578 (263h27m18.197327039s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.651699423 (263h27m18.203169894s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.653098288 (263h27m18.204568749s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.656601418 (263h27m18.208071899s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.659046414 (263h27m18.210516875s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:20.448435324 (263h27m18.999905785s) [upload=232059]: Next returned nil segment Nov 20 07:31:20.448449921 (263h27m18.999920373s) [upload=232059]: Waiting for error group managing segments... Nov 20 07:31:20.840686863 (263h27m19.392157314s) [noise=true , address=185.167.204.206:4047 , piece_id=AOJHHOC6D4ES5PSABO5CPOA6FFMQCWJSJC4SYRR4TBGE3ZW6WVYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.840944473 (263h27m19.392414934s) [noise=true , address=185.167.204.205:4009 , piece_id=PHZYFRVS7TV7P2TSPX7MMZ3H63VUEUNYLTDKYIRC7PA7YJ2MGJXQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.841171586 (263h27m19.392642047s) [noise=true , address=185.167.204.206:4061 , piece_id=ND4H2MBLMA7TRKNRPKWRV35RW7JBWOQ4W3TDUST35KQSUFMTUJVQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.845413794 (263h27m19.396884255s) [noise=true , address=185.167.204.206:4054 , piece_id=2FKWZRLJAX6LEUNCRXNH4R3MZ6DNY3VHVZ5JK5QEJZ76KD5EDRAA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.846588840 (263h27m19.398059302s) [noise=true , address=185.167.204.206:4072 , piece_id=25EIWSZDRFORHSBI6DXITGLG4JE3YNY6WWUOH4CIRASABTDW6CLA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.848580414 (263h27m19.400050875s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.849535923 (263h27m19.401006414s) [noise=true , address=185.167.204.206:4053 , piece_id=WOHYIAC6PUGDO7LH3WUAC6AZGDPGMSXQPYKFGFOJWRZMP7EFZWRQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853075914 (263h27m19.404546375s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853778040 (263h27m19.405248491s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.869053197 (263h27m19.420523658s) [noise=true , address=185.167.204.206:4058 , piece_id=SISDILWJPPH4JOHOTL3GKS6LEG3DSVWBSU6IWHZU5R3LCX57CE5A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.884471807 (263h27m19.435942268s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.891395812 (263h27m19.442866273s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.407423253 (263h27m19.958893714s) [noise=true , address=81.171.14.70:4046 , piece_id=OHLJUIVJXEARMXSQJAVQHNOUOFT3UMOWA2E2HOZBJD2CETJ6AVWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.434063861 (263h27m19.985534322s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.458913289 (263h27m20.01038375s) [noise=true , address=81.171.14.70:4027 , piece_id=26ZOOIR73NY4PAJQ3WSAU4ZCXMVYEOJDWSTS4PIDHHYVRPRJF44A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.480425362 (263h27m20.031895813s) [noise=true , address=81.171.14.70:4033 , piece_id=VVU5PQACV4GKY45RPB2C3NWUBYEX7ECQZN4W336ZYULO2CQHQSYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.487065786 (263h27m20.038536237s) [noise=true , address=81.171.14.70:4032 , piece_id=2NLDGLW73R6LJ7XNNAJYRTVPLCCSMOAHGBKIKI7TEOKI4L2T6XWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.504477020 (263h27m20.055947481s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.891152100 (263h27m20.442622561s) [noise=true , address=81.171.14.70:4031 , piece_id=JWMOD7NPWBUIK2ZQAER3YFMZQNDXZKFP345L66NVGKV7EKI7DLOQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.903537184 (263h27m20.455007645s) [noise=true , address=81.171.14.70:4034 , piece_id=K2P6O2RPHOR433TRB7YFBTJSLEY623J7CRMAM77KOZMQKMOLLHZA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.931241638 (263h27m20.482712109s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.939822769 (263h27m20.49129323s) [noise=true , address=81.171.14.70:4029 , piece_id=WXAQ7CIDAZMB2J2GHSMZ532DAMVAJRBNRP3VT7YSY4HJLGZDBX6Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.042469878 (263h27m20.593940339s) [noise=true , address=89.149.201.147:4005 , piece_id=7NYFIWT6B2AO3XCWMMI4TZYM7NROZRLMOLJTKMZYIMCNS6PKIYIQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.044590426 (263h27m20.596060887s) [noise=true , address=89.149.201.147:4020 , piece_id=SSNUBTKK3UIRO2TQY4CIEMM5DRSPC4RUXUEFDYCHK7FOSIHU5S7A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.081767748 (263h27m20.633238209s) [noise=true , address=89.149.201.147:4008 , piece_id=2NUEBJBDOHBC3YOEX53YH3SHG6XK5WI6WTNEJITLXZKDWLLOSARQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133782203 (263h27m20.685252664s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133874820 (263h27m20.685345281s) [seg_pos={0 0}, upload=232059]: Segment reached optimal threshold of 26 pieces. Nov 20 07:31:22.134328153 (263h27m20.685798624s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134338482 (263h27m20.685808943s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134362959 (263h27m20.68583342s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134385041 (263h27m20.685855502s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134417913 (263h27m20.685888364s) [seg_pos={0 0}, upload=232059]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 07:31:22.134530067 (263h27m20.686000528s) [upload=232059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 07:31:22.134536409 (263h27m20.68600687s) [upload=232059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 07:33:08.217836685 (263h29m6.769307177s) [upload=232059]: Done uploading segments... Nov 20 07:33:08.217918711 (263h29m6.769389162s) [upload=232059]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.772118407s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 5.859695688s trace: https://jaeger.dev.storj.io/trace/29eebe057654c99d FAIL (2025-11-20 08:02:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Nov 20 07:31:19.629873593 (263h27m18.181344064s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.633306430 (263h27m18.184776891s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.636780656 (263h27m18.188251117s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.639327946 (263h27m18.190798397s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.641216883 (263h27m18.192687334s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.645856578 (263h27m18.197327039s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.651699423 (263h27m18.203169894s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.653098288 (263h27m18.204568749s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.656601418 (263h27m18.208071899s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.659046414 (263h27m18.210516875s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:20.448435324 (263h27m18.999905785s) [upload=232059]: Next returned nil segment Nov 20 07:31:20.448449921 (263h27m18.999920373s) [upload=232059]: Waiting for error group managing segments... Nov 20 07:31:20.840686863 (263h27m19.392157314s) [noise=true , address=185.167.204.206:4047 , piece_id=AOJHHOC6D4ES5PSABO5CPOA6FFMQCWJSJC4SYRR4TBGE3ZW6WVYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.840944473 (263h27m19.392414934s) [noise=true , address=185.167.204.205:4009 , piece_id=PHZYFRVS7TV7P2TSPX7MMZ3H63VUEUNYLTDKYIRC7PA7YJ2MGJXQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.841171586 (263h27m19.392642047s) [noise=true , address=185.167.204.206:4061 , piece_id=ND4H2MBLMA7TRKNRPKWRV35RW7JBWOQ4W3TDUST35KQSUFMTUJVQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.845413794 (263h27m19.396884255s) [noise=true , address=185.167.204.206:4054 , piece_id=2FKWZRLJAX6LEUNCRXNH4R3MZ6DNY3VHVZ5JK5QEJZ76KD5EDRAA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.846588840 (263h27m19.398059302s) [noise=true , address=185.167.204.206:4072 , piece_id=25EIWSZDRFORHSBI6DXITGLG4JE3YNY6WWUOH4CIRASABTDW6CLA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.848580414 (263h27m19.400050875s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.849535923 (263h27m19.401006414s) [noise=true , address=185.167.204.206:4053 , piece_id=WOHYIAC6PUGDO7LH3WUAC6AZGDPGMSXQPYKFGFOJWRZMP7EFZWRQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853075914 (263h27m19.404546375s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853778040 (263h27m19.405248491s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.869053197 (263h27m19.420523658s) [noise=true , address=185.167.204.206:4058 , piece_id=SISDILWJPPH4JOHOTL3GKS6LEG3DSVWBSU6IWHZU5R3LCX57CE5A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.884471807 (263h27m19.435942268s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.891395812 (263h27m19.442866273s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.407423253 (263h27m19.958893714s) [noise=true , address=81.171.14.70:4046 , piece_id=OHLJUIVJXEARMXSQJAVQHNOUOFT3UMOWA2E2HOZBJD2CETJ6AVWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.434063861 (263h27m19.985534322s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.458913289 (263h27m20.01038375s) [noise=true , address=81.171.14.70:4027 , piece_id=26ZOOIR73NY4PAJQ3WSAU4ZCXMVYEOJDWSTS4PIDHHYVRPRJF44A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.480425362 (263h27m20.031895813s) [noise=true , address=81.171.14.70:4033 , piece_id=VVU5PQACV4GKY45RPB2C3NWUBYEX7ECQZN4W336ZYULO2CQHQSYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.487065786 (263h27m20.038536237s) [noise=true , address=81.171.14.70:4032 , piece_id=2NLDGLW73R6LJ7XNNAJYRTVPLCCSMOAHGBKIKI7TEOKI4L2T6XWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.504477020 (263h27m20.055947481s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.891152100 (263h27m20.442622561s) [noise=true , address=81.171.14.70:4031 , piece_id=JWMOD7NPWBUIK2ZQAER3YFMZQNDXZKFP345L66NVGKV7EKI7DLOQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.903537184 (263h27m20.455007645s) [noise=true , address=81.171.14.70:4034 , piece_id=K2P6O2RPHOR433TRB7YFBTJSLEY623J7CRMAM77KOZMQKMOLLHZA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.931241638 (263h27m20.482712109s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.939822769 (263h27m20.49129323s) [noise=true , address=81.171.14.70:4029 , piece_id=WXAQ7CIDAZMB2J2GHSMZ532DAMVAJRBNRP3VT7YSY4HJLGZDBX6Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.042469878 (263h27m20.593940339s) [noise=true , address=89.149.201.147:4005 , piece_id=7NYFIWT6B2AO3XCWMMI4TZYM7NROZRLMOLJTKMZYIMCNS6PKIYIQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.044590426 (263h27m20.596060887s) [noise=true , address=89.149.201.147:4020 , piece_id=SSNUBTKK3UIRO2TQY4CIEMM5DRSPC4RUXUEFDYCHK7FOSIHU5S7A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.081767748 (263h27m20.633238209s) [noise=true , address=89.149.201.147:4008 , piece_id=2NUEBJBDOHBC3YOEX53YH3SHG6XK5WI6WTNEJITLXZKDWLLOSARQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133782203 (263h27m20.685252664s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133874820 (263h27m20.685345281s) [seg_pos={0 0}, upload=232059]: Segment reached optimal threshold of 26 pieces. Nov 20 07:31:22.134328153 (263h27m20.685798624s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134338482 (263h27m20.685808943s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134362959 (263h27m20.68583342s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134385041 (263h27m20.685855502s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134417913 (263h27m20.685888364s) [seg_pos={0 0}, upload=232059]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 07:31:22.134530067 (263h27m20.686000528s) [upload=232059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 07:31:22.134536409 (263h27m20.68600687s) [upload=232059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 07:33:08.217836685 (263h29m6.769307177s) [upload=232059]: Done uploading segments... Nov 20 07:33:08.217918711 (263h29m6.769389162s) [upload=232059]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.859783645s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 5.786917679s trace: https://jaeger.dev.storj.io/trace/29eebe057654c99d FAIL (2025-11-20 08:02:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Nov 20 07:31:19.629873593 (263h27m18.181344064s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.633306430 (263h27m18.184776891s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.636780656 (263h27m18.188251117s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.639327946 (263h27m18.190798397s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.641216883 (263h27m18.192687334s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.645856578 (263h27m18.197327039s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.651699423 (263h27m18.203169894s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.653098288 (263h27m18.204568749s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.656601418 (263h27m18.208071899s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.659046414 (263h27m18.210516875s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:20.448435324 (263h27m18.999905785s) [upload=232059]: Next returned nil segment Nov 20 07:31:20.448449921 (263h27m18.999920373s) [upload=232059]: Waiting for error group managing segments... Nov 20 07:31:20.840686863 (263h27m19.392157314s) [noise=true , address=185.167.204.206:4047 , piece_id=AOJHHOC6D4ES5PSABO5CPOA6FFMQCWJSJC4SYRR4TBGE3ZW6WVYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.840944473 (263h27m19.392414934s) [noise=true , address=185.167.204.205:4009 , piece_id=PHZYFRVS7TV7P2TSPX7MMZ3H63VUEUNYLTDKYIRC7PA7YJ2MGJXQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.841171586 (263h27m19.392642047s) [noise=true , address=185.167.204.206:4061 , piece_id=ND4H2MBLMA7TRKNRPKWRV35RW7JBWOQ4W3TDUST35KQSUFMTUJVQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.845413794 (263h27m19.396884255s) [noise=true , address=185.167.204.206:4054 , piece_id=2FKWZRLJAX6LEUNCRXNH4R3MZ6DNY3VHVZ5JK5QEJZ76KD5EDRAA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.846588840 (263h27m19.398059302s) [noise=true , address=185.167.204.206:4072 , piece_id=25EIWSZDRFORHSBI6DXITGLG4JE3YNY6WWUOH4CIRASABTDW6CLA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.848580414 (263h27m19.400050875s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.849535923 (263h27m19.401006414s) [noise=true , address=185.167.204.206:4053 , piece_id=WOHYIAC6PUGDO7LH3WUAC6AZGDPGMSXQPYKFGFOJWRZMP7EFZWRQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853075914 (263h27m19.404546375s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853778040 (263h27m19.405248491s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.869053197 (263h27m19.420523658s) [noise=true , address=185.167.204.206:4058 , piece_id=SISDILWJPPH4JOHOTL3GKS6LEG3DSVWBSU6IWHZU5R3LCX57CE5A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.884471807 (263h27m19.435942268s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.891395812 (263h27m19.442866273s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.407423253 (263h27m19.958893714s) [noise=true , address=81.171.14.70:4046 , piece_id=OHLJUIVJXEARMXSQJAVQHNOUOFT3UMOWA2E2HOZBJD2CETJ6AVWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.434063861 (263h27m19.985534322s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.458913289 (263h27m20.01038375s) [noise=true , address=81.171.14.70:4027 , piece_id=26ZOOIR73NY4PAJQ3WSAU4ZCXMVYEOJDWSTS4PIDHHYVRPRJF44A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.480425362 (263h27m20.031895813s) [noise=true , address=81.171.14.70:4033 , piece_id=VVU5PQACV4GKY45RPB2C3NWUBYEX7ECQZN4W336ZYULO2CQHQSYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.487065786 (263h27m20.038536237s) [noise=true , address=81.171.14.70:4032 , piece_id=2NLDGLW73R6LJ7XNNAJYRTVPLCCSMOAHGBKIKI7TEOKI4L2T6XWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.504477020 (263h27m20.055947481s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.891152100 (263h27m20.442622561s) [noise=true , address=81.171.14.70:4031 , piece_id=JWMOD7NPWBUIK2ZQAER3YFMZQNDXZKFP345L66NVGKV7EKI7DLOQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.903537184 (263h27m20.455007645s) [noise=true , address=81.171.14.70:4034 , piece_id=K2P6O2RPHOR433TRB7YFBTJSLEY623J7CRMAM77KOZMQKMOLLHZA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.931241638 (263h27m20.482712109s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.939822769 (263h27m20.49129323s) [noise=true , address=81.171.14.70:4029 , piece_id=WXAQ7CIDAZMB2J2GHSMZ532DAMVAJRBNRP3VT7YSY4HJLGZDBX6Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.042469878 (263h27m20.593940339s) [noise=true , address=89.149.201.147:4005 , piece_id=7NYFIWT6B2AO3XCWMMI4TZYM7NROZRLMOLJTKMZYIMCNS6PKIYIQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.044590426 (263h27m20.596060887s) [noise=true , address=89.149.201.147:4020 , piece_id=SSNUBTKK3UIRO2TQY4CIEMM5DRSPC4RUXUEFDYCHK7FOSIHU5S7A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.081767748 (263h27m20.633238209s) [noise=true , address=89.149.201.147:4008 , piece_id=2NUEBJBDOHBC3YOEX53YH3SHG6XK5WI6WTNEJITLXZKDWLLOSARQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133782203 (263h27m20.685252664s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133874820 (263h27m20.685345281s) [seg_pos={0 0}, upload=232059]: Segment reached optimal threshold of 26 pieces. Nov 20 07:31:22.134328153 (263h27m20.685798624s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134338482 (263h27m20.685808943s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134362959 (263h27m20.68583342s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134385041 (263h27m20.685855502s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134417913 (263h27m20.685888364s) [seg_pos={0 0}, upload=232059]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 07:31:22.134530067 (263h27m20.686000528s) [upload=232059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 07:31:22.134536409 (263h27m20.68600687s) [upload=232059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 07:33:08.217836685 (263h29m6.769307177s) [upload=232059]: Done uploading segments... Nov 20 07:33:08.217918711 (263h29m6.769389162s) [upload=232059]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.786945361s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 6.295488425s trace: https://jaeger.dev.storj.io/trace/29eebe057654c99d FAIL (2025-11-20 08:01:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Nov 20 07:31:19.629873593 (263h27m18.181344064s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.633306430 (263h27m18.184776891s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.636780656 (263h27m18.188251117s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.639327946 (263h27m18.190798397s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.641216883 (263h27m18.192687334s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.645856578 (263h27m18.197327039s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.651699423 (263h27m18.203169894s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.653098288 (263h27m18.204568749s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.656601418 (263h27m18.208071899s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.659046414 (263h27m18.210516875s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:20.448435324 (263h27m18.999905785s) [upload=232059]: Next returned nil segment Nov 20 07:31:20.448449921 (263h27m18.999920373s) [upload=232059]: Waiting for error group managing segments... Nov 20 07:31:20.840686863 (263h27m19.392157314s) [noise=true , address=185.167.204.206:4047 , piece_id=AOJHHOC6D4ES5PSABO5CPOA6FFMQCWJSJC4SYRR4TBGE3ZW6WVYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.840944473 (263h27m19.392414934s) [noise=true , address=185.167.204.205:4009 , piece_id=PHZYFRVS7TV7P2TSPX7MMZ3H63VUEUNYLTDKYIRC7PA7YJ2MGJXQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.841171586 (263h27m19.392642047s) [noise=true , address=185.167.204.206:4061 , piece_id=ND4H2MBLMA7TRKNRPKWRV35RW7JBWOQ4W3TDUST35KQSUFMTUJVQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.845413794 (263h27m19.396884255s) [noise=true , address=185.167.204.206:4054 , piece_id=2FKWZRLJAX6LEUNCRXNH4R3MZ6DNY3VHVZ5JK5QEJZ76KD5EDRAA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.846588840 (263h27m19.398059302s) [noise=true , address=185.167.204.206:4072 , piece_id=25EIWSZDRFORHSBI6DXITGLG4JE3YNY6WWUOH4CIRASABTDW6CLA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.848580414 (263h27m19.400050875s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.849535923 (263h27m19.401006414s) [noise=true , address=185.167.204.206:4053 , piece_id=WOHYIAC6PUGDO7LH3WUAC6AZGDPGMSXQPYKFGFOJWRZMP7EFZWRQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853075914 (263h27m19.404546375s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853778040 (263h27m19.405248491s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.869053197 (263h27m19.420523658s) [noise=true , address=185.167.204.206:4058 , piece_id=SISDILWJPPH4JOHOTL3GKS6LEG3DSVWBSU6IWHZU5R3LCX57CE5A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.884471807 (263h27m19.435942268s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.891395812 (263h27m19.442866273s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.407423253 (263h27m19.958893714s) [noise=true , address=81.171.14.70:4046 , piece_id=OHLJUIVJXEARMXSQJAVQHNOUOFT3UMOWA2E2HOZBJD2CETJ6AVWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.434063861 (263h27m19.985534322s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.458913289 (263h27m20.01038375s) [noise=true , address=81.171.14.70:4027 , piece_id=26ZOOIR73NY4PAJQ3WSAU4ZCXMVYEOJDWSTS4PIDHHYVRPRJF44A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.480425362 (263h27m20.031895813s) [noise=true , address=81.171.14.70:4033 , piece_id=VVU5PQACV4GKY45RPB2C3NWUBYEX7ECQZN4W336ZYULO2CQHQSYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.487065786 (263h27m20.038536237s) [noise=true , address=81.171.14.70:4032 , piece_id=2NLDGLW73R6LJ7XNNAJYRTVPLCCSMOAHGBKIKI7TEOKI4L2T6XWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.504477020 (263h27m20.055947481s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.891152100 (263h27m20.442622561s) [noise=true , address=81.171.14.70:4031 , piece_id=JWMOD7NPWBUIK2ZQAER3YFMZQNDXZKFP345L66NVGKV7EKI7DLOQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.903537184 (263h27m20.455007645s) [noise=true , address=81.171.14.70:4034 , piece_id=K2P6O2RPHOR433TRB7YFBTJSLEY623J7CRMAM77KOZMQKMOLLHZA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.931241638 (263h27m20.482712109s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.939822769 (263h27m20.49129323s) [noise=true , address=81.171.14.70:4029 , piece_id=WXAQ7CIDAZMB2J2GHSMZ532DAMVAJRBNRP3VT7YSY4HJLGZDBX6Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.042469878 (263h27m20.593940339s) [noise=true , address=89.149.201.147:4005 , piece_id=7NYFIWT6B2AO3XCWMMI4TZYM7NROZRLMOLJTKMZYIMCNS6PKIYIQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.044590426 (263h27m20.596060887s) [noise=true , address=89.149.201.147:4020 , piece_id=SSNUBTKK3UIRO2TQY4CIEMM5DRSPC4RUXUEFDYCHK7FOSIHU5S7A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.081767748 (263h27m20.633238209s) [noise=true , address=89.149.201.147:4008 , piece_id=2NUEBJBDOHBC3YOEX53YH3SHG6XK5WI6WTNEJITLXZKDWLLOSARQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133782203 (263h27m20.685252664s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133874820 (263h27m20.685345281s) [seg_pos={0 0}, upload=232059]: Segment reached optimal threshold of 26 pieces. Nov 20 07:31:22.134328153 (263h27m20.685798624s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134338482 (263h27m20.685808943s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134362959 (263h27m20.68583342s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134385041 (263h27m20.685855502s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134417913 (263h27m20.685888364s) [seg_pos={0 0}, upload=232059]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 07:31:22.134530067 (263h27m20.686000528s) [upload=232059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 07:31:22.134536409 (263h27m20.68600687s) [upload=232059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 07:33:08.217836685 (263h29m6.769307177s) [upload=232059]: Done uploading segments... Nov 20 07:33:08.217918711 (263h29m6.769389162s) [upload=232059]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.295622531s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 6.444975415s trace: https://jaeger.dev.storj.io/trace/29eebe057654c99d FAIL (2025-11-20 08:00:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Nov 20 07:31:19.629873593 (263h27m18.181344064s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.633306430 (263h27m18.184776891s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.636780656 (263h27m18.188251117s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.639327946 (263h27m18.190798397s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.641216883 (263h27m18.192687334s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.645856578 (263h27m18.197327039s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.651699423 (263h27m18.203169894s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.653098288 (263h27m18.204568749s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.656601418 (263h27m18.208071899s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.659046414 (263h27m18.210516875s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:20.448435324 (263h27m18.999905785s) [upload=232059]: Next returned nil segment Nov 20 07:31:20.448449921 (263h27m18.999920373s) [upload=232059]: Waiting for error group managing segments... Nov 20 07:31:20.840686863 (263h27m19.392157314s) [noise=true , address=185.167.204.206:4047 , piece_id=AOJHHOC6D4ES5PSABO5CPOA6FFMQCWJSJC4SYRR4TBGE3ZW6WVYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.840944473 (263h27m19.392414934s) [noise=true , address=185.167.204.205:4009 , piece_id=PHZYFRVS7TV7P2TSPX7MMZ3H63VUEUNYLTDKYIRC7PA7YJ2MGJXQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.841171586 (263h27m19.392642047s) [noise=true , address=185.167.204.206:4061 , piece_id=ND4H2MBLMA7TRKNRPKWRV35RW7JBWOQ4W3TDUST35KQSUFMTUJVQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.845413794 (263h27m19.396884255s) [noise=true , address=185.167.204.206:4054 , piece_id=2FKWZRLJAX6LEUNCRXNH4R3MZ6DNY3VHVZ5JK5QEJZ76KD5EDRAA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.846588840 (263h27m19.398059302s) [noise=true , address=185.167.204.206:4072 , piece_id=25EIWSZDRFORHSBI6DXITGLG4JE3YNY6WWUOH4CIRASABTDW6CLA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.848580414 (263h27m19.400050875s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.849535923 (263h27m19.401006414s) [noise=true , address=185.167.204.206:4053 , piece_id=WOHYIAC6PUGDO7LH3WUAC6AZGDPGMSXQPYKFGFOJWRZMP7EFZWRQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853075914 (263h27m19.404546375s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853778040 (263h27m19.405248491s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.869053197 (263h27m19.420523658s) [noise=true , address=185.167.204.206:4058 , piece_id=SISDILWJPPH4JOHOTL3GKS6LEG3DSVWBSU6IWHZU5R3LCX57CE5A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.884471807 (263h27m19.435942268s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.891395812 (263h27m19.442866273s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.407423253 (263h27m19.958893714s) [noise=true , address=81.171.14.70:4046 , piece_id=OHLJUIVJXEARMXSQJAVQHNOUOFT3UMOWA2E2HOZBJD2CETJ6AVWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.434063861 (263h27m19.985534322s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.458913289 (263h27m20.01038375s) [noise=true , address=81.171.14.70:4027 , piece_id=26ZOOIR73NY4PAJQ3WSAU4ZCXMVYEOJDWSTS4PIDHHYVRPRJF44A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.480425362 (263h27m20.031895813s) [noise=true , address=81.171.14.70:4033 , piece_id=VVU5PQACV4GKY45RPB2C3NWUBYEX7ECQZN4W336ZYULO2CQHQSYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.487065786 (263h27m20.038536237s) [noise=true , address=81.171.14.70:4032 , piece_id=2NLDGLW73R6LJ7XNNAJYRTVPLCCSMOAHGBKIKI7TEOKI4L2T6XWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.504477020 (263h27m20.055947481s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.891152100 (263h27m20.442622561s) [noise=true , address=81.171.14.70:4031 , piece_id=JWMOD7NPWBUIK2ZQAER3YFMZQNDXZKFP345L66NVGKV7EKI7DLOQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.903537184 (263h27m20.455007645s) [noise=true , address=81.171.14.70:4034 , piece_id=K2P6O2RPHOR433TRB7YFBTJSLEY623J7CRMAM77KOZMQKMOLLHZA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.931241638 (263h27m20.482712109s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.939822769 (263h27m20.49129323s) [noise=true , address=81.171.14.70:4029 , piece_id=WXAQ7CIDAZMB2J2GHSMZ532DAMVAJRBNRP3VT7YSY4HJLGZDBX6Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.042469878 (263h27m20.593940339s) [noise=true , address=89.149.201.147:4005 , piece_id=7NYFIWT6B2AO3XCWMMI4TZYM7NROZRLMOLJTKMZYIMCNS6PKIYIQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.044590426 (263h27m20.596060887s) [noise=true , address=89.149.201.147:4020 , piece_id=SSNUBTKK3UIRO2TQY4CIEMM5DRSPC4RUXUEFDYCHK7FOSIHU5S7A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.081767748 (263h27m20.633238209s) [noise=true , address=89.149.201.147:4008 , piece_id=2NUEBJBDOHBC3YOEX53YH3SHG6XK5WI6WTNEJITLXZKDWLLOSARQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133782203 (263h27m20.685252664s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133874820 (263h27m20.685345281s) [seg_pos={0 0}, upload=232059]: Segment reached optimal threshold of 26 pieces. Nov 20 07:31:22.134328153 (263h27m20.685798624s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134338482 (263h27m20.685808943s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134362959 (263h27m20.68583342s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134385041 (263h27m20.685855502s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134417913 (263h27m20.685888364s) [seg_pos={0 0}, upload=232059]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 07:31:22.134530067 (263h27m20.686000528s) [upload=232059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 07:31:22.134536409 (263h27m20.68600687s) [upload=232059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 07:33:08.217836685 (263h29m6.769307177s) [upload=232059]: Done uploading segments... Nov 20 07:33:08.217918711 (263h29m6.769389162s) [upload=232059]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.445010703s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 5.800988693s trace: https://jaeger.dev.storj.io/trace/29eebe057654c99d FAIL (2025-11-20 07:59:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Nov 20 07:31:19.629873593 (263h27m18.181344064s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.633306430 (263h27m18.184776891s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.636780656 (263h27m18.188251117s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.639327946 (263h27m18.190798397s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.641216883 (263h27m18.192687334s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.645856578 (263h27m18.197327039s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.651699423 (263h27m18.203169894s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.653098288 (263h27m18.204568749s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.656601418 (263h27m18.208071899s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.659046414 (263h27m18.210516875s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:20.448435324 (263h27m18.999905785s) [upload=232059]: Next returned nil segment Nov 20 07:31:20.448449921 (263h27m18.999920373s) [upload=232059]: Waiting for error group managing segments... Nov 20 07:31:20.840686863 (263h27m19.392157314s) [noise=true , address=185.167.204.206:4047 , piece_id=AOJHHOC6D4ES5PSABO5CPOA6FFMQCWJSJC4SYRR4TBGE3ZW6WVYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.840944473 (263h27m19.392414934s) [noise=true , address=185.167.204.205:4009 , piece_id=PHZYFRVS7TV7P2TSPX7MMZ3H63VUEUNYLTDKYIRC7PA7YJ2MGJXQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.841171586 (263h27m19.392642047s) [noise=true , address=185.167.204.206:4061 , piece_id=ND4H2MBLMA7TRKNRPKWRV35RW7JBWOQ4W3TDUST35KQSUFMTUJVQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.845413794 (263h27m19.396884255s) [noise=true , address=185.167.204.206:4054 , piece_id=2FKWZRLJAX6LEUNCRXNH4R3MZ6DNY3VHVZ5JK5QEJZ76KD5EDRAA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.846588840 (263h27m19.398059302s) [noise=true , address=185.167.204.206:4072 , piece_id=25EIWSZDRFORHSBI6DXITGLG4JE3YNY6WWUOH4CIRASABTDW6CLA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.848580414 (263h27m19.400050875s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.849535923 (263h27m19.401006414s) [noise=true , address=185.167.204.206:4053 , piece_id=WOHYIAC6PUGDO7LH3WUAC6AZGDPGMSXQPYKFGFOJWRZMP7EFZWRQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853075914 (263h27m19.404546375s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853778040 (263h27m19.405248491s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.869053197 (263h27m19.420523658s) [noise=true , address=185.167.204.206:4058 , piece_id=SISDILWJPPH4JOHOTL3GKS6LEG3DSVWBSU6IWHZU5R3LCX57CE5A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.884471807 (263h27m19.435942268s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.891395812 (263h27m19.442866273s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.407423253 (263h27m19.958893714s) [noise=true , address=81.171.14.70:4046 , piece_id=OHLJUIVJXEARMXSQJAVQHNOUOFT3UMOWA2E2HOZBJD2CETJ6AVWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.434063861 (263h27m19.985534322s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.458913289 (263h27m20.01038375s) [noise=true , address=81.171.14.70:4027 , piece_id=26ZOOIR73NY4PAJQ3WSAU4ZCXMVYEOJDWSTS4PIDHHYVRPRJF44A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.480425362 (263h27m20.031895813s) [noise=true , address=81.171.14.70:4033 , piece_id=VVU5PQACV4GKY45RPB2C3NWUBYEX7ECQZN4W336ZYULO2CQHQSYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.487065786 (263h27m20.038536237s) [noise=true , address=81.171.14.70:4032 , piece_id=2NLDGLW73R6LJ7XNNAJYRTVPLCCSMOAHGBKIKI7TEOKI4L2T6XWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.504477020 (263h27m20.055947481s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.891152100 (263h27m20.442622561s) [noise=true , address=81.171.14.70:4031 , piece_id=JWMOD7NPWBUIK2ZQAER3YFMZQNDXZKFP345L66NVGKV7EKI7DLOQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.903537184 (263h27m20.455007645s) [noise=true , address=81.171.14.70:4034 , piece_id=K2P6O2RPHOR433TRB7YFBTJSLEY623J7CRMAM77KOZMQKMOLLHZA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.931241638 (263h27m20.482712109s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.939822769 (263h27m20.49129323s) [noise=true , address=81.171.14.70:4029 , piece_id=WXAQ7CIDAZMB2J2GHSMZ532DAMVAJRBNRP3VT7YSY4HJLGZDBX6Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.042469878 (263h27m20.593940339s) [noise=true , address=89.149.201.147:4005 , piece_id=7NYFIWT6B2AO3XCWMMI4TZYM7NROZRLMOLJTKMZYIMCNS6PKIYIQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.044590426 (263h27m20.596060887s) [noise=true , address=89.149.201.147:4020 , piece_id=SSNUBTKK3UIRO2TQY4CIEMM5DRSPC4RUXUEFDYCHK7FOSIHU5S7A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.081767748 (263h27m20.633238209s) [noise=true , address=89.149.201.147:4008 , piece_id=2NUEBJBDOHBC3YOEX53YH3SHG6XK5WI6WTNEJITLXZKDWLLOSARQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133782203 (263h27m20.685252664s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133874820 (263h27m20.685345281s) [seg_pos={0 0}, upload=232059]: Segment reached optimal threshold of 26 pieces. Nov 20 07:31:22.134328153 (263h27m20.685798624s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134338482 (263h27m20.685808943s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134362959 (263h27m20.68583342s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134385041 (263h27m20.685855502s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134417913 (263h27m20.685888364s) [seg_pos={0 0}, upload=232059]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 07:31:22.134530067 (263h27m20.686000528s) [upload=232059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 07:31:22.134536409 (263h27m20.68600687s) [upload=232059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 07:33:08.217836685 (263h29m6.769307177s) [upload=232059]: Done uploading segments... Nov 20 07:33:08.217918711 (263h29m6.769389162s) [upload=232059]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.801093803s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 5.287370103s trace: https://jaeger.dev.storj.io/trace/29eebe057654c99d FAIL (2025-11-20 07:58:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Nov 20 07:31:19.629873593 (263h27m18.181344064s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.633306430 (263h27m18.184776891s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.636780656 (263h27m18.188251117s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.639327946 (263h27m18.190798397s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.641216883 (263h27m18.192687334s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.645856578 (263h27m18.197327039s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.651699423 (263h27m18.203169894s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.653098288 (263h27m18.204568749s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.656601418 (263h27m18.208071899s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.659046414 (263h27m18.210516875s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:20.448435324 (263h27m18.999905785s) [upload=232059]: Next returned nil segment Nov 20 07:31:20.448449921 (263h27m18.999920373s) [upload=232059]: Waiting for error group managing segments... Nov 20 07:31:20.840686863 (263h27m19.392157314s) [noise=true , address=185.167.204.206:4047 , piece_id=AOJHHOC6D4ES5PSABO5CPOA6FFMQCWJSJC4SYRR4TBGE3ZW6WVYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.840944473 (263h27m19.392414934s) [noise=true , address=185.167.204.205:4009 , piece_id=PHZYFRVS7TV7P2TSPX7MMZ3H63VUEUNYLTDKYIRC7PA7YJ2MGJXQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.841171586 (263h27m19.392642047s) [noise=true , address=185.167.204.206:4061 , piece_id=ND4H2MBLMA7TRKNRPKWRV35RW7JBWOQ4W3TDUST35KQSUFMTUJVQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.845413794 (263h27m19.396884255s) [noise=true , address=185.167.204.206:4054 , piece_id=2FKWZRLJAX6LEUNCRXNH4R3MZ6DNY3VHVZ5JK5QEJZ76KD5EDRAA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.846588840 (263h27m19.398059302s) [noise=true , address=185.167.204.206:4072 , piece_id=25EIWSZDRFORHSBI6DXITGLG4JE3YNY6WWUOH4CIRASABTDW6CLA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.848580414 (263h27m19.400050875s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.849535923 (263h27m19.401006414s) [noise=true , address=185.167.204.206:4053 , piece_id=WOHYIAC6PUGDO7LH3WUAC6AZGDPGMSXQPYKFGFOJWRZMP7EFZWRQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853075914 (263h27m19.404546375s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853778040 (263h27m19.405248491s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.869053197 (263h27m19.420523658s) [noise=true , address=185.167.204.206:4058 , piece_id=SISDILWJPPH4JOHOTL3GKS6LEG3DSVWBSU6IWHZU5R3LCX57CE5A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.884471807 (263h27m19.435942268s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.891395812 (263h27m19.442866273s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.407423253 (263h27m19.958893714s) [noise=true , address=81.171.14.70:4046 , piece_id=OHLJUIVJXEARMXSQJAVQHNOUOFT3UMOWA2E2HOZBJD2CETJ6AVWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.434063861 (263h27m19.985534322s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.458913289 (263h27m20.01038375s) [noise=true , address=81.171.14.70:4027 , piece_id=26ZOOIR73NY4PAJQ3WSAU4ZCXMVYEOJDWSTS4PIDHHYVRPRJF44A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.480425362 (263h27m20.031895813s) [noise=true , address=81.171.14.70:4033 , piece_id=VVU5PQACV4GKY45RPB2C3NWUBYEX7ECQZN4W336ZYULO2CQHQSYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.487065786 (263h27m20.038536237s) [noise=true , address=81.171.14.70:4032 , piece_id=2NLDGLW73R6LJ7XNNAJYRTVPLCCSMOAHGBKIKI7TEOKI4L2T6XWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.504477020 (263h27m20.055947481s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.891152100 (263h27m20.442622561s) [noise=true , address=81.171.14.70:4031 , piece_id=JWMOD7NPWBUIK2ZQAER3YFMZQNDXZKFP345L66NVGKV7EKI7DLOQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.903537184 (263h27m20.455007645s) [noise=true , address=81.171.14.70:4034 , piece_id=K2P6O2RPHOR433TRB7YFBTJSLEY623J7CRMAM77KOZMQKMOLLHZA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.931241638 (263h27m20.482712109s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.939822769 (263h27m20.49129323s) [noise=true , address=81.171.14.70:4029 , piece_id=WXAQ7CIDAZMB2J2GHSMZ532DAMVAJRBNRP3VT7YSY4HJLGZDBX6Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.042469878 (263h27m20.593940339s) [noise=true , address=89.149.201.147:4005 , piece_id=7NYFIWT6B2AO3XCWMMI4TZYM7NROZRLMOLJTKMZYIMCNS6PKIYIQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.044590426 (263h27m20.596060887s) [noise=true , address=89.149.201.147:4020 , piece_id=SSNUBTKK3UIRO2TQY4CIEMM5DRSPC4RUXUEFDYCHK7FOSIHU5S7A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.081767748 (263h27m20.633238209s) [noise=true , address=89.149.201.147:4008 , piece_id=2NUEBJBDOHBC3YOEX53YH3SHG6XK5WI6WTNEJITLXZKDWLLOSARQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133782203 (263h27m20.685252664s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133874820 (263h27m20.685345281s) [seg_pos={0 0}, upload=232059]: Segment reached optimal threshold of 26 pieces. Nov 20 07:31:22.134328153 (263h27m20.685798624s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134338482 (263h27m20.685808943s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134362959 (263h27m20.68583342s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134385041 (263h27m20.685855502s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134417913 (263h27m20.685888364s) [seg_pos={0 0}, upload=232059]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 07:31:22.134530067 (263h27m20.686000528s) [upload=232059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 07:31:22.134536409 (263h27m20.68600687s) [upload=232059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 07:33:08.217836685 (263h29m6.769307177s) [upload=232059]: Done uploading segments... Nov 20 07:33:08.217918711 (263h29m6.769389162s) [upload=232059]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.287400331s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 5.765138425s trace: https://jaeger.dev.storj.io/trace/29eebe057654c99d FAIL (2025-11-20 07:58:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Nov 20 07:31:19.629873593 (263h27m18.181344064s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.633306430 (263h27m18.184776891s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.636780656 (263h27m18.188251117s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.639327946 (263h27m18.190798397s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.641216883 (263h27m18.192687334s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.645856578 (263h27m18.197327039s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.651699423 (263h27m18.203169894s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.653098288 (263h27m18.204568749s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.656601418 (263h27m18.208071899s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.659046414 (263h27m18.210516875s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:20.448435324 (263h27m18.999905785s) [upload=232059]: Next returned nil segment Nov 20 07:31:20.448449921 (263h27m18.999920373s) [upload=232059]: Waiting for error group managing segments... Nov 20 07:31:20.840686863 (263h27m19.392157314s) [noise=true , address=185.167.204.206:4047 , piece_id=AOJHHOC6D4ES5PSABO5CPOA6FFMQCWJSJC4SYRR4TBGE3ZW6WVYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.840944473 (263h27m19.392414934s) [noise=true , address=185.167.204.205:4009 , piece_id=PHZYFRVS7TV7P2TSPX7MMZ3H63VUEUNYLTDKYIRC7PA7YJ2MGJXQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.841171586 (263h27m19.392642047s) [noise=true , address=185.167.204.206:4061 , piece_id=ND4H2MBLMA7TRKNRPKWRV35RW7JBWOQ4W3TDUST35KQSUFMTUJVQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.845413794 (263h27m19.396884255s) [noise=true , address=185.167.204.206:4054 , piece_id=2FKWZRLJAX6LEUNCRXNH4R3MZ6DNY3VHVZ5JK5QEJZ76KD5EDRAA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.846588840 (263h27m19.398059302s) [noise=true , address=185.167.204.206:4072 , piece_id=25EIWSZDRFORHSBI6DXITGLG4JE3YNY6WWUOH4CIRASABTDW6CLA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.848580414 (263h27m19.400050875s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.849535923 (263h27m19.401006414s) [noise=true , address=185.167.204.206:4053 , piece_id=WOHYIAC6PUGDO7LH3WUAC6AZGDPGMSXQPYKFGFOJWRZMP7EFZWRQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853075914 (263h27m19.404546375s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853778040 (263h27m19.405248491s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.869053197 (263h27m19.420523658s) [noise=true , address=185.167.204.206:4058 , piece_id=SISDILWJPPH4JOHOTL3GKS6LEG3DSVWBSU6IWHZU5R3LCX57CE5A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.884471807 (263h27m19.435942268s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.891395812 (263h27m19.442866273s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.407423253 (263h27m19.958893714s) [noise=true , address=81.171.14.70:4046 , piece_id=OHLJUIVJXEARMXSQJAVQHNOUOFT3UMOWA2E2HOZBJD2CETJ6AVWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.434063861 (263h27m19.985534322s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.458913289 (263h27m20.01038375s) [noise=true , address=81.171.14.70:4027 , piece_id=26ZOOIR73NY4PAJQ3WSAU4ZCXMVYEOJDWSTS4PIDHHYVRPRJF44A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.480425362 (263h27m20.031895813s) [noise=true , address=81.171.14.70:4033 , piece_id=VVU5PQACV4GKY45RPB2C3NWUBYEX7ECQZN4W336ZYULO2CQHQSYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.487065786 (263h27m20.038536237s) [noise=true , address=81.171.14.70:4032 , piece_id=2NLDGLW73R6LJ7XNNAJYRTVPLCCSMOAHGBKIKI7TEOKI4L2T6XWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.504477020 (263h27m20.055947481s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.891152100 (263h27m20.442622561s) [noise=true , address=81.171.14.70:4031 , piece_id=JWMOD7NPWBUIK2ZQAER3YFMZQNDXZKFP345L66NVGKV7EKI7DLOQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.903537184 (263h27m20.455007645s) [noise=true , address=81.171.14.70:4034 , piece_id=K2P6O2RPHOR433TRB7YFBTJSLEY623J7CRMAM77KOZMQKMOLLHZA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.931241638 (263h27m20.482712109s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.939822769 (263h27m20.49129323s) [noise=true , address=81.171.14.70:4029 , piece_id=WXAQ7CIDAZMB2J2GHSMZ532DAMVAJRBNRP3VT7YSY4HJLGZDBX6Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.042469878 (263h27m20.593940339s) [noise=true , address=89.149.201.147:4005 , piece_id=7NYFIWT6B2AO3XCWMMI4TZYM7NROZRLMOLJTKMZYIMCNS6PKIYIQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.044590426 (263h27m20.596060887s) [noise=true , address=89.149.201.147:4020 , piece_id=SSNUBTKK3UIRO2TQY4CIEMM5DRSPC4RUXUEFDYCHK7FOSIHU5S7A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.081767748 (263h27m20.633238209s) [noise=true , address=89.149.201.147:4008 , piece_id=2NUEBJBDOHBC3YOEX53YH3SHG6XK5WI6WTNEJITLXZKDWLLOSARQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133782203 (263h27m20.685252664s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133874820 (263h27m20.685345281s) [seg_pos={0 0}, upload=232059]: Segment reached optimal threshold of 26 pieces. Nov 20 07:31:22.134328153 (263h27m20.685798624s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134338482 (263h27m20.685808943s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134362959 (263h27m20.68583342s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134385041 (263h27m20.685855502s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134417913 (263h27m20.685888364s) [seg_pos={0 0}, upload=232059]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 07:31:22.134530067 (263h27m20.686000528s) [upload=232059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 07:31:22.134536409 (263h27m20.68600687s) [upload=232059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 07:33:08.217836685 (263h29m6.769307177s) [upload=232059]: Done uploading segments... Nov 20 07:33:08.217918711 (263h29m6.769389162s) [upload=232059]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.765170416s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 5.673052032s trace: https://jaeger.dev.storj.io/trace/29eebe057654c99d FAIL (2025-11-20 07:57:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Nov 20 07:31:19.629873593 (263h27m18.181344064s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.633306430 (263h27m18.184776891s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.636780656 (263h27m18.188251117s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.639327946 (263h27m18.190798397s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.641216883 (263h27m18.192687334s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.645856578 (263h27m18.197327039s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.651699423 (263h27m18.203169894s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.653098288 (263h27m18.204568749s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.656601418 (263h27m18.208071899s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.659046414 (263h27m18.210516875s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:20.448435324 (263h27m18.999905785s) [upload=232059]: Next returned nil segment Nov 20 07:31:20.448449921 (263h27m18.999920373s) [upload=232059]: Waiting for error group managing segments... Nov 20 07:31:20.840686863 (263h27m19.392157314s) [noise=true , address=185.167.204.206:4047 , piece_id=AOJHHOC6D4ES5PSABO5CPOA6FFMQCWJSJC4SYRR4TBGE3ZW6WVYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.840944473 (263h27m19.392414934s) [noise=true , address=185.167.204.205:4009 , piece_id=PHZYFRVS7TV7P2TSPX7MMZ3H63VUEUNYLTDKYIRC7PA7YJ2MGJXQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.841171586 (263h27m19.392642047s) [noise=true , address=185.167.204.206:4061 , piece_id=ND4H2MBLMA7TRKNRPKWRV35RW7JBWOQ4W3TDUST35KQSUFMTUJVQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.845413794 (263h27m19.396884255s) [noise=true , address=185.167.204.206:4054 , piece_id=2FKWZRLJAX6LEUNCRXNH4R3MZ6DNY3VHVZ5JK5QEJZ76KD5EDRAA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.846588840 (263h27m19.398059302s) [noise=true , address=185.167.204.206:4072 , piece_id=25EIWSZDRFORHSBI6DXITGLG4JE3YNY6WWUOH4CIRASABTDW6CLA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.848580414 (263h27m19.400050875s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.849535923 (263h27m19.401006414s) [noise=true , address=185.167.204.206:4053 , piece_id=WOHYIAC6PUGDO7LH3WUAC6AZGDPGMSXQPYKFGFOJWRZMP7EFZWRQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853075914 (263h27m19.404546375s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853778040 (263h27m19.405248491s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.869053197 (263h27m19.420523658s) [noise=true , address=185.167.204.206:4058 , piece_id=SISDILWJPPH4JOHOTL3GKS6LEG3DSVWBSU6IWHZU5R3LCX57CE5A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.884471807 (263h27m19.435942268s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.891395812 (263h27m19.442866273s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.407423253 (263h27m19.958893714s) [noise=true , address=81.171.14.70:4046 , piece_id=OHLJUIVJXEARMXSQJAVQHNOUOFT3UMOWA2E2HOZBJD2CETJ6AVWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.434063861 (263h27m19.985534322s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.458913289 (263h27m20.01038375s) [noise=true , address=81.171.14.70:4027 , piece_id=26ZOOIR73NY4PAJQ3WSAU4ZCXMVYEOJDWSTS4PIDHHYVRPRJF44A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.480425362 (263h27m20.031895813s) [noise=true , address=81.171.14.70:4033 , piece_id=VVU5PQACV4GKY45RPB2C3NWUBYEX7ECQZN4W336ZYULO2CQHQSYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.487065786 (263h27m20.038536237s) [noise=true , address=81.171.14.70:4032 , piece_id=2NLDGLW73R6LJ7XNNAJYRTVPLCCSMOAHGBKIKI7TEOKI4L2T6XWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.504477020 (263h27m20.055947481s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.891152100 (263h27m20.442622561s) [noise=true , address=81.171.14.70:4031 , piece_id=JWMOD7NPWBUIK2ZQAER3YFMZQNDXZKFP345L66NVGKV7EKI7DLOQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.903537184 (263h27m20.455007645s) [noise=true , address=81.171.14.70:4034 , piece_id=K2P6O2RPHOR433TRB7YFBTJSLEY623J7CRMAM77KOZMQKMOLLHZA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.931241638 (263h27m20.482712109s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.939822769 (263h27m20.49129323s) [noise=true , address=81.171.14.70:4029 , piece_id=WXAQ7CIDAZMB2J2GHSMZ532DAMVAJRBNRP3VT7YSY4HJLGZDBX6Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.042469878 (263h27m20.593940339s) [noise=true , address=89.149.201.147:4005 , piece_id=7NYFIWT6B2AO3XCWMMI4TZYM7NROZRLMOLJTKMZYIMCNS6PKIYIQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.044590426 (263h27m20.596060887s) [noise=true , address=89.149.201.147:4020 , piece_id=SSNUBTKK3UIRO2TQY4CIEMM5DRSPC4RUXUEFDYCHK7FOSIHU5S7A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.081767748 (263h27m20.633238209s) [noise=true , address=89.149.201.147:4008 , piece_id=2NUEBJBDOHBC3YOEX53YH3SHG6XK5WI6WTNEJITLXZKDWLLOSARQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133782203 (263h27m20.685252664s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133874820 (263h27m20.685345281s) [seg_pos={0 0}, upload=232059]: Segment reached optimal threshold of 26 pieces. Nov 20 07:31:22.134328153 (263h27m20.685798624s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134338482 (263h27m20.685808943s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134362959 (263h27m20.68583342s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134385041 (263h27m20.685855502s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134417913 (263h27m20.685888364s) [seg_pos={0 0}, upload=232059]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 07:31:22.134530067 (263h27m20.686000528s) [upload=232059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 07:31:22.134536409 (263h27m20.68600687s) [upload=232059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 07:33:08.217836685 (263h29m6.769307177s) [upload=232059]: Done uploading segments... Nov 20 07:33:08.217918711 (263h29m6.769389162s) [upload=232059]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.673079225s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 5.803906769s trace: https://jaeger.dev.storj.io/trace/29eebe057654c99d FAIL (2025-11-20 07:57:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Nov 20 07:31:19.629873593 (263h27m18.181344064s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.633306430 (263h27m18.184776891s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.636780656 (263h27m18.188251117s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.639327946 (263h27m18.190798397s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.641216883 (263h27m18.192687334s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.645856578 (263h27m18.197327039s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.651699423 (263h27m18.203169894s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.653098288 (263h27m18.204568749s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.656601418 (263h27m18.208071899s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.659046414 (263h27m18.210516875s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:20.448435324 (263h27m18.999905785s) [upload=232059]: Next returned nil segment Nov 20 07:31:20.448449921 (263h27m18.999920373s) [upload=232059]: Waiting for error group managing segments... Nov 20 07:31:20.840686863 (263h27m19.392157314s) [noise=true , address=185.167.204.206:4047 , piece_id=AOJHHOC6D4ES5PSABO5CPOA6FFMQCWJSJC4SYRR4TBGE3ZW6WVYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.840944473 (263h27m19.392414934s) [noise=true , address=185.167.204.205:4009 , piece_id=PHZYFRVS7TV7P2TSPX7MMZ3H63VUEUNYLTDKYIRC7PA7YJ2MGJXQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.841171586 (263h27m19.392642047s) [noise=true , address=185.167.204.206:4061 , piece_id=ND4H2MBLMA7TRKNRPKWRV35RW7JBWOQ4W3TDUST35KQSUFMTUJVQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.845413794 (263h27m19.396884255s) [noise=true , address=185.167.204.206:4054 , piece_id=2FKWZRLJAX6LEUNCRXNH4R3MZ6DNY3VHVZ5JK5QEJZ76KD5EDRAA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.846588840 (263h27m19.398059302s) [noise=true , address=185.167.204.206:4072 , piece_id=25EIWSZDRFORHSBI6DXITGLG4JE3YNY6WWUOH4CIRASABTDW6CLA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.848580414 (263h27m19.400050875s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.849535923 (263h27m19.401006414s) [noise=true , address=185.167.204.206:4053 , piece_id=WOHYIAC6PUGDO7LH3WUAC6AZGDPGMSXQPYKFGFOJWRZMP7EFZWRQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853075914 (263h27m19.404546375s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853778040 (263h27m19.405248491s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.869053197 (263h27m19.420523658s) [noise=true , address=185.167.204.206:4058 , piece_id=SISDILWJPPH4JOHOTL3GKS6LEG3DSVWBSU6IWHZU5R3LCX57CE5A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.884471807 (263h27m19.435942268s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.891395812 (263h27m19.442866273s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.407423253 (263h27m19.958893714s) [noise=true , address=81.171.14.70:4046 , piece_id=OHLJUIVJXEARMXSQJAVQHNOUOFT3UMOWA2E2HOZBJD2CETJ6AVWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.434063861 (263h27m19.985534322s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.458913289 (263h27m20.01038375s) [noise=true , address=81.171.14.70:4027 , piece_id=26ZOOIR73NY4PAJQ3WSAU4ZCXMVYEOJDWSTS4PIDHHYVRPRJF44A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.480425362 (263h27m20.031895813s) [noise=true , address=81.171.14.70:4033 , piece_id=VVU5PQACV4GKY45RPB2C3NWUBYEX7ECQZN4W336ZYULO2CQHQSYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.487065786 (263h27m20.038536237s) [noise=true , address=81.171.14.70:4032 , piece_id=2NLDGLW73R6LJ7XNNAJYRTVPLCCSMOAHGBKIKI7TEOKI4L2T6XWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.504477020 (263h27m20.055947481s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.891152100 (263h27m20.442622561s) [noise=true , address=81.171.14.70:4031 , piece_id=JWMOD7NPWBUIK2ZQAER3YFMZQNDXZKFP345L66NVGKV7EKI7DLOQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.903537184 (263h27m20.455007645s) [noise=true , address=81.171.14.70:4034 , piece_id=K2P6O2RPHOR433TRB7YFBTJSLEY623J7CRMAM77KOZMQKMOLLHZA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.931241638 (263h27m20.482712109s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.939822769 (263h27m20.49129323s) [noise=true , address=81.171.14.70:4029 , piece_id=WXAQ7CIDAZMB2J2GHSMZ532DAMVAJRBNRP3VT7YSY4HJLGZDBX6Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.042469878 (263h27m20.593940339s) [noise=true , address=89.149.201.147:4005 , piece_id=7NYFIWT6B2AO3XCWMMI4TZYM7NROZRLMOLJTKMZYIMCNS6PKIYIQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.044590426 (263h27m20.596060887s) [noise=true , address=89.149.201.147:4020 , piece_id=SSNUBTKK3UIRO2TQY4CIEMM5DRSPC4RUXUEFDYCHK7FOSIHU5S7A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.081767748 (263h27m20.633238209s) [noise=true , address=89.149.201.147:4008 , piece_id=2NUEBJBDOHBC3YOEX53YH3SHG6XK5WI6WTNEJITLXZKDWLLOSARQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133782203 (263h27m20.685252664s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133874820 (263h27m20.685345281s) [seg_pos={0 0}, upload=232059]: Segment reached optimal threshold of 26 pieces. Nov 20 07:31:22.134328153 (263h27m20.685798624s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134338482 (263h27m20.685808943s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134362959 (263h27m20.68583342s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134385041 (263h27m20.685855502s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134417913 (263h27m20.685888364s) [seg_pos={0 0}, upload=232059]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 07:31:22.134530067 (263h27m20.686000528s) [upload=232059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 07:31:22.134536409 (263h27m20.68600687s) [upload=232059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 07:33:08.217836685 (263h29m6.769307177s) [upload=232059]: Done uploading segments... Nov 20 07:33:08.217918711 (263h29m6.769389162s) [upload=232059]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.803940131s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 6.160120371s trace: https://jaeger.dev.storj.io/trace/29eebe057654c99d FAIL (2025-11-20 07:56:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Nov 20 07:31:19.629873593 (263h27m18.181344064s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.633306430 (263h27m18.184776891s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.636780656 (263h27m18.188251117s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.639327946 (263h27m18.190798397s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.641216883 (263h27m18.192687334s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.645856578 (263h27m18.197327039s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.651699423 (263h27m18.203169894s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.653098288 (263h27m18.204568749s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.656601418 (263h27m18.208071899s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.659046414 (263h27m18.210516875s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:20.448435324 (263h27m18.999905785s) [upload=232059]: Next returned nil segment Nov 20 07:31:20.448449921 (263h27m18.999920373s) [upload=232059]: Waiting for error group managing segments... Nov 20 07:31:20.840686863 (263h27m19.392157314s) [noise=true , address=185.167.204.206:4047 , piece_id=AOJHHOC6D4ES5PSABO5CPOA6FFMQCWJSJC4SYRR4TBGE3ZW6WVYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.840944473 (263h27m19.392414934s) [noise=true , address=185.167.204.205:4009 , piece_id=PHZYFRVS7TV7P2TSPX7MMZ3H63VUEUNYLTDKYIRC7PA7YJ2MGJXQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.841171586 (263h27m19.392642047s) [noise=true , address=185.167.204.206:4061 , piece_id=ND4H2MBLMA7TRKNRPKWRV35RW7JBWOQ4W3TDUST35KQSUFMTUJVQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.845413794 (263h27m19.396884255s) [noise=true , address=185.167.204.206:4054 , piece_id=2FKWZRLJAX6LEUNCRXNH4R3MZ6DNY3VHVZ5JK5QEJZ76KD5EDRAA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.846588840 (263h27m19.398059302s) [noise=true , address=185.167.204.206:4072 , piece_id=25EIWSZDRFORHSBI6DXITGLG4JE3YNY6WWUOH4CIRASABTDW6CLA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.848580414 (263h27m19.400050875s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.849535923 (263h27m19.401006414s) [noise=true , address=185.167.204.206:4053 , piece_id=WOHYIAC6PUGDO7LH3WUAC6AZGDPGMSXQPYKFGFOJWRZMP7EFZWRQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853075914 (263h27m19.404546375s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853778040 (263h27m19.405248491s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.869053197 (263h27m19.420523658s) [noise=true , address=185.167.204.206:4058 , piece_id=SISDILWJPPH4JOHOTL3GKS6LEG3DSVWBSU6IWHZU5R3LCX57CE5A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.884471807 (263h27m19.435942268s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.891395812 (263h27m19.442866273s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.407423253 (263h27m19.958893714s) [noise=true , address=81.171.14.70:4046 , piece_id=OHLJUIVJXEARMXSQJAVQHNOUOFT3UMOWA2E2HOZBJD2CETJ6AVWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.434063861 (263h27m19.985534322s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.458913289 (263h27m20.01038375s) [noise=true , address=81.171.14.70:4027 , piece_id=26ZOOIR73NY4PAJQ3WSAU4ZCXMVYEOJDWSTS4PIDHHYVRPRJF44A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.480425362 (263h27m20.031895813s) [noise=true , address=81.171.14.70:4033 , piece_id=VVU5PQACV4GKY45RPB2C3NWUBYEX7ECQZN4W336ZYULO2CQHQSYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.487065786 (263h27m20.038536237s) [noise=true , address=81.171.14.70:4032 , piece_id=2NLDGLW73R6LJ7XNNAJYRTVPLCCSMOAHGBKIKI7TEOKI4L2T6XWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.504477020 (263h27m20.055947481s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.891152100 (263h27m20.442622561s) [noise=true , address=81.171.14.70:4031 , piece_id=JWMOD7NPWBUIK2ZQAER3YFMZQNDXZKFP345L66NVGKV7EKI7DLOQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.903537184 (263h27m20.455007645s) [noise=true , address=81.171.14.70:4034 , piece_id=K2P6O2RPHOR433TRB7YFBTJSLEY623J7CRMAM77KOZMQKMOLLHZA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.931241638 (263h27m20.482712109s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.939822769 (263h27m20.49129323s) [noise=true , address=81.171.14.70:4029 , piece_id=WXAQ7CIDAZMB2J2GHSMZ532DAMVAJRBNRP3VT7YSY4HJLGZDBX6Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.042469878 (263h27m20.593940339s) [noise=true , address=89.149.201.147:4005 , piece_id=7NYFIWT6B2AO3XCWMMI4TZYM7NROZRLMOLJTKMZYIMCNS6PKIYIQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.044590426 (263h27m20.596060887s) [noise=true , address=89.149.201.147:4020 , piece_id=SSNUBTKK3UIRO2TQY4CIEMM5DRSPC4RUXUEFDYCHK7FOSIHU5S7A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.081767748 (263h27m20.633238209s) [noise=true , address=89.149.201.147:4008 , piece_id=2NUEBJBDOHBC3YOEX53YH3SHG6XK5WI6WTNEJITLXZKDWLLOSARQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133782203 (263h27m20.685252664s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133874820 (263h27m20.685345281s) [seg_pos={0 0}, upload=232059]: Segment reached optimal threshold of 26 pieces. Nov 20 07:31:22.134328153 (263h27m20.685798624s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134338482 (263h27m20.685808943s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134362959 (263h27m20.68583342s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134385041 (263h27m20.685855502s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134417913 (263h27m20.685888364s) [seg_pos={0 0}, upload=232059]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 07:31:22.134530067 (263h27m20.686000528s) [upload=232059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 07:31:22.134536409 (263h27m20.68600687s) [upload=232059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 07:33:08.217836685 (263h29m6.769307177s) [upload=232059]: Done uploading segments... Nov 20 07:33:08.217918711 (263h29m6.769389162s) [upload=232059]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.160144076s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 5.767369761s trace: https://jaeger.dev.storj.io/trace/29eebe057654c99d FAIL (2025-11-20 07:55:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Nov 20 07:31:19.629873593 (263h27m18.181344064s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.633306430 (263h27m18.184776891s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.636780656 (263h27m18.188251117s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.639327946 (263h27m18.190798397s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.641216883 (263h27m18.192687334s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.645856578 (263h27m18.197327039s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.651699423 (263h27m18.203169894s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.653098288 (263h27m18.204568749s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.656601418 (263h27m18.208071899s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.659046414 (263h27m18.210516875s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:20.448435324 (263h27m18.999905785s) [upload=232059]: Next returned nil segment Nov 20 07:31:20.448449921 (263h27m18.999920373s) [upload=232059]: Waiting for error group managing segments... Nov 20 07:31:20.840686863 (263h27m19.392157314s) [noise=true , address=185.167.204.206:4047 , piece_id=AOJHHOC6D4ES5PSABO5CPOA6FFMQCWJSJC4SYRR4TBGE3ZW6WVYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.840944473 (263h27m19.392414934s) [noise=true , address=185.167.204.205:4009 , piece_id=PHZYFRVS7TV7P2TSPX7MMZ3H63VUEUNYLTDKYIRC7PA7YJ2MGJXQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.841171586 (263h27m19.392642047s) [noise=true , address=185.167.204.206:4061 , piece_id=ND4H2MBLMA7TRKNRPKWRV35RW7JBWOQ4W3TDUST35KQSUFMTUJVQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.845413794 (263h27m19.396884255s) [noise=true , address=185.167.204.206:4054 , piece_id=2FKWZRLJAX6LEUNCRXNH4R3MZ6DNY3VHVZ5JK5QEJZ76KD5EDRAA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.846588840 (263h27m19.398059302s) [noise=true , address=185.167.204.206:4072 , piece_id=25EIWSZDRFORHSBI6DXITGLG4JE3YNY6WWUOH4CIRASABTDW6CLA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.848580414 (263h27m19.400050875s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.849535923 (263h27m19.401006414s) [noise=true , address=185.167.204.206:4053 , piece_id=WOHYIAC6PUGDO7LH3WUAC6AZGDPGMSXQPYKFGFOJWRZMP7EFZWRQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853075914 (263h27m19.404546375s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853778040 (263h27m19.405248491s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.869053197 (263h27m19.420523658s) [noise=true , address=185.167.204.206:4058 , piece_id=SISDILWJPPH4JOHOTL3GKS6LEG3DSVWBSU6IWHZU5R3LCX57CE5A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.884471807 (263h27m19.435942268s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.891395812 (263h27m19.442866273s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.407423253 (263h27m19.958893714s) [noise=true , address=81.171.14.70:4046 , piece_id=OHLJUIVJXEARMXSQJAVQHNOUOFT3UMOWA2E2HOZBJD2CETJ6AVWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.434063861 (263h27m19.985534322s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.458913289 (263h27m20.01038375s) [noise=true , address=81.171.14.70:4027 , piece_id=26ZOOIR73NY4PAJQ3WSAU4ZCXMVYEOJDWSTS4PIDHHYVRPRJF44A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.480425362 (263h27m20.031895813s) [noise=true , address=81.171.14.70:4033 , piece_id=VVU5PQACV4GKY45RPB2C3NWUBYEX7ECQZN4W336ZYULO2CQHQSYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.487065786 (263h27m20.038536237s) [noise=true , address=81.171.14.70:4032 , piece_id=2NLDGLW73R6LJ7XNNAJYRTVPLCCSMOAHGBKIKI7TEOKI4L2T6XWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.504477020 (263h27m20.055947481s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.891152100 (263h27m20.442622561s) [noise=true , address=81.171.14.70:4031 , piece_id=JWMOD7NPWBUIK2ZQAER3YFMZQNDXZKFP345L66NVGKV7EKI7DLOQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.903537184 (263h27m20.455007645s) [noise=true , address=81.171.14.70:4034 , piece_id=K2P6O2RPHOR433TRB7YFBTJSLEY623J7CRMAM77KOZMQKMOLLHZA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.931241638 (263h27m20.482712109s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.939822769 (263h27m20.49129323s) [noise=true , address=81.171.14.70:4029 , piece_id=WXAQ7CIDAZMB2J2GHSMZ532DAMVAJRBNRP3VT7YSY4HJLGZDBX6Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.042469878 (263h27m20.593940339s) [noise=true , address=89.149.201.147:4005 , piece_id=7NYFIWT6B2AO3XCWMMI4TZYM7NROZRLMOLJTKMZYIMCNS6PKIYIQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.044590426 (263h27m20.596060887s) [noise=true , address=89.149.201.147:4020 , piece_id=SSNUBTKK3UIRO2TQY4CIEMM5DRSPC4RUXUEFDYCHK7FOSIHU5S7A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.081767748 (263h27m20.633238209s) [noise=true , address=89.149.201.147:4008 , piece_id=2NUEBJBDOHBC3YOEX53YH3SHG6XK5WI6WTNEJITLXZKDWLLOSARQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133782203 (263h27m20.685252664s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133874820 (263h27m20.685345281s) [seg_pos={0 0}, upload=232059]: Segment reached optimal threshold of 26 pieces. Nov 20 07:31:22.134328153 (263h27m20.685798624s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134338482 (263h27m20.685808943s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134362959 (263h27m20.68583342s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134385041 (263h27m20.685855502s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134417913 (263h27m20.685888364s) [seg_pos={0 0}, upload=232059]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 07:31:22.134530067 (263h27m20.686000528s) [upload=232059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 07:31:22.134536409 (263h27m20.68600687s) [upload=232059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 07:33:08.217836685 (263h29m6.769307177s) [upload=232059]: Done uploading segments... Nov 20 07:33:08.217918711 (263h29m6.769389162s) [upload=232059]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.767399397s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 5.773176294s trace: https://jaeger.dev.storj.io/trace/29eebe057654c99d FAIL (2025-11-20 07:54:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Nov 20 07:31:19.629873593 (263h27m18.181344064s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.633306430 (263h27m18.184776891s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.636780656 (263h27m18.188251117s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.639327946 (263h27m18.190798397s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.641216883 (263h27m18.192687334s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.645856578 (263h27m18.197327039s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.651699423 (263h27m18.203169894s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.653098288 (263h27m18.204568749s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.656601418 (263h27m18.208071899s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.659046414 (263h27m18.210516875s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:20.448435324 (263h27m18.999905785s) [upload=232059]: Next returned nil segment Nov 20 07:31:20.448449921 (263h27m18.999920373s) [upload=232059]: Waiting for error group managing segments... Nov 20 07:31:20.840686863 (263h27m19.392157314s) [noise=true , address=185.167.204.206:4047 , piece_id=AOJHHOC6D4ES5PSABO5CPOA6FFMQCWJSJC4SYRR4TBGE3ZW6WVYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.840944473 (263h27m19.392414934s) [noise=true , address=185.167.204.205:4009 , piece_id=PHZYFRVS7TV7P2TSPX7MMZ3H63VUEUNYLTDKYIRC7PA7YJ2MGJXQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.841171586 (263h27m19.392642047s) [noise=true , address=185.167.204.206:4061 , piece_id=ND4H2MBLMA7TRKNRPKWRV35RW7JBWOQ4W3TDUST35KQSUFMTUJVQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.845413794 (263h27m19.396884255s) [noise=true , address=185.167.204.206:4054 , piece_id=2FKWZRLJAX6LEUNCRXNH4R3MZ6DNY3VHVZ5JK5QEJZ76KD5EDRAA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.846588840 (263h27m19.398059302s) [noise=true , address=185.167.204.206:4072 , piece_id=25EIWSZDRFORHSBI6DXITGLG4JE3YNY6WWUOH4CIRASABTDW6CLA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.848580414 (263h27m19.400050875s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.849535923 (263h27m19.401006414s) [noise=true , address=185.167.204.206:4053 , piece_id=WOHYIAC6PUGDO7LH3WUAC6AZGDPGMSXQPYKFGFOJWRZMP7EFZWRQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853075914 (263h27m19.404546375s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853778040 (263h27m19.405248491s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.869053197 (263h27m19.420523658s) [noise=true , address=185.167.204.206:4058 , piece_id=SISDILWJPPH4JOHOTL3GKS6LEG3DSVWBSU6IWHZU5R3LCX57CE5A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.884471807 (263h27m19.435942268s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.891395812 (263h27m19.442866273s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.407423253 (263h27m19.958893714s) [noise=true , address=81.171.14.70:4046 , piece_id=OHLJUIVJXEARMXSQJAVQHNOUOFT3UMOWA2E2HOZBJD2CETJ6AVWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.434063861 (263h27m19.985534322s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.458913289 (263h27m20.01038375s) [noise=true , address=81.171.14.70:4027 , piece_id=26ZOOIR73NY4PAJQ3WSAU4ZCXMVYEOJDWSTS4PIDHHYVRPRJF44A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.480425362 (263h27m20.031895813s) [noise=true , address=81.171.14.70:4033 , piece_id=VVU5PQACV4GKY45RPB2C3NWUBYEX7ECQZN4W336ZYULO2CQHQSYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.487065786 (263h27m20.038536237s) [noise=true , address=81.171.14.70:4032 , piece_id=2NLDGLW73R6LJ7XNNAJYRTVPLCCSMOAHGBKIKI7TEOKI4L2T6XWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.504477020 (263h27m20.055947481s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.891152100 (263h27m20.442622561s) [noise=true , address=81.171.14.70:4031 , piece_id=JWMOD7NPWBUIK2ZQAER3YFMZQNDXZKFP345L66NVGKV7EKI7DLOQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.903537184 (263h27m20.455007645s) [noise=true , address=81.171.14.70:4034 , piece_id=K2P6O2RPHOR433TRB7YFBTJSLEY623J7CRMAM77KOZMQKMOLLHZA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.931241638 (263h27m20.482712109s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.939822769 (263h27m20.49129323s) [noise=true , address=81.171.14.70:4029 , piece_id=WXAQ7CIDAZMB2J2GHSMZ532DAMVAJRBNRP3VT7YSY4HJLGZDBX6Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.042469878 (263h27m20.593940339s) [noise=true , address=89.149.201.147:4005 , piece_id=7NYFIWT6B2AO3XCWMMI4TZYM7NROZRLMOLJTKMZYIMCNS6PKIYIQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.044590426 (263h27m20.596060887s) [noise=true , address=89.149.201.147:4020 , piece_id=SSNUBTKK3UIRO2TQY4CIEMM5DRSPC4RUXUEFDYCHK7FOSIHU5S7A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.081767748 (263h27m20.633238209s) [noise=true , address=89.149.201.147:4008 , piece_id=2NUEBJBDOHBC3YOEX53YH3SHG6XK5WI6WTNEJITLXZKDWLLOSARQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133782203 (263h27m20.685252664s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133874820 (263h27m20.685345281s) [seg_pos={0 0}, upload=232059]: Segment reached optimal threshold of 26 pieces. Nov 20 07:31:22.134328153 (263h27m20.685798624s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134338482 (263h27m20.685808943s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134362959 (263h27m20.68583342s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134385041 (263h27m20.685855502s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134417913 (263h27m20.685888364s) [seg_pos={0 0}, upload=232059]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 07:31:22.134530067 (263h27m20.686000528s) [upload=232059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 07:31:22.134536409 (263h27m20.68600687s) [upload=232059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 07:33:08.217836685 (263h29m6.769307177s) [upload=232059]: Done uploading segments... Nov 20 07:33:08.217918711 (263h29m6.769389162s) [upload=232059]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.773197684s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 5.740822324s trace: https://jaeger.dev.storj.io/trace/29eebe057654c99d FAIL (2025-11-20 07:54:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Nov 20 07:31:19.629873593 (263h27m18.181344064s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.633306430 (263h27m18.184776891s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.636780656 (263h27m18.188251117s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.639327946 (263h27m18.190798397s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.641216883 (263h27m18.192687334s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.645856578 (263h27m18.197327039s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.651699423 (263h27m18.203169894s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.653098288 (263h27m18.204568749s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.656601418 (263h27m18.208071899s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.659046414 (263h27m18.210516875s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:20.448435324 (263h27m18.999905785s) [upload=232059]: Next returned nil segment Nov 20 07:31:20.448449921 (263h27m18.999920373s) [upload=232059]: Waiting for error group managing segments... Nov 20 07:31:20.840686863 (263h27m19.392157314s) [noise=true , address=185.167.204.206:4047 , piece_id=AOJHHOC6D4ES5PSABO5CPOA6FFMQCWJSJC4SYRR4TBGE3ZW6WVYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.840944473 (263h27m19.392414934s) [noise=true , address=185.167.204.205:4009 , piece_id=PHZYFRVS7TV7P2TSPX7MMZ3H63VUEUNYLTDKYIRC7PA7YJ2MGJXQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.841171586 (263h27m19.392642047s) [noise=true , address=185.167.204.206:4061 , piece_id=ND4H2MBLMA7TRKNRPKWRV35RW7JBWOQ4W3TDUST35KQSUFMTUJVQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.845413794 (263h27m19.396884255s) [noise=true , address=185.167.204.206:4054 , piece_id=2FKWZRLJAX6LEUNCRXNH4R3MZ6DNY3VHVZ5JK5QEJZ76KD5EDRAA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.846588840 (263h27m19.398059302s) [noise=true , address=185.167.204.206:4072 , piece_id=25EIWSZDRFORHSBI6DXITGLG4JE3YNY6WWUOH4CIRASABTDW6CLA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.848580414 (263h27m19.400050875s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.849535923 (263h27m19.401006414s) [noise=true , address=185.167.204.206:4053 , piece_id=WOHYIAC6PUGDO7LH3WUAC6AZGDPGMSXQPYKFGFOJWRZMP7EFZWRQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853075914 (263h27m19.404546375s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853778040 (263h27m19.405248491s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.869053197 (263h27m19.420523658s) [noise=true , address=185.167.204.206:4058 , piece_id=SISDILWJPPH4JOHOTL3GKS6LEG3DSVWBSU6IWHZU5R3LCX57CE5A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.884471807 (263h27m19.435942268s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.891395812 (263h27m19.442866273s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.407423253 (263h27m19.958893714s) [noise=true , address=81.171.14.70:4046 , piece_id=OHLJUIVJXEARMXSQJAVQHNOUOFT3UMOWA2E2HOZBJD2CETJ6AVWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.434063861 (263h27m19.985534322s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.458913289 (263h27m20.01038375s) [noise=true , address=81.171.14.70:4027 , piece_id=26ZOOIR73NY4PAJQ3WSAU4ZCXMVYEOJDWSTS4PIDHHYVRPRJF44A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.480425362 (263h27m20.031895813s) [noise=true , address=81.171.14.70:4033 , piece_id=VVU5PQACV4GKY45RPB2C3NWUBYEX7ECQZN4W336ZYULO2CQHQSYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.487065786 (263h27m20.038536237s) [noise=true , address=81.171.14.70:4032 , piece_id=2NLDGLW73R6LJ7XNNAJYRTVPLCCSMOAHGBKIKI7TEOKI4L2T6XWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.504477020 (263h27m20.055947481s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.891152100 (263h27m20.442622561s) [noise=true , address=81.171.14.70:4031 , piece_id=JWMOD7NPWBUIK2ZQAER3YFMZQNDXZKFP345L66NVGKV7EKI7DLOQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.903537184 (263h27m20.455007645s) [noise=true , address=81.171.14.70:4034 , piece_id=K2P6O2RPHOR433TRB7YFBTJSLEY623J7CRMAM77KOZMQKMOLLHZA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.931241638 (263h27m20.482712109s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.939822769 (263h27m20.49129323s) [noise=true , address=81.171.14.70:4029 , piece_id=WXAQ7CIDAZMB2J2GHSMZ532DAMVAJRBNRP3VT7YSY4HJLGZDBX6Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.042469878 (263h27m20.593940339s) [noise=true , address=89.149.201.147:4005 , piece_id=7NYFIWT6B2AO3XCWMMI4TZYM7NROZRLMOLJTKMZYIMCNS6PKIYIQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.044590426 (263h27m20.596060887s) [noise=true , address=89.149.201.147:4020 , piece_id=SSNUBTKK3UIRO2TQY4CIEMM5DRSPC4RUXUEFDYCHK7FOSIHU5S7A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.081767748 (263h27m20.633238209s) [noise=true , address=89.149.201.147:4008 , piece_id=2NUEBJBDOHBC3YOEX53YH3SHG6XK5WI6WTNEJITLXZKDWLLOSARQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133782203 (263h27m20.685252664s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133874820 (263h27m20.685345281s) [seg_pos={0 0}, upload=232059]: Segment reached optimal threshold of 26 pieces. Nov 20 07:31:22.134328153 (263h27m20.685798624s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134338482 (263h27m20.685808943s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134362959 (263h27m20.68583342s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134385041 (263h27m20.685855502s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134417913 (263h27m20.685888364s) [seg_pos={0 0}, upload=232059]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 07:31:22.134530067 (263h27m20.686000528s) [upload=232059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 07:31:22.134536409 (263h27m20.68600687s) [upload=232059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 07:33:08.217836685 (263h29m6.769307177s) [upload=232059]: Done uploading segments... Nov 20 07:33:08.217918711 (263h29m6.769389162s) [upload=232059]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.740853372s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 5.825554596s trace: https://jaeger.dev.storj.io/trace/29eebe057654c99d FAIL (2025-11-20 07:53:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Nov 20 07:31:19.629873593 (263h27m18.181344064s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.633306430 (263h27m18.184776891s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.636780656 (263h27m18.188251117s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.639327946 (263h27m18.190798397s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.641216883 (263h27m18.192687334s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.645856578 (263h27m18.197327039s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.651699423 (263h27m18.203169894s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.653098288 (263h27m18.204568749s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.656601418 (263h27m18.208071899s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.659046414 (263h27m18.210516875s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:20.448435324 (263h27m18.999905785s) [upload=232059]: Next returned nil segment Nov 20 07:31:20.448449921 (263h27m18.999920373s) [upload=232059]: Waiting for error group managing segments... Nov 20 07:31:20.840686863 (263h27m19.392157314s) [noise=true , address=185.167.204.206:4047 , piece_id=AOJHHOC6D4ES5PSABO5CPOA6FFMQCWJSJC4SYRR4TBGE3ZW6WVYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.840944473 (263h27m19.392414934s) [noise=true , address=185.167.204.205:4009 , piece_id=PHZYFRVS7TV7P2TSPX7MMZ3H63VUEUNYLTDKYIRC7PA7YJ2MGJXQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.841171586 (263h27m19.392642047s) [noise=true , address=185.167.204.206:4061 , piece_id=ND4H2MBLMA7TRKNRPKWRV35RW7JBWOQ4W3TDUST35KQSUFMTUJVQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.845413794 (263h27m19.396884255s) [noise=true , address=185.167.204.206:4054 , piece_id=2FKWZRLJAX6LEUNCRXNH4R3MZ6DNY3VHVZ5JK5QEJZ76KD5EDRAA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.846588840 (263h27m19.398059302s) [noise=true , address=185.167.204.206:4072 , piece_id=25EIWSZDRFORHSBI6DXITGLG4JE3YNY6WWUOH4CIRASABTDW6CLA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.848580414 (263h27m19.400050875s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.849535923 (263h27m19.401006414s) [noise=true , address=185.167.204.206:4053 , piece_id=WOHYIAC6PUGDO7LH3WUAC6AZGDPGMSXQPYKFGFOJWRZMP7EFZWRQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853075914 (263h27m19.404546375s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853778040 (263h27m19.405248491s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.869053197 (263h27m19.420523658s) [noise=true , address=185.167.204.206:4058 , piece_id=SISDILWJPPH4JOHOTL3GKS6LEG3DSVWBSU6IWHZU5R3LCX57CE5A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.884471807 (263h27m19.435942268s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.891395812 (263h27m19.442866273s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.407423253 (263h27m19.958893714s) [noise=true , address=81.171.14.70:4046 , piece_id=OHLJUIVJXEARMXSQJAVQHNOUOFT3UMOWA2E2HOZBJD2CETJ6AVWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.434063861 (263h27m19.985534322s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.458913289 (263h27m20.01038375s) [noise=true , address=81.171.14.70:4027 , piece_id=26ZOOIR73NY4PAJQ3WSAU4ZCXMVYEOJDWSTS4PIDHHYVRPRJF44A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.480425362 (263h27m20.031895813s) [noise=true , address=81.171.14.70:4033 , piece_id=VVU5PQACV4GKY45RPB2C3NWUBYEX7ECQZN4W336ZYULO2CQHQSYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.487065786 (263h27m20.038536237s) [noise=true , address=81.171.14.70:4032 , piece_id=2NLDGLW73R6LJ7XNNAJYRTVPLCCSMOAHGBKIKI7TEOKI4L2T6XWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.504477020 (263h27m20.055947481s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.891152100 (263h27m20.442622561s) [noise=true , address=81.171.14.70:4031 , piece_id=JWMOD7NPWBUIK2ZQAER3YFMZQNDXZKFP345L66NVGKV7EKI7DLOQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.903537184 (263h27m20.455007645s) [noise=true , address=81.171.14.70:4034 , piece_id=K2P6O2RPHOR433TRB7YFBTJSLEY623J7CRMAM77KOZMQKMOLLHZA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.931241638 (263h27m20.482712109s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.939822769 (263h27m20.49129323s) [noise=true , address=81.171.14.70:4029 , piece_id=WXAQ7CIDAZMB2J2GHSMZ532DAMVAJRBNRP3VT7YSY4HJLGZDBX6Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.042469878 (263h27m20.593940339s) [noise=true , address=89.149.201.147:4005 , piece_id=7NYFIWT6B2AO3XCWMMI4TZYM7NROZRLMOLJTKMZYIMCNS6PKIYIQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.044590426 (263h27m20.596060887s) [noise=true , address=89.149.201.147:4020 , piece_id=SSNUBTKK3UIRO2TQY4CIEMM5DRSPC4RUXUEFDYCHK7FOSIHU5S7A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.081767748 (263h27m20.633238209s) [noise=true , address=89.149.201.147:4008 , piece_id=2NUEBJBDOHBC3YOEX53YH3SHG6XK5WI6WTNEJITLXZKDWLLOSARQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133782203 (263h27m20.685252664s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133874820 (263h27m20.685345281s) [seg_pos={0 0}, upload=232059]: Segment reached optimal threshold of 26 pieces. Nov 20 07:31:22.134328153 (263h27m20.685798624s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134338482 (263h27m20.685808943s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134362959 (263h27m20.68583342s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134385041 (263h27m20.685855502s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134417913 (263h27m20.685888364s) [seg_pos={0 0}, upload=232059]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 07:31:22.134530067 (263h27m20.686000528s) [upload=232059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 07:31:22.134536409 (263h27m20.68600687s) [upload=232059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 07:33:08.217836685 (263h29m6.769307177s) [upload=232059]: Done uploading segments... Nov 20 07:33:08.217918711 (263h29m6.769389162s) [upload=232059]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.825666479s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 5.686809975s trace: https://jaeger.dev.storj.io/trace/29eebe057654c99d FAIL (2025-11-20 07:52:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Nov 20 07:31:19.629873593 (263h27m18.181344064s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.633306430 (263h27m18.184776891s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.636780656 (263h27m18.188251117s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.639327946 (263h27m18.190798397s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.641216883 (263h27m18.192687334s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.645856578 (263h27m18.197327039s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.651699423 (263h27m18.203169894s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.653098288 (263h27m18.204568749s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.656601418 (263h27m18.208071899s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.659046414 (263h27m18.210516875s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:20.448435324 (263h27m18.999905785s) [upload=232059]: Next returned nil segment Nov 20 07:31:20.448449921 (263h27m18.999920373s) [upload=232059]: Waiting for error group managing segments... Nov 20 07:31:20.840686863 (263h27m19.392157314s) [noise=true , address=185.167.204.206:4047 , piece_id=AOJHHOC6D4ES5PSABO5CPOA6FFMQCWJSJC4SYRR4TBGE3ZW6WVYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.840944473 (263h27m19.392414934s) [noise=true , address=185.167.204.205:4009 , piece_id=PHZYFRVS7TV7P2TSPX7MMZ3H63VUEUNYLTDKYIRC7PA7YJ2MGJXQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.841171586 (263h27m19.392642047s) [noise=true , address=185.167.204.206:4061 , piece_id=ND4H2MBLMA7TRKNRPKWRV35RW7JBWOQ4W3TDUST35KQSUFMTUJVQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.845413794 (263h27m19.396884255s) [noise=true , address=185.167.204.206:4054 , piece_id=2FKWZRLJAX6LEUNCRXNH4R3MZ6DNY3VHVZ5JK5QEJZ76KD5EDRAA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.846588840 (263h27m19.398059302s) [noise=true , address=185.167.204.206:4072 , piece_id=25EIWSZDRFORHSBI6DXITGLG4JE3YNY6WWUOH4CIRASABTDW6CLA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.848580414 (263h27m19.400050875s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.849535923 (263h27m19.401006414s) [noise=true , address=185.167.204.206:4053 , piece_id=WOHYIAC6PUGDO7LH3WUAC6AZGDPGMSXQPYKFGFOJWRZMP7EFZWRQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853075914 (263h27m19.404546375s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853778040 (263h27m19.405248491s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.869053197 (263h27m19.420523658s) [noise=true , address=185.167.204.206:4058 , piece_id=SISDILWJPPH4JOHOTL3GKS6LEG3DSVWBSU6IWHZU5R3LCX57CE5A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.884471807 (263h27m19.435942268s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.891395812 (263h27m19.442866273s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.407423253 (263h27m19.958893714s) [noise=true , address=81.171.14.70:4046 , piece_id=OHLJUIVJXEARMXSQJAVQHNOUOFT3UMOWA2E2HOZBJD2CETJ6AVWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.434063861 (263h27m19.985534322s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.458913289 (263h27m20.01038375s) [noise=true , address=81.171.14.70:4027 , piece_id=26ZOOIR73NY4PAJQ3WSAU4ZCXMVYEOJDWSTS4PIDHHYVRPRJF44A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.480425362 (263h27m20.031895813s) [noise=true , address=81.171.14.70:4033 , piece_id=VVU5PQACV4GKY45RPB2C3NWUBYEX7ECQZN4W336ZYULO2CQHQSYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.487065786 (263h27m20.038536237s) [noise=true , address=81.171.14.70:4032 , piece_id=2NLDGLW73R6LJ7XNNAJYRTVPLCCSMOAHGBKIKI7TEOKI4L2T6XWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.504477020 (263h27m20.055947481s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.891152100 (263h27m20.442622561s) [noise=true , address=81.171.14.70:4031 , piece_id=JWMOD7NPWBUIK2ZQAER3YFMZQNDXZKFP345L66NVGKV7EKI7DLOQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.903537184 (263h27m20.455007645s) [noise=true , address=81.171.14.70:4034 , piece_id=K2P6O2RPHOR433TRB7YFBTJSLEY623J7CRMAM77KOZMQKMOLLHZA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.931241638 (263h27m20.482712109s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.939822769 (263h27m20.49129323s) [noise=true , address=81.171.14.70:4029 , piece_id=WXAQ7CIDAZMB2J2GHSMZ532DAMVAJRBNRP3VT7YSY4HJLGZDBX6Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.042469878 (263h27m20.593940339s) [noise=true , address=89.149.201.147:4005 , piece_id=7NYFIWT6B2AO3XCWMMI4TZYM7NROZRLMOLJTKMZYIMCNS6PKIYIQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.044590426 (263h27m20.596060887s) [noise=true , address=89.149.201.147:4020 , piece_id=SSNUBTKK3UIRO2TQY4CIEMM5DRSPC4RUXUEFDYCHK7FOSIHU5S7A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.081767748 (263h27m20.633238209s) [noise=true , address=89.149.201.147:4008 , piece_id=2NUEBJBDOHBC3YOEX53YH3SHG6XK5WI6WTNEJITLXZKDWLLOSARQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133782203 (263h27m20.685252664s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133874820 (263h27m20.685345281s) [seg_pos={0 0}, upload=232059]: Segment reached optimal threshold of 26 pieces. Nov 20 07:31:22.134328153 (263h27m20.685798624s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134338482 (263h27m20.685808943s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134362959 (263h27m20.68583342s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134385041 (263h27m20.685855502s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134417913 (263h27m20.685888364s) [seg_pos={0 0}, upload=232059]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 07:31:22.134530067 (263h27m20.686000528s) [upload=232059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 07:31:22.134536409 (263h27m20.68600687s) [upload=232059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 07:33:08.217836685 (263h29m6.769307177s) [upload=232059]: Done uploading segments... Nov 20 07:33:08.217918711 (263h29m6.769389162s) [upload=232059]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.686840023s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 5.755328227s trace: https://jaeger.dev.storj.io/trace/29eebe057654c99d FAIL (2025-11-20 07:52:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Nov 20 07:31:19.629873593 (263h27m18.181344064s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.633306430 (263h27m18.184776891s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.636780656 (263h27m18.188251117s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.639327946 (263h27m18.190798397s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.641216883 (263h27m18.192687334s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.645856578 (263h27m18.197327039s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.651699423 (263h27m18.203169894s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.653098288 (263h27m18.204568749s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.656601418 (263h27m18.208071899s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.659046414 (263h27m18.210516875s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:20.448435324 (263h27m18.999905785s) [upload=232059]: Next returned nil segment Nov 20 07:31:20.448449921 (263h27m18.999920373s) [upload=232059]: Waiting for error group managing segments... Nov 20 07:31:20.840686863 (263h27m19.392157314s) [noise=true , address=185.167.204.206:4047 , piece_id=AOJHHOC6D4ES5PSABO5CPOA6FFMQCWJSJC4SYRR4TBGE3ZW6WVYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.840944473 (263h27m19.392414934s) [noise=true , address=185.167.204.205:4009 , piece_id=PHZYFRVS7TV7P2TSPX7MMZ3H63VUEUNYLTDKYIRC7PA7YJ2MGJXQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.841171586 (263h27m19.392642047s) [noise=true , address=185.167.204.206:4061 , piece_id=ND4H2MBLMA7TRKNRPKWRV35RW7JBWOQ4W3TDUST35KQSUFMTUJVQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.845413794 (263h27m19.396884255s) [noise=true , address=185.167.204.206:4054 , piece_id=2FKWZRLJAX6LEUNCRXNH4R3MZ6DNY3VHVZ5JK5QEJZ76KD5EDRAA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.846588840 (263h27m19.398059302s) [noise=true , address=185.167.204.206:4072 , piece_id=25EIWSZDRFORHSBI6DXITGLG4JE3YNY6WWUOH4CIRASABTDW6CLA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.848580414 (263h27m19.400050875s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.849535923 (263h27m19.401006414s) [noise=true , address=185.167.204.206:4053 , piece_id=WOHYIAC6PUGDO7LH3WUAC6AZGDPGMSXQPYKFGFOJWRZMP7EFZWRQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853075914 (263h27m19.404546375s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853778040 (263h27m19.405248491s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.869053197 (263h27m19.420523658s) [noise=true , address=185.167.204.206:4058 , piece_id=SISDILWJPPH4JOHOTL3GKS6LEG3DSVWBSU6IWHZU5R3LCX57CE5A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.884471807 (263h27m19.435942268s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.891395812 (263h27m19.442866273s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.407423253 (263h27m19.958893714s) [noise=true , address=81.171.14.70:4046 , piece_id=OHLJUIVJXEARMXSQJAVQHNOUOFT3UMOWA2E2HOZBJD2CETJ6AVWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.434063861 (263h27m19.985534322s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.458913289 (263h27m20.01038375s) [noise=true , address=81.171.14.70:4027 , piece_id=26ZOOIR73NY4PAJQ3WSAU4ZCXMVYEOJDWSTS4PIDHHYVRPRJF44A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.480425362 (263h27m20.031895813s) [noise=true , address=81.171.14.70:4033 , piece_id=VVU5PQACV4GKY45RPB2C3NWUBYEX7ECQZN4W336ZYULO2CQHQSYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.487065786 (263h27m20.038536237s) [noise=true , address=81.171.14.70:4032 , piece_id=2NLDGLW73R6LJ7XNNAJYRTVPLCCSMOAHGBKIKI7TEOKI4L2T6XWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.504477020 (263h27m20.055947481s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.891152100 (263h27m20.442622561s) [noise=true , address=81.171.14.70:4031 , piece_id=JWMOD7NPWBUIK2ZQAER3YFMZQNDXZKFP345L66NVGKV7EKI7DLOQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.903537184 (263h27m20.455007645s) [noise=true , address=81.171.14.70:4034 , piece_id=K2P6O2RPHOR433TRB7YFBTJSLEY623J7CRMAM77KOZMQKMOLLHZA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.931241638 (263h27m20.482712109s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.939822769 (263h27m20.49129323s) [noise=true , address=81.171.14.70:4029 , piece_id=WXAQ7CIDAZMB2J2GHSMZ532DAMVAJRBNRP3VT7YSY4HJLGZDBX6Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.042469878 (263h27m20.593940339s) [noise=true , address=89.149.201.147:4005 , piece_id=7NYFIWT6B2AO3XCWMMI4TZYM7NROZRLMOLJTKMZYIMCNS6PKIYIQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.044590426 (263h27m20.596060887s) [noise=true , address=89.149.201.147:4020 , piece_id=SSNUBTKK3UIRO2TQY4CIEMM5DRSPC4RUXUEFDYCHK7FOSIHU5S7A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.081767748 (263h27m20.633238209s) [noise=true , address=89.149.201.147:4008 , piece_id=2NUEBJBDOHBC3YOEX53YH3SHG6XK5WI6WTNEJITLXZKDWLLOSARQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133782203 (263h27m20.685252664s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133874820 (263h27m20.685345281s) [seg_pos={0 0}, upload=232059]: Segment reached optimal threshold of 26 pieces. Nov 20 07:31:22.134328153 (263h27m20.685798624s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134338482 (263h27m20.685808943s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134362959 (263h27m20.68583342s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134385041 (263h27m20.685855502s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134417913 (263h27m20.685888364s) [seg_pos={0 0}, upload=232059]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 07:31:22.134530067 (263h27m20.686000528s) [upload=232059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 07:31:22.134536409 (263h27m20.68600687s) [upload=232059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 07:33:08.217836685 (263h29m6.769307177s) [upload=232059]: Done uploading segments... Nov 20 07:33:08.217918711 (263h29m6.769389162s) [upload=232059]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.755359707s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 5.731104721s trace: https://jaeger.dev.storj.io/trace/29eebe057654c99d FAIL (2025-11-20 07:51:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Nov 20 07:31:19.629873593 (263h27m18.181344064s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.633306430 (263h27m18.184776891s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.636780656 (263h27m18.188251117s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.639327946 (263h27m18.190798397s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.641216883 (263h27m18.192687334s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.645856578 (263h27m18.197327039s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.651699423 (263h27m18.203169894s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.653098288 (263h27m18.204568749s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.656601418 (263h27m18.208071899s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.659046414 (263h27m18.210516875s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:20.448435324 (263h27m18.999905785s) [upload=232059]: Next returned nil segment Nov 20 07:31:20.448449921 (263h27m18.999920373s) [upload=232059]: Waiting for error group managing segments... Nov 20 07:31:20.840686863 (263h27m19.392157314s) [noise=true , address=185.167.204.206:4047 , piece_id=AOJHHOC6D4ES5PSABO5CPOA6FFMQCWJSJC4SYRR4TBGE3ZW6WVYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.840944473 (263h27m19.392414934s) [noise=true , address=185.167.204.205:4009 , piece_id=PHZYFRVS7TV7P2TSPX7MMZ3H63VUEUNYLTDKYIRC7PA7YJ2MGJXQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.841171586 (263h27m19.392642047s) [noise=true , address=185.167.204.206:4061 , piece_id=ND4H2MBLMA7TRKNRPKWRV35RW7JBWOQ4W3TDUST35KQSUFMTUJVQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.845413794 (263h27m19.396884255s) [noise=true , address=185.167.204.206:4054 , piece_id=2FKWZRLJAX6LEUNCRXNH4R3MZ6DNY3VHVZ5JK5QEJZ76KD5EDRAA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.846588840 (263h27m19.398059302s) [noise=true , address=185.167.204.206:4072 , piece_id=25EIWSZDRFORHSBI6DXITGLG4JE3YNY6WWUOH4CIRASABTDW6CLA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.848580414 (263h27m19.400050875s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.849535923 (263h27m19.401006414s) [noise=true , address=185.167.204.206:4053 , piece_id=WOHYIAC6PUGDO7LH3WUAC6AZGDPGMSXQPYKFGFOJWRZMP7EFZWRQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853075914 (263h27m19.404546375s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853778040 (263h27m19.405248491s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.869053197 (263h27m19.420523658s) [noise=true , address=185.167.204.206:4058 , piece_id=SISDILWJPPH4JOHOTL3GKS6LEG3DSVWBSU6IWHZU5R3LCX57CE5A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.884471807 (263h27m19.435942268s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.891395812 (263h27m19.442866273s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.407423253 (263h27m19.958893714s) [noise=true , address=81.171.14.70:4046 , piece_id=OHLJUIVJXEARMXSQJAVQHNOUOFT3UMOWA2E2HOZBJD2CETJ6AVWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.434063861 (263h27m19.985534322s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.458913289 (263h27m20.01038375s) [noise=true , address=81.171.14.70:4027 , piece_id=26ZOOIR73NY4PAJQ3WSAU4ZCXMVYEOJDWSTS4PIDHHYVRPRJF44A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.480425362 (263h27m20.031895813s) [noise=true , address=81.171.14.70:4033 , piece_id=VVU5PQACV4GKY45RPB2C3NWUBYEX7ECQZN4W336ZYULO2CQHQSYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.487065786 (263h27m20.038536237s) [noise=true , address=81.171.14.70:4032 , piece_id=2NLDGLW73R6LJ7XNNAJYRTVPLCCSMOAHGBKIKI7TEOKI4L2T6XWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.504477020 (263h27m20.055947481s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.891152100 (263h27m20.442622561s) [noise=true , address=81.171.14.70:4031 , piece_id=JWMOD7NPWBUIK2ZQAER3YFMZQNDXZKFP345L66NVGKV7EKI7DLOQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.903537184 (263h27m20.455007645s) [noise=true , address=81.171.14.70:4034 , piece_id=K2P6O2RPHOR433TRB7YFBTJSLEY623J7CRMAM77KOZMQKMOLLHZA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.931241638 (263h27m20.482712109s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.939822769 (263h27m20.49129323s) [noise=true , address=81.171.14.70:4029 , piece_id=WXAQ7CIDAZMB2J2GHSMZ532DAMVAJRBNRP3VT7YSY4HJLGZDBX6Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.042469878 (263h27m20.593940339s) [noise=true , address=89.149.201.147:4005 , piece_id=7NYFIWT6B2AO3XCWMMI4TZYM7NROZRLMOLJTKMZYIMCNS6PKIYIQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.044590426 (263h27m20.596060887s) [noise=true , address=89.149.201.147:4020 , piece_id=SSNUBTKK3UIRO2TQY4CIEMM5DRSPC4RUXUEFDYCHK7FOSIHU5S7A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.081767748 (263h27m20.633238209s) [noise=true , address=89.149.201.147:4008 , piece_id=2NUEBJBDOHBC3YOEX53YH3SHG6XK5WI6WTNEJITLXZKDWLLOSARQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133782203 (263h27m20.685252664s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133874820 (263h27m20.685345281s) [seg_pos={0 0}, upload=232059]: Segment reached optimal threshold of 26 pieces. Nov 20 07:31:22.134328153 (263h27m20.685798624s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134338482 (263h27m20.685808943s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134362959 (263h27m20.68583342s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134385041 (263h27m20.685855502s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134417913 (263h27m20.685888364s) [seg_pos={0 0}, upload=232059]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 07:31:22.134530067 (263h27m20.686000528s) [upload=232059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 07:31:22.134536409 (263h27m20.68600687s) [upload=232059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 07:33:08.217836685 (263h29m6.769307177s) [upload=232059]: Done uploading segments... Nov 20 07:33:08.217918711 (263h29m6.769389162s) [upload=232059]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.731210462s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 5.712395719s trace: https://jaeger.dev.storj.io/trace/29eebe057654c99d FAIL (2025-11-20 07:51:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Nov 20 07:31:19.629873593 (263h27m18.181344064s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.633306430 (263h27m18.184776891s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.636780656 (263h27m18.188251117s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.639327946 (263h27m18.190798397s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.641216883 (263h27m18.192687334s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.645856578 (263h27m18.197327039s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.651699423 (263h27m18.203169894s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.653098288 (263h27m18.204568749s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.656601418 (263h27m18.208071899s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.659046414 (263h27m18.210516875s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:20.448435324 (263h27m18.999905785s) [upload=232059]: Next returned nil segment Nov 20 07:31:20.448449921 (263h27m18.999920373s) [upload=232059]: Waiting for error group managing segments... Nov 20 07:31:20.840686863 (263h27m19.392157314s) [noise=true , address=185.167.204.206:4047 , piece_id=AOJHHOC6D4ES5PSABO5CPOA6FFMQCWJSJC4SYRR4TBGE3ZW6WVYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.840944473 (263h27m19.392414934s) [noise=true , address=185.167.204.205:4009 , piece_id=PHZYFRVS7TV7P2TSPX7MMZ3H63VUEUNYLTDKYIRC7PA7YJ2MGJXQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.841171586 (263h27m19.392642047s) [noise=true , address=185.167.204.206:4061 , piece_id=ND4H2MBLMA7TRKNRPKWRV35RW7JBWOQ4W3TDUST35KQSUFMTUJVQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.845413794 (263h27m19.396884255s) [noise=true , address=185.167.204.206:4054 , piece_id=2FKWZRLJAX6LEUNCRXNH4R3MZ6DNY3VHVZ5JK5QEJZ76KD5EDRAA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.846588840 (263h27m19.398059302s) [noise=true , address=185.167.204.206:4072 , piece_id=25EIWSZDRFORHSBI6DXITGLG4JE3YNY6WWUOH4CIRASABTDW6CLA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.848580414 (263h27m19.400050875s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.849535923 (263h27m19.401006414s) [noise=true , address=185.167.204.206:4053 , piece_id=WOHYIAC6PUGDO7LH3WUAC6AZGDPGMSXQPYKFGFOJWRZMP7EFZWRQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853075914 (263h27m19.404546375s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853778040 (263h27m19.405248491s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.869053197 (263h27m19.420523658s) [noise=true , address=185.167.204.206:4058 , piece_id=SISDILWJPPH4JOHOTL3GKS6LEG3DSVWBSU6IWHZU5R3LCX57CE5A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.884471807 (263h27m19.435942268s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.891395812 (263h27m19.442866273s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.407423253 (263h27m19.958893714s) [noise=true , address=81.171.14.70:4046 , piece_id=OHLJUIVJXEARMXSQJAVQHNOUOFT3UMOWA2E2HOZBJD2CETJ6AVWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.434063861 (263h27m19.985534322s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.458913289 (263h27m20.01038375s) [noise=true , address=81.171.14.70:4027 , piece_id=26ZOOIR73NY4PAJQ3WSAU4ZCXMVYEOJDWSTS4PIDHHYVRPRJF44A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.480425362 (263h27m20.031895813s) [noise=true , address=81.171.14.70:4033 , piece_id=VVU5PQACV4GKY45RPB2C3NWUBYEX7ECQZN4W336ZYULO2CQHQSYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.487065786 (263h27m20.038536237s) [noise=true , address=81.171.14.70:4032 , piece_id=2NLDGLW73R6LJ7XNNAJYRTVPLCCSMOAHGBKIKI7TEOKI4L2T6XWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.504477020 (263h27m20.055947481s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.891152100 (263h27m20.442622561s) [noise=true , address=81.171.14.70:4031 , piece_id=JWMOD7NPWBUIK2ZQAER3YFMZQNDXZKFP345L66NVGKV7EKI7DLOQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.903537184 (263h27m20.455007645s) [noise=true , address=81.171.14.70:4034 , piece_id=K2P6O2RPHOR433TRB7YFBTJSLEY623J7CRMAM77KOZMQKMOLLHZA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.931241638 (263h27m20.482712109s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.939822769 (263h27m20.49129323s) [noise=true , address=81.171.14.70:4029 , piece_id=WXAQ7CIDAZMB2J2GHSMZ532DAMVAJRBNRP3VT7YSY4HJLGZDBX6Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.042469878 (263h27m20.593940339s) [noise=true , address=89.149.201.147:4005 , piece_id=7NYFIWT6B2AO3XCWMMI4TZYM7NROZRLMOLJTKMZYIMCNS6PKIYIQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.044590426 (263h27m20.596060887s) [noise=true , address=89.149.201.147:4020 , piece_id=SSNUBTKK3UIRO2TQY4CIEMM5DRSPC4RUXUEFDYCHK7FOSIHU5S7A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.081767748 (263h27m20.633238209s) [noise=true , address=89.149.201.147:4008 , piece_id=2NUEBJBDOHBC3YOEX53YH3SHG6XK5WI6WTNEJITLXZKDWLLOSARQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133782203 (263h27m20.685252664s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133874820 (263h27m20.685345281s) [seg_pos={0 0}, upload=232059]: Segment reached optimal threshold of 26 pieces. Nov 20 07:31:22.134328153 (263h27m20.685798624s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134338482 (263h27m20.685808943s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134362959 (263h27m20.68583342s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134385041 (263h27m20.685855502s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134417913 (263h27m20.685888364s) [seg_pos={0 0}, upload=232059]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 07:31:22.134530067 (263h27m20.686000528s) [upload=232059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 07:31:22.134536409 (263h27m20.68600687s) [upload=232059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 07:33:08.217836685 (263h29m6.769307177s) [upload=232059]: Done uploading segments... Nov 20 07:33:08.217918711 (263h29m6.769389162s) [upload=232059]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.712420136s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 5.754865653s trace: https://jaeger.dev.storj.io/trace/29eebe057654c99d FAIL (2025-11-20 07:50:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Nov 20 07:31:19.629873593 (263h27m18.181344064s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.633306430 (263h27m18.184776891s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.636780656 (263h27m18.188251117s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.639327946 (263h27m18.190798397s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.641216883 (263h27m18.192687334s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.645856578 (263h27m18.197327039s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.651699423 (263h27m18.203169894s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.653098288 (263h27m18.204568749s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.656601418 (263h27m18.208071899s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.659046414 (263h27m18.210516875s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:20.448435324 (263h27m18.999905785s) [upload=232059]: Next returned nil segment Nov 20 07:31:20.448449921 (263h27m18.999920373s) [upload=232059]: Waiting for error group managing segments... Nov 20 07:31:20.840686863 (263h27m19.392157314s) [noise=true , address=185.167.204.206:4047 , piece_id=AOJHHOC6D4ES5PSABO5CPOA6FFMQCWJSJC4SYRR4TBGE3ZW6WVYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.840944473 (263h27m19.392414934s) [noise=true , address=185.167.204.205:4009 , piece_id=PHZYFRVS7TV7P2TSPX7MMZ3H63VUEUNYLTDKYIRC7PA7YJ2MGJXQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.841171586 (263h27m19.392642047s) [noise=true , address=185.167.204.206:4061 , piece_id=ND4H2MBLMA7TRKNRPKWRV35RW7JBWOQ4W3TDUST35KQSUFMTUJVQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.845413794 (263h27m19.396884255s) [noise=true , address=185.167.204.206:4054 , piece_id=2FKWZRLJAX6LEUNCRXNH4R3MZ6DNY3VHVZ5JK5QEJZ76KD5EDRAA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.846588840 (263h27m19.398059302s) [noise=true , address=185.167.204.206:4072 , piece_id=25EIWSZDRFORHSBI6DXITGLG4JE3YNY6WWUOH4CIRASABTDW6CLA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.848580414 (263h27m19.400050875s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.849535923 (263h27m19.401006414s) [noise=true , address=185.167.204.206:4053 , piece_id=WOHYIAC6PUGDO7LH3WUAC6AZGDPGMSXQPYKFGFOJWRZMP7EFZWRQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853075914 (263h27m19.404546375s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853778040 (263h27m19.405248491s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.869053197 (263h27m19.420523658s) [noise=true , address=185.167.204.206:4058 , piece_id=SISDILWJPPH4JOHOTL3GKS6LEG3DSVWBSU6IWHZU5R3LCX57CE5A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.884471807 (263h27m19.435942268s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.891395812 (263h27m19.442866273s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.407423253 (263h27m19.958893714s) [noise=true , address=81.171.14.70:4046 , piece_id=OHLJUIVJXEARMXSQJAVQHNOUOFT3UMOWA2E2HOZBJD2CETJ6AVWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.434063861 (263h27m19.985534322s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.458913289 (263h27m20.01038375s) [noise=true , address=81.171.14.70:4027 , piece_id=26ZOOIR73NY4PAJQ3WSAU4ZCXMVYEOJDWSTS4PIDHHYVRPRJF44A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.480425362 (263h27m20.031895813s) [noise=true , address=81.171.14.70:4033 , piece_id=VVU5PQACV4GKY45RPB2C3NWUBYEX7ECQZN4W336ZYULO2CQHQSYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.487065786 (263h27m20.038536237s) [noise=true , address=81.171.14.70:4032 , piece_id=2NLDGLW73R6LJ7XNNAJYRTVPLCCSMOAHGBKIKI7TEOKI4L2T6XWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.504477020 (263h27m20.055947481s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.891152100 (263h27m20.442622561s) [noise=true , address=81.171.14.70:4031 , piece_id=JWMOD7NPWBUIK2ZQAER3YFMZQNDXZKFP345L66NVGKV7EKI7DLOQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.903537184 (263h27m20.455007645s) [noise=true , address=81.171.14.70:4034 , piece_id=K2P6O2RPHOR433TRB7YFBTJSLEY623J7CRMAM77KOZMQKMOLLHZA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.931241638 (263h27m20.482712109s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.939822769 (263h27m20.49129323s) [noise=true , address=81.171.14.70:4029 , piece_id=WXAQ7CIDAZMB2J2GHSMZ532DAMVAJRBNRP3VT7YSY4HJLGZDBX6Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.042469878 (263h27m20.593940339s) [noise=true , address=89.149.201.147:4005 , piece_id=7NYFIWT6B2AO3XCWMMI4TZYM7NROZRLMOLJTKMZYIMCNS6PKIYIQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.044590426 (263h27m20.596060887s) [noise=true , address=89.149.201.147:4020 , piece_id=SSNUBTKK3UIRO2TQY4CIEMM5DRSPC4RUXUEFDYCHK7FOSIHU5S7A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.081767748 (263h27m20.633238209s) [noise=true , address=89.149.201.147:4008 , piece_id=2NUEBJBDOHBC3YOEX53YH3SHG6XK5WI6WTNEJITLXZKDWLLOSARQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133782203 (263h27m20.685252664s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133874820 (263h27m20.685345281s) [seg_pos={0 0}, upload=232059]: Segment reached optimal threshold of 26 pieces. Nov 20 07:31:22.134328153 (263h27m20.685798624s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134338482 (263h27m20.685808943s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134362959 (263h27m20.68583342s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134385041 (263h27m20.685855502s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134417913 (263h27m20.685888364s) [seg_pos={0 0}, upload=232059]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 07:31:22.134530067 (263h27m20.686000528s) [upload=232059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 07:31:22.134536409 (263h27m20.68600687s) [upload=232059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 07:33:08.217836685 (263h29m6.769307177s) [upload=232059]: Done uploading segments... Nov 20 07:33:08.217918711 (263h29m6.769389162s) [upload=232059]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.754906441s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 6.206548876s trace: https://jaeger.dev.storj.io/trace/29eebe057654c99d FAIL (2025-11-20 07:49:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Nov 20 07:31:19.629873593 (263h27m18.181344064s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.633306430 (263h27m18.184776891s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.636780656 (263h27m18.188251117s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.639327946 (263h27m18.190798397s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.641216883 (263h27m18.192687334s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.645856578 (263h27m18.197327039s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.651699423 (263h27m18.203169894s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.653098288 (263h27m18.204568749s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.656601418 (263h27m18.208071899s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.659046414 (263h27m18.210516875s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:20.448435324 (263h27m18.999905785s) [upload=232059]: Next returned nil segment Nov 20 07:31:20.448449921 (263h27m18.999920373s) [upload=232059]: Waiting for error group managing segments... Nov 20 07:31:20.840686863 (263h27m19.392157314s) [noise=true , address=185.167.204.206:4047 , piece_id=AOJHHOC6D4ES5PSABO5CPOA6FFMQCWJSJC4SYRR4TBGE3ZW6WVYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.840944473 (263h27m19.392414934s) [noise=true , address=185.167.204.205:4009 , piece_id=PHZYFRVS7TV7P2TSPX7MMZ3H63VUEUNYLTDKYIRC7PA7YJ2MGJXQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.841171586 (263h27m19.392642047s) [noise=true , address=185.167.204.206:4061 , piece_id=ND4H2MBLMA7TRKNRPKWRV35RW7JBWOQ4W3TDUST35KQSUFMTUJVQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.845413794 (263h27m19.396884255s) [noise=true , address=185.167.204.206:4054 , piece_id=2FKWZRLJAX6LEUNCRXNH4R3MZ6DNY3VHVZ5JK5QEJZ76KD5EDRAA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.846588840 (263h27m19.398059302s) [noise=true , address=185.167.204.206:4072 , piece_id=25EIWSZDRFORHSBI6DXITGLG4JE3YNY6WWUOH4CIRASABTDW6CLA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.848580414 (263h27m19.400050875s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.849535923 (263h27m19.401006414s) [noise=true , address=185.167.204.206:4053 , piece_id=WOHYIAC6PUGDO7LH3WUAC6AZGDPGMSXQPYKFGFOJWRZMP7EFZWRQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853075914 (263h27m19.404546375s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853778040 (263h27m19.405248491s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.869053197 (263h27m19.420523658s) [noise=true , address=185.167.204.206:4058 , piece_id=SISDILWJPPH4JOHOTL3GKS6LEG3DSVWBSU6IWHZU5R3LCX57CE5A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.884471807 (263h27m19.435942268s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.891395812 (263h27m19.442866273s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.407423253 (263h27m19.958893714s) [noise=true , address=81.171.14.70:4046 , piece_id=OHLJUIVJXEARMXSQJAVQHNOUOFT3UMOWA2E2HOZBJD2CETJ6AVWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.434063861 (263h27m19.985534322s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.458913289 (263h27m20.01038375s) [noise=true , address=81.171.14.70:4027 , piece_id=26ZOOIR73NY4PAJQ3WSAU4ZCXMVYEOJDWSTS4PIDHHYVRPRJF44A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.480425362 (263h27m20.031895813s) [noise=true , address=81.171.14.70:4033 , piece_id=VVU5PQACV4GKY45RPB2C3NWUBYEX7ECQZN4W336ZYULO2CQHQSYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.487065786 (263h27m20.038536237s) [noise=true , address=81.171.14.70:4032 , piece_id=2NLDGLW73R6LJ7XNNAJYRTVPLCCSMOAHGBKIKI7TEOKI4L2T6XWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.504477020 (263h27m20.055947481s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.891152100 (263h27m20.442622561s) [noise=true , address=81.171.14.70:4031 , piece_id=JWMOD7NPWBUIK2ZQAER3YFMZQNDXZKFP345L66NVGKV7EKI7DLOQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.903537184 (263h27m20.455007645s) [noise=true , address=81.171.14.70:4034 , piece_id=K2P6O2RPHOR433TRB7YFBTJSLEY623J7CRMAM77KOZMQKMOLLHZA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.931241638 (263h27m20.482712109s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.939822769 (263h27m20.49129323s) [noise=true , address=81.171.14.70:4029 , piece_id=WXAQ7CIDAZMB2J2GHSMZ532DAMVAJRBNRP3VT7YSY4HJLGZDBX6Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.042469878 (263h27m20.593940339s) [noise=true , address=89.149.201.147:4005 , piece_id=7NYFIWT6B2AO3XCWMMI4TZYM7NROZRLMOLJTKMZYIMCNS6PKIYIQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.044590426 (263h27m20.596060887s) [noise=true , address=89.149.201.147:4020 , piece_id=SSNUBTKK3UIRO2TQY4CIEMM5DRSPC4RUXUEFDYCHK7FOSIHU5S7A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.081767748 (263h27m20.633238209s) [noise=true , address=89.149.201.147:4008 , piece_id=2NUEBJBDOHBC3YOEX53YH3SHG6XK5WI6WTNEJITLXZKDWLLOSARQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133782203 (263h27m20.685252664s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133874820 (263h27m20.685345281s) [seg_pos={0 0}, upload=232059]: Segment reached optimal threshold of 26 pieces. Nov 20 07:31:22.134328153 (263h27m20.685798624s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134338482 (263h27m20.685808943s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134362959 (263h27m20.68583342s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134385041 (263h27m20.685855502s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134417913 (263h27m20.685888364s) [seg_pos={0 0}, upload=232059]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 07:31:22.134530067 (263h27m20.686000528s) [upload=232059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 07:31:22.134536409 (263h27m20.68600687s) [upload=232059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 07:33:08.217836685 (263h29m6.769307177s) [upload=232059]: Done uploading segments... Nov 20 07:33:08.217918711 (263h29m6.769389162s) [upload=232059]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.206578432s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 6.311774526s trace: https://jaeger.dev.storj.io/trace/29eebe057654c99d FAIL (2025-11-20 07:48:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Nov 20 07:31:19.629873593 (263h27m18.181344064s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.633306430 (263h27m18.184776891s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.636780656 (263h27m18.188251117s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.639327946 (263h27m18.190798397s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.641216883 (263h27m18.192687334s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.645856578 (263h27m18.197327039s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.651699423 (263h27m18.203169894s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.653098288 (263h27m18.204568749s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.656601418 (263h27m18.208071899s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.659046414 (263h27m18.210516875s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:20.448435324 (263h27m18.999905785s) [upload=232059]: Next returned nil segment Nov 20 07:31:20.448449921 (263h27m18.999920373s) [upload=232059]: Waiting for error group managing segments... Nov 20 07:31:20.840686863 (263h27m19.392157314s) [noise=true , address=185.167.204.206:4047 , piece_id=AOJHHOC6D4ES5PSABO5CPOA6FFMQCWJSJC4SYRR4TBGE3ZW6WVYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.840944473 (263h27m19.392414934s) [noise=true , address=185.167.204.205:4009 , piece_id=PHZYFRVS7TV7P2TSPX7MMZ3H63VUEUNYLTDKYIRC7PA7YJ2MGJXQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.841171586 (263h27m19.392642047s) [noise=true , address=185.167.204.206:4061 , piece_id=ND4H2MBLMA7TRKNRPKWRV35RW7JBWOQ4W3TDUST35KQSUFMTUJVQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.845413794 (263h27m19.396884255s) [noise=true , address=185.167.204.206:4054 , piece_id=2FKWZRLJAX6LEUNCRXNH4R3MZ6DNY3VHVZ5JK5QEJZ76KD5EDRAA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.846588840 (263h27m19.398059302s) [noise=true , address=185.167.204.206:4072 , piece_id=25EIWSZDRFORHSBI6DXITGLG4JE3YNY6WWUOH4CIRASABTDW6CLA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.848580414 (263h27m19.400050875s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.849535923 (263h27m19.401006414s) [noise=true , address=185.167.204.206:4053 , piece_id=WOHYIAC6PUGDO7LH3WUAC6AZGDPGMSXQPYKFGFOJWRZMP7EFZWRQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853075914 (263h27m19.404546375s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853778040 (263h27m19.405248491s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.869053197 (263h27m19.420523658s) [noise=true , address=185.167.204.206:4058 , piece_id=SISDILWJPPH4JOHOTL3GKS6LEG3DSVWBSU6IWHZU5R3LCX57CE5A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.884471807 (263h27m19.435942268s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.891395812 (263h27m19.442866273s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.407423253 (263h27m19.958893714s) [noise=true , address=81.171.14.70:4046 , piece_id=OHLJUIVJXEARMXSQJAVQHNOUOFT3UMOWA2E2HOZBJD2CETJ6AVWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.434063861 (263h27m19.985534322s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.458913289 (263h27m20.01038375s) [noise=true , address=81.171.14.70:4027 , piece_id=26ZOOIR73NY4PAJQ3WSAU4ZCXMVYEOJDWSTS4PIDHHYVRPRJF44A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.480425362 (263h27m20.031895813s) [noise=true , address=81.171.14.70:4033 , piece_id=VVU5PQACV4GKY45RPB2C3NWUBYEX7ECQZN4W336ZYULO2CQHQSYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.487065786 (263h27m20.038536237s) [noise=true , address=81.171.14.70:4032 , piece_id=2NLDGLW73R6LJ7XNNAJYRTVPLCCSMOAHGBKIKI7TEOKI4L2T6XWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.504477020 (263h27m20.055947481s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.891152100 (263h27m20.442622561s) [noise=true , address=81.171.14.70:4031 , piece_id=JWMOD7NPWBUIK2ZQAER3YFMZQNDXZKFP345L66NVGKV7EKI7DLOQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.903537184 (263h27m20.455007645s) [noise=true , address=81.171.14.70:4034 , piece_id=K2P6O2RPHOR433TRB7YFBTJSLEY623J7CRMAM77KOZMQKMOLLHZA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.931241638 (263h27m20.482712109s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.939822769 (263h27m20.49129323s) [noise=true , address=81.171.14.70:4029 , piece_id=WXAQ7CIDAZMB2J2GHSMZ532DAMVAJRBNRP3VT7YSY4HJLGZDBX6Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.042469878 (263h27m20.593940339s) [noise=true , address=89.149.201.147:4005 , piece_id=7NYFIWT6B2AO3XCWMMI4TZYM7NROZRLMOLJTKMZYIMCNS6PKIYIQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.044590426 (263h27m20.596060887s) [noise=true , address=89.149.201.147:4020 , piece_id=SSNUBTKK3UIRO2TQY4CIEMM5DRSPC4RUXUEFDYCHK7FOSIHU5S7A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.081767748 (263h27m20.633238209s) [noise=true , address=89.149.201.147:4008 , piece_id=2NUEBJBDOHBC3YOEX53YH3SHG6XK5WI6WTNEJITLXZKDWLLOSARQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133782203 (263h27m20.685252664s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133874820 (263h27m20.685345281s) [seg_pos={0 0}, upload=232059]: Segment reached optimal threshold of 26 pieces. Nov 20 07:31:22.134328153 (263h27m20.685798624s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134338482 (263h27m20.685808943s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134362959 (263h27m20.68583342s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134385041 (263h27m20.685855502s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134417913 (263h27m20.685888364s) [seg_pos={0 0}, upload=232059]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 07:31:22.134530067 (263h27m20.686000528s) [upload=232059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 07:31:22.134536409 (263h27m20.68600687s) [upload=232059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 07:33:08.217836685 (263h29m6.769307177s) [upload=232059]: Done uploading segments... Nov 20 07:33:08.217918711 (263h29m6.769389162s) [upload=232059]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.311804184s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 5.289510468s trace: https://jaeger.dev.storj.io/trace/29eebe057654c99d FAIL (2025-11-20 07:47:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Nov 20 07:31:19.629873593 (263h27m18.181344064s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.633306430 (263h27m18.184776891s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.636780656 (263h27m18.188251117s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.639327946 (263h27m18.190798397s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.641216883 (263h27m18.192687334s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.645856578 (263h27m18.197327039s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.651699423 (263h27m18.203169894s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.653098288 (263h27m18.204568749s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.656601418 (263h27m18.208071899s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.659046414 (263h27m18.210516875s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:20.448435324 (263h27m18.999905785s) [upload=232059]: Next returned nil segment Nov 20 07:31:20.448449921 (263h27m18.999920373s) [upload=232059]: Waiting for error group managing segments... Nov 20 07:31:20.840686863 (263h27m19.392157314s) [noise=true , address=185.167.204.206:4047 , piece_id=AOJHHOC6D4ES5PSABO5CPOA6FFMQCWJSJC4SYRR4TBGE3ZW6WVYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.840944473 (263h27m19.392414934s) [noise=true , address=185.167.204.205:4009 , piece_id=PHZYFRVS7TV7P2TSPX7MMZ3H63VUEUNYLTDKYIRC7PA7YJ2MGJXQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.841171586 (263h27m19.392642047s) [noise=true , address=185.167.204.206:4061 , piece_id=ND4H2MBLMA7TRKNRPKWRV35RW7JBWOQ4W3TDUST35KQSUFMTUJVQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.845413794 (263h27m19.396884255s) [noise=true , address=185.167.204.206:4054 , piece_id=2FKWZRLJAX6LEUNCRXNH4R3MZ6DNY3VHVZ5JK5QEJZ76KD5EDRAA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.846588840 (263h27m19.398059302s) [noise=true , address=185.167.204.206:4072 , piece_id=25EIWSZDRFORHSBI6DXITGLG4JE3YNY6WWUOH4CIRASABTDW6CLA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.848580414 (263h27m19.400050875s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.849535923 (263h27m19.401006414s) [noise=true , address=185.167.204.206:4053 , piece_id=WOHYIAC6PUGDO7LH3WUAC6AZGDPGMSXQPYKFGFOJWRZMP7EFZWRQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853075914 (263h27m19.404546375s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853778040 (263h27m19.405248491s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.869053197 (263h27m19.420523658s) [noise=true , address=185.167.204.206:4058 , piece_id=SISDILWJPPH4JOHOTL3GKS6LEG3DSVWBSU6IWHZU5R3LCX57CE5A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.884471807 (263h27m19.435942268s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.891395812 (263h27m19.442866273s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.407423253 (263h27m19.958893714s) [noise=true , address=81.171.14.70:4046 , piece_id=OHLJUIVJXEARMXSQJAVQHNOUOFT3UMOWA2E2HOZBJD2CETJ6AVWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.434063861 (263h27m19.985534322s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.458913289 (263h27m20.01038375s) [noise=true , address=81.171.14.70:4027 , piece_id=26ZOOIR73NY4PAJQ3WSAU4ZCXMVYEOJDWSTS4PIDHHYVRPRJF44A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.480425362 (263h27m20.031895813s) [noise=true , address=81.171.14.70:4033 , piece_id=VVU5PQACV4GKY45RPB2C3NWUBYEX7ECQZN4W336ZYULO2CQHQSYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.487065786 (263h27m20.038536237s) [noise=true , address=81.171.14.70:4032 , piece_id=2NLDGLW73R6LJ7XNNAJYRTVPLCCSMOAHGBKIKI7TEOKI4L2T6XWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.504477020 (263h27m20.055947481s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.891152100 (263h27m20.442622561s) [noise=true , address=81.171.14.70:4031 , piece_id=JWMOD7NPWBUIK2ZQAER3YFMZQNDXZKFP345L66NVGKV7EKI7DLOQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.903537184 (263h27m20.455007645s) [noise=true , address=81.171.14.70:4034 , piece_id=K2P6O2RPHOR433TRB7YFBTJSLEY623J7CRMAM77KOZMQKMOLLHZA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.931241638 (263h27m20.482712109s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.939822769 (263h27m20.49129323s) [noise=true , address=81.171.14.70:4029 , piece_id=WXAQ7CIDAZMB2J2GHSMZ532DAMVAJRBNRP3VT7YSY4HJLGZDBX6Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.042469878 (263h27m20.593940339s) [noise=true , address=89.149.201.147:4005 , piece_id=7NYFIWT6B2AO3XCWMMI4TZYM7NROZRLMOLJTKMZYIMCNS6PKIYIQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.044590426 (263h27m20.596060887s) [noise=true , address=89.149.201.147:4020 , piece_id=SSNUBTKK3UIRO2TQY4CIEMM5DRSPC4RUXUEFDYCHK7FOSIHU5S7A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.081767748 (263h27m20.633238209s) [noise=true , address=89.149.201.147:4008 , piece_id=2NUEBJBDOHBC3YOEX53YH3SHG6XK5WI6WTNEJITLXZKDWLLOSARQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133782203 (263h27m20.685252664s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133874820 (263h27m20.685345281s) [seg_pos={0 0}, upload=232059]: Segment reached optimal threshold of 26 pieces. Nov 20 07:31:22.134328153 (263h27m20.685798624s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134338482 (263h27m20.685808943s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134362959 (263h27m20.68583342s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134385041 (263h27m20.685855502s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134417913 (263h27m20.685888364s) [seg_pos={0 0}, upload=232059]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 07:31:22.134530067 (263h27m20.686000528s) [upload=232059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 07:31:22.134536409 (263h27m20.68600687s) [upload=232059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 07:33:08.217836685 (263h29m6.769307177s) [upload=232059]: Done uploading segments... Nov 20 07:33:08.217918711 (263h29m6.769389162s) [upload=232059]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.289539263s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 7.195890089s trace: https://jaeger.dev.storj.io/trace/29eebe057654c99d FAIL (2025-11-20 07:46:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Nov 20 07:31:19.629873593 (263h27m18.181344064s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.633306430 (263h27m18.184776891s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.636780656 (263h27m18.188251117s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.639327946 (263h27m18.190798397s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.641216883 (263h27m18.192687334s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.645856578 (263h27m18.197327039s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.651699423 (263h27m18.203169894s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.653098288 (263h27m18.204568749s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.656601418 (263h27m18.208071899s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.659046414 (263h27m18.210516875s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:20.448435324 (263h27m18.999905785s) [upload=232059]: Next returned nil segment Nov 20 07:31:20.448449921 (263h27m18.999920373s) [upload=232059]: Waiting for error group managing segments... Nov 20 07:31:20.840686863 (263h27m19.392157314s) [noise=true , address=185.167.204.206:4047 , piece_id=AOJHHOC6D4ES5PSABO5CPOA6FFMQCWJSJC4SYRR4TBGE3ZW6WVYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.840944473 (263h27m19.392414934s) [noise=true , address=185.167.204.205:4009 , piece_id=PHZYFRVS7TV7P2TSPX7MMZ3H63VUEUNYLTDKYIRC7PA7YJ2MGJXQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.841171586 (263h27m19.392642047s) [noise=true , address=185.167.204.206:4061 , piece_id=ND4H2MBLMA7TRKNRPKWRV35RW7JBWOQ4W3TDUST35KQSUFMTUJVQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.845413794 (263h27m19.396884255s) [noise=true , address=185.167.204.206:4054 , piece_id=2FKWZRLJAX6LEUNCRXNH4R3MZ6DNY3VHVZ5JK5QEJZ76KD5EDRAA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.846588840 (263h27m19.398059302s) [noise=true , address=185.167.204.206:4072 , piece_id=25EIWSZDRFORHSBI6DXITGLG4JE3YNY6WWUOH4CIRASABTDW6CLA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.848580414 (263h27m19.400050875s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.849535923 (263h27m19.401006414s) [noise=true , address=185.167.204.206:4053 , piece_id=WOHYIAC6PUGDO7LH3WUAC6AZGDPGMSXQPYKFGFOJWRZMP7EFZWRQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853075914 (263h27m19.404546375s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853778040 (263h27m19.405248491s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.869053197 (263h27m19.420523658s) [noise=true , address=185.167.204.206:4058 , piece_id=SISDILWJPPH4JOHOTL3GKS6LEG3DSVWBSU6IWHZU5R3LCX57CE5A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.884471807 (263h27m19.435942268s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.891395812 (263h27m19.442866273s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.407423253 (263h27m19.958893714s) [noise=true , address=81.171.14.70:4046 , piece_id=OHLJUIVJXEARMXSQJAVQHNOUOFT3UMOWA2E2HOZBJD2CETJ6AVWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.434063861 (263h27m19.985534322s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.458913289 (263h27m20.01038375s) [noise=true , address=81.171.14.70:4027 , piece_id=26ZOOIR73NY4PAJQ3WSAU4ZCXMVYEOJDWSTS4PIDHHYVRPRJF44A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.480425362 (263h27m20.031895813s) [noise=true , address=81.171.14.70:4033 , piece_id=VVU5PQACV4GKY45RPB2C3NWUBYEX7ECQZN4W336ZYULO2CQHQSYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.487065786 (263h27m20.038536237s) [noise=true , address=81.171.14.70:4032 , piece_id=2NLDGLW73R6LJ7XNNAJYRTVPLCCSMOAHGBKIKI7TEOKI4L2T6XWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.504477020 (263h27m20.055947481s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.891152100 (263h27m20.442622561s) [noise=true , address=81.171.14.70:4031 , piece_id=JWMOD7NPWBUIK2ZQAER3YFMZQNDXZKFP345L66NVGKV7EKI7DLOQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.903537184 (263h27m20.455007645s) [noise=true , address=81.171.14.70:4034 , piece_id=K2P6O2RPHOR433TRB7YFBTJSLEY623J7CRMAM77KOZMQKMOLLHZA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.931241638 (263h27m20.482712109s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.939822769 (263h27m20.49129323s) [noise=true , address=81.171.14.70:4029 , piece_id=WXAQ7CIDAZMB2J2GHSMZ532DAMVAJRBNRP3VT7YSY4HJLGZDBX6Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.042469878 (263h27m20.593940339s) [noise=true , address=89.149.201.147:4005 , piece_id=7NYFIWT6B2AO3XCWMMI4TZYM7NROZRLMOLJTKMZYIMCNS6PKIYIQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.044590426 (263h27m20.596060887s) [noise=true , address=89.149.201.147:4020 , piece_id=SSNUBTKK3UIRO2TQY4CIEMM5DRSPC4RUXUEFDYCHK7FOSIHU5S7A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.081767748 (263h27m20.633238209s) [noise=true , address=89.149.201.147:4008 , piece_id=2NUEBJBDOHBC3YOEX53YH3SHG6XK5WI6WTNEJITLXZKDWLLOSARQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133782203 (263h27m20.685252664s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133874820 (263h27m20.685345281s) [seg_pos={0 0}, upload=232059]: Segment reached optimal threshold of 26 pieces. Nov 20 07:31:22.134328153 (263h27m20.685798624s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134338482 (263h27m20.685808943s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134362959 (263h27m20.68583342s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134385041 (263h27m20.685855502s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134417913 (263h27m20.685888364s) [seg_pos={0 0}, upload=232059]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 07:31:22.134530067 (263h27m20.686000528s) [upload=232059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 07:31:22.134536409 (263h27m20.68600687s) [upload=232059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 07:33:08.217836685 (263h29m6.769307177s) [upload=232059]: Done uploading segments... Nov 20 07:33:08.217918711 (263h29m6.769389162s) [upload=232059]: Upload finished. err: metaclient: context deadline exceeded Duration: 7.195926347s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 5.845364255s trace: https://jaeger.dev.storj.io/trace/29eebe057654c99d FAIL (2025-11-20 07:45:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Nov 20 07:31:19.629873593 (263h27m18.181344064s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.633306430 (263h27m18.184776891s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.636780656 (263h27m18.188251117s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.639327946 (263h27m18.190798397s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.641216883 (263h27m18.192687334s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.645856578 (263h27m18.197327039s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.651699423 (263h27m18.203169894s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.653098288 (263h27m18.204568749s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.656601418 (263h27m18.208071899s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.659046414 (263h27m18.210516875s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:20.448435324 (263h27m18.999905785s) [upload=232059]: Next returned nil segment Nov 20 07:31:20.448449921 (263h27m18.999920373s) [upload=232059]: Waiting for error group managing segments... Nov 20 07:31:20.840686863 (263h27m19.392157314s) [noise=true , address=185.167.204.206:4047 , piece_id=AOJHHOC6D4ES5PSABO5CPOA6FFMQCWJSJC4SYRR4TBGE3ZW6WVYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.840944473 (263h27m19.392414934s) [noise=true , address=185.167.204.205:4009 , piece_id=PHZYFRVS7TV7P2TSPX7MMZ3H63VUEUNYLTDKYIRC7PA7YJ2MGJXQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.841171586 (263h27m19.392642047s) [noise=true , address=185.167.204.206:4061 , piece_id=ND4H2MBLMA7TRKNRPKWRV35RW7JBWOQ4W3TDUST35KQSUFMTUJVQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.845413794 (263h27m19.396884255s) [noise=true , address=185.167.204.206:4054 , piece_id=2FKWZRLJAX6LEUNCRXNH4R3MZ6DNY3VHVZ5JK5QEJZ76KD5EDRAA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.846588840 (263h27m19.398059302s) [noise=true , address=185.167.204.206:4072 , piece_id=25EIWSZDRFORHSBI6DXITGLG4JE3YNY6WWUOH4CIRASABTDW6CLA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.848580414 (263h27m19.400050875s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.849535923 (263h27m19.401006414s) [noise=true , address=185.167.204.206:4053 , piece_id=WOHYIAC6PUGDO7LH3WUAC6AZGDPGMSXQPYKFGFOJWRZMP7EFZWRQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853075914 (263h27m19.404546375s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853778040 (263h27m19.405248491s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.869053197 (263h27m19.420523658s) [noise=true , address=185.167.204.206:4058 , piece_id=SISDILWJPPH4JOHOTL3GKS6LEG3DSVWBSU6IWHZU5R3LCX57CE5A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.884471807 (263h27m19.435942268s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.891395812 (263h27m19.442866273s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.407423253 (263h27m19.958893714s) [noise=true , address=81.171.14.70:4046 , piece_id=OHLJUIVJXEARMXSQJAVQHNOUOFT3UMOWA2E2HOZBJD2CETJ6AVWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.434063861 (263h27m19.985534322s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.458913289 (263h27m20.01038375s) [noise=true , address=81.171.14.70:4027 , piece_id=26ZOOIR73NY4PAJQ3WSAU4ZCXMVYEOJDWSTS4PIDHHYVRPRJF44A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.480425362 (263h27m20.031895813s) [noise=true , address=81.171.14.70:4033 , piece_id=VVU5PQACV4GKY45RPB2C3NWUBYEX7ECQZN4W336ZYULO2CQHQSYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.487065786 (263h27m20.038536237s) [noise=true , address=81.171.14.70:4032 , piece_id=2NLDGLW73R6LJ7XNNAJYRTVPLCCSMOAHGBKIKI7TEOKI4L2T6XWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.504477020 (263h27m20.055947481s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.891152100 (263h27m20.442622561s) [noise=true , address=81.171.14.70:4031 , piece_id=JWMOD7NPWBUIK2ZQAER3YFMZQNDXZKFP345L66NVGKV7EKI7DLOQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.903537184 (263h27m20.455007645s) [noise=true , address=81.171.14.70:4034 , piece_id=K2P6O2RPHOR433TRB7YFBTJSLEY623J7CRMAM77KOZMQKMOLLHZA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.931241638 (263h27m20.482712109s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.939822769 (263h27m20.49129323s) [noise=true , address=81.171.14.70:4029 , piece_id=WXAQ7CIDAZMB2J2GHSMZ532DAMVAJRBNRP3VT7YSY4HJLGZDBX6Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.042469878 (263h27m20.593940339s) [noise=true , address=89.149.201.147:4005 , piece_id=7NYFIWT6B2AO3XCWMMI4TZYM7NROZRLMOLJTKMZYIMCNS6PKIYIQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.044590426 (263h27m20.596060887s) [noise=true , address=89.149.201.147:4020 , piece_id=SSNUBTKK3UIRO2TQY4CIEMM5DRSPC4RUXUEFDYCHK7FOSIHU5S7A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.081767748 (263h27m20.633238209s) [noise=true , address=89.149.201.147:4008 , piece_id=2NUEBJBDOHBC3YOEX53YH3SHG6XK5WI6WTNEJITLXZKDWLLOSARQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133782203 (263h27m20.685252664s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133874820 (263h27m20.685345281s) [seg_pos={0 0}, upload=232059]: Segment reached optimal threshold of 26 pieces. Nov 20 07:31:22.134328153 (263h27m20.685798624s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134338482 (263h27m20.685808943s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134362959 (263h27m20.68583342s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134385041 (263h27m20.685855502s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134417913 (263h27m20.685888364s) [seg_pos={0 0}, upload=232059]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 07:31:22.134530067 (263h27m20.686000528s) [upload=232059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 07:31:22.134536409 (263h27m20.68600687s) [upload=232059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 07:33:08.217836685 (263h29m6.769307177s) [upload=232059]: Done uploading segments... Nov 20 07:33:08.217918711 (263h29m6.769389162s) [upload=232059]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.845394763s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 6.866260517s trace: https://jaeger.dev.storj.io/trace/29eebe057654c99d FAIL (2025-11-20 07:45:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Nov 20 07:31:19.629873593 (263h27m18.181344064s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.633306430 (263h27m18.184776891s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.636780656 (263h27m18.188251117s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.639327946 (263h27m18.190798397s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.641216883 (263h27m18.192687334s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.645856578 (263h27m18.197327039s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.651699423 (263h27m18.203169894s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.653098288 (263h27m18.204568749s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.656601418 (263h27m18.208071899s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.659046414 (263h27m18.210516875s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:20.448435324 (263h27m18.999905785s) [upload=232059]: Next returned nil segment Nov 20 07:31:20.448449921 (263h27m18.999920373s) [upload=232059]: Waiting for error group managing segments... Nov 20 07:31:20.840686863 (263h27m19.392157314s) [noise=true , address=185.167.204.206:4047 , piece_id=AOJHHOC6D4ES5PSABO5CPOA6FFMQCWJSJC4SYRR4TBGE3ZW6WVYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.840944473 (263h27m19.392414934s) [noise=true , address=185.167.204.205:4009 , piece_id=PHZYFRVS7TV7P2TSPX7MMZ3H63VUEUNYLTDKYIRC7PA7YJ2MGJXQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.841171586 (263h27m19.392642047s) [noise=true , address=185.167.204.206:4061 , piece_id=ND4H2MBLMA7TRKNRPKWRV35RW7JBWOQ4W3TDUST35KQSUFMTUJVQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.845413794 (263h27m19.396884255s) [noise=true , address=185.167.204.206:4054 , piece_id=2FKWZRLJAX6LEUNCRXNH4R3MZ6DNY3VHVZ5JK5QEJZ76KD5EDRAA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.846588840 (263h27m19.398059302s) [noise=true , address=185.167.204.206:4072 , piece_id=25EIWSZDRFORHSBI6DXITGLG4JE3YNY6WWUOH4CIRASABTDW6CLA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.848580414 (263h27m19.400050875s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.849535923 (263h27m19.401006414s) [noise=true , address=185.167.204.206:4053 , piece_id=WOHYIAC6PUGDO7LH3WUAC6AZGDPGMSXQPYKFGFOJWRZMP7EFZWRQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853075914 (263h27m19.404546375s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853778040 (263h27m19.405248491s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.869053197 (263h27m19.420523658s) [noise=true , address=185.167.204.206:4058 , piece_id=SISDILWJPPH4JOHOTL3GKS6LEG3DSVWBSU6IWHZU5R3LCX57CE5A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.884471807 (263h27m19.435942268s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.891395812 (263h27m19.442866273s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.407423253 (263h27m19.958893714s) [noise=true , address=81.171.14.70:4046 , piece_id=OHLJUIVJXEARMXSQJAVQHNOUOFT3UMOWA2E2HOZBJD2CETJ6AVWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.434063861 (263h27m19.985534322s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.458913289 (263h27m20.01038375s) [noise=true , address=81.171.14.70:4027 , piece_id=26ZOOIR73NY4PAJQ3WSAU4ZCXMVYEOJDWSTS4PIDHHYVRPRJF44A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.480425362 (263h27m20.031895813s) [noise=true , address=81.171.14.70:4033 , piece_id=VVU5PQACV4GKY45RPB2C3NWUBYEX7ECQZN4W336ZYULO2CQHQSYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.487065786 (263h27m20.038536237s) [noise=true , address=81.171.14.70:4032 , piece_id=2NLDGLW73R6LJ7XNNAJYRTVPLCCSMOAHGBKIKI7TEOKI4L2T6XWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.504477020 (263h27m20.055947481s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.891152100 (263h27m20.442622561s) [noise=true , address=81.171.14.70:4031 , piece_id=JWMOD7NPWBUIK2ZQAER3YFMZQNDXZKFP345L66NVGKV7EKI7DLOQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.903537184 (263h27m20.455007645s) [noise=true , address=81.171.14.70:4034 , piece_id=K2P6O2RPHOR433TRB7YFBTJSLEY623J7CRMAM77KOZMQKMOLLHZA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.931241638 (263h27m20.482712109s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.939822769 (263h27m20.49129323s) [noise=true , address=81.171.14.70:4029 , piece_id=WXAQ7CIDAZMB2J2GHSMZ532DAMVAJRBNRP3VT7YSY4HJLGZDBX6Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.042469878 (263h27m20.593940339s) [noise=true , address=89.149.201.147:4005 , piece_id=7NYFIWT6B2AO3XCWMMI4TZYM7NROZRLMOLJTKMZYIMCNS6PKIYIQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.044590426 (263h27m20.596060887s) [noise=true , address=89.149.201.147:4020 , piece_id=SSNUBTKK3UIRO2TQY4CIEMM5DRSPC4RUXUEFDYCHK7FOSIHU5S7A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.081767748 (263h27m20.633238209s) [noise=true , address=89.149.201.147:4008 , piece_id=2NUEBJBDOHBC3YOEX53YH3SHG6XK5WI6WTNEJITLXZKDWLLOSARQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133782203 (263h27m20.685252664s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133874820 (263h27m20.685345281s) [seg_pos={0 0}, upload=232059]: Segment reached optimal threshold of 26 pieces. Nov 20 07:31:22.134328153 (263h27m20.685798624s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134338482 (263h27m20.685808943s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134362959 (263h27m20.68583342s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134385041 (263h27m20.685855502s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134417913 (263h27m20.685888364s) [seg_pos={0 0}, upload=232059]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 07:31:22.134530067 (263h27m20.686000528s) [upload=232059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 07:31:22.134536409 (263h27m20.68600687s) [upload=232059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 07:33:08.217836685 (263h29m6.769307177s) [upload=232059]: Done uploading segments... Nov 20 07:33:08.217918711 (263h29m6.769389162s) [upload=232059]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.866291165s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 5.251986736s trace: https://jaeger.dev.storj.io/trace/29eebe057654c99d FAIL (2025-11-20 07:44:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Nov 20 07:31:19.629873593 (263h27m18.181344064s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.633306430 (263h27m18.184776891s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.636780656 (263h27m18.188251117s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.639327946 (263h27m18.190798397s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.641216883 (263h27m18.192687334s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.645856578 (263h27m18.197327039s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.651699423 (263h27m18.203169894s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.653098288 (263h27m18.204568749s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.656601418 (263h27m18.208071899s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.659046414 (263h27m18.210516875s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:20.448435324 (263h27m18.999905785s) [upload=232059]: Next returned nil segment Nov 20 07:31:20.448449921 (263h27m18.999920373s) [upload=232059]: Waiting for error group managing segments... Nov 20 07:31:20.840686863 (263h27m19.392157314s) [noise=true , address=185.167.204.206:4047 , piece_id=AOJHHOC6D4ES5PSABO5CPOA6FFMQCWJSJC4SYRR4TBGE3ZW6WVYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.840944473 (263h27m19.392414934s) [noise=true , address=185.167.204.205:4009 , piece_id=PHZYFRVS7TV7P2TSPX7MMZ3H63VUEUNYLTDKYIRC7PA7YJ2MGJXQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.841171586 (263h27m19.392642047s) [noise=true , address=185.167.204.206:4061 , piece_id=ND4H2MBLMA7TRKNRPKWRV35RW7JBWOQ4W3TDUST35KQSUFMTUJVQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.845413794 (263h27m19.396884255s) [noise=true , address=185.167.204.206:4054 , piece_id=2FKWZRLJAX6LEUNCRXNH4R3MZ6DNY3VHVZ5JK5QEJZ76KD5EDRAA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.846588840 (263h27m19.398059302s) [noise=true , address=185.167.204.206:4072 , piece_id=25EIWSZDRFORHSBI6DXITGLG4JE3YNY6WWUOH4CIRASABTDW6CLA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.848580414 (263h27m19.400050875s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.849535923 (263h27m19.401006414s) [noise=true , address=185.167.204.206:4053 , piece_id=WOHYIAC6PUGDO7LH3WUAC6AZGDPGMSXQPYKFGFOJWRZMP7EFZWRQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853075914 (263h27m19.404546375s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853778040 (263h27m19.405248491s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.869053197 (263h27m19.420523658s) [noise=true , address=185.167.204.206:4058 , piece_id=SISDILWJPPH4JOHOTL3GKS6LEG3DSVWBSU6IWHZU5R3LCX57CE5A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.884471807 (263h27m19.435942268s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.891395812 (263h27m19.442866273s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.407423253 (263h27m19.958893714s) [noise=true , address=81.171.14.70:4046 , piece_id=OHLJUIVJXEARMXSQJAVQHNOUOFT3UMOWA2E2HOZBJD2CETJ6AVWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.434063861 (263h27m19.985534322s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.458913289 (263h27m20.01038375s) [noise=true , address=81.171.14.70:4027 , piece_id=26ZOOIR73NY4PAJQ3WSAU4ZCXMVYEOJDWSTS4PIDHHYVRPRJF44A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.480425362 (263h27m20.031895813s) [noise=true , address=81.171.14.70:4033 , piece_id=VVU5PQACV4GKY45RPB2C3NWUBYEX7ECQZN4W336ZYULO2CQHQSYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.487065786 (263h27m20.038536237s) [noise=true , address=81.171.14.70:4032 , piece_id=2NLDGLW73R6LJ7XNNAJYRTVPLCCSMOAHGBKIKI7TEOKI4L2T6XWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.504477020 (263h27m20.055947481s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.891152100 (263h27m20.442622561s) [noise=true , address=81.171.14.70:4031 , piece_id=JWMOD7NPWBUIK2ZQAER3YFMZQNDXZKFP345L66NVGKV7EKI7DLOQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.903537184 (263h27m20.455007645s) [noise=true , address=81.171.14.70:4034 , piece_id=K2P6O2RPHOR433TRB7YFBTJSLEY623J7CRMAM77KOZMQKMOLLHZA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.931241638 (263h27m20.482712109s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.939822769 (263h27m20.49129323s) [noise=true , address=81.171.14.70:4029 , piece_id=WXAQ7CIDAZMB2J2GHSMZ532DAMVAJRBNRP3VT7YSY4HJLGZDBX6Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.042469878 (263h27m20.593940339s) [noise=true , address=89.149.201.147:4005 , piece_id=7NYFIWT6B2AO3XCWMMI4TZYM7NROZRLMOLJTKMZYIMCNS6PKIYIQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.044590426 (263h27m20.596060887s) [noise=true , address=89.149.201.147:4020 , piece_id=SSNUBTKK3UIRO2TQY4CIEMM5DRSPC4RUXUEFDYCHK7FOSIHU5S7A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.081767748 (263h27m20.633238209s) [noise=true , address=89.149.201.147:4008 , piece_id=2NUEBJBDOHBC3YOEX53YH3SHG6XK5WI6WTNEJITLXZKDWLLOSARQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133782203 (263h27m20.685252664s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133874820 (263h27m20.685345281s) [seg_pos={0 0}, upload=232059]: Segment reached optimal threshold of 26 pieces. Nov 20 07:31:22.134328153 (263h27m20.685798624s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134338482 (263h27m20.685808943s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134362959 (263h27m20.68583342s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134385041 (263h27m20.685855502s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134417913 (263h27m20.685888364s) [seg_pos={0 0}, upload=232059]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 07:31:22.134530067 (263h27m20.686000528s) [upload=232059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 07:31:22.134536409 (263h27m20.68600687s) [upload=232059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 07:33:08.217836685 (263h29m6.769307177s) [upload=232059]: Done uploading segments... Nov 20 07:33:08.217918711 (263h29m6.769389162s) [upload=232059]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.252020551s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 5.761430197s trace: https://jaeger.dev.storj.io/trace/29eebe057654c99d FAIL (2025-11-20 07:43:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Nov 20 07:31:19.629873593 (263h27m18.181344064s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.633306430 (263h27m18.184776891s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.636780656 (263h27m18.188251117s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.639327946 (263h27m18.190798397s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.641216883 (263h27m18.192687334s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.645856578 (263h27m18.197327039s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.651699423 (263h27m18.203169894s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.653098288 (263h27m18.204568749s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.656601418 (263h27m18.208071899s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.659046414 (263h27m18.210516875s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:20.448435324 (263h27m18.999905785s) [upload=232059]: Next returned nil segment Nov 20 07:31:20.448449921 (263h27m18.999920373s) [upload=232059]: Waiting for error group managing segments... Nov 20 07:31:20.840686863 (263h27m19.392157314s) [noise=true , address=185.167.204.206:4047 , piece_id=AOJHHOC6D4ES5PSABO5CPOA6FFMQCWJSJC4SYRR4TBGE3ZW6WVYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.840944473 (263h27m19.392414934s) [noise=true , address=185.167.204.205:4009 , piece_id=PHZYFRVS7TV7P2TSPX7MMZ3H63VUEUNYLTDKYIRC7PA7YJ2MGJXQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.841171586 (263h27m19.392642047s) [noise=true , address=185.167.204.206:4061 , piece_id=ND4H2MBLMA7TRKNRPKWRV35RW7JBWOQ4W3TDUST35KQSUFMTUJVQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.845413794 (263h27m19.396884255s) [noise=true , address=185.167.204.206:4054 , piece_id=2FKWZRLJAX6LEUNCRXNH4R3MZ6DNY3VHVZ5JK5QEJZ76KD5EDRAA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.846588840 (263h27m19.398059302s) [noise=true , address=185.167.204.206:4072 , piece_id=25EIWSZDRFORHSBI6DXITGLG4JE3YNY6WWUOH4CIRASABTDW6CLA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.848580414 (263h27m19.400050875s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.849535923 (263h27m19.401006414s) [noise=true , address=185.167.204.206:4053 , piece_id=WOHYIAC6PUGDO7LH3WUAC6AZGDPGMSXQPYKFGFOJWRZMP7EFZWRQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853075914 (263h27m19.404546375s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853778040 (263h27m19.405248491s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.869053197 (263h27m19.420523658s) [noise=true , address=185.167.204.206:4058 , piece_id=SISDILWJPPH4JOHOTL3GKS6LEG3DSVWBSU6IWHZU5R3LCX57CE5A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.884471807 (263h27m19.435942268s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.891395812 (263h27m19.442866273s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.407423253 (263h27m19.958893714s) [noise=true , address=81.171.14.70:4046 , piece_id=OHLJUIVJXEARMXSQJAVQHNOUOFT3UMOWA2E2HOZBJD2CETJ6AVWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.434063861 (263h27m19.985534322s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.458913289 (263h27m20.01038375s) [noise=true , address=81.171.14.70:4027 , piece_id=26ZOOIR73NY4PAJQ3WSAU4ZCXMVYEOJDWSTS4PIDHHYVRPRJF44A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.480425362 (263h27m20.031895813s) [noise=true , address=81.171.14.70:4033 , piece_id=VVU5PQACV4GKY45RPB2C3NWUBYEX7ECQZN4W336ZYULO2CQHQSYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.487065786 (263h27m20.038536237s) [noise=true , address=81.171.14.70:4032 , piece_id=2NLDGLW73R6LJ7XNNAJYRTVPLCCSMOAHGBKIKI7TEOKI4L2T6XWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.504477020 (263h27m20.055947481s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.891152100 (263h27m20.442622561s) [noise=true , address=81.171.14.70:4031 , piece_id=JWMOD7NPWBUIK2ZQAER3YFMZQNDXZKFP345L66NVGKV7EKI7DLOQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.903537184 (263h27m20.455007645s) [noise=true , address=81.171.14.70:4034 , piece_id=K2P6O2RPHOR433TRB7YFBTJSLEY623J7CRMAM77KOZMQKMOLLHZA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.931241638 (263h27m20.482712109s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.939822769 (263h27m20.49129323s) [noise=true , address=81.171.14.70:4029 , piece_id=WXAQ7CIDAZMB2J2GHSMZ532DAMVAJRBNRP3VT7YSY4HJLGZDBX6Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.042469878 (263h27m20.593940339s) [noise=true , address=89.149.201.147:4005 , piece_id=7NYFIWT6B2AO3XCWMMI4TZYM7NROZRLMOLJTKMZYIMCNS6PKIYIQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.044590426 (263h27m20.596060887s) [noise=true , address=89.149.201.147:4020 , piece_id=SSNUBTKK3UIRO2TQY4CIEMM5DRSPC4RUXUEFDYCHK7FOSIHU5S7A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.081767748 (263h27m20.633238209s) [noise=true , address=89.149.201.147:4008 , piece_id=2NUEBJBDOHBC3YOEX53YH3SHG6XK5WI6WTNEJITLXZKDWLLOSARQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133782203 (263h27m20.685252664s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133874820 (263h27m20.685345281s) [seg_pos={0 0}, upload=232059]: Segment reached optimal threshold of 26 pieces. Nov 20 07:31:22.134328153 (263h27m20.685798624s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134338482 (263h27m20.685808943s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134362959 (263h27m20.68583342s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134385041 (263h27m20.685855502s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134417913 (263h27m20.685888364s) [seg_pos={0 0}, upload=232059]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 07:31:22.134530067 (263h27m20.686000528s) [upload=232059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 07:31:22.134536409 (263h27m20.68600687s) [upload=232059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 07:33:08.217836685 (263h29m6.769307177s) [upload=232059]: Done uploading segments... Nov 20 07:33:08.217918711 (263h29m6.769389162s) [upload=232059]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.761460055s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 5.559888376s trace: https://jaeger.dev.storj.io/trace/29eebe057654c99d FAIL (2025-11-20 07:43:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Nov 20 07:31:19.629873593 (263h27m18.181344064s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.633306430 (263h27m18.184776891s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.636780656 (263h27m18.188251117s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.639327946 (263h27m18.190798397s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.641216883 (263h27m18.192687334s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.645856578 (263h27m18.197327039s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.651699423 (263h27m18.203169894s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.653098288 (263h27m18.204568749s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.656601418 (263h27m18.208071899s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.659046414 (263h27m18.210516875s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:20.448435324 (263h27m18.999905785s) [upload=232059]: Next returned nil segment Nov 20 07:31:20.448449921 (263h27m18.999920373s) [upload=232059]: Waiting for error group managing segments... Nov 20 07:31:20.840686863 (263h27m19.392157314s) [noise=true , address=185.167.204.206:4047 , piece_id=AOJHHOC6D4ES5PSABO5CPOA6FFMQCWJSJC4SYRR4TBGE3ZW6WVYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.840944473 (263h27m19.392414934s) [noise=true , address=185.167.204.205:4009 , piece_id=PHZYFRVS7TV7P2TSPX7MMZ3H63VUEUNYLTDKYIRC7PA7YJ2MGJXQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.841171586 (263h27m19.392642047s) [noise=true , address=185.167.204.206:4061 , piece_id=ND4H2MBLMA7TRKNRPKWRV35RW7JBWOQ4W3TDUST35KQSUFMTUJVQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.845413794 (263h27m19.396884255s) [noise=true , address=185.167.204.206:4054 , piece_id=2FKWZRLJAX6LEUNCRXNH4R3MZ6DNY3VHVZ5JK5QEJZ76KD5EDRAA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.846588840 (263h27m19.398059302s) [noise=true , address=185.167.204.206:4072 , piece_id=25EIWSZDRFORHSBI6DXITGLG4JE3YNY6WWUOH4CIRASABTDW6CLA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.848580414 (263h27m19.400050875s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.849535923 (263h27m19.401006414s) [noise=true , address=185.167.204.206:4053 , piece_id=WOHYIAC6PUGDO7LH3WUAC6AZGDPGMSXQPYKFGFOJWRZMP7EFZWRQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853075914 (263h27m19.404546375s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853778040 (263h27m19.405248491s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.869053197 (263h27m19.420523658s) [noise=true , address=185.167.204.206:4058 , piece_id=SISDILWJPPH4JOHOTL3GKS6LEG3DSVWBSU6IWHZU5R3LCX57CE5A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.884471807 (263h27m19.435942268s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.891395812 (263h27m19.442866273s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.407423253 (263h27m19.958893714s) [noise=true , address=81.171.14.70:4046 , piece_id=OHLJUIVJXEARMXSQJAVQHNOUOFT3UMOWA2E2HOZBJD2CETJ6AVWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.434063861 (263h27m19.985534322s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.458913289 (263h27m20.01038375s) [noise=true , address=81.171.14.70:4027 , piece_id=26ZOOIR73NY4PAJQ3WSAU4ZCXMVYEOJDWSTS4PIDHHYVRPRJF44A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.480425362 (263h27m20.031895813s) [noise=true , address=81.171.14.70:4033 , piece_id=VVU5PQACV4GKY45RPB2C3NWUBYEX7ECQZN4W336ZYULO2CQHQSYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.487065786 (263h27m20.038536237s) [noise=true , address=81.171.14.70:4032 , piece_id=2NLDGLW73R6LJ7XNNAJYRTVPLCCSMOAHGBKIKI7TEOKI4L2T6XWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.504477020 (263h27m20.055947481s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.891152100 (263h27m20.442622561s) [noise=true , address=81.171.14.70:4031 , piece_id=JWMOD7NPWBUIK2ZQAER3YFMZQNDXZKFP345L66NVGKV7EKI7DLOQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.903537184 (263h27m20.455007645s) [noise=true , address=81.171.14.70:4034 , piece_id=K2P6O2RPHOR433TRB7YFBTJSLEY623J7CRMAM77KOZMQKMOLLHZA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.931241638 (263h27m20.482712109s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.939822769 (263h27m20.49129323s) [noise=true , address=81.171.14.70:4029 , piece_id=WXAQ7CIDAZMB2J2GHSMZ532DAMVAJRBNRP3VT7YSY4HJLGZDBX6Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.042469878 (263h27m20.593940339s) [noise=true , address=89.149.201.147:4005 , piece_id=7NYFIWT6B2AO3XCWMMI4TZYM7NROZRLMOLJTKMZYIMCNS6PKIYIQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.044590426 (263h27m20.596060887s) [noise=true , address=89.149.201.147:4020 , piece_id=SSNUBTKK3UIRO2TQY4CIEMM5DRSPC4RUXUEFDYCHK7FOSIHU5S7A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.081767748 (263h27m20.633238209s) [noise=true , address=89.149.201.147:4008 , piece_id=2NUEBJBDOHBC3YOEX53YH3SHG6XK5WI6WTNEJITLXZKDWLLOSARQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133782203 (263h27m20.685252664s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133874820 (263h27m20.685345281s) [seg_pos={0 0}, upload=232059]: Segment reached optimal threshold of 26 pieces. Nov 20 07:31:22.134328153 (263h27m20.685798624s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134338482 (263h27m20.685808943s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134362959 (263h27m20.68583342s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134385041 (263h27m20.685855502s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134417913 (263h27m20.685888364s) [seg_pos={0 0}, upload=232059]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 07:31:22.134530067 (263h27m20.686000528s) [upload=232059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 07:31:22.134536409 (263h27m20.68600687s) [upload=232059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 07:33:08.217836685 (263h29m6.769307177s) [upload=232059]: Done uploading segments... Nov 20 07:33:08.217918711 (263h29m6.769389162s) [upload=232059]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.559935586s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 6.195380119s trace: https://jaeger.dev.storj.io/trace/29eebe057654c99d FAIL (2025-11-20 07:42:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Nov 20 07:31:19.629873593 (263h27m18.181344064s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.633306430 (263h27m18.184776891s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.636780656 (263h27m18.188251117s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.639327946 (263h27m18.190798397s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.641216883 (263h27m18.192687334s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.645856578 (263h27m18.197327039s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.651699423 (263h27m18.203169894s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.653098288 (263h27m18.204568749s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.656601418 (263h27m18.208071899s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:19.659046414 (263h27m18.210516875s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Uploading piece... Nov 20 07:31:20.448435324 (263h27m18.999905785s) [upload=232059]: Next returned nil segment Nov 20 07:31:20.448449921 (263h27m18.999920373s) [upload=232059]: Waiting for error group managing segments... Nov 20 07:31:20.840686863 (263h27m19.392157314s) [noise=true , address=185.167.204.206:4047 , piece_id=AOJHHOC6D4ES5PSABO5CPOA6FFMQCWJSJC4SYRR4TBGE3ZW6WVYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.840944473 (263h27m19.392414934s) [noise=true , address=185.167.204.205:4009 , piece_id=PHZYFRVS7TV7P2TSPX7MMZ3H63VUEUNYLTDKYIRC7PA7YJ2MGJXQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.841171586 (263h27m19.392642047s) [noise=true , address=185.167.204.206:4061 , piece_id=ND4H2MBLMA7TRKNRPKWRV35RW7JBWOQ4W3TDUST35KQSUFMTUJVQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.845413794 (263h27m19.396884255s) [noise=true , address=185.167.204.206:4054 , piece_id=2FKWZRLJAX6LEUNCRXNH4R3MZ6DNY3VHVZ5JK5QEJZ76KD5EDRAA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.846588840 (263h27m19.398059302s) [noise=true , address=185.167.204.206:4072 , piece_id=25EIWSZDRFORHSBI6DXITGLG4JE3YNY6WWUOH4CIRASABTDW6CLA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.848580414 (263h27m19.400050875s) [noise=true , address=185.167.204.205:4011 , piece_id=37K72MUDNPRBVN5LSKD3PZDYIB5BH46RJR7SOTIHIZ3HHMVB6U5Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.849535923 (263h27m19.401006414s) [noise=true , address=185.167.204.206:4053 , piece_id=WOHYIAC6PUGDO7LH3WUAC6AZGDPGMSXQPYKFGFOJWRZMP7EFZWRQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853075914 (263h27m19.404546375s) [noise=true , address=185.167.204.206:4037 , piece_id=W5CZY4WHZB4GHMSQ3FGMGLLIUQP72VLKYSK2YCJRH235PLFLAMNA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.853778040 (263h27m19.405248491s) [noise=true , address=185.167.204.206:4060 , piece_id=C2DI35EVADCEYJXFXTMWZVW3TQUY4X7P5YUL4URX7VVXH6NPOWCA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.869053197 (263h27m19.420523658s) [noise=true , address=185.167.204.206:4058 , piece_id=SISDILWJPPH4JOHOTL3GKS6LEG3DSVWBSU6IWHZU5R3LCX57CE5A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.884471807 (263h27m19.435942268s) [noise=true , address=185.167.204.206:4041 , piece_id=PCP7K6BVFE47IOTDMC3BCA5FK7EH4ME7A3ZWYXVJZ6EVRO5QQXZQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:20.891395812 (263h27m19.442866273s) [noise=true , address=185.167.204.206:4052 , piece_id=ZJQ5VUNXRCIHOEDQLF2TURV7LILJWUFSWOHB56P72XOCVLOOSD3A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.407423253 (263h27m19.958893714s) [noise=true , address=81.171.14.70:4046 , piece_id=OHLJUIVJXEARMXSQJAVQHNOUOFT3UMOWA2E2HOZBJD2CETJ6AVWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.434063861 (263h27m19.985534322s) [noise=true , address=81.171.14.70:4044 , piece_id=5QBLXHRZQ4UBBQIWBSOYUFPTEVP54EINV2RGPQ4JAUVFMNRD7PDA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.458913289 (263h27m20.01038375s) [noise=true , address=81.171.14.70:4027 , piece_id=26ZOOIR73NY4PAJQ3WSAU4ZCXMVYEOJDWSTS4PIDHHYVRPRJF44A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.480425362 (263h27m20.031895813s) [noise=true , address=81.171.14.70:4033 , piece_id=VVU5PQACV4GKY45RPB2C3NWUBYEX7ECQZN4W336ZYULO2CQHQSYA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.487065786 (263h27m20.038536237s) [noise=true , address=81.171.14.70:4032 , piece_id=2NLDGLW73R6LJ7XNNAJYRTVPLCCSMOAHGBKIKI7TEOKI4L2T6XWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.504477020 (263h27m20.055947481s) [noise=true , address=81.171.14.70:4026 , piece_id=6YWTEBFE2GX553FTSNQ55OCWSX77JVF7TT4K5YRTPQTU6R2652LA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.891152100 (263h27m20.442622561s) [noise=true , address=81.171.14.70:4031 , piece_id=JWMOD7NPWBUIK2ZQAER3YFMZQNDXZKFP345L66NVGKV7EKI7DLOQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.903537184 (263h27m20.455007645s) [noise=true , address=81.171.14.70:4034 , piece_id=K2P6O2RPHOR433TRB7YFBTJSLEY623J7CRMAM77KOZMQKMOLLHZA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.931241638 (263h27m20.482712109s) [noise=true , address=81.171.14.70:4036 , piece_id=ZX2W4M2D5QMYTUSK5PTIGKJQSDQAYF7IZIZMP5STEI67GCLYQTJA, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:21.939822769 (263h27m20.49129323s) [noise=true , address=81.171.14.70:4029 , piece_id=WXAQ7CIDAZMB2J2GHSMZ532DAMVAJRBNRP3VT7YSY4HJLGZDBX6Q, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.042469878 (263h27m20.593940339s) [noise=true , address=89.149.201.147:4005 , piece_id=7NYFIWT6B2AO3XCWMMI4TZYM7NROZRLMOLJTKMZYIMCNS6PKIYIQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.044590426 (263h27m20.596060887s) [noise=true , address=89.149.201.147:4020 , piece_id=SSNUBTKK3UIRO2TQY4CIEMM5DRSPC4RUXUEFDYCHK7FOSIHU5S7A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.081767748 (263h27m20.633238209s) [noise=true , address=89.149.201.147:4008 , piece_id=2NUEBJBDOHBC3YOEX53YH3SHG6XK5WI6WTNEJITLXZKDWLLOSARQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133782203 (263h27m20.685252664s) [noise=true , address=89.149.201.147:4010 , piece_id=M2VVMSGISR5TL44JT2KHQM62JYBX5C22QIFLIP5RV3XMJFK3W2HQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: <nil> Nov 20 07:31:22.133874820 (263h27m20.685345281s) [seg_pos={0 0}, upload=232059]: Segment reached optimal threshold of 26 pieces. Nov 20 07:31:22.134328153 (263h27m20.685798624s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134338482 (263h27m20.685808943s) [noise=true , address=89.149.201.147:4011 , piece_id=OKQPXRH2GOVRP6AVL7QFOYQ7JVQ2EZMGA4754ATR4CQEXRFZJ64A, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134362959 (263h27m20.68583342s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Nov 20 07:31:22.134385041 (263h27m20.685855502s) [noise=true , address=89.149.201.147:4024 , piece_id=YNLEKM5T5EQ5ERY7SWMDDSXVDNR5CL2I6IWCKUOIYXHQIVSZSFWQ, seg_pos={0 0}, upload=232059]: Long tail cancellation due to optimal threshold Nov 20 07:31:22.134417913 (263h27m20.685888364s) [seg_pos={0 0}, upload=232059]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 07:31:22.134530067 (263h27m20.686000528s) [upload=232059]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 07:31:22.134536409 (263h27m20.68600687s) [upload=232059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 07:33:08.217836685 (263h29m6.769307177s) [upload=232059]: Done uploading segments... Nov 20 07:33:08.217918711 (263h29m6.769389162s) [upload=232059]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.195407191s core uplink eu-select-1 eu1-placement-15

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)