checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60):

1 out of 60 is failed (threshold=3) [...................................................X........]

6.39732545s

https://jaeger.dev.storj.io/trace/64a70b063120f6ff

orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
Dec 24 17:41:34.817232055 (458h12m34.68831509s) [upload=402229]: Starting upload
Dec 24 17:41:34.817285716 (458h12m34.688368751s) [upload=402229]: Done starting upload
Dec 24 17:41:34.817371771 (458h12m34.688454806s) [upload=402229]: Uploading segments...
Dec 24 17:41:34.817473855 (458h12m34.68855689s) [upload=402229]: Got next segment. Inline: false
Dec 24 17:41:34.817508080 (458h12m34.688591115s) [upload=402229]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec 24 17:41:34.817512659 (458h12m34.688595694s) [upload=402229]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec 24 17:41:35.067154038 (458h12m34.938237083s) [seg_pos={0 0}, upload=402229]: Begin upload segment...
Dec 24 17:41:35.067209534 (458h12m34.938292579s) [seg_pos={0 0}, upload=402229]: Done begin upload segment.
Dec 24 17:41:35.067237456 (458h12m34.938320491s) [noise=true , address=145.79.227.45:4231   , piece_id=O2RJOW4SBW2XC3PJ5XJ5NLPCTUZXQQBYZDGOBX3YZTW6FDVTOFMA, seg_pos={0 0}, upload=402229]: Uploading piece...
Dec 24 17:41:35.067270990 (458h12m34.938354025s) [noise=true , address=145.79.227.51:4411   , piece_id=3RKCEBKZSY2MSVPVE7CBSF32WX7APWEIGNX6QRZ6KEN3NYGIMBCQ, seg_pos={0 0}, upload=402229]: Uploading piece...
Dec 24 17:41:35.067737579 (458h12m34.938820624s) [noise=true , address=145.79.227.37:4566   , piece_id=JMK6ZS4UFM3ETIID532YYHTAO2CIYHEJBEU4Z3LLT32J6QL5VY5A, seg_pos={0 0}, upload=402229]: Uploading piece...
Dec 24 17:41:35.068069410 (458h12m34.939152455s) [noise=true , address=145.79.227.11:4730   , piece_id=BNYY6GVOVFYX6YSQR7F23ASYKM5SJWHGK5NQIYTDMO3SGIXU6TNQ, seg_pos={0 0}, upload=402229]: Uploading piece...
Dec 24 17:41:35.068471236 (458h12m34.939554281s) [noise=true , address=145.79.227.32:4834   , piece_id=OI4HEZS66F5LGW33SYDOAD4CDE47KP3MZ3C53BLTJWTV7D6AYK6Q, seg_pos={0 0}, upload=402229]: Uploading piece...
Dec 24 17:41:35.068826392 (458h12m34.939909437s) [noise=true , address=145.79.227.29:4941   , piece_id=T3QBPFJWPSOCGUJ6C4RC3YGRTTVIDHCUKKL6GYAJRNREPIUM2OCA, seg_pos={0 0}, upload=402229]: Uploading piece...
Dec 24 17:41:35.069118318 (458h12m34.940201353s) [noise=true , address=145.79.227.4:4187    , piece_id=IAJZIMUQQETQWLVZX6J2UU6RBBHHL5IZNOEBRLV5ZDE6A5MOPEYQ, seg_pos={0 0}, upload=402229]: Uploading piece...
Dec 24 17:41:35.069520844 (458h12m34.94060389s) [noise=true , address=45.91.116.11:4117    , piece_id=IMHTEB3WAFAO6554DFSOVOLTOIU65TI6KQSBEJNVP4W3M6STQYDA, seg_pos={0 0}, upload=402229]: Uploading piece...
Dec 24 17:41:35.069964640 (458h12m34.941047675s) [noise=true , address=145.79.227.49:4339   , piece_id=HBGK2U2V2OIPYUOBXJPV7O7FCP2TB2MAB44WRQSO4R7FYOHV3ROA, seg_pos={0 0}, upload=402229]: Uploading piece...
Dec 24 17:41:35.070342990 (458h12m34.941426035s) [noise=true , address=145.79.227.7:4294    , piece_id=RAWBIZM3YPIHZ64SK7KXOXTL4GPVK3JGRGDINJN57USLVX53T6TA, seg_pos={0 0}, upload=402229]: Uploading piece...
Dec 24 17:41:35.071430701 (458h12m34.942513736s) [noise=true , address=45.91.116.14:4191    , piece_id=PZSZV2XFKZOJ5W5HP22PWW776L4ATWJZBEEQTJV6JEHYSIKBS35Q, seg_pos={0 0}, upload=402229]: Uploading piece...
Dec 24 17:41:35.071491077 (458h12m34.942574112s) [noise=true , address=145.79.227.50:4374   , piece_id=MA5VLFQAK6U245SGQR5UODBBIQD7CPICYCYTM5SL3GMCLXURWZ7A, seg_pos={0 0}, upload=402229]: Uploading piece...
Dec 24 17:41:35.072542138 (458h12m34.943625183s) [noise=true , address=145.79.227.52:4446   , piece_id=NJF5KORJX4IZ2VFF3I7GTKELUFDRCZMZK2GZOUNFPURAPUDT47YQ, seg_pos={0 0}, upload=402229]: Uploading piece...
Dec 24 17:41:35.072669880 (458h12m34.943752925s) [noise=true , address=145.79.227.33:4869   , piece_id=VVRKB2PIP4RRW4DZ3OA67MRRVCKPTACQPY633LHHLLZBUNVPKJGQ, seg_pos={0 0}, upload=402229]: Uploading piece...
Dec 24 17:41:35.073725251 (458h12m34.944808286s) [noise=true , address=145.79.227.38:4979   , piece_id=3SSLNJ545M7DSFJWO2V7K4AOQMXIXQUAXOAOQIX6NP757T22VWGA, seg_pos={0 0}, upload=402229]: Uploading piece...
Dec 24 17:41:35.075362869 (458h12m34.946445904s) [noise=true , address=145.79.227.46:4603   , piece_id=ILEBQVEFNXVBYTGLFBMG4BRO3HNAJ5GYPH53IQF2V7RRSOLHFIQQ, seg_pos={0 0}, upload=402229]: Uploading piece...
Dec 24 17:41:36.870712973 (458h12m36.741796018s) [upload=402229]: Next returned nil segment
Dec 24 17:41:36.870729545 (458h12m36.74181258s) [upload=402229]: Waiting for error group managing segments...
Dec 24 17:41:37.160017607 (458h12m37.031100642s) [noise=true , address=145.79.227.32:4834   , piece_id=OI4HEZS66F5LGW33SYDOAD4CDE47KP3MZ3C53BLTJWTV7D6AYK6Q, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil>
Dec 24 17:41:37.172949711 (458h12m37.044032757s) [noise=true , address=145.79.227.45:4231   , piece_id=O2RJOW4SBW2XC3PJ5XJ5NLPCTUZXQQBYZDGOBX3YZTW6FDVTOFMA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil>
Dec 24 17:41:37.183665827 (458h12m37.054748862s) [noise=true , address=145.79.227.50:4374   , piece_id=MA5VLFQAK6U245SGQR5UODBBIQD7CPICYCYTM5SL3GMCLXURWZ7A, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil>
Dec 24 17:41:37.245183227 (458h12m37.116266262s) [noise=true , address=145.79.227.7:4294    , piece_id=RAWBIZM3YPIHZ64SK7KXOXTL4GPVK3JGRGDINJN57USLVX53T6TA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil>
Dec 24 17:41:37.324356015 (458h12m37.19543905s) [noise=true , address=45.91.116.14:4191    , piece_id=PZSZV2XFKZOJ5W5HP22PWW776L4ATWJZBEEQTJV6JEHYSIKBS35Q, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil>
Dec 24 17:41:37.442771707 (458h12m37.313854752s) [noise=true , address=45.91.116.11:4117    , piece_id=IMHTEB3WAFAO6554DFSOVOLTOIU65TI6KQSBEJNVP4W3M6STQYDA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil>
Dec 24 17:41:37.478430989 (458h12m37.349514054s) [noise=true , address=145.79.227.51:4411   , piece_id=3RKCEBKZSY2MSVPVE7CBSF32WX7APWEIGNX6QRZ6KEN3NYGIMBCQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil>
Dec 24 17:41:37.926537889 (458h12m37.797620924s) [noise=true , address=145.79.227.33:4869   , piece_id=VVRKB2PIP4RRW4DZ3OA67MRRVCKPTACQPY633LHHLLZBUNVPKJGQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil>
Dec 24 17:41:38.187478223 (458h12m38.058561268s) [noise=true , address=145.79.227.52:4446   , piece_id=NJF5KORJX4IZ2VFF3I7GTKELUFDRCZMZK2GZOUNFPURAPUDT47YQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil>
Dec 24 17:41:38.189416954 (458h12m38.060499999s) [noise=true , address=145.79.227.46:4603   , piece_id=ILEBQVEFNXVBYTGLFBMG4BRO3HNAJ5GYPH53IQF2V7RRSOLHFIQQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil>
Dec 24 17:41:38.202496650 (458h12m38.073579685s) [noise=true , address=145.79.227.38:4979   , piece_id=3SSLNJ545M7DSFJWO2V7K4AOQMXIXQUAXOAOQIX6NP757T22VWGA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil>
Dec 24 17:41:38.237024437 (458h12m38.108107492s) [noise=true , address=145.79.227.4:4187    , piece_id=IAJZIMUQQETQWLVZX6J2UU6RBBHHL5IZNOEBRLV5ZDE6A5MOPEYQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil>
Dec 24 17:42:04.130206679 (458h13m4.001289724s) [noise=true , address=145.79.227.49:4339   , piece_id=HBGK2U2V2OIPYUOBXJPV7O7FCP2TB2MAB44WRQSO4R7FYOHV3ROA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: write tcp 188.166.225.170:37998->145.79.227.49:4339: use of closed network connection; write tcp 188.166.225.170:37998->145.79.227.49:4339: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37998->145.79.227.49:4339: use of closed network connection
Dec 24 17:42:04.130319203 (458h13m4.001402248s) [noise=true , address=145.79.227.11:4730   , piece_id=BNYY6GVOVFYX6YSQR7F23ASYKM5SJWHGK5NQIYTDMO3SGIXU6TNQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:43852->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:43852->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43852->145.79.227.11:4730: use of closed network connection
Dec 24 17:42:04.130411048 (458h13m4.001494083s) [noise=true , address=145.79.227.37:4566   , piece_id=JMK6ZS4UFM3ETIID532YYHTAO2CIYHEJBEU4Z3LLT32J6QL5VY5A, seg_pos={0 0}, upload=402229]: Done uploading piece. err: ecclient: upload failed (node:1SaNJZaVix7BSbEWhu2Vmt3XjDDWCsQ8wTSiFR7MQ8oGwD9N2F, address:145.79.227.37:4566): protocol: write tcp 188.166.225.170:44142->145.79.227.37:4566: use of closed network connection; write tcp 188.166.225.170:44142->145.79.227.37:4566: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44142->145.79.227.37:4566: use of closed network connection
Dec 24 17:42:04.130495238 (458h13m4.001578283s) [noise=true , address=145.79.227.29:4941   , piece_id=T3QBPFJWPSOCGUJ6C4RC3YGRTTVIDHCUKKL6GYAJRNREPIUM2OCA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: ecclient: upload failed (node:125fn3wMJUNjsKTgsssLJkZAobCbaAS9jC2VyxXxbUA2ei4Gjni, address:145.79.227.29:4941): protocol: write tcp 188.166.225.170:40326->145.79.227.29:4941: use of closed network connection; write tcp 188.166.225.170:40326->145.79.227.29:4941: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40326->145.79.227.29:4941: use of closed network connection
Dec 24 17:42:04.130522550 (458h13m4.001605595s) [seg_pos={0 0}, upload=402229]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
Dec 24 17:42:04.370980973 (458h13m4.242064028s) [upload=402229]: Done uploading segments...
Dec 24 17:42:04.371031650 (458h13m4.242114695s) [upload=402229]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)

	storj.io/orbiter/checkers.(*Uplink).formatErrWithLogs:185
	storj.io/orbiter/checkers.(*Uplink).Check:128
	storj.io/orbiter/service.(*Silencer).Check:25
	storj.io/orbiter/metrics.(*CheckerMetrics).Check:82
	storj.io/orbiter/checkers.(*AntiBlip).checkDelegate:61
	storj.io/orbiter/checkers.(*AntiBlip).Check:76
	storj.io/orbiter/service.(*Jittered).Run.func1:75
	storj.io/orbiter/service.(*Jittered).Run:76
	storj.io/orbiter/registry.(*Registry).Run.(*Registry).Run.func1.func2:76
	golang.org/x/sync/errgroup.(*Group).add.func1:130