long-t5-local-base-finetuned-justification-v10

This model is a fine-tuned version of google/long-t5-local-base on the None dataset. It achieves the following results on the evaluation set:

• Loss: 10.3775

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-07
• train_batch_size: 1
• eval_batch_size: 1
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 500

Training results

Training Loss	Epoch	Step	Validation Loss
10.3775	1.0	676	10.3775
10.3775	2.0	1352	10.3775
10.3775	3.0	2028	10.3775
10.3775	4.0	2704	10.3775
10.3775	5.0	3380	10.3775
10.3775	6.0	4056	10.3775
10.3775	7.0	4732	10.3775
10.3775	8.0	5408	10.3775
10.3775	9.0	6084	10.3775
10.3775	10.0	6760	10.3775
10.3775	11.0	7436	10.3775
10.3775	12.0	8112	10.3775
10.3775	13.0	8788	10.3775
10.3775	14.0	9464	10.3775
10.3775	15.0	10140	10.3775
10.3775	16.0	10816	10.3775
10.3775	17.0	11492	10.3775
10.3775	18.0	12168	10.3775
10.3775	19.0	12844	10.3775
10.3775	20.0	13520	10.3775
10.3775	21.0	14196	10.3775
10.3775	22.0	14872	10.3775
10.3775	23.0	15548	10.3775
10.3775	24.0	16224	10.3775
10.3775	25.0	16900	10.3775
10.3775	26.0	17576	10.3775
10.3775	27.0	18252	10.3775
10.3775	28.0	18928	10.3775
10.3775	29.0	19604	10.3775
10.3775	30.0	20280	10.3775
10.3775	31.0	20956	10.3775
10.3775	32.0	21632	10.3775
10.3775	33.0	22308	10.3775
10.3775	34.0	22984	10.3775
10.3775	35.0	23660	10.3775
10.3775	36.0	24336	10.3775
10.3775	37.0	25012	10.3775
10.3775	38.0	25688	10.3775
10.3775	39.0	26364	10.3775
10.3775	40.0	27040	10.3775
10.3775	41.0	27716	10.3775
10.3775	42.0	28392	10.3775
10.3775	43.0	29068	10.3775
10.3775	44.0	29744	10.3775
10.3775	45.0	30420	10.3775
10.3775	46.0	31096	10.3775
10.3775	47.0	31772	10.3775
10.3775	48.0	32448	10.3775
10.3775	49.0	33124	10.3775
10.3775	50.0	33800	10.3775
10.3775	51.0	34476	10.3775
10.3775	52.0	35152	10.3775
10.3775	53.0	35828	10.3775
10.3775	54.0	36504	10.3775
10.3775	55.0	37180	10.3775
10.3775	56.0	37856	10.3775
10.3775	57.0	38532	10.3775
10.3775	58.0	39208	10.3775
10.3775	59.0	39884	10.3775
10.3775	60.0	40560	10.3775
10.3775	61.0	41236	10.3775
10.3775	62.0	41912	10.3775
10.3775	63.0	42588	10.3775
10.3775	64.0	43264	10.3775
10.3775	65.0	43940	10.3775
10.3775	66.0	44616	10.3775
10.3775	67.0	45292	10.3775
10.3775	68.0	45968	10.3775
10.3775	69.0	46644	10.3775
10.3775	70.0	47320	10.3775
10.3775	71.0	47996	10.3775
10.3775	72.0	48672	10.3775
10.3775	73.0	49348	10.3775
10.3775	74.0	50024	10.3775
10.3775	75.0	50700	10.3775
10.3775	76.0	51376	10.3775
10.3775	77.0	52052	10.3775
10.3775	78.0	52728	10.3775
10.3775	79.0	53404	10.3775
10.3775	80.0	54080	10.3775
10.3775	81.0	54756	10.3775
10.3775	82.0	55432	10.3775
10.3775	83.0	56108	10.3775
10.3775	84.0	56784	10.3775
10.3775	85.0	57460	10.3775
10.3775	86.0	58136	10.3775
10.3775	87.0	58812	10.3775
10.3775	88.0	59488	10.3775
10.3775	89.0	60164	10.3775
10.3775	90.0	60840	10.3775
10.3775	91.0	61516	10.3775
10.3775	92.0	62192	10.3775
10.3775	93.0	62868	10.3775
10.3775	94.0	63544	10.3775
10.3775	95.0	64220	10.3775
10.3775	96.0	64896	10.3775
10.3775	97.0	65572	10.3775
10.3775	98.0	66248	10.3775
10.3775	99.0	66924	10.3775
10.3775	100.0	67600	10.3775
10.3775	101.0	68276	10.3775
10.3775	102.0	68952	10.3775
10.3775	103.0	69628	10.3775
10.3775	104.0	70304	10.3775
10.3775	105.0	70980	10.3775
10.3775	106.0	71656	10.3775
10.3775	107.0	72332	10.3775
10.3775	108.0	73008	10.3775
10.3775	109.0	73684	10.3775
10.3775	110.0	74360	10.3775
10.3775	111.0	75036	10.3775
10.3775	112.0	75712	10.3775
10.3775	113.0	76388	10.3775
10.3775	114.0	77064	10.3775
10.3775	115.0	77740	10.3775
10.3775	116.0	78416	10.3775
10.3775	117.0	79092	10.3775
10.3775	118.0	79768	10.3775
10.3775	119.0	80444	10.3775
10.3775	120.0	81120	10.3775
10.3775	121.0	81796	10.3775
10.3775	122.0	82472	10.3775
10.3775	123.0	83148	10.3775
10.3775	124.0	83824	10.3775
10.3775	125.0	84500	10.3775
10.3775	126.0	85176	10.3775
10.3775	127.0	85852	10.3775
10.3775	128.0	86528	10.3775
10.3775	129.0	87204	10.3775
10.3775	130.0	87880	10.3775
10.3775	131.0	88556	10.3775
10.3775	132.0	89232	10.3775
10.3775	133.0	89908	10.3775
10.3775	134.0	90584	10.3775
10.3775	135.0	91260	10.3775
10.3775	136.0	91936	10.3775
10.3775	137.0	92612	10.3775
10.3775	138.0	93288	10.3775
10.3775	139.0	93964	10.3775
10.3775	140.0	94640	10.3775
10.3775	141.0	95316	10.3775
10.3775	142.0	95992	10.3775
10.3775	143.0	96668	10.3775
10.3775	144.0	97344	10.3775
10.3775	145.0	98020	10.3775
10.3775	146.0	98696	10.3775
10.3775	147.0	99372	10.3775
10.3775	148.0	100048	10.3775
10.3775	149.0	100724	10.3775
10.3775	150.0	101400	10.3775
10.3775	151.0	102076	10.3775
10.3775	152.0	102752	10.3775
10.3775	153.0	103428	10.3775
10.3775	154.0	104104	10.3775
10.3775	155.0	104780	10.3775
10.3775	156.0	105456	10.3775
10.3775	157.0	106132	10.3775
10.3775	158.0	106808	10.3775
10.3775	159.0	107484	10.3775
10.3775	160.0	108160	10.3775
10.3775	161.0	108836	10.3775
10.3775	162.0	109512	10.3775
10.3775	163.0	110188	10.3775
10.3775	164.0	110864	10.3775
10.3775	165.0	111540	10.3775
10.3775	166.0	112216	10.3775
10.3775	167.0	112892	10.3775
10.3775	168.0	113568	10.3775
10.3775	169.0	114244	10.3775
10.3775	170.0	114920	10.3775
10.3775	171.0	115596	10.3775
10.3775	172.0	116272	10.3775
10.3775	173.0	116948	10.3775
10.3775	174.0	117624	10.3775
10.3775	175.0	118300	10.3775
10.3775	176.0	118976	10.3775
10.3775	177.0	119652	10.3775
10.3775	178.0	120328	10.3775
10.3775	179.0	121004	10.3775
10.3775	180.0	121680	10.3775
10.3775	181.0	122356	10.3775
10.3775	182.0	123032	10.3775
10.3775	183.0	123708	10.3775
10.3775	184.0	124384	10.3775
10.3775	185.0	125060	10.3775
10.3775	186.0	125736	10.3775
10.3775	187.0	126412	10.3775
10.3775	188.0	127088	10.3775
10.3775	189.0	127764	10.3775
10.3775	190.0	128440	10.3775
10.3775	191.0	129116	10.3775
10.3775	192.0	129792	10.3775
10.3775	193.0	130468	10.3775
10.3775	194.0	131144	10.3775
10.3775	195.0	131820	10.3775
10.3775	196.0	132496	10.3775
10.3775	197.0	133172	10.3775
10.3775	198.0	133848	10.3775
10.3775	199.0	134524	10.3775
10.3775	200.0	135200	10.3775
10.3775	201.0	135876	10.3775
10.3775	202.0	136552	10.3775
10.3775	203.0	137228	10.3775
10.3775	204.0	137904	10.3775
10.3775	205.0	138580	10.3775
10.3775	206.0	139256	10.3775
10.3775	207.0	139932	10.3775
10.3775	208.0	140608	10.3775
10.3775	209.0	141284	10.3775
10.3775	210.0	141960	10.3775
10.3775	211.0	142636	10.3775
10.3775	212.0	143312	10.3775
10.3775	213.0	143988	10.3775
10.3775	214.0	144664	10.3775
10.3775	215.0	145340	10.3775
10.3775	216.0	146016	10.3775
10.3775	217.0	146692	10.3775
10.3775	218.0	147368	10.3775
10.3775	219.0	148044	10.3775
10.3775	220.0	148720	10.3775
10.3775	221.0	149396	10.3775
10.3775	222.0	150072	10.3775
10.3775	223.0	150748	10.3775
10.3775	224.0	151424	10.3775
10.3775	225.0	152100	10.3775
10.3775	226.0	152776	10.3775
10.3775	227.0	153452	10.3775
10.3775	228.0	154128	10.3775
10.3775	229.0	154804	10.3775
10.3775	230.0	155480	10.3775
10.3775	231.0	156156	10.3775
10.3775	232.0	156832	10.3775
10.3775	233.0	157508	10.3775
10.3775	234.0	158184	10.3775
10.3775	235.0	158860	10.3775
10.3775	236.0	159536	10.3775
10.3775	237.0	160212	10.3775
10.3775	238.0	160888	10.3775
10.3775	239.0	161564	10.3775
10.3775	240.0	162240	10.3775
10.3775	241.0	162916	10.3775
10.3775	242.0	163592	10.3775
10.3775	243.0	164268	10.3775
10.3775	244.0	164944	10.3775
10.3775	245.0	165620	10.3775
10.3775	246.0	166296	10.3775
10.3775	247.0	166972	10.3775
10.3775	248.0	167648	10.3775
10.3775	249.0	168324	10.3775
10.3775	250.0	169000	10.3775
10.3775	251.0	169676	10.3775
10.3775	252.0	170352	10.3775
10.3775	253.0	171028	10.3775
10.3775	254.0	171704	10.3775
10.3775	255.0	172380	10.3775
10.3775	256.0	173056	10.3775
10.3775	257.0	173732	10.3775
10.3775	258.0	174408	10.3775
10.3775	259.0	175084	10.3775
10.3775	260.0	175760	10.3775
10.3775	261.0	176436	10.3775
10.3775	262.0	177112	10.3775
10.3775	263.0	177788	10.3775
10.3775	264.0	178464	10.3775
10.3775	265.0	179140	10.3775
10.3775	266.0	179816	10.3775
10.3775	267.0	180492	10.3775
10.3775	268.0	181168	10.3775
10.3775	269.0	181844	10.3775
10.3775	270.0	182520	10.3775
10.3775	271.0	183196	10.3775
10.3775	272.0	183872	10.3775
10.3775	273.0	184548	10.3775
10.3775	274.0	185224	10.3775
10.3775	275.0	185900	10.3775
10.3775	276.0	186576	10.3775
10.3775	277.0	187252	10.3775
10.3775	278.0	187928	10.3775
10.3775	279.0	188604	10.3775
10.3775	280.0	189280	10.3775
10.3775	281.0	189956	10.3775
10.3775	282.0	190632	10.3775
10.3775	283.0	191308	10.3775
10.3775	284.0	191984	10.3775
10.3775	285.0	192660	10.3775
10.3775	286.0	193336	10.3775
10.3775	287.0	194012	10.3775
10.3775	288.0	194688	10.3775
10.3775	289.0	195364	10.3775
10.3775	290.0	196040	10.3775
10.3775	291.0	196716	10.3775
10.3775	292.0	197392	10.3775
10.3775	293.0	198068	10.3775
10.3775	294.0	198744	10.3775
10.3775	295.0	199420	10.3775
10.3775	296.0	200096	10.3775
10.3775	297.0	200772	10.3775
10.3775	298.0	201448	10.3775
10.3775	299.0	202124	10.3775
10.3775	300.0	202800	10.3775
10.3775	301.0	203476	10.3775
10.3775	302.0	204152	10.3775
10.3775	303.0	204828	10.3775
10.3775	304.0	205504	10.3775
10.3775	305.0	206180	10.3775
10.3775	306.0	206856	10.3775
10.3775	307.0	207532	10.3775
10.3775	308.0	208208	10.3775
10.3775	309.0	208884	10.3775
10.3775	310.0	209560	10.3775
10.3775	311.0	210236	10.3775
10.3775	312.0	210912	10.3775
10.3775	313.0	211588	10.3775
10.3775	314.0	212264	10.3775
10.3775	315.0	212940	10.3775
10.3775	316.0	213616	10.3775
10.3775	317.0	214292	10.3775
10.3775	318.0	214968	10.3775
10.3775	319.0	215644	10.3775
10.3775	320.0	216320	10.3775
10.3775	321.0	216996	10.3775
10.3775	322.0	217672	10.3775
10.3775	323.0	218348	10.3775
10.3775	324.0	219024	10.3775
10.3775	325.0	219700	10.3775
10.3775	326.0	220376	10.3775
10.3775	327.0	221052	10.3775
10.3775	328.0	221728	10.3775
10.3775	329.0	222404	10.3775
10.3775	330.0	223080	10.3775
10.3775	331.0	223756	10.3775
10.3775	332.0	224432	10.3775
10.3775	333.0	225108	10.3775
10.3775	334.0	225784	10.3775
10.3775	335.0	226460	10.3775
10.3775	336.0	227136	10.3775
10.3775	337.0	227812	10.3775
10.3775	338.0	228488	10.3775
10.3775	339.0	229164	10.3775
10.3775	340.0	229840	10.3775
10.3775	341.0	230516	10.3775
10.3775	342.0	231192	10.3775
10.3775	343.0	231868	10.3775
10.3775	344.0	232544	10.3775
10.3775	345.0	233220	10.3775
10.3775	346.0	233896	10.3775
10.3775	347.0	234572	10.3775
10.3775	348.0	235248	10.3775
10.3775	349.0	235924	10.3775
10.3775	350.0	236600	10.3775
10.3775	351.0	237276	10.3775
10.3775	352.0	237952	10.3775
10.3775	353.0	238628	10.3775
10.3775	354.0	239304	10.3775
10.3775	355.0	239980	10.3775
10.3775	356.0	240656	10.3775
10.3775	357.0	241332	10.3775
10.3775	358.0	242008	10.3775
10.3775	359.0	242684	10.3775
10.3775	360.0	243360	10.3775
10.3775	361.0	244036	10.3775
10.3775	362.0	244712	10.3775
10.3775	363.0	245388	10.3775
10.3775	364.0	246064	10.3775
10.3775	365.0	246740	10.3775
10.3775	366.0	247416	10.3775
10.3775	367.0	248092	10.3775
10.3775	368.0	248768	10.3775
10.3775	369.0	249444	10.3775
10.3775	370.0	250120	10.3775
10.3775	371.0	250796	10.3775
10.3775	372.0	251472	10.3775
10.3775	373.0	252148	10.3775
10.3775	374.0	252824	10.3775
10.3775	375.0	253500	10.3775
10.3775	376.0	254176	10.3775
10.3775	377.0	254852	10.3775
10.3775	378.0	255528	10.3775
10.3775	379.0	256204	10.3775
10.3775	380.0	256880	10.3775
10.3775	381.0	257556	10.3775
10.3775	382.0	258232	10.3775
10.3775	383.0	258908	10.3775
10.3775	384.0	259584	10.3775
10.3775	385.0	260260	10.3775
10.3775	386.0	260936	10.3775
10.3775	387.0	261612	10.3775
10.3775	388.0	262288	10.3775
10.3775	389.0	262964	10.3775
10.3775	390.0	263640	10.3775
10.3775	391.0	264316	10.3775
10.3775	392.0	264992	10.3775
10.3775	393.0	265668	10.3775
10.3775	394.0	266344	10.3775
10.3775	395.0	267020	10.3775
10.3775	396.0	267696	10.3775
10.3775	397.0	268372	10.3775
10.3775	398.0	269048	10.3775
10.3775	399.0	269724	10.3775
10.3775	400.0	270400	10.3775
10.3775	401.0	271076	10.3775
10.3775	402.0	271752	10.3775
10.3775	403.0	272428	10.3775
10.3775	404.0	273104	10.3775
10.3775	405.0	273780	10.3775
10.3775	406.0	274456	10.3775
10.3775	407.0	275132	10.3775
10.3775	408.0	275808	10.3775
10.3775	409.0	276484	10.3775
10.3775	410.0	277160	10.3775
10.3775	411.0	277836	10.3775
10.3775	412.0	278512	10.3775
10.3775	413.0	279188	10.3775
10.3775	414.0	279864	10.3775
10.3775	415.0	280540	10.3775
10.3775	416.0	281216	10.3775
10.3775	417.0	281892	10.3775
10.3775	418.0	282568	10.3775
10.3775	419.0	283244	10.3775
10.3775	420.0	283920	10.3775
10.3775	421.0	284596	10.3775
10.3775	422.0	285272	10.3775
10.3775	423.0	285948	10.3775
10.3775	424.0	286624	10.3775
10.3775	425.0	287300	10.3775
10.3775	426.0	287976	10.3775
10.3775	427.0	288652	10.3775
10.3775	428.0	289328	10.3775
10.3775	429.0	290004	10.3775
10.3775	430.0	290680	10.3775
10.3775	431.0	291356	10.3775
10.3775	432.0	292032	10.3775
10.3775	433.0	292708	10.3775
10.3775	434.0	293384	10.3775
10.3775	435.0	294060	10.3775
10.3775	436.0	294736	10.3775
10.3775	437.0	295412	10.3775
10.3775	438.0	296088	10.3775
10.3775	439.0	296764	10.3775
10.3775	440.0	297440	10.3775
10.3775	441.0	298116	10.3775
10.3775	442.0	298792	10.3775
10.3775	443.0	299468	10.3775
10.3775	444.0	300144	10.3775
10.3775	445.0	300820	10.3775
10.3775	446.0	301496	10.3775
10.3775	447.0	302172	10.3775
10.3775	448.0	302848	10.3775
10.3775	449.0	303524	10.3775
10.3775	450.0	304200	10.3775
10.3775	451.0	304876	10.3775
10.3775	452.0	305552	10.3775
10.3775	453.0	306228	10.3775
10.3775	454.0	306904	10.3775
10.3775	455.0	307580	10.3775
10.3775	456.0	308256	10.3775
10.3775	457.0	308932	10.3775
10.3775	458.0	309608	10.3775
10.3775	459.0	310284	10.3775
10.3775	460.0	310960	10.3775
10.3775	461.0	311636	10.3775
10.3775	462.0	312312	10.3775
10.3775	463.0	312988	10.3775
10.3775	464.0	313664	10.3775
10.3775	465.0	314340	10.3775
10.3775	466.0	315016	10.3775
10.3775	467.0	315692	10.3775
10.3775	468.0	316368	10.3775
10.3775	469.0	317044	10.3775
10.3775	470.0	317720	10.3775
10.3775	471.0	318396	10.3775
10.3775	472.0	319072	10.3775
10.3775	473.0	319748	10.3775
10.3775	474.0	320424	10.3775
10.3775	475.0	321100	10.3775
10.3775	476.0	321776	10.3775
10.3775	477.0	322452	10.3775
10.3775	478.0	323128	10.3775
10.3775	479.0	323804	10.3775
10.3775	480.0	324480	10.3775
10.3775	481.0	325156	10.3775
10.3775	482.0	325832	10.3775
10.3775	483.0	326508	10.3775
10.3775	484.0	327184	10.3775
10.3775	485.0	327860	10.3775
10.3775	486.0	328536	10.3775
10.3775	487.0	329212	10.3775
10.3775	488.0	329888	10.3775
10.3775	489.0	330564	10.3775
10.3775	490.0	331240	10.3775
10.3775	491.0	331916	10.3775
10.3775	492.0	332592	10.3775
10.3775	493.0	333268	10.3775
10.3775	494.0	333944	10.3775
10.3775	495.0	334620	10.3775
10.3775	496.0	335296	10.3775
10.3775	497.0	335972	10.3775
10.3775	498.0	336648	10.3775
10.3775	499.0	337324	10.3775
10.3775	500.0	338000	10.3775

Framework versions

• Transformers 4.36.2
• Pytorch 2.2.2+cu121
• Datasets 2.16.0
• Tokenizers 0.15.2