Public model checkpoints for our paper Information Entropy Invariance: Enhancing Length Extrapolation in Attention Mechanisms.
Code is accessible at GitHub.
	Inference Providers
	NEW
	
	
	This model isn't deployed by any Inference Provider.
	๐
			
		Ask for provider support