[Paper] An Evaluation of Context Length Extrapolation in Long Code via Positional Embeddings and Efficient Attention
The rapid advancement of large language models (LLMs) has led to a significant increase in automated tools in the software engineering, capable of performing va...