Perhaps, but every time i conceptualize dense models, it seems like its overfitting, and the prime attention is never going to be that dense.