Use input attention mask instead of casual mask in attention
#76
by
CyberZHG
- opened
The current implementation does not work with left/leading padding.
Add revision/code_revision = "5f13a7e" to AutoXxx.from_pretrained if you want to the modified version.