Commit 3948a2cf authored by ywolter's avatar ywolter
Browse files

Add tokenize_function to utilize the trained tokenizer for text processing

parent c7f4f830
Show whitespace changes
Inline Side-by-side
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Please to comment