Instructions to use openai/privacy-filter with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use openai/privacy-filter with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("token-classification", model="openai/privacy-filter")# Load model directly from transformers import AutoTokenizer, AutoModelForTokenClassification tokenizer = AutoTokenizer.from_pretrained("openai/privacy-filter") model = AutoModelForTokenClassification.from_pretrained("openai/privacy-filter") - Transformers.js
How to use openai/privacy-filter with Transformers.js:
// npm i @huggingface/transformers import { pipeline } from '@huggingface/transformers'; // Allocate pipeline const pipe = await pipeline('token-classification', 'openai/privacy-filter'); - Notebooks
- Google Colab
- Kaggle
why??
#12
by josephmayo - opened
there's no even point of open sourcing ths shii, whats it's use?
and then they'll say "open ai is also contributing to open source lol"
While i do agree its most likely their goal, in many enterprises having an automated way to sanitize PII is of value. Even if its not permitted by policy people screw up all the time. And when its caught, some of us have to go back manually and clean it up., which can be a pain depending on the system you use ( and when its not caught, it opens you up for liability suits, or data leaks )
mihaimaruseac changed discussion status to closed