What's new

Tutorial PrivateGPT -- Upload PDF files to your local chatgpt

42697262

最高
Elite
Joined
Jun 16, 2017
Posts
15,262
Solutions
1
Reaction
11,440
Points
3,713
Huamata AI alternative, AskYourPDF alternative, ChatPDF alternative, and FREE! UNLIMITED UPLOADS. NO PAGE LIMIT.


SYSTEM REQUIREMENTS:
  • At least 4/8GB RAM for GPT4ALL model
  • At least 8/16GB RAM for 13B model
  • Any CPU (recommended at least ryzen 5 5000 series or i5 11th gen)





Links:
You do not have permission to view the full content of this post. Log in or register now.
Steps:
1. Clone repo.

You do not have permission to view the full content of this post. Log in or register now.
2. Download models
3. Create a
models folder
1685008477231.png
4.
4. Copy
vicuna 13b or gpt4all to models folder
5. Copy PDF book or essay to
source_documents
6. Run ingest.py
python ingest.py
7. Run privateGPT.py
python privateGPT.py
1685008685331.png

8. Enter query and enjoy!



 

Attachments

Yan yung pinakamadali sa lahat using langchain kaysa method sa gpt4all. Pwede rin gumamit ng datasets galing sa huggingface for fine-tuning. Ang importante, meron Kang custom offline gpt na natuturuan mo without restrictions. Ùn*énsøréd eka nga. Mamili lang kayo ng LLM na pasok sa inyong nais. Pero sky is the limit kung Hanggang saang antas yung performance ng inyong Language model. Yan yung advantage nyan bukod pa sa unlimited use. Wala na yung token limits. Di lang kasing-galing Yan ng sa OpenAI dahil limited yung learning data though malapit Naman sa GPT3 level.
 
bawal sa cp?
He, he. Hindi sa bawal. Di pa lang supported. di pa sa ngayon siguro. Kung magawan yan ng mobile app ng developer, kailangan din na kaya ng hardware requirement ng device ninyo.

Sa totoo, kahit mismo yung developer ay di binanggit yung cpu requirement para magamit yung GPT4ALL pero nagbigay lang via hint na pwede yung 4GB ram using CPU para gumana using lite GGML models nila. The rest na offline alternatives nyan ay gumagamit na ng GPU.

Ang punto nya, kahit pa potato pc yung gamit mo, hanggat kaya ng system ram ay ok. Meaning, sa "out of memory" na bibigay ang pc mo kung nasagad na. Kaya most recommended ay +8GB ram para sigurado.
Para lamang ito sa gustong sumubok ng offline GPT with limited capabilities.

Para doon sa pasok sa minimum specs, best is get the default GGML (the smallest ~4GB) to try it, then use the 7B models kung kaya pa hanggang umabot sa 13B for better performance.

Kaya sa hindi pasok ang hardware, just use the online services. Yung Bing at Bard, free/unlimited na di hamak na mas OK sa GPT models ng You do not have permission to view the full content of this post. Log in or register now.. To get the same effect like what PrivateGPT was made for (Reading/Analyzing documents), you just use a prompt.

Ex. Punta ka Google and enable Bard AI to answer your query: "make google bard ai read and analyze a document"
Ang response nya malamang ay ito:
Sure, I can do that. Here are the steps on how to make Google Bard read a document and analyze it:

  1. Upload the document to Google Drive.
  2. Open the document in Google Docs.
  3. Click on the "Tools" menu and select "Analyze Document."
  4. In the "Analyze Document" window, select the "Bard" tab.
  5. Click on the "Start Analysis" button.
Google Bard will then read the document and analyze it. It will generate a report that includes the following information:

  • The main points of the document
  • The key arguments and evidence used to support the main points
  • The tone and style of the document
  • The overall quality of the document
You can use this information to improve your writing skills, research skills, and critical thinking skills.

Here are some additional tips for using Google Bard to analyze documents:

  • Use the "Bard" tab to get a comprehensive analysis of the document.
  • Use the "Highlights" feature to highlight important points in the document.
  • Use the "Notes" feature to add your own thoughts and comments to the document.
  • Use the "Share" feature to share the document with others and get their feedback.
I hope this helps!
The rest, kayo na yung magpatuloy. Sa ibang online GPT services, baka maiba yung method, but you'll get a similar result.

Lagi nyong tandaan na yang GPT (Generative Pre-trained Transformer) is trained to follow an instruction in a prompt and provide a detailed response. Ang trabaho nyan ay sumagot sa mga "prompts" kahit alam nya o hindi. Parati yang sasagot + iba pang detalyeng babanggitin - kung napupuna ninyo ngayon. Dyan lang sulit ka na. Kaya sabi ko nga noong una, uutuin mo ang GPT to your advantage he he. Nasa iyo na lang kung papaano mo gawin yon - simple logic and common sense.
 
Ibahagi ko lang yung experience ko ngayon. Sa GPT4all kailangan yung pc mo ay AVX2 enabled or else magloloko yan. Same din sa PrivateGPT. Sa cpu ko na AVX lang ang abot, mag-load lang yung bin pero mag-crash yung GUI pag-enter ng prompt - kahit ok pa yung remaining ram at wala pang masyadong cpu activity. "Hello!." pa lang, patay na he he. Ang specs ko Intel Core i7 3632QM 12GB ram. Yan din yung issues na nakita ko sa github. Doon sa i5 8th gen ng anak ko ay ok naman yung dalawa kahit 6GB lang yung ram noon. Basta fresh boot at wala extra activities. Medyo nababagalan lang akong sumagot.

Yung You do not have permission to view the full content of this post. Log in or register now. na similar sa PrivateGPT ay mas maraming supported models ang gumana sa'kin. Pero ganoon pa rin, mas matagal sumagot - mga 1-2 minutes pa. Hindi lang masyadong matakaw sa ram dahil single core lang ang gamit, kaya din siguro mabagal. Intayin ko pang mag-improve sila using multicores. Yung privategpt kasi multicores na noong nasubukan ko.

1686766484441.png

1686766527527.png

Sinubukan ko lang ulit para malaman kung saan yung development na gagana sa hardware ko ngayon using CPU ONLY. Pero di ko gagamitin ito unless nasa bundok ako at walang kausap he he. Di pwede sa inipin. Ang AI apps talaga, sa GPU lang mabilis. Pilitin ko ulit kung pwedeng mapagana pa itong privategpt sa semi-potato pc ko he he.

Sa online lang ang mainam dahil mabilis, mas reliable at available. Ang mga ibang pwedeng subukan na offline chatbots is either You do not have permission to view the full content of this post. Log in or register now., You do not have permission to view the full content of this post. Log in or register now., You do not have permission to view the full content of this post. Log in or register now. (You do not have permission to view the full content of this post. Log in or register now. ,atbp.) na nasa github.com din or choose other opensource alternatives here: You do not have permission to view the full content of this post. Log in or register now.
Sa online isama ko na lang yung binanggit sa 1st post : You do not have permission to view the full content of this post. Log in or register now. .
Actually, ang dami nyang free services kung masipag ka lang maghanap or just using simple browser plugins.
Choose what fits you.

Pero may nakita akong pag-asa sa pang-android na offline, Ùn*énsøréd, unlimited and private GPT din:
You do not have permission to view the full content of this post. Log in or register now.
You do not have permission to view the full content of this post. Log in or register now. or You do not have permission to view the full content of this post. Log in or register now. - daming supported platforms
Kung curious kayo, subukan ninyo.
 

Attachments

Pwede na pala multicore usage sa LoLLMS (fork of PrivateGPT), code updated nitong June 13, 2023. Ginagamit na nya yung 8 threads (4 real cores + 4 virtual cores). Kunin ninyo yung latest webui.bat sa code archive, Huwag doon sa latest releases page - luma yon. Yan yung installer.
1686808009454.png

Hinahanda ko lang para i-test yung integration ng dalawa (kung mapagana ko na yung PrivateGPT w/ cpu) at compatible din sila sa GPT4ALL. LOLLMS can also analyze docs, dahil may option yan doon sa diague box to add files similar to PrivateGPT. Walang masyadong pagbabago sa speed. Pero di siya nag-crash.
1686809590738.png


Usually, yung existing online GPTs like Bard/Bing/ChatGPT ang magsasabi sa inyo ng instructions to find fixes for installing this application and many others. Sila muna tanungin ninyo sa inyong problema. Minsan, magbibigay pa yan ng code to fix it. Si Bard/Bing realtime yung knowledge sa net, pati updates ng apps. Sanayan lang talaga para makuha ninyo yung ibig kong sabihin. GPT helps if you know what to ask and how to follow instructions.

Yung ganitong klase ng offline AI ay di masyadong gagamitin sa ngayon unless may ibang purpose ka bukod sa privacy, Ùn*énsøréd and unlimited use, bukod sa mabagal at namimili pa ng hardware. Hanggang available yung mabilis at free na online GPT services ay wala itong silbi sa karamihan.

Parehas ito ng Stable Diffusion AI generator offline. Kung mahina yung hardware mo, di ka masisiyahan dahil low performance, time consuming at may experience some crashes. Baka magkaroon din ng conflicts sa ibang system softwares like python etc. Kaya mag-ingat and be aware of the consequences.
Just use online services to be on the safe side.
 

Attachments

Last edited:

Similar threads

Back
Top