Hugging Face's logo
Lorenzo Cevolani's picture
10

Lorenzo Cevolani

LorenzoCevolaniAXA
21world's profile picture
·

AI & ML interests

NLP, Transformers, GNN and many more!

Organizations

AXA Belgium - AIAS Team's profile picture

LorenzoCevolaniAXA's activity

New activity in neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w4a16 about 1 month ago

weights does not exist when trying to deploy in sagemaker endpoint

1
#1 opened about 1 month ago by LorenzoCevolaniAXA
New activity in mistral-community/Mixtral-8x22B-Instruct-v0.1-4bit 5 months ago

error in sagemaker deployement
#2 opened 5 months ago by LorenzoCevolaniAXA
New activity in text-generation-inference/Mixtral-8x7B-Instruct-v0.1-medusa 5 months ago

What about latencies
#3 opened 5 months ago by LorenzoCevolaniAXA
New activity in ybelkada/Mixtral-8x7B-Instruct-v0.1-AWQ 5 months ago

latency is slower than standard model, is it normal?
#5 opened 5 months ago by LorenzoCevolaniAXA
New activity in text-generation-inference/Mixtral-8x7B-Instruct-v0.1-medusa 6 months ago

how to use this model on sagemaker endpoints

2
#1 opened 7 months ago by LorenzoCevolaniAXA
New activity in CohereForAI/c4ai-command-r-v01 6 months ago

Error "sharded is not supported for AutoModel" when deploying on sagemaker endpoint
#22 opened 6 months ago by LorenzoCevolaniAXA
New activity in CohereForAI/aya-101 7 months ago

Correct machine to deploy the model on AWS Sagemaker
#11 opened 7 months ago by LorenzoCevolaniAXA
New activity in mistralai/Mixtral-8x7B-Instruct-v0.1 9 months ago

SageMaker Deployment Error

11
#53 opened 9 months ago by seabasshn
New activity in intfloat/multilingual-e5-large 11 months ago

Sagemaker Instance suggestion for Inference
#18 opened 11 months ago by LorenzoCevolaniAXA
New activity in DAMO-NLP-MT/polylm-chat-13b about 1 year ago

protoc error while deploying the model into SM instance

1
#1 opened about 1 year ago by LorenzoCevolaniAXA