Questions tagged [nvme]
98 questions
17
votes
2 answers
Why is there both character device and block device for nvme?
I am trying to understand the configuration of nvme.
But I do not understand why there are two devices: nvme block and nvme character device:
crw------- 1 root root 243, 0 Dec 12 16:09 /dev/nvme0
brw-rw---- 1 root disk 259, 0 Jan 14 01:30…
![](../../users/profiles/292068.webp)
GP92
- 599
- 2
- 6
- 25
17
votes
8 answers
Understanding NVMe storage and hardware requirements
I'm a bit confused about the recent developments in PCIe-based storage, particularly as it relates to the NVMe specification and its hardware compatibility.
While I've worked extensively with SSDs in disk form-factor and some higher-end PCIe devices…
![](../../users/profiles/13325.webp)
ewwhite
- 194,921
- 91
- 434
- 799
11
votes
3 answers
Automatically mount SSD instance storage on AWS EC2 in Ubuntu 16.04
I am using an Ubuntu 16.04 EC2 from AWS on c5d.2xlarge HW. It comes with a 200 GB SSD called /dev/nvme1n1.
I am able to mount this drive using:
$ sudo mkfs.ext4 -E nodiscard /dev/nvme1n1
$ sudo mount -o discard /dev/nvme1n1 /home/ubuntu
To try…
![](../../users/profiles/499350.webp)
John Corson
- 113
- 1
- 6
8
votes
1 answer
The setup of S2D that delivers up to 2M IOPS to SQL FCI
We are about to deploy shared storage researching for ultra-fast storage to implement Microsoft SQL Server Failover Cluster (FCI). So far the project goes, we would to start with 500K IOPS for 8k blocks about 70r/30w pattern.
Also we would like to…
![](../../users/profiles/400613.webp)
Joshua Turnwell
- 530
- 3
- 12
7
votes
0 answers
Write performance is 5 times worse with LUKS on top of mdadm RAID10 than without LUKS
I have servers with many NVMe disks. I am testing disk performance with fio using the following:
fio --name=asdf --rw=randwrite --direct=1 --ioengine=libaio --bs=16k --numjobs=8 --size=10G --runtime=60 --group_reporting
For a single disk, LUKS…
![](../../users/profiles/88876.webp)
tacos_tacos_tacos
- 3,220
- 16
- 58
- 97
6
votes
3 answers
Disabling ext4 write barriers when using an external journal
I'm currently experimenting with different ways of improving write speeds to a fairly large, rotating disk-based, software-raid (mdadm) array on Debian using fast NVMe devices.
I found that using a pair of such devices (raid1, mirrored) to store the…
![](../../users/profiles/144828.webp)
jcharaoui
- 322
- 1
- 12
6
votes
3 answers
What is the Long term stability of NVMe or SSD stored data?
Background:
We need ready access to 30TB of audio data, although only a small fraction of it is ever requested for playback, that playback needs to be done immediately even for multi-year old data. The data resides in a SAN of multiple arrays and a…
![](../../users/profiles/342838.webp)
Rowan Hawkins
- 590
- 2
- 18
6
votes
3 answers
Very slow write speed (NVME drive) on 10G network
Setting up an experimental lab cluster, the write speed for data received via 10G fiber connection is 10% of the local write speeds.
Testing transfer speed between two identical machines; iperf3 shows good memory to memory speed of 9.43Gbits/s. And…
![](../../users/profiles/721970.webp)
roman
- 191
- 6
6
votes
3 answers
MongoDB on NVMe in production
I'm setting up my db production environment and I have some questions. The server has two NVMe disks, but they cannot be used in the hardware RAID controller. Do I need RAID with NVMe?
Would it be enough to use them as JBOD in production? Or should…
![](../../users/profiles/696116.webp)
Green
- 163
- 3
5
votes
3 answers
How to limit ZFS writes on NVME SSD in RAID1 to avoid rapid disk wear?
Currently I'm running Proxmox 5.3-7 on ZFS with few idling debian virtual machines. I'm using two SSDPE2MX450G7 NVME drives in RAID 1. After 245 days of running this setup the S.M.A.R.T values are terrible.
SMART/Health Information (NVMe Log 0x02,…
![](../../users/profiles/506995.webp)
Peter R.
- 53
- 1
- 4
5
votes
1 answer
Does any PCIe slot support NVMe SSD's automatically or do I need a specific M.2 slot?
I have been trying to dissect the information I find with googling, but have come to the conclusion that I cannot find with certainty the answer to the following questions:
Given you know the basics of your own desktop system, how do I know it…
![](../../users/profiles/24901.webp)
Abel
- 1,007
- 8
- 20
- 32
5
votes
2 answers
Supermicro Server fails to boot from NVMe SSD
I have a SuperMicro server with an NVMe boot drive and an additional SSD for data. I was attempting to install ubuntu on the NVMe boot drive and even though the installation succeeds and the correct boot device is set in the BIOS, the server does…
![](../../users/profiles/189583.webp)
Keno Fischer
- 241
- 1
- 3
- 8
5
votes
1 answer
Are my drives being utilized equally with Linux Software RAID 0 array?
I have four NVMe drives in a RAID 0 configuration.
I am attempting to determine how many IOPS the array is handling.
When I run iostat, it appears that one drive is handling more IO than the other three drives.
Is this an error with the way that…
![](../../users/profiles/631768.webp)
Vincent Saelzler
- 51
- 1
5
votes
2 answers
How to explain these fio bandwidth results?
Been running a couple of fio tests on a new server with the following setup:
1x Samsung PM981a 512GB M.2 NVMe drive.
Proxmox installed with ZFS on root.
1x VM with 30GB space created and Debian 10 installed.
6x Intel P4510 2TB U.2 NVMe drives…
![](../../users/profiles/309909.webp)
Woodgnome
- 193
- 6
4
votes
2 answers
Cannot connect to EC2 instance after converting Ubuntu 16 PV to Ubuntu 16 HVM
So it's been a few days and I still can not connect to my new HVM instance with EC2 running Ubuntu 16. For reference, I am trying to upgrade our server from an m3 instance running Ubuntu 16, to a C5 instance running Ubuntu 16. For almost every…
![](../../users/profiles/402408.webp)
Alex
- 221
- 1
- 7