TimeStored Blog

\P 11 shows 9 decimal places? - Kdb+ / qStudio

Home › Forums › Kdb+ / qStudio › \P 11 shows 9 decimal places?

Log In Register Lost Password
Viewing 2 posts - 1 through 2 (of 2 total)
  • Author
    Posts
  • May 29, 2016 at 11:35 am #111272

    Jim
    Member

    Why when I set \P to 11 does it show less decimal places than that?

    `
    q)\P 11
    q)a:101.1234567890123
    q)a
    101.12345679
    `

    May 29, 2016 at 11:59 am #111274

    matt
    Participant

    Hi Jim!

    I’m by no means an expert in kdb+, but I believe it’s because \P sets the number of digits to display, not the number of decimal places. You might want to use Q.fmt and .Q.f instead if you want to follow a more specific format for output (note: these return strings). See http://code.kx.com/wiki/Reference/DisplayPrecision for more info.

  • Author
    Posts
Log In Register Lost Password
Viewing 2 posts - 1 through 2 (of 2 total)

You must be logged in to reply to this topic.