Shopping at LEGO or Amazon?
Please use our links: LEGO.comAmazon
As an Amazon Associate we earn from qualifying purchases.

Brickset.com site issues

11315171819

Comments

  • HuwHuw Administrator Posts: 7,116
    Between 5 and 6 am GMT it reimports and churns the data so that will be the cause of apparently missing minifigs at around that time.
    klintonAstrobricks
  • maaaaaaamaaaaaaa Member Posts: 11
    Huw said:
    What about other parts of the site that are loaded via ajax/javascript, such as the sets/shop/more section on the home page?

    I'm wondering if there's some Javascript that runs everywhere else OK but not Safari.

    Or it could just be a transient issue caused by database timeouts or something.
    Yes, the infinitive loading spinner for the personal collection happens on all pages on Brickset for me. It also looks like as soon as a page makes a request to the database it won't finish loading properly. For example, it doesn't load the sets in the site updates section on the homepage.

    Everything works fine on mobile safari.

    Very strange. And I could swear the issue just popped up last week or so.
  • HuwHuw Administrator Posts: 7,116
    Does safari have a developer console that could show javascript errors?

    It might be worth loading the page with ctrl-f5 to fetch the latest version of the javascript file.
  • maaaaaaamaaaaaaa Member Posts: 11
    Huw said:
    Does safari have a developer console that could show javascript errors?

    It might be worth loading the page with ctrl-f5 to fetch the latest version of the javascript file.
    @Huw Thank you for all the feedback.

    I checked the console, and indeed there was an error thrown by a frame that couldn't be loaded from static.quantcast.mgr.consensu.org. I use Ghostery to block trackers, so I disabled that one and suddenly everything works like a charm. The same setup on Chrome and there it works with Ghostery fully enabled. Super odd.

    I've whitelisted Brickset in Ghostery on Safari for now.

    Cheers
    Huw
  • oldtodd33oldtodd33 Member Posts: 2,728
    I own the Vikings Chess set #851861 which is listed as "gear". Is this why Brickset won't record the minfigures as owned into my collection or is there some other reason?
  • HuwHuw Administrator Posts: 7,116
    Is it recorded with a different number at Bricklink?
  • oldtodd33oldtodd33 Member Posts: 2,728
    Yep, the bl part is G577stor. 
  • HuwHuw Administrator Posts: 7,116
    I've added an entry to our cross reference table so the figs should be added overnight  when the data is next crunched.
  • oldtodd33oldtodd33 Member Posts: 2,728
    Thank you!
  • oldtodd33oldtodd33 Member Posts: 2,728
    Thank you! I was looking incorrectly though. The Vikings chess set is actually G577 not the number I previously posted, that's the empty box which the suffix stor makes sense. They also have Knights Kingdom chess set as G678.
  • iwybsiwybs Member Posts: 400
    Today I was browsing Brickset like normal when some tabs returned "access denied", "rate limited", and "temporary ban" messages from Cloudflare.  Has anybody else seen this? Is Brickset having to resort to aggressive rate limiting due to unusually heavy traffic? I have not seen this before and my browsing behavior today wasn't unusual in any way.
  • iwybsiwybs Member Posts: 400
    To add to the above comment, this occurs in Chrome on Android and on Windows 10, after opening only five tabs.  Has anybody seen this before?  It's so strange.  I've used Brickset like this - opening a number of tabs one after the other, to come back to them later - for years with no problems.  What's going on?
  • HuwHuw Administrator Posts: 7,116
    I have enabled rate limiting as an experiment due to the number of database timeouts that have been occurring over the last few days.

    I had it set to one view of the /sets/* pages per 15 seconds but a lot of people noted they were seeing the error so it's now 1 per 5 seconds. Surely that should be enough for any legitimate user?
    VorpalRyu
  • iwybsiwybs Member Posts: 400
    I'll often open up to a dozen tabs at once, sort of as temporary bookmarks to remind me to come back to them and read through them in order.  For instance, today I was wanting to read through the instructions of the 2020 kits on my wanted list.  The rate limiter didn't just kick in when I opened a lot of tabs in quick succession, either: It also blocked me when I was downloading those instructions, even though I only accessed those at the rate of about once per three or four minutes, and they don't even pass directly through the Brickset server.  I understand the desire to block crawlers and bots from misusing the Brickset servers, but if that's the goal you should set the rate limit at something characteristic of bots rather than human users like me: say five downloads per second, not one download every five seconds.   I assure you I haven't the foggiest idea how to automate anything whatever on the internet.
    sid3windr
  • HuwHuw Administrator Posts: 7,116
    Right, good point.

    I've disabled it now because I found the cause of the server slowdown and timeouts. Requests from Russian IPs were flooding the server with requests for small image files, so I've blocked them and enabled CloudFlare 'challenge' for all users in Russia which should prevent it.
    datsunrobbie
  • y_badinery_badiner Member Posts: 1

    Hi, dears!

    I am Brickset user from Russia. I see the captcha every time I entering Brickset.com over a year, even if my password remembered by browser. But I’m okay if this thing about safety. Today I successfully completed the captcha and saw this:


    Error 1020

    Access denied

    Ray ID: 550c279ee88cd115

    2020-01-06 07:59:49 UTC


    I can no longer access Brickset from my computer or my phone. So when I can use this wonderful site again?

  • HuwHuw Administrator Posts: 7,116
    Unfortunately there are many bad actors in Russia and recently I've seen an increase in malicious traffic seeking to disrupt service and bring the site down so for now I have blocked Russian IP addresses (and a few other countries).

    I will review the situation in a few days.

    Sorry for the inconvenience.
  • AdeelZubairAdeelZubair Member Posts: 2,710
    Hi @Huw, I have an accessibly issue on my devices. I've provided information on the error below. Can't access any content such as images and instructions.

    Error 1015 Ray ID: 56ca0abed8536a23
    2020-02-29 10:44:15 UTC

    You are being rate limited What happened? The owner of this website (brickset.com) has banned you temporarily from accessing this website.

    Cloudflare Ray ID: 56ca0abed8536a23

    Performance & security by Cloudflare
  • HuwHuw Administrator Posts: 7,116
    I've set a rate limit, 10 pages in 10 seconds. Are you going that fast?

  • AdeelZubairAdeelZubair Member Posts: 2,710
    edited February 2020
    Huw said:
    I've set a rate limit, 10 pages in 10 seconds. Are you going that fast?

    Haha, I know the site inside out and it shows. I'm mainly using the site for research purposes and MOCs in short bursts, I'll attempt to even it out. Thanks for responding quickly.
  • HuwHuw Administrator Posts: 7,116
    I've removed it now. Some twat was crawling the site earlier causing it to struggle so I enabled it to try and prevent that but it causes other problems, it seems.
    NickF22stluxAdeelZubairsid3windrdavetheoxygenmanBrixfan02
  • thedingman5thedingman5 Member Posts: 292
    That is a very, very subtle April Fool's joke :)  Kudos!!!!
  • AstrobricksAstrobricks Member Posts: 5,555
    A non joke delivered on February 29th? Subtle indeed
    drdavewatfordsid3windrBumblepants
  • LobotLobot Member Posts: 1,030
    @Huw - The forum isn't working with IE11 today; whenever I click on a thread it opens but displays a blank page?  I tried clearing my browsing history but it didn't make any difference.
  • HuwHuw Administrator Posts: 7,116
    You're still using IE11?? I think you know the solution...
    BumblepantsdavetheoxygenmanAstrobrickssid3windr
  • nwr122nwr122 Member Posts: 150
    edited April 2020
    I seem to be encountering a generic error when looking up sets since mid - afternoon, (You've encountered a bug). Tried both Safari and Chrome, same issue. Anybody else having issues or is there known problem @Huw?

    Edit: Same error when trying to navigate to my collection as well
  • nwr122nwr122 Member Posts: 150
    edited April 2020
    Ok, this morning seems to be more fruitful, looking up sets and navigating to collection is working as adding and editing ACM for new sets to the collection. However, for 4 specific sets, when I increase the QTY owned and then go to edit the ACM data, I am still receiving the general error message. Sets in question are 75169, 70604, 30274, and 75134. Error message below. I was logged in, but have edited out log in and collection data from the error screen


  • HuwHuw Administrator Posts: 7,116
    I think that would have been while the site was recompiling following the upload of new code. If it's not OK now, to let me know.
    nwr122
  • nwr122nwr122 Member Posts: 150
    Thanks @Huw, still the same with 75169, only set I've tried but on two browsers and I've logged out and back in and cleared cookies etc. The set details page loads, but clicking on ACM throw the above error
  • HuwHuw Administrator Posts: 7,116
    There were errors in the log relating to this so I've made a change. Can you let me know if it's better now?
    nwr122
  • nwr122nwr122 Member Posts: 150
    Hi @Huw, still the same error with that set, haven't tried others
  • HuwHuw Administrator Posts: 7,116
    Any better now?
    nwr122
  • nwr122nwr122 Member Posts: 150
    Hi @Huw, it is working now, many thanks
    MaffyD
  • HuwHuw Administrator Posts: 7,116
    Good, thanks fore letting me know.
  • graphitegraphite Member Posts: 3,275
    I was looking into using the "my notes" field in the database and just threw a keyword into one of the notes on a set, but when I try to do a query for sets where "my note" contains or equals the keyword, or is just not empty, I get a list of 16691 sets.  Even if I do AND with "I own" it shows all 16691.

    Set with my test string is 75192 and my query looked like

    SELECT * FROM Sets
    WHERE (UserNotes = 'blah')
    ORDER BY SortKey ASC

    Just wondering if I'm doing something wrong or if there is something broken.  Thanks!
  • HuwHuw Administrator Posts: 7,116
    I'll look into it...
    graphite
  • MylesendMylesend Member Posts: 3
    I recently joined and created a couple bricklists.  For some reason now though whenever I go to add something, it doesn't "stick".  I click the button but nothing happens.
  • iwybsiwybs Member Posts: 400
    While experimenting with the query builder last night, I found that a query could be built to search for Tag = "Tag 1" AND Tag = "Tag 2" but the query, when run, returned no results.  Is this a known bug?
  • HuwHuw Administrator Posts: 7,116
    I'll check both issues out in the morning.
  • HuwHuw Administrator Posts: 7,116
    @Mylesend, this should now be sorted. LMK

    @iwybs, you need to use 'contains' rather than 'equals'
  • iwybsiwybs Member Posts: 400
    Thanks - that opens up a whole new world in using the site, I've been wanting to be able to search with multiple tags for ages.
  • rd1899rd1899 Member Posts: 211
    edited May 2020
    For https://brickset.com/sets/21054-1/The-White-House, the first "more images" thumbnail doesn't work.  Directly following the link (https://images.brickset.com/sets/AdditionalImages/21054-1/21054_alt1.jpg) leads to a 404 not found error.



  • HuwHuw Administrator Posts: 7,116
    Sorted, thanks.

  • minifigmanminifigman Member Posts: 21
    I have an issue with the wish list I noticed today. A lot of the stuff I had on there is suddenly missing and the number of items between the header and the list don't match anymore.






    This might be related to syncing it with BrickOwl, which doesn't work right now.
  • 560Heliport560Heliport Member Posts: 4,244
    Set inventories are incomplete: images for most parts don't show up. The part numbers, etc. show, but only a few images. It seems to be affecting all sets, well all the ones I checked randomly. Maybe it's coming that way from LEGO? 
  • paulmisonpaulmison Member Posts: 39
    Set inventories are incomplete: images for most parts don't show up. 
    Maybe it's coming that way from LEGO? 
    I agree it’s an issue at Lego's end. It looks as if the redesign of the customer support pages, which I noticed last week on the UK site, has now reached the US, and the existing image links are 404ing. However, there are still images for Bricks and Pieces, so I’m sure it’s fixable by changing the rules for constructing image URLs.
  • HuwHuw Administrator Posts: 7,116
    I'm working on it...
    paulmison
  • 560Heliport560Heliport Member Posts: 4,244
    It seems to be fixed- thanks @Huw
  • HuwHuw Administrator Posts: 7,116
    LEGO has rearranged things but luckily it was a fairly easy fix.
    560HeliportstluxpaulmisonAstrobrickscanon03
  • paulmisonpaulmison Member Posts: 39
    Thanks @Huw! The inventories are such a useful part of the site- thanks for keeping it running smoothly.
Sign In or Register to comment.

Shopping at LEGO.com or Amazon?

Please use our links: LEGO.com Amazon

Recent discussions Categories Privacy Policy Brickset.com

Howdy, Stranger!

It looks like you're new here. Sign in or register to get started.

Brickset.com is a participant in the Amazon Services LLC Associates Program, the Amazon.com.ca, Inc. Associates Program and the Amazon EU Associates Programme, which are affiliate advertising programs designed to provide a means for sites to earn advertising fees by advertising and linking to Amazon.

As an Amazon Associate we earn from qualifying purchases.